Article
Inkling 2 Mini is a looped transformer with 24 layers. The middle 12 layers loop three times; the first and last six run once.
Looping lets a model reason more while writing less, which has raised concerns about monitorability. We studied this as part of our release.
Reported by 4 sources
How the story developed · 2
View full event- 11/21 04:39 (UTC+8)Hugging Face and Thinking Machines Lab Release Inkling 2 MiniHugging Face Blog
- 11/21 04:20 (UTC+8)
Inkling 2 Mini is a looped transformer with 24 layers. The middle 12 layers loop three times; the first and last six run once. Looping lets a model reason more while writing less, which has raised concerns about monitorability. We studied this as part of our release. This report
