Skip to content

Inkling 2 Mini is a looped transformer with 24 layers. The middle 12 layers loop three times; the first and last six run once. Looping lets a model reason more while writing less, which has raised concerns about monitorability. We studied this as part of our release.

Thinking Machines · X· @thinkymachines·· 8 hours ago

11.6K views · 170 likes · 2 reposts (at collection)

Original
Article

Inkling 2 Mini is a looped transformer with 24 layers. The middle 12 layers loop three times; the first and last six run once.

Looping lets a model reason more while writing less, which has raised concerns about monitorability. We studied this as part of our release.

Reported by 4 sources

    How the story developed · 2

    View full event
    1. 11/21 04:39 (UTC+8)
      Hugging Face and Thinking Machines Lab Release Inkling 2 MiniHugging Face Blog
    2. 11/21 04:20 (UTC+8)

      Inkling 2 Mini is a looped transformer with 24 layers. The middle 12 layers loop three times; the first and last six run once. Looping lets a model reason more while writing less, which has raised concerns about monitorability. We studied this as part of our release. This report

    Read next

    See the full storyThinking Machines Releases Inkling 2 Mini