跳到正文

Inkling 2 Mini is a looped transformer with 24 layers. The middle 12 layers loop three times; the first and last six run once. Looping lets a model reason more while writing less, which has raised concerns about monitorability. We studied this as part of our release.

Thinking Machines · X· @thinkymachines·· 8 小时前

1.2万 次浏览 · 170 赞 · 2 转发 (收录时)

原文

中文版本尚未就绪 · 显示原文

正文 · 中文版本尚未就绪(原文)

Inkling 2 Mini is a looped transformer with 24 layers. The middle 12 layers loop three times; the first and last six run once.

Looping lets a model reason more while writing less, which has raised concerns about monitorability. We studied this as part of our release.

4 家信源报道

    这件事的进展 · 2

    查看完整事件
    1. 11月21日 04:39
      Hugging Face and Thinking Machines Lab Release Inkling 2 MiniHugging Face Blog
    2. 11月21日 04:20

      Inkling 2 Mini is a looped transformer with 24 layers. The middle 12 layers loop three times; the first and last six run once. Looping lets a model reason more while writing less, which has raised concerns about monitorability. We studied this as part of our release. 本条

    接下来读什么

    查看这件事的完整进展Thinking Machines Releases Inkling 2 Mini