中文版本尚未就绪 · 显示原文
发生了什么
We're grateful for our research partner working with us to study looped transformers. Goodfire explored how layers pass information to future loops, and which interpretability tools allow us to understand the model's inner workings.
We're grateful for our research partner working with us to study looped transformers.
Goodfire explored how layers pass information to future loops, and which interpretability tools allow us to understand the model's inner workings.
在 X 查看被引用的帖子Looped models are weird. A layer can write to itself or read from "future" layers.
@thinkymachines gave us early access to Inkling 2 Mini so we could study its inner mechanisms. We uncover how it coordinates information flow across layers, blocks, and loops.
Studying Inkling 2 Mini gave us cause for optimism: as transformers continue to evolve, we believe our ability to understand their internal mechanisms can evolve with them.
Read the full post: goodfire.com/research/interpr…
这件事的进展 · 2
查看完整事件- 11月21日 08:23
Thinking Machines Thanks Goodfire for Studying Looped Transformers 本条
- 11月21日 04:39Hugging Face and Thinking Machines Lab Release Inkling 2 MiniHugging Face Blog
