Why do Kimi and DeepSeek appear in the same model-architecture diagram?
Kimi 和 DeepSeek，为什么出现在同一张模型架构图里？
What happened
Of the 45 layers in GLM-5.3-Flash, 34 use Kimi's KDA linear-attention approach and 11 use DeepSeek's KPool-DSA sparse attention. Linear and Sparse attention appear together in one model for the first time. The combination reflects a shift away from finding a single best mechanism toward assigning different roles: Linear maintains long histories at low cost, while Sparse retrieves specific information as needed.
DeepSeekKimi / Moonshot AIReasoningOpen sourceDeployment engineeringData and trainingTrends#Trends#Reasoning#Data and training#Deployment and engineering#Open-source ecosystem#DeepSeek
Keep reading
Latest daily · Issue 24NVIDIA and AI4Bharat Introduce Nemotron-pretraining-Indic-v1 and an Open Data Generation PipelineTrending now
- 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
- 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
- 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
- 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights
Tomorrow at 08:00, a briefing like this arrives in your inbox.
The same kind of briefing as the one above: a few stories worth reading. Free. Mail starts after you confirm, and every letter has a one-click unsubscribe. Read a past issue · 2026-10-17