TorchNeuron brings native PyTorch support for Hugging Face models on AWS Trainium
Hugging Face libraries now support TorchNeuron, a native PyTorch backend for AWS Trainium entering public beta on Oct. 20, 2026. Transformers supports 89% of the top 100 most-used text-generation model architectures out of the box, compared with 46% in Optimum Neuron v0.4.5. Hugging Face recommends using its libraries directly instead of Optimum Neuron, with examples covering distributed inference, fine-tuning and image generation; training still requires shape management and disabling asynchronous weight loading.
Model releases and updates
The DecoderMiniMax releases M3.1 Flash with stronger reasoning and lower task costs
MiniMax released M3.1 Flash, a reasoning model scoring 42 on the Artificial Analysis Intelligence Index, up from M3’s 29, at less than half the cost per task. It supports text and images with up to one million tokens of context; API pricing is $0.15 per million input tokens and $0.60 per million output tokens. Artificial Analysis reports a 93 percent hallucination rate because it answers rather than declines uncertain questions; open weights are planned for October 23.
Product releases and updates
MiniMax M3.1 Flash is now available on Ollama Cloud
MiniMax M3.1 Flash is on Ollama Cloud, hosted in the US with zero data retention. Ollama describes fast coding and agentic workflows, image understanding, and a 1M-token context window. Try it on Ollama Cloud: ollama run minimax-m3.1-flash:cloud Claude Code: ollama launch claude --model minimax-m3.1-flash:cloud Codex: ollama launch codex -–model minimax-m3.1-flash:cloud
AWS Machine Learning BlogFirst-partyPegasus 1.5 from TwelveLabs is now available in Amazon Bedrock
TwelveLabs’ Pegasus 1.5 is now available on Amazon Bedrock in US West (Oregon), generating structured, timestamped JSON for video segments matching user-defined criteria. It supports videos up to 2 hours long, reference images in multimodal prompts, and processing directly from Amazon S3 or base64 input without pre-indexing. The post provides API examples for general analysis, structured output, video segmentation, and image-guided queries.
Day-0 support for Ming-3.0 in vLLM-Omni
vLLM-Omni adds day-0 support for Ming-3.0. @AntLingAGI just open-sourced 5 speech models across TTS, audio understanding, and ASR, described by vLLM as all MoE, from 0.5B to 126B-A6.5B. Serve them today with vLLM-Omni. https://t.co/7yCGCzKBka
Industry
Ars Technica · AIDisney seeks Character.AI staff and technology through bankruptcy deal that could sidestep lawsuits
Disney could acquire Character.AI’s staff and much of its technology stack while sidestepping ongoing legal issues if the deal is completed and approved by the courts. Bankruptcy filings say litigation and regulatory concerns deterred potential buyers, while a multistate investigation expanded to 46 states and territories. States participating in the bankruptcy proceedings reserved their rights to challenge any bankruptcy plan.
Germany and NVIDIA Sign Declaration to Advance Industrial and Physical AI
Germany’s federal government signed a Joint Declaration of Intent with NVIDIA to pursue a joint initiative advancing AI models for physical AI and broader industrial adoption. Chancellor Friedrich Merz and NVIDIA CEO Jensen Huang emphasized manufacturing, automotive expertise and small and medium-sized businesses. NVIDIA also announced planned investments in Agile Robots, Avelios Medical, Mirelo and Reflex Aerospace as part of a nearly $10 billion commitment across Europe.
Research
Google open-sources Harness² research on recursive agent harness improvement
Google researchers introduced and open-sourced Harness², a system that modifies agent harness code, system prompts, tools, and skills during execution. It combines task-level proposal, probing, and composition with a persistent library of improvement experience, supporting OpenCode and Codex. The reported WorkBuddy-Bench results show GLM-5 improving from 64.2 to 75.7 with OpenCode after a single improvement step, exceeding the unmodified Gemini 3.5 Flash score of 72.4.
Meta publishes technical report on Muse Glimmer, its 30B open-weight agentic model
Today Meta published a technical report on Muse Glimmer, its 30B open-weight model built for agentic tasks on consumer hardware. Meta says it runs at practical speeds on a Mac or PC with a single consumer GPU at 4-bit precision and leads comparably-sized open models on tool use and multi-step planning. The report covers model architecture, distillation, quantization, and more: https://go.meta.me/4Bcvxol
Tips and perspectives
AWS Machine Learning BlogFirst-partyHow push-based KV transfer improves TTFT and TPOT in vLLM
AWS explains its push-based NIXL connector for vLLM, which overlaps destination registration with prefill and moves transfer preparation to a background thread. In a Qwen3-32B benchmark on a 1P1D deployment using Amazon EC2 P5en instances with EFA and prefix caching disabled, push mode delivered up to 3x better TTFT and up to 30 percent better TPOT than pull mode, with results varying by workload and configuration. The post details the architecture, benchmark reproduction, and routing tradeoff of selecting the decode instance earlier.
Tomorrow at 08:00, a briefing like this arrives in your inbox.
The same kind of briefing as the one above: a few stories worth reading. Free. Mail starts after you confirm, and every letter has a one-click unsubscribe. Read a past issue · 2026-10-19