#Multimodal

the physics behind the roadster - https://roadster.pplx.app/

the physics behind the roadster - https://roadster.pplx.app/

Alexandr Wang Thanks Meta Superintelligence Labs for Reaching a Model-Building Milestone

Alexandr Wang thanked Meta Superintelligence Labs’ research teams after a week of launches, including Muse Wonder [full] and Muse Spark open. He said MSL and TBD began a little more than a year ago with the goal of producing a frontier model within a year or so, despite the ambition of that target given where Llama 4 landed. Wang said the teams have also built a scalable system for continuing to advance models at the frontier.

We just open-sourced another pair of state-of-the-art Decision Models:

Aravind Srinivas announced two open-sourced Decision Models: pplx-decider-flash-v1.2: 4B params, 1 cent per million tokens, and the top 4B model on the HF Decision Index. pplx-decider-v1.2: 27B params, 2 cents per million tokens, and #2 overall on the HF Decision Index.

Six projects from the last few weeks that caught our attention: A wildfire analysis prototype that maps the fire’s spread over time and tracks hot spots, made with Opus 5.5.

Six projects from the last few weeks that caught our attention: A wildfire analysis prototype that maps the fire’s spread over time and tracks hot spots, made with Opus 5.5.

Jeff Dean shares Elorian’s Glimpse visual thinking model announcement

Jeff Dean writes, “Have a glimpse at this! Nice work, @AndrewDai and Elorian folks!” https://twitter.com/AndrewDai/status/2111142161584628060 In the quoted announcement, Andrew Dai introduces Glimpse as their first visual thinking model, claiming competitive frontier performance compared with Astra on key public visual reasoning benchmarks.

With Gemini 4 Argon, you can use Canvas to turn dense PDFs into interactive, animated web apps you can explore at your own pace.

With Gemini 4 Argon, you can use Canvas to turn dense PDFs into interactive, animated web apps you can explore at your own pace.

Google releases Gemini 4 Argon with temporary half-price API access

Google is rolling out Gemini 4 Argon globally to developers, enterprises, and paid subscribers, emphasizing coding, professional knowledge work, multimodal understanding, and sustained task execution. API pricing is $2 per million input tokens and $10 per million output tokens through November 30, rising to $4 and $20 on December 1. Google reports that Argon worked unattended for 11 hours on ADK optimizations, with engineers merging two changes; Ethan Mollick described improvements but noted remaining weaknesses in complex multi-agent tasks.

UBTECH introduces Thinker-WM, unifying video, depth, and robot actions in one world model

UBTECH introduces Thinker-WM, a multimodal world model that jointly models RGB video, depth, and robot actions through a shared Unified Dynamics Transformer. In material supplied by UBTECH and republished by QbitAI, the company reports leading results on WorldOlympiad, EWMBench, and WorldArena1.0 Track-1, including scores of 0.740 on WorldOlympiad and 4.66 on EWMBench. The model supports six capability modes through shared weights, and adding depth improved RoboTwin single-task success by 15 percentage points over a baseline without depth.

Elorian releases Glimpse, its first AI model built around visual reasoning

Elorian released Glimpse on Friday as a research preview with API access and a waitlist-only chat interface. Its visual scratch space lets it crop image regions, retrieve video frames, and run code to measure or compare visual content during reasoning. Pricing is $0.60 per million input tokens and $3 per million output tokens; Elorian’s evaluations report performance above GPT-6 Astra on scientific chart reasoning and short-form video captioning.

Mark Wahlberg Is Open to AI Enhancing Films and Carrying On His Legacy

Mark Wahlberg said at TechCrunch Disrupt that AI can have a place in filmmaking when it enhances the work while keeping storytelling at its heart. He may use AI to enhance the stadium setting in his upcoming Pete Rose biopic, and said he’d be open to an AI likeness continuing his legacy, including in his animated series “Ted.”

Alibaba’s Qwen AI Will Power the New BMW iX3’s China-Market Cabin

BMW announced that the next-generation BMW iX3 will include AI cabin capabilities developed for China. BMW and Alibaba jointly developed the system using Alibaba’s Qwen large language model, while Banma handles cabin applications and in-vehicle integration; it will be part of the BMW Intelligent Personal Assistant. IDC data cited in the source puts Alibaba Cloud first in China’s automotive public cloud IaaS market in the second half of 2025, with a 42% share.

vLLM Supports Muse Spark Open in a Story Highlighting Its Capabilities

@90VuHwwuzNhhW3h says vLLM supports Muse Spark Open and made a little film to tell its story, using open-source models served by vLLM-Omni. The inference engine also gets a role behind the camera. https://t.co/n3gvdWTC6T The main author calls the film cute and says it brings multimodal understanding, 1M context, agentic planning, DSpark, and cross-platform support to life. https://t.co/yHPXC7qfdM

NVIDIA Nemotron 3.5 Bolt 74B-A9B 24GB is now on Ollama

NVIDIA Nemotron 3.5 Bolt 74B-A9B 24GB is now on Ollama. This vision-language model (VLM) is designed to run everyday agentic tasks locally, using native 2-bit quantization to fit in 24GB of memory and run alongside other applications. ollama run nemotron-3.5-bolt

NVIDIA Nemotron 3.5 Super VL is now available on Ollama

NVIDIA Nemotron 3.5 Super VL is now available on Ollama. The model combines reasoning and visual understanding across a range of agent workflows. Ollama says it delivers up to 5x higher throughput on a single GPU for agentic tasks compared with other open models of its size.

Meta launches Muse Spark Open, an open-weight AI model designed for Macs

Meta has launched Muse Spark Open, a natively multimodal open-weight model with 816 billion parameters and a 1 million token context window, built for complex coding tasks and agentic workflows. It is designed to run locally on Macs, though Engadget reports it requires at least 1 terabyte of RAM. Meta claims superior performance over other popular open-weight models in its evaluations and is making the model available now through multiple API platforms.

The same story is shown in the picks as 《Meta releases Muse Spark Open, an open-weight multimodal mixture-of-experts model》

Perplexity adds NVIDIA Nemotron 3.5 Super VL for subscribers and Agent API

NVIDIA’s Nemotron 3.5 Super VL is now available in Perplexity for Pro and Max subscribers and in Agent API, according to @perplexity_ai. Aravind Srinivas calls Nemotron one of America’s leading open-weight multimodal models and encourages users to try it. https://twitter.com/perplexity_ai/status/2110793639727358422

Tim Cook says Apple Intelligence with Alibaba Qwen will launch China beta in late October

Apple Executive Chairman Tim Cook said Apple Intelligence and the related Alibaba Qwen models have received approval, with a beta set to launch in China later in October. Speaking to media during an October 15 visit to Shanghai, Cook said the initial features include live translation, writing tools, and a photo cleanup tool; Siri AI is excluded from this release.

JD.com’s 11.11 Starts With Double-Digit Growth in First-Day Buyers

JD.com said the number of users placing orders on the first day of its 11.11 event grew by double digits year over year. At a launch event on October 15, the company also announced its “333” service plan and unveiled more than 100 service offerings. JD.com said its AI capabilities are being used across more than 3,000 scenarios, including retail, logistics, health, industry, food delivery and home services.

Perplexity adds NVIDIA’s Nemotron 3.5 Super VL for subscribers and Agent API

NVIDIA’s Nemotron 3.5 Super VL is now available in Perplexity for Pro and Max subscribers, and in Agent API. https://t.co/fMVGtyZFFQ

Meta releases Muse Spark Open with downloadable weights and conditional commercial use

Baoyu reports that Meta released Muse Spark Open on October 15, an open-weight model with 816B total parameters, 42B active parameters, and a 1M token context window. It accepts text, images, video, and audio and outputs text; the Muse Model License permits free commercial use subject to attribution, usage restrictions, and a separate agreement for qualifying API businesses. The model card lists minimum memory requirements of 700GB for NVFP4 and 2TB for BF16, while Meta describes optimization for two Mac Studio machines with 512GB unified memory each.

The same story is shown in the picks as 《Meta releases Muse Spark Open, an open-weight multimodal mixture-of-experts model》

Meta announces Muse Spark Open weights release today

Clément Delangue reacts with “Meta is back!” and links to https://huggingface.co/meta-models/Muse-Spark-Open-816B-A42B. In the quoted post, @finkd says Muse Spark Open weights are releasing today and that it runs great on new Mac Studios thanks to work with @johnternus and Apple. https://twitter.com/finkd/status/2110778025629347999

Meta releases Muse Spark Open for coding and agentic work

Today Meta is releasing Muse Spark Open, which it calls the most capable US open-weight model to date. Built for coding and agentic work, Meta says it excels at long-horizon tasks, complex software engineering, and multi-step reasoning. Key model specs include 816B total / 42B active parameters, a 1M token context window, and native multimodality across text, image, video, and audio.

The same story is shown in the picks as 《Meta releases Muse Spark Open, an open-weight multimodal mixture-of-experts model》

Meta releases Muse Spark Open, an open-weight multimodal mixture-of-experts model

Meta’s Muse Spark Open is an open-weight mixture-of-experts model with approximately 816 billion parameters, around 42 billion active per token, and a context window of up to one million tokens. Trained for agentic coding, it accepts text, images, audio, and video and generates text. Hugging Face provides inference and deployment recipes, reports its own quantization tests, and demonstrates attention-layer LoRA fine-tuning with TRL while keeping the experts frozen.

Nvidia’s Nemotron 3.5 Super VL leads US open weight models on Artificial Analysis Intelligence Index

Nvidia’s Nemotron 3.5 Super VL is now the leading US open weight model, scoring 26 on the Artificial Analysis Intelligence Index. Artificial Analysis reports twice the intelligence of its predecessor, Nemotron 3 Super (13), using ~60% fewer output tokens per task. https://t.co/VMIiXLcLDj

vLLM adds day-0 support for NVIDIA Nemotron 3.5 Super VL

🎉 Day-0 support for NVIDIA Nemotron 3.5 Super VL in vLLM! 120B total parameters, 12B active per token, and a 1M-token context window. Text, images, documents and video in one open multimodal model, with reasoning and tool use for agent workflows. Here is what is supported and how to get started. 🧵 1/4

Nvidia releases Nemotron 3.5 Super VL for continuously running enterprise AI agents

Nvidia released Nemotron 3.5 Super VL, an open multimodal model with 120 billion parameters and 12 billion active per token, for continuously running enterprise agents. Nvidia says it approaches Nemotron 3 Ultra’s accuracy on specified agent tasks with about one-fifth the parameters, and is releasing weights, datasets, and training recipes. The accompanying Nemotron 3.5 Bolt 74B-A9B 24GB targets local agents, while Bolt E4B 4GB is planned for later this month.

NVIDIA introduces Nemotron 3.5 Super VL, an open model for long-running AI agents

Meet NVIDIA Nemotron 3.5 Super VL. NVIDIA’s new open model combines reasoning and tool use with text, image, document, and video understanding for long-running AI agents. 120B total parameters with 12B active.

The same story is shown in the picks as 《NVIDIA Expands Nemotron Family With Super VL and Bolt Open Models》

YouTube Music begins labeling songs created or significantly altered with AI

Google is rolling out AI labels in the YouTube Music app and website for songs created entirely or significantly altered with AI. Labels appear on the player page and open more information when tapped. Google says it will use partners and its own detection tools to identify AI music, while publishers can optionally disclose whether tracks use fully, partially, or no generative AI.

NVIDIA Expands Nemotron Family With Super VL and Bolt Open Models

NVIDIA released Nemotron 3.5 Super VL, an open 120-billion-parameter model for multimodal agents, and Nemotron 3.5 Bolt 74B-A9B 24GB for local agentic workloads; Bolt E4B 4GB is coming Oct. 23. Super VL targets tool use, business workflows and visual document understanding, with open weights, datasets and training recipes. Bolt 74B-A9B uses native 2-bit quantization to fit in 24GB of memory, while Bolt E4B targets physical and conversational agents.

Tutorial Breaks Down Building an Interactive 3D Narrative Game Based on The Little Prince

This comprehensive tutorial breaks down how to build an interactive 3D narrative game based on The Little Prince using an AI-driven workflow featuring Opus 5.5, Astra, Tripo, Blender, and Unity. Spanning asset generation, scene building, rigging, and animation, it provides https://t.co/tIWxDkVbFb

Apertus 1.5 Release Notes Detail Multimodal Understanding, Thinking Mode, and Longer Context

Project Apertus released Apertus 1.5 in 8B and 70B sizes, adding image and audio understanding, optional thinking, a 262,144-token context window, and improved instruction-following and tool use. The weights were released on Hugging Face on July 24, 2026 under Apache 2.0; the models generate only text, and spoken-language processing remains experimental. The team also publishes training data, recipes, intermediate checkpoints, and reproducible evaluation records.

Skywork AI releases open-source Matrix-Game 4.0 for real-time gaming on one RTX 5090

Skywork AI released Matrix-Game 4.0, an open-source game world model that reportedly runs at 480p and 60 FPS on one RTX 5090, with input response under 0.15 seconds and peak VRAM usage of approximately 18.5GiB. A game engine maintains state and executes rules, while a video model generates visuals from structural frames and dynamic captions. Model weights and code are available through https://huggingface.co/Skywork/Matrix-Game-4.0 and https://github.com/SkyworkAI/Matrix-Game.

The same story is shown in the picks as 《Kunlun Tech releases and open-sources Matrix-Game 4.0 for single-GPU real-time gameplay》

How Huawei’s Kirin 9050 Pro logic folding supports Mate 90 flagship features

Huawei says its mass-produced Kirin 9050 Pro uses logic folding to shorten signal paths through vertically connected circuit layers, supporting performance and efficiency gains in the Mate 90 Pro Max. The article explains how dense hybrid bonding enables this layout and how memory coordination allows Kirin 9050 chips to run a 30B MoE model with less than 2.5GB of additional memory usage. Huawei also says Kirin 2027 chips are in testing, with results meeting expectations so far.

Claude Opus 5.5 and Grok 4.7 reproduce 72 Eiffel Tower names in offline 3D builds

Artificial Analysis asked AI models to build the Eiffel Tower in 3D offline. Claude Opus 5.5 and Grok 4.7 included all 72 inscribed scientists’, engineers’, and mathematicians’ names in the correct order, although the shared brief never mentioned them. Claude Opus 5.5 also matched each set to its orientation in Paris. Both models worked as agents without internet access, and the names first appeared in their generated code, never in files or tool outputs they read.

How BaoCut Aligns English and Chinese in Bilingual Subtitles

The author introduces an episode about subtitle translation challenges and how their open-source project BaoCut aligns English and Chinese when the languages use different word orders. They describe subtitles appearing before someone speaks, sentences split into pieces that do not match the spoken translation, and two or three lines covering half the screen. The post links to the project: https://t.co/c3VnQEt8x3

Alexandr Wang Praises a Physics Visualization Made With Muse Wonder Full

pretty cool example of an advanced physics visualization using muse wonder full 🍉 https://t.co/yusJ7QHT7e

Sundar Pichai Praises Creativity in a Prompting and Model Demo

I have to admit, I watched this a few times, especially to the end :) @fofrAI shared a video of a pelican riding a bike, made by Argon using Fourier epicycles, with time-synced Lyria 3.5 music prompted by Argon. The creativity in the prompting and the model is awesome to see https://t.co/ISAviHYpf5

YouTube adds Made with AI labels to AI-generated songs

YouTube is rolling out a “Made with AI” label for tracks created primarily with generative AI, starting today in YouTube Music and expanding to the main YouTube app later. Listeners can tap the label on the player page for more information. YouTube says it uses disclosures from music partners and its own detection tools to identify tracks, including those with AI-generated compositions and vocals.

YouTube Music launches labels identifying generative AI use in songs

YouTube Music announced Wednesday that it is rolling out labels identifying generative AI use in songs, with clickable details about AI’s role in composition and vocals; the labels also extend to the main YouTube app. Partners can declare tracks as Fully Gen AI, Partly Gen AI, or No Gen AI, with pitch correction such as Auto-Tune falling under No Gen AI. YouTube emphasizes disclosure, and AI involvement alone does not make a track ineligible for monetization.

Android adds AI scam protection to Google Messages

Android is introducing new scam defenses, including an opt-in enhanced protection setting for Google Messages rolling out in the coming weeks. It uses cloud-based Gemini models to assess conversations with unrecognized senders and on-device Gemini Nano to check unfamiliar links before users open them. Additional safeguards block apps from enabling call forwarding and conceal sensitive information during screen-sharing in Chrome and Android WebView.