#Multimodal

My AI doppelganger tells me what to eat

Victoria Song reviews roughly 100 days with Twin Health, an AI digital twin program that predicts glucose responses to food using personal health data and continuous glucose monitoring. She reports improved labs, including triglycerides dropping by 70mg/dL, but no meaningful weight loss or hoped-for success reducing medications; some lab values were already improving before the program. Human coaching helped motivate exercise, while extensive tracking caused fatigue and raised questions about privacy and trust in higher-stakes medical uses.

Alexandr Wang Says Muse Wonder Is SOTA on Hard Document OCR Tasks

Muse Wonder is SOTA on hard document OCR tasks. The more you know! https://t.co/3BqOkxbLI9

HiRO-ACEv2 simulates extreme weather at 3 km resolution for a fraction of the cost

Ai2 introduced HiRO-ACEv2, an updated climate emulator that generates global 3 km rain, wind, and pressure data at about 1/300th the cost of X-SHiELD. Given coarsened X-SHiELD data, its HiROv2 downscaling model matches high-resolution statistics to within 3%, even for events occurring once in a million data points. The system currently works only with ACE tuned to match X-SHiELD and cannot yet generate high-resolution data for other climates; downloadable models, tutorial notebooks, and a web demo are available.

Textbook biology, brought to life right in your browser 🌿 This interactive 5-stage visual atlas built by Argon in @antigravity turns dense textbook biology into a hands-on experience. With fluid animations and scientific precision, you can scroll from a sunlit leaf all the way down to sub-cellular chloroplasts. The model pairs accuracy with a seamless interactive design, demonstrating how to build educational tools that can make complex science visual and effortless to explore.

Textbook biology, brought to life right in your browser 🌿 This interactive 5-stage visual atlas built by Argon in @antigravity turns dense textbook biology into a hands-on experience. With fluid animations and scientific precision, you can scroll from a sunlit leaf all the way down to sub-cellular chloroplasts. The model pairs accuracy with a seamless interactive design, demonstrating how to build educational tools that can make complex science visual and effortless to explore.

Deezer will soon let you filter out AI-generated music

Deezer is developing a toggle to filter out AI-generated music, expected to arrive before the end of the year. Enabling it will hide AI-generated tracks, albums, and related artists from search results. The company cited a survey from last year showing around 45% of its customers wanted to remove AI music from their feeds, and said in July that AI-generated tracks accounted for more than 50% of daily uploads, averaging 90,000 tracks per day.

Ethan Mollick Shares a “Gemini 4 TiKz Unicorn”

Gemini 4 TiKz unicorn https://t.co/On8DiHHQC2 https://t.co/IU4uAJM8fh

Researchers report jailbreak vulnerabilities in OpenAI and Google image models

White Circle researchers report that their RISE attack method bypassed safeguards in DALL·E 3, Nano Banana 2, and GPT-Image-2 to generate explicit images about 13 percent of the time. The method uses widely available models to iteratively develop and evaluate jailbreak strategies. White Circle told Ars Technica that subsequent testing found ChatGPT Images 2.5 and Nano Banana 2.1 significantly more vulnerable than their predecessors; Google and OpenAI did not respond to requests for comment.

Alexandr Wang Says Muse Wonder Inference Bugs Are Being Fixed

we have been fixing a bunch of inference bugs on the deployment of muse wonder -- it should keep getting better as we fix more of them really apologize to everyone for the ups and downs in using the model, but rest assured the whole team is working hard to make everything great! https://t.co/3z9nBs8WTn

Alexandr Wang makes a “chic entry” into noahbench

@itsnoahd says Muse Wonder (not full) comes in 4th on Noahbench, just below Opus 5.5, and calls its price-to-performance-to-speed ratio “perfect.” They say each task takes 10 minutes. Alexandr Wang calls it “a chic entry into noahbench.” https://t.co/VLAlRoBsDN

Alexandr Wang Shares a Muse Wonder Video Interview

video interview of muse wonder -- check it out! https://t.co/fV1PPIuo0r

PHANES AI and Tianlong Mobile Launch SeePhys Hub for Whole-Body Data Collection

PHANES AI and Tianlong Mobile launched SeePhys Hub on October 14 to supplement first-person human demonstration data with whole-body motion and optional tactile pressure recordings. The system combines a four-camera headband, two wristbands and three waist and leg trackers, with software for processing data and mapping human movements to robots. PHANES AI plans to release a whole-body, all-modality world model in 2027 and prioritize application validation in industrial, restaurant and retail settings.

Gemini 4 Argon: How a 24-word prompt built a custom synthesizer that turns galloping horses, rippling water, and your own hands into music.

Gemini 4 Argon: How a 24-word prompt built a custom synthesizer that turns galloping horses, rippling water, and your own hands into music.

Ethan Mollick Shares a Gemini 4 TikZ Unicorn

Gemini 4 TikZ unicorn https://t.co/LoMVqLkZjD https://t.co/IU4uAJM8fh

Simon Willison updates llm-meta-ai 0.2 for Meta AI’s Muse Wonder

Simon Willison updated his llm-meta-ai plugin to support Meta AI’s newly released Muse Wonder models. He shares pelican drawings across six reasoning levels, from minimal to max, and compares them with Muse 1.3 and Muse 1.2, reporting material drawing improvements between releases. He suggests these may be Meta’s first Fable class models and reports that Artificial Analysis scores Muse Wonder (Max) as equivalent to GPT-6.1 Sol.

Simon Willison adds Gemini 4 Argon support to llm-gemini 0.35

Simon Willison added Gemini 4 Argon support to llm-gemini, following the model’s availability today through the Gemini API and a $100/month subscription plan. He praised its SVG pelican illustrations, with the high illustration costing 17.166 cents. Argon launches at $2/million input and $10/million output, with prices set to double on December 1st; Artificial Analysis reports $2,407 to run its benchmark, which Willison considers a more useful comparison than per-token pricing.

How Gemini 4 Argon Built a Japanese Temple Complex in Blender

Baoyu describes a demonstration in which Gemini 4 Argon used Antigravity to build a Japanese temple complex in Blender from one prompt containing a detailed workflow. The prompt referenced a scene-building skill document and requested architectural plans, four Nano Banana reference images, and coordinated agents that checked renders against those references and iteratively revised the scene. The demonstrator requested animation and programmatically generated bell sounds and ambient audio the next day, making those later additions to the initial modeling workflow.

Gemini 4 Argon lets you reimagine your video or webcam feed as a playable synthesizer. Spin up an interactive audio app in Canvas, set the vibe, and play your camera like an instrument.

Gemini 4 Argon lets you reimagine your video or webcam feed as a playable synthesizer. Spin up an interactive audio app in Canvas, set the vibe, and play your camera like an instrument.

Ray-Ban Meta Audio glasses review: I don’t miss the camera

Victoria Song finds the camera-free Ray-Ban Meta Audio glasses comfortable and useful as open-ear headphones, while finding Muse Spark helpful mainly for simple requests and reminders. Her review unit lasted two full workdays without returning to its case, but audio suffered from sound leakage and loud surroundings. Removing the camera eased her discomfort wearing smart glasses in public, though she argues that it does not resolve broader privacy concerns and finds the glasses expensive for their current capabilities.

Gemini 4 Argon taught a robot to play cornhole just by watching a video

Gemini 4 Argon taught a robot to play cornhole just by watching a video. It mapped the physics, coded its own simulation, and taught @Apptronik's Apollo humanoid to sink 7 throws in a row.

Google wants to host your personal vibe-coded apps in the Play Store

Google says the Play Store will soon let people privately host and share apps they built with AI. Starting today, Ask Play expands from answering questions on individual listings to recommending apps and games, including detailed comparison charts; Gemini will get a similar capability soon. Google also announced Game Finder, which draws on insights into how 1.2 billion people play games on Android to build a Gamer DNA profile and match users with similar players.

Google DeepMind launches Gemini 4 Argon for complex reasoning and agentic tasks

Google DeepMind has launched Gemini 4 Argon globally through its API and selected Google products, with access depending on subscription or service tier. Introductory pricing is $2 per million input tokens and $10 per million output tokens, with cached input tokens at 95% off and a 1M unified input-output token limit through the Gemini API. Google reports improvements across coding, professional workflows, scientific research, and robotics, alongside stronger agent safeguards and prompt injection resistance.

Gemini 4 Argon rolls out to Google Ultra and Pro subscribers

Gemini 4 Argon is rolling out today to Google Ultra and Pro subscribers in @GeminiApp and Search, and to Ultra subscribers in @antigravity. Demis Hassabis praises its knowledge work and coding capabilities, sharing a wizard chess game they asked it to create as an example of its physics understanding and 3D modeling capabilities that reminds him of Battlechess on the Amiga. More information and full availability: https://blog.google/innovation-and-ai/models-and-research/gemini-models/introducing-gemini-4-argon/

The same story is shown in the picks as 《Gemini 4 Argon is now available worldwide as Google's most capable frontier model》

Apple launches HomeView, its first smart display for the home

Apple has launched HomeView, a $299 smart display with Siri AI, a 7-inch screen, and Apple Home, Matter, and Thread support. Preorders are open in eight countries, with shipping November 13th; tabletop and wall-mounted versions cost the same. In her first look, Jennifer Pattison Tuohy observed demos but had not tried the device herself, highlighting that personal context requires facial recognition and an Apple Intelligence-capable iPhone on the same network, while chained smart home commands are limited to specific device types.

XGRIDS Reconstructs China’s Minning Town as a 6.2 Billion-Gaussian 3D Model

XGRIDS reconstructed 23.5 square kilometers of Minning Town as a continuous 3D Gaussian model containing 6.2 billion Gaussian ellipsoids, featured in a China Media Group documentary. The project used 186,000 aerial and ground images and 15 billion LiDAR points, collected over seven days; reconstruction reached centimeter-level geometric accuracy with error below 2 cm. The production team used XGRIDS’ LCC Plugin for Unreal Engine to bring the model into the documentary.

Alexandr Wang urges followers to “fill your soul with wonder”

fill your soul with wonder

Artificial Analysis launches AA-3D to benchmark AI models building interactive 3D scenes

Artificial Analysis launched AA-3D, a benchmark in which AI agents turn 55 written briefs across seven domains into interactive three.js scenes for blind human comparisons. Over 10,000 counted votes from over 1,000 panelists rank 21 models by Elo with 95% confidence intervals; Claude Sonnet 5.5, Claude Opus 5.5, GPT-6 Astra, and Claude Fable 5.1 are statistically tied at the top. Models receive up to three hours and 250 turns, and reported costs range from $0.20 to $32.08 per scene.

Alexandr Wang Says They’re Fixing Issues as Quickly as They Find Them

we are fixing issues as fast as we can see them! there's definitely still issues we're trying to iron out, but thank you to everyone for giving us a bit of time to work through all the kinks 🫶

Alexandr Wang Says Muse Wonder Focused on Building a Model for Everyone

this was a big focus area for muse wonder; our goal was to build a model for everyone!

Alexandr Wang Reacts to @SPAC89’s Praise for Muse Wonder

@SPAC89 praised Meta’s Muse Wonder Full 1.0 Max, saying it produced high-quality 3D results in 22 minutes while using 5% of their weekly limit. They compared it with Opus 5.5 Xhigh and GPT-6.1 Sol Ultra, and called Muse Wonder a frontier model among the top 1–2 models. 🍉 MUSE WONDER 🍉

Alexandr Wang Praises an Animation Made With Muse Wonder

@chetaslua says Muse Wonder made the animation using code, and that ElevenLabs voices and Suno music were chosen by Muse. Alexandr Wang calls the animation artistic.

Alexandr Wang Says He Played Muse “Cooked” for About 90 Minutes

i unironically played muse'cooked for about 90 mins the other night little jolly is just so fkn cute. his hands are so small. how does he even cook??

OnePlus 16 Launches in China With 185Hz Display and 9,000mAh Battery

OnePlus launched the OnePlus 16 on October 12, with preorders open ahead of its October 13 sale in China. The phone features a 185Hz fourth-generation Oriental Screen, a 9,000mAh battery, and support for native 185FPS gaming; its China subsidy price starts at 5,199 yuan. The article also lists four storage configurations, with launch prices from 5,699 yuan to 8,199 yuan.

Meta launches Muse Wonder with developer access and conflicting consumer availability statements

Meta released Muse Wonder and Muse Wonder Full on October 12, according to Baoyu’s account of the announcement. Developers can access Muse Wonder through Meta Model API or Muse Code, while Full is available to Muse Code subscribers; Meta’s blog and Zuckerberg’s X post differ on consumer availability. The models support a 1 million Token context window and multimodal input with text output, while Meta’s reported benchmarks show strengths in sustained agentic and coding tasks alongside weaker results elsewhere.

The same story is shown in the picks as 《Meta releases frontier models Muse Wonder and Muse Wonder Full》

Le Chonk cooked on visual grounding. Pinpoints exactly where things are in an image. 42% on Dense 200, ahead of even frontier closed models..

Le Chonk cooked on visual grounding. Pinpoints exactly where things are in an image. 42% on Dense 200, ahead of even frontier closed models..

Import AI 476: New Benchmarks Test Visual Reasoning and Research Taste

Import AI 476 covers Humanity’s Sixth Sense, a benchmark from Elorian and Scale AI that tests intuitive visual reasoning. People scored 93.1 aggregate pass@1, while GPT 6 Astra scored 53.6; GLM-5.3-flash and Kimi K3 scored 26.8 and 25.5. The newsletter also examines how AI could accelerate space development and reports on TasteVal, a benchmark of AI systems’ research taste.

Huawei’s Eight Years of Foldable Phones Put Its Mate X7 Ahead of Apple’s First Foldable

Huawei’s Mate X7 continues an eight-year evolution of foldable designs, while Apple’s iPhone Duo has just entered the market. IDC data for the first quarter of 2026 puts Huawei first in China’s foldable phone market with a 60% share. The article highlights Huawei’s range of foldable formats, the Mate X7’s multitasking features and hinge design, and its 11,999-yuan starting price, below the iPhone Duo’s.

He Kaiming team releases VISTA visual harness for multimodal reasoning

He Kaiming's team published VISTA, a visual-native harness that lets existing multimodal models observe environments, store raw frames outside context, and recall, zoom or inspect them during reasoning without retraining. Paired with VISTA, Claude Opus 5.0 completed all 25 public ARC-AGI-3 games with a perfect 100 action-efficiency score, using 57.4% fewer actions than the human first-play baseline, while GPT-5.6 Sol scored 99. The team also tested browser games, mazes and connect-the-dots tasks, and lists embodied tasks as future work.

vLLM Congratulates vllm-sr on Open-Sourcing Decision 3.0 Multimodal Model

vLLM congratulated the vllm-sr team on releasing Decision 3.0, described as a state-of-the-art multimodal Jev model whose weights are now open-sourced on Hugging Face. The quoted announcement from Xunzhuo Liu says the open model family spans 0.6B to 27B and ranks #1 on both Jev Decision Index boards in its evaluation, on a new Pareto frontier.

Odyssey opens public preview of its Odyssey-3 world model

Odyssey has launched a free public research preview of Odyssey-3, a world model that generates interactive environments from text prompts and runs in real time on an autoregressive diffusion transformer. The base model has 14 billion parameters and outputs 832 × 480 video, while Odyssey-3 Pro supports 1280 × 720. Its reported 66.1-point Physics-IQ Verified score came from a single run using a selection method, below the benchmark's four-run requirement.

Ethan Mollick Reacts to a Mathematician’s Opus 5.5 Music Video

A mathematician makes an Opus 5.5 music video in response to OpenAI’s proofs. Pretty great.