On Wednesday, Meta unveiled voice-only Ray-Ban glasses without a camera, new Ray-Ban frames, a cheaper line of Meta glasses, and a new VR headset due next spring for $1,300. It weighs one-fifth as much as the Quest 3.
At Connect 2026, Meta put the Muse personal agent at the center of its hardware-plus-agent strategy, announcing voice and real-time video capabilities and several glasses devices, while previewing—but not releasing—a new frontier model.
🚀 Tencent Hy Translation just landed.Powered by Hy-MT2. 33 languages. 5 Chinese minority languages & dialects. Voice. Photo. Full offline — on-device, no network required. Already live in 12 countries and regions. Travel, drive, work or read abroad. Accurate. Natural. Always available. ⏬ ⏬⏬ https://apps.apple.com/us/app/tencent-hy-translate/id6801428074
@finkd just unveiled Muse Realtime Avatar, our real-time embodiment technology that turns Muse Realtime Voice into expressive, interactive avatars. Muse Realtime Avatar opens up a new way to interact in @Muse, starting with real-time conversations. 🧵👇 #MetaConnect
Google DeepMind has released two speech-generation models: Gemini 3.8 Flash TTS for character design and fine-grained creative control, and Gemini 3.8 Flash-Lite TTS for high-volume voiceovers and voice agents.
Why it matters: The article outlines the models' voice cloning, line-by-line direction, and benchmark results, helping readers assess their suitability for dubbing and podcast production.
Qwen has launched Qwen Intelligence with three state-of-the-art agents for mobile. The first, Mobile Planner Agent, handles task planning and decomposition, and is evaluated on MobilePA-Bench.
Why it matters: The official release gives benchmark results and access points for three mobile agents, helping readers assess the current capabilities of on-device agents.
Alibaba has released Qwen-Audio-3.1 with upgrades to ASR, TTS, and Realtime, plus two new models, TTS-Next and ASR-Next. Five models now cover audio understanding, generation, interaction, and creation.
Why it matters: The article lists the capabilities of all five audio models and their price reductions, helping readers assess voice-stack choices and cost changes.
At Singapore AI Day, NVIDIA and its partners showcased AI deployments across Southeast Asia. Singapore's HTX is researching public-safety AI using Nemotron 3 Super and Nemotron 3 Nano Omni.
I've been on a Blender kick with Opus 5.5. Its better 3D modeling and vision mean you can build an entire world from a single prompt. Historically accurate San Francisco Market street in 1906, pre-earthquake
I had trouble picturing the whole Iron Tangle level from Dungeon Crawler Carl, so I made an interactive artifact and I think I finally understand it: https://claude.ai/artifact/NTcG664cCbibbZNUFnCSu9?sk=HtqECKbpVqi8-DDzHAkh-Q
DeepSeek has released DeepSeek-V4.1-Flash, describing it as smarter, faster, and more efficient. It is the smallest model in a new architecture family, with native visual understanding, and is designed for stronger capabilities, faster inference, and higher throughput, with the architecture able to scale to larger models.
Why it matters: As the smallest model in DeepSeek's new architecture family, its native visual understanding and higher inference throughput offer a view of its lightweight multimodal positioning.
Meet Astra's TikZ unicorn. I find it mind blowing that a single entity can do this, as well as get essentially 100% on Frontier Math Tier 4, ARC-AGI 3, & ExploitBench. And it's not behind closed doors, anyone can just go and talk to it. Impossible to overstate the implications.
Hugging Face has introduced the NeoMME family of multimodal multilingual encoders in 260M and 800M sizes. A single bidirectional Transformer directly processes text tokens and raw image patches, without a separate vision tower or causal language model.
Google DeepMind has introduced agentic video understanding for Gemini 3.7 Flash, 3.6 Flash, and 3.5 Flash-Lite. Video analysis uses up to 88% fewer tokens and costs up to 66% less, while accuracy improves by up to 7%.
Why it matters: The article gives token and cost reductions and access details, helping readers assess how the economics of long-video analysis are changing.
Google DeepMind has released Gemini Omni 1.1 Flash, offering developers video-generation controls through the Gemini API in Google AI Studio.
Why it matters: The article details capabilities such as extending scenes, interpolating between first and last frames, and 4K upscaling, helping readers assess how controllable video-generation workflows are becoming.
Google has released AgentHands, a research prototype described in a paper at CHI 2026, that maps LLM reasoning output to gestures synchronized with speech in XR. This lets an agent point things out and demonstrate objects or steps in the user's physical space. The system comprises four modules: object registration, a gesture-event library, gesture-embedding inference, and synchronized execution in a headset. Gestures are categorized by dimensions including left or right hand, spatial anchoring, and VFX. In a controlled study with N=12, AgentHands significantly improved spatial reference over a voice-only baseline.
Jim Fan announces T-Rex, an open-source tactile robot learning methodology developed through a collaboration between NVIDIA and Berkeley. Its mixture-of-transformer architecture pairs a slow visuomotor expert with a fast tactile expert running at 4 touch ticks per vision tick; a 50-hour (~5,500 episodes) synchronized robot play dataset collected on tactile hand hardware with 22 degrees of freedom is available today on HuggingFace. Extending EgoScale, its training recipe combines human egocentric video pretraining with tactile robot play mid-training, which Fan says helps bridge contact-free pretraining and contact-rich manipulation.
Why it matters: T-Rex offers a transferable approach to contact-rich robot learning by combining human video pretraining, synchronized tactile robot data, and separate visual and tactile processing rates.
DeepSeek has launched the experimental multimodal model DeepSeek-V4-Flash-Vision-Exp on its API platform. Its text capabilities match DeepSeek-V4-Flash across agents, reasoning, and world knowledge.
Why it matters: The official release gives the new model's text-capability alignment with V4-Flash and improvements on multimodal-agent benchmarks, helping readers assess its readiness for multimodal agents.
Google Research has proposed PhotoScan, a deep-learning framework that estimates body-fat percentage, the android-to-gynoid fat ratio (A/G), and the visceral-to-subcutaneous fat area ratio (V/S) from ordinary 2D phone photos. It was pretrained on more than 35,000 UK Biobank records, fine-tuned on a cohort of 677 adults, and validated on an independent cohort of 132 people.
Microsoft Research has introduced MindTopo, a benchmark for topological reasoning in multimodal LLMs. It covers connectivity, separation, ordering, containment, and knot relations, across static reasoning and interactive planning. Current models are substantially better at static recognition than interactive planning, but both remain far below human performance; failures occur more often in planning than perception. Image and video generation helps only when topology is preserved within a single frame and remains unreliable across multi-step operations.
Google DeepMind has released SL2T, a multilingual sign-language-to-text model, bringing sign-language AI to consumer products for the first time. On Pixel 11, Gboard and Live Transcribe support dictation from American Sign Language (ASL) to English; more devices and languages are planned.
Why it matters: The source describes the capabilities and limits of a multilingual sign-to-text model and where it is available, helping readers assess sign-language translation in real products.
Google Research has released AMIE (Video), which uses Gemini and Project Astra for real-time video clinical interviews. It can perceive nonverbal cues, guide virtual physical examinations, and reason about diagnoses in real time.
Why it matters: AMIE extends from text to live video consultations, showing how an asynchronous multi-agent architecture can balance conversational latency with clinical reasoning.
Microsoft Research has released CARE-X, a research model and unified chest X-ray vision-language model that can generate reports, make structured diagnostic predictions, and localize lesions. It uses reinforcement learning (DAPO) to reward clinical correctness across multiple tasks.
Meta has released Muse Glimmer, a 30B-parameter multimodal model distilled from Muse and licensed under Apache 2.0. It targets local-agent use cases such as coding, document analysis, and personal assistance.
Why it matters: Meta has open-sourced a 30B multimodal model with reproducible details on its architecture, benchmarks, local deployment, and self-improvement demonstrations.
Mistral AI has released Shieldstral, a 3B open-weight multimodal safety classifier available under Apache 2.0 and runnable on a single 16 GB NVIDIA GPU. It frames content moderation as a policy-adaptive question-answering task: policies are written in natural language at inference time, without retraining. It handles text and images together and outputs calibrated continuous safety scores. Mistral says it matches models up to seven times larger on text safety and sets a new state of the art in multimodal moderation.
Why it matters: The 3B open safety classifier makes moderation policy a natural-language prompt at inference time, offering a view of what smaller models can do for content moderation.
Andrej Karpathy gave Opus 5 the opening passage of The Lord of the Rings and a 1M-token budget (about $10), asking it to render the story in Three.js. Opus ran for about two hours and wrote 5,500 lines of code to procedurally generate a rough but playable 3D scene.
Google DeepMind has released Gemini Robotics ER 2, positioned as the robot's high-level brain: it converses with people, understands the physical world, and plans multi-step tasks before handing execution to a lower-level VLA model. It can also call tools such as Google Search natively.
Why it matters: The official release gives concrete figures for ER 2's progress classification and temporal localization, along with access details, helping readers assess its limits on long tasks.
Google DeepMind has released Gemini Robotics 2 with three models: Gemini Robotics 2, a vision-language-action model for translating visual and language input into motion; Gemini Robotics ER 2 for embodied reasoning; and Gemini Robotics On-Device 2, which runs locally on devices.
Why it matters: The article explains the three models' roles and access points, helping readers assess pathways to full-body robot control and multi-robot collaboration.
Google Research has published SymptomAI, a study in which five Gemini Flash 2.0-based conversational agents interviewed 13,917 participants and evaluated differential diagnoses (DDx).
Why it matters: Google's randomized study compares five questioning strategies across 13,917 people and, for the first time, compares diagnoses with Fitbit physiological signals, offering evidence on real-world conversational triage.
Google DeepMind has released three models: Gemini 3.6 Flash, 3.5 Flash-Lite, and 3.5 Flash Cyber for security work.
Why it matters: The source compares token efficiency, pricing, and benchmark results across the three Flash models, helping readers assess cost changes for agent workflows.
Inkling is Lilian Weng’s organization’s open weights model. It aims to serve as a foundation with solid performance across broad categories of capabilities, for practical use and customization. Weng invites users to try it on Tinker.
Why it matters: The release positions Inkling as a foundation for practical customization, with full weights and fine-tuning availability giving concrete context for its intended use.
Thinking Machines Lab has released the open-source Inkling family on Hugging Face. Inkling is an MoE model with about 1T total and 41B active parameters, natively supporting image, audio, and text inputs with a 1M-token context. The release also includes Inkling-Small, with 276B total and 12B active parameters.
Why it matters: The article gives Inkling's architecture, deployment setup, and benchmark comparisons, helping readers assess the practical requirements of an approximately 1T-parameter open multimodal model.
Google DeepMind has released Nano Banana 2 Lite and Gemini Omni Flash. The former is the fastest model in the Nano Banana family.
Why it matters: Both models are available to developers, with details on latency, pricing, and capability limits to help assess the cost and usability of the image-to-video pipeline.
Google reports on consumer understanding of dermatology AI tools. Among 2,345 participants, more than 62% of those using AI tried to name a skin condition, with 23% accuracy—nearly three times the control group's 8%. The “Wizard of Oz” group reached 36% accuracy. But the AI group showed no statistically significant improvement in deciding what care to seek and was slightly more likely than dermatologists to recommend less urgent care (30% vs. 27%).
Google DeepMind has released Gemma 4 12B, an agentic multimodal model aimed at laptops, positioned between the edge-focused E4B and the 26B MoE. It is the company's first medium-sized model with native audio input.
Why it matters: Gemma 4 12B removes multimodal encoders and feeds visual and audio input directly into the LLM, giving readers a view of hardware requirements for local multimodal agents.
In a paper published in Nature, Google Research describes PHRM, a system that uses the front-facing camera to record a few seconds of video after face unlock and estimate heart rate and resting heart rate in the background using deep learning.
Why it matters: Google passively measures heart rate with a phone's front camera after unlock and has released its largest phone-video dataset to date along with a pretrained model.
Google DeepMind has added Street View scene anchoring to the experimental Project Genie prototype. It can generate interactive worlds based on real locations in the United States, with optional styles such as Ocean World, Desert Sands, Stone Age, and B&W film.
Why it matters: The source explains Project Genie's capabilities and availability with Street View, offering a view of how world models may be deployed.
Google DeepMind has released Gemini Omni Flash, the first model in the Omni family. It can combine images, audio, video, and text as inputs to generate high-quality video and supports iterative video editing through natural-language conversation.
Why it matters: The source describes the first Omni model's input and output capabilities and where it is available, helping readers assess the practical reach of multimodal video generation.
Google has announced that it is extending content transparency and verification tools across Search, Gemini, Chrome, Pixel, and Cloud. The Gemini app already supports SynthID verification for images, video, and audio, with 50 million uses to date. The feature is coming to Search today and Chrome in the coming weeks.
Why it matters: The source details where SynthID and C2PA verification are available across Search, Gemini, and Chrome, helping readers assess the practical reach of provenance tools.
Google DeepMind has released Gemini 3.5 Flash, the first model in the Gemini 3.5 family, positioning it as a frontier model for agents and coding. It is available starting today in the Gemini app, AI Mode in Google Search, Google Antigravity, the Gemini API, and Gemini Enterprise.
Why it matters: Gemini 3.5 Flash beats 3.1 Pro on coding and agent benchmarks and includes speed and cost comparisons, helping readers assess its potential for long-horizon tasks.
