Skip to content
All news · Today9 items

#Multimodal

All collected and published items, ordered by time. Picks are a selected subset.
4/30Thu
  1. Google DeepMind62

    Google DeepMind launches AI co-clinician research program

    Google DeepMind has announced an AI co-clinician research program exploring a “triple-care” model in which AI agents assist with patient care under clinical supervision. In blind evaluation of 98 real primary-care queries, the system had no critical errors in 97 cases, and doctors preferred its responses to those from existing evidence-synthesis tools. It also outperformed other frontier models on open-ended medication questions in OpenFDA's RxQA.

    Why it matters: Google DeepMind reports results from physician blind reviews, RxQA, and simulated remote consultations, offering a view of current medical-AI capabilities.

4/13Mon
  1. Google DeepMind71

    Google DeepMind releases Gemini Robotics-ER 1.6

    Google DeepMind has released Gemini Robotics-ER 1.6, a major upgrade to its reasoning-first robotics model. It improves spatial reasoning and multi-view understanding and adds the ability to read complex instruments such as pressure gauges and level meters.

    Why it matters: The source details changes in spatial reasoning, multi-view understanding, and instrument reading, along with access information, giving a view of progress in high-level robot reasoning.

4/9Thu
  1. Google Research36

    Google introduces PaperVizAgent and ScholarPeer academic agents

    Google has released two AI agents for academic workflows: PaperVizAgent generates figures for papers, while ScholarPeer automates peer review. PaperVizAgent coordinates five agents for retrieval, planning, style, visualization, and review. It scored 60.2 on a 0–100 evaluation, ahead of GPT-Image-1.5, Nano-Banana-Pro, and Paper2Any, and was the only framework to exceed the human baseline of 50.0.

4/3Fri
3/25Wed
  1. Google Research62

    Google releases Vibe Coding XR, turning natural language into Android XR apps with Gemini and XR Blocks

    Google has released the Vibe Coding XR workflow, combining Gemini's long-context reasoning with the XR Blocks framework, based on WebXR, three.js, and LiteRT.js, to turn natural language directly into physics-aware Android XR apps. Google says the process takes under 60 seconds.

    Why it matters: Google combines Gemini and XR Blocks into a workflow for generating XR apps from a single sentence and reports preliminary VCXR60 benchmark results, offering a view of the changing barrier to spatial-computing prototypes.

3/18Wed
3/17Tue
  1. Mistral AI78

    Mistral releases Mistral Small 4, unifying reasoning, multimodal, and coding capabilities

    Mistral AI has released Mistral Small 4, the next major version of the Mistral Small family and its first model to combine Magistral's reasoning, Pixtral's multimodal, and Devstral's agentic-coding capabilities in one model. It is licensed under Apache 2.0.

    Why it matters: Mistral has combined reasoning, multimodal, and coding capabilities in one open small model, with adjustable reasoning effort and deployment requirements to help assess implementation costs.

12/17Wed
  1. Mistral AI65

    Mistral releases OCR 3, with a 74% win rate over its predecessor on forms and handwriting

    Mistral AI has released Mistral OCR 3, reporting a 74% overall win rate against Mistral OCR 2 on forms, scanned documents, complex tables, and handwriting. The company says it outperforms both enterprise document-processing and AI-native OCR solutions in accuracy.

    Why it matters: The official post compares win rates with the previous version on forms, handwriting, and tables and gives pricing per thousand pages, helping readers assess document-parsing costs and use cases.

12/3Wed
  1. Mistral AI82

    Mistral releases Mistral 3 family, from 675B Mistral Large 3 to 3B, 8B, and 14B Ministral 3

    Mistral has released the Mistral 3 family: dense small models at 3B, 8B, and 14B, plus Mistral Large 3, a sparse MoE model with 41B active and 675B total parameters. All are open-source under Apache 2.0.

    Why it matters: Mistral has released Apache-2.0 weights ranging from 3B to 675B, giving readers a view of open-model options from edge devices to frontier scale.

8/1Fri
7/17Thu
  1. Mistral AI62

    Mistral adds Deep Research, voice mode, and more to Le Chat

    Mistral has introduced several new features in Le Chat, including a preview of Deep Research mode, voice mode powered by the new Voxtral model, multilingual reasoning supported by the Magistral reasoning model, Projects for organizing conversations, and image editing in partnership with Black Forest Labs.

    Why it matters: Mistral has brought deep research, voice, reasoning, and image editing into Le Chat at once, giving readers a view of the assistant's expanding capabilities.

5/7Wed
  1. Mistral AI72

    Mistral AI releases Mistral Medium 3 for low-cost enterprise deployment

    Mistral AI has released Mistral Medium 3, which it says reaches at least 90% of Claude Sonnet 3.7's performance on several benchmarks. Pricing is $0.40 per million input tokens and $2 per million output tokens.

    Why it matters: The official release gives Mistral Medium 3's pricing, comparison model, and deployment requirements, helping readers assess the cost of enterprise self-hosting.

3/17Mon
  1. Mistral AI71

    Mistral releases Mistral Small 3.1 with multimodal support and 128K context

    Mistral AI has released Mistral Small 3.1, improving text performance and multimodal understanding over Mistral Small 3. It extends the context window to 128K tokens, runs at 150 tokens per second, and is open-source under Apache 2.0.

    Why it matters: Mistral reports comparisons for a small model across text, multimodal, and long-context tasks, helping readers assess on-device deployment options.

3/7Fri
  1. Mistral AI78

    Mistral AI releases Mistral OCR document-understanding API

    Mistral AI has released Mistral OCR, an optical-character-recognition API that parses images and PDFs into ordered, interleaved text and images. It is also the default model for document understanding in Le Chat.

    Why it matters: The official release compares it with Google, Azure, and Gemini models and prices it at $1 per 1,000 pages, helping readers assess document-processing replacement costs.

2/17Mon
  1. Mistral AI62

    Mistral releases regional language model Mistral Saba

    Mistral AI has released its first regional language model, Mistral Saba, with 24B parameters. Trained on Middle Eastern and South Asian data, it supports Arabic and several Indic languages and performs particularly well in Tamil and other South Indian languages.

    Why it matters: Mistral's first regional model has 24B parameters but is positioned against models five times larger and can run locally on a single GPU, offering a new option for Middle Eastern and South Asian markets.

2/7Fri
  1. Mistral AI66

    Mistral releases new Le Chat with Pro, Team, and Enterprise tiers

    Mistral has released a new version of Le Chat, adding Flash Answers in preview at up to about 1,000 words per second, code execution in a sandbox, image generation powered by Black Forest Labs Flux Ultra, and iOS and Android apps.

    Why it matters: The official release lists mobile availability, Flash Answers speed, and Pro pricing, helping readers compare Le Chat with other assistants.