Skip to content
K = 0.731
All news · Today9 items

#Multimodal

All collected and published items, ordered by time. Picks are a selected subset.
10/9Fri
  1. Google AI · X49

    It’s Friday 🎉 Here’s a look at this week’s announcements: — https://t.co/a9bSlm0Yxk is now available globally in English, allowing anyone to use our detector portal to easily verify if images, video, or audio files were AI-generated by Google or industry partners — Nano Banana

    It’s Friday 🎉 Here’s a look at this week’s announcements: — https://t.co/a9bSlm0Yxk is now available globally in English, allowing anyone to use our detector portal to easily verify if images, video, or audio files were AI-generated by Google or industry partners — Nano Banana

  2. The Decoder62

    Anthropic’s Claude Science maps the first complete ultraviolet sky

    Anthropic’s Claude Science has produced the first complete map of the ultraviolet sky. Claude Science coordinated multiple AI agents to download data from several space missions, calibrate and combine it, then use inpainting to fill gaps. In tests, predictions differed from actual measurements by about 10% on average. Johns Hopkins astrophysicist Brice Ménard described the process on Anthropic’s website and said the map will be used as teaching material.

  3. 雷锋网45

    Doubao Work adds a creative canvas, with Doubao 2.1 Lite and Seedream 5.0 Flash

    Doubao Work introduced a creative canvas that brings assets, design proposals, and finished work together on an infinite canvas, and integrates the new image model Seedream 5.0 Flash. Its agents can handle complex creative workflows, from understanding requests and planning concepts to generating images, videos, and complete designs. It also added the lightweight Doubao 2.1 Lite model for frequent office tasks such as everyday Q&A, document writing, spreadsheet work, and slide creation, with improvements to response speed and usage limits. Users can access it by upgrading the client and selecting the model.

  6. 量子位62

    MirroS launches AgentGarten: code environments and real-time neural rendering let agents learn by playing

    The MirroS team launched AgentGarten, connecting an executable code environment to a real-time neural renderer: code defines the physics, while the model generates visual feedback, enabling continuous agent interaction at more than 30 fps. In a recreated hide-and-seek experiment, hiders learned to move barriers into cover by round 4, while seekers learned to use a ramp to climb over a wall by round 10; comparable OpenAI experiments in 2019 took about 25 million and 100 million rounds, respectively. The team also published a blog, technical report, code repository, and project site.

10/8Thu
  1. 量子位60

    Shengshu Technology opens Vidu Q4 preview: about RMB 0.6 per second at 720p, with direct output up to 4K

    Shengshu Technology opened a preview of its next-generation flagship video-generation model, Vidu Q4, highlighting lifelike expression. It first released three capabilities: character performance, camera language, and visual-effects scenes. The model supports direct output up to 4K, clips up to 16 seconds, and up to 15 reference images and three reference audio clips per generation.

  4. 雷锋网22

    Former Tencent Hunyuan vision-model lead Hu Han starts a multimodal AI venture, targeting a valuation of hundreds of millions of dollars

    Hu Han, formerly head of the algorithm center for Tencent Hunyuan's vision foundation models, has made progress on a new venture focused on multimodal AI. It plans to raise tens of millions of dollars at a target valuation of several hundred million dollars, with Vision Plus Capital as the financing advisor. Multiple investment firms have approached Hu over the past month. He believes the model could eventually be sold to large technology companies such as DeepSeek.

  7. 雷锋网42

    CARES 4.0 launches in Hong Kong: CAS's CAIR introduces a multimodal clinical agent system

    The Centre for Artificial Intelligence and Robotics (CAIR) at the Hong Kong Institute of Science and Innovation, Chinese Academy of Sciences, launched CARES 4.0, a multimodal clinical agent system, at the 4th Hong Kong Embodied Intelligence and Medical Technology Forum. Built on the Harness agent framework, it uses in-house foundation models for CT, MRI, ultrasound, endoscopy, and EEG, and has been validated at several top-tier hospitals. The CARES 4.0 website is open. Its framework and general toolkit are available, medical toolkits are being released in stages, and its in-house open-source ultrasound and surgical-video models will be integrated and made freely available.

  9. vLLM · X62

    vLLM-Omni technical report proposes a unified serving runtime for omni-modality generation

    The vLLM project shared the vLLM-Omni technical report, describing a unified serving runtime for omni-modality generation. It argues that speech assistants, visual generation, world models and robot loops diverge from a single text decode loop into multi-stage autoregressive pipelines, iterative diffusion and stateful sessions, which LLM servers and diffusion stacks each cover only partially. vLLM-Omni acts as a shared control plane with an orchestrator, specialized engines, a connector and one session path. Paper and repo links are included.

  11. Mark Chen · X81

    OpenAI rolls out GPT-6 and Intelligent UI in ChatGPT for everyone

    OpenAI says GPT-6 and Intelligent UI are now rolling out in ChatGPT for everyone, offering fast, interactive answers and tools for users’ tasks. Mark Chen encourages users to try Intelligent UI, saying every ChatGPT completion now has the potential to create a custom UI and calling it phenomenal for learning new things. https://twitter.com/OpenAI/status/2107894997538525580

    Why it matters: The described custom interfaces could make learning more visual and interactive by placing explanations and task tools directly within the flow of a ChatGPT answer.

  12. Sam Altman · X78

    ChatGPT adds GPT-6 and Intelligent UI for custom interactive answers

    ChatGPT can now generate a custom UI for you! https://twitter.com/OpenAI/status/2107894997538525580 In the quoted post, OpenAI says GPT-6 and Intelligent UI are rolling out in ChatGPT for everyone, offering fast, interactive answers, more visual explanations, and tools available on the spot.

    The same story is shown in the picks as 《OpenAI 在 ChatGPT 全球上线 GPT-6 并推出 Intelligent UI》

  15. Tibor Blaho · X66

    GPT‑6 Instant and Intelligent UI in ChatGPT

    Tibor Blaho highlights GPT‑6 Instant and Intelligent UI in ChatGPT, quoting @_awchen’s account of the UI’s release. @_awchen describes preserving nearly all the power of HTML while making interfaces feel fast and native to ChatGPT, alongside post-training gpt-6 to judge when an interface would help and what it should display or enable. The quoted author says the work required many prototypes and that the team is still figuring out some aspects.

  16. TechCrunch · AI80

    OpenAI launches Intelligent UI with GPT-6, shifting ChatGPT toward visual interaction

    OpenAI introduced a new interface called Intelligent UI, rolling it out starting Wednesday with the new GPT-6 model. Conversations now include more interactive elements such as buttons, custom calculators, interactive charts, and editable graphics.

    The same story is shown in the picks as 《OpenAI 在 ChatGPT 全球上线 GPT-6 并推出 Intelligent UI》

  17. NVIDIA AI · X62

    SynthID Detector opens to all, including NVIDIA Cosmos watermarks

    Google DeepMind's SynthID Detector is now available to everyone, letting users check whether online content was generated with Google AI or tools from industry partners including OpenAI, NVIDIA and Kakao, with Apple coming soon. NVIDIA AI said it watermarks content generated by NVIDIA Cosmos on build.nvidia.com, so anyone can upload that content to the detector and confirm it came from its models.

  19. Perplexity · X58

    Perplexity releases pplx-embed-v2-late multimodal embedding models

    Perplexity is releasing pplx-embed-v2-late, described as two late-interaction embedding models that retrieve text, images, and pages through a shared embedding space for cross-modal querying. The company says both models reach frontier performance and are publicly available on Hugging Face, with a blog post at perplexity.ai/hub/blog/multimodal-embeddings-beyond-a-single-vector.

10/7Wed
  1. TechCrunch · AI62

    Google launches SynthID website, opening AI-generated content detection to everyone

    Google launched a new website on Tuesday that lets anyone check whether an image, video, or audio clip was AI-generated. The tool had previously been available only to select journalists, media professionals, and researchers. The site supports image formats including JPG, PNG, and GIF; video formats including MP4, MOV, and WEBM; and audio formats including WAV, MP3, and FLAC. Detection is based on SynthID, which Google introduced in 2023.

  3. Google AI · X62

    Google opens SynthID watermark checking to anyone via synthid.com

    Google AI says its SynthID technology, which verifies whether an image, video, or audio file is AI-generated, is now accessible to anyone at synthid.com. The portal checks files watermarked by Google or industry partners including OpenAI, NVIDIA, and Kakao, with Apple coming soon. Google says it has watermarked 180 billion images and videos and more than 240,000 years of audio, handling 1 million verification requests daily.

  4. Ars Technica · AI62

    Google upgrades SynthID detector and opens it worldwide

    Google announced that its SynthID detector now supports watermarks embedded by all partners and launched the standalone website SynthID.com for public use. Previously, people outside Google's trusted tester group could check watermarks only by asking Gemini, and the detector recognized only Google's own version of SynthID; images watermarked by partners such as ChatGPT were not flagged.

  5. 量子位40

    Meshy makes a16z's top 50 consumer AI apps by monthly revenue, the list's only AI 3D company

    Meshy ranked 31st on the first monthly revenue ranking added to the seventh edition of a16z's Top 100 Gen AI Consumer Apps report. It was the only AI 3D company on the list, alongside OpenAI, Anthropic, Canva, and others. Rankings use U.S. consumer card-spending data tracked by YipitData. Meshy's annual recurring revenue has exceeded $100 million, and it has more than 15 million registered users.

  7. Josh Woodward · X74

    Nano Banana announces Nano Banana 2.1 with improved image generation and editing

    Nano Banana announced Nano Banana 2.1, claiming improvements over its previous models across the board, including visual design, mask-based editing, subject consistency, and more natural-looking imagery. It is available in @GeminiApp, @GoogleAIStudio, and more. Josh Woodward commented, “Mask-based editing is my favorite from today, much more coming soon!” https://twitter.com/NanoBanana/status/2107521202466046453

    Why it matters: The announcement frames the upgrade around visual design, editing, subject consistency, and natural appearance, providing a concrete comparison with previous models.

  8. Ollama · X48

    Ollama adds Google DeepMind's EmbeddingGemma 2 for on-device multimodal embeddings

    .@GoogleDeepMind EmbeddingGemma 2 is now available on Ollama. Made for consumer devices and is multimodal. ollama pull embeddinggemma-2 Quoted post by @GoogleDeepMind (context, not the main author's work): Meet EmbeddingGemma 2, our first natively multimodal open model for on-device embeddings. It expands beyond text to unify code, images, audio, and video in a shared space. 🧵

  9. Google DeepMind71

    Google DeepMind releases EmbeddingGemma 2, a lightweight open multimodal embedding model

    Google DeepMind released EmbeddingGemma 2, a 740M-parameter open model based on the Gemma 4 architecture and licensed under Apache 2.0. It maps text, images, audio, and video into a shared embedding space.

    Why it matters: EmbeddingGemma 2 maps text, images, audio, and video into one embedding space and reports concrete on-device memory and vector truncation figures, helping assess local multimodal retrieval.

  10. The Decoder66

    Google releases EmbeddingGemma 2 multimodal embedding model

    Google released EmbeddingGemma 2, an open multimodal embedding model that converts text, images, video, audio, and code into numerical vectors. It has 740 million parameters. Google says it outperforms competitors with more than twice as many parameters on multimodal embedding benchmarks and scores 78.68 on the Massive Text Embedding Benchmark (Code), nearly 10 points above the previous model's 68.76.

  11. Simon Willison42

    Hands-on with Mistral Large 4: comparing Claude, GPT, and Gemini on an SVG generation test

    Simon Willison used the same prompt to ask Mistral Large 4, claude-opus-5.5, gpt-6.1-sol, and gemini-3.8-flash each to generate an SVG of an armadillo jaywalking on Mars in fishnet stockings, comparing frontier models after benchmark saturation. He ran the test with the LLM command-line tool, using each model's default reasoning level.

  13. Boris Cherny · X24

    I asked Opus 5.5 to make an interactive website companion for the latest @AcquiredFM Home Depot episode. It came out pretty nice! Water color illustrations all drawn by Claude, too: https://claude.ai/artifact/RdE6uE7WozcP2MLfx3BDky Episode here: https://www.acquired.fm/episodes/home-depot

    I asked Opus 5.5 to make an interactive website companion for the latest @AcquiredFM Home Depot episode. It came out pretty nice! Water color illustrations all drawn by Claude, too: https://claude.ai/artifact/RdE6uE7WozcP2MLfx3BDky Episode here: https://www.acquired.fm/episodes/home-depot