Skip to content
K = 0.731
2026.10.17 · Sat

#多模态

#多模态

Research

Research papers, technical reports, benchmarks and datasets.

10/15Thu
  1. Hugging Face Blog73

    HiRO-ACEv2 simulates extreme weather at 3 km resolution for a fraction of the cost

    Ai2 introduced HiRO-ACEv2, an updated climate emulator that generates global 3 km rain, wind, and pressure data at about 1/300th the cost of X-SHiELD. Given coarsened X-SHiELD data, its HiROv2 downscaling model matches high-resolution statistics to within 3%, even for events occurring once in a million data points. The system currently works only with ACE tuned to match X-SHiELD and cannot yet generate high-resolution data for other climates; downloadable models, tutorial notebooks, and a web demo are available.

    Why it matters: The comparison with X-SHiELD gives researchers a concrete cost and accuracy reference for extreme weather simulations, with applicability currently limited to the climate represented in training.

9/25Fri
  1. Google Research65

    Google Research introduces AI video co-director framework for coherent long-form video generation

    Google Research has introduced an AI video co-director multi-agent framework, an orchestration layer on top of Gemini and Veo. It models long-form video generation as a problem of global optimization and world-state tracking to mitigate semantic drift and cascading failures.

    Why it matters: Google breaks long-video generation into four composable frameworks and reports continuity improvements across several benchmarks, illustrating how multi-agent orchestration can reduce semantic drift.

8/22Sat
  1. Jim Fan · X69

    NVIDIA and Berkeley open-source T-Rex methodology for tactile robot learning

    Jim Fan announces T-Rex, an open-source tactile robot learning methodology developed through a collaboration between NVIDIA and Berkeley. Its mixture-of-transformer architecture pairs a slow visuomotor expert with a fast tactile expert running at 4 touch ticks per vision tick; a 50-hour (~5,500 episodes) synchronized robot play dataset collected on tactile hand hardware with 22 degrees of freedom is available today on HuggingFace. Extending EgoScale, its training recipe combines human egocentric video pretraining with tactile robot play mid-training, which Fan says helps bridge contact-free pretraining and contact-rich manipulation.

    Why it matters: T-Rex offers a transferable approach to contact-rich robot learning by combining human video pretraining, synchronized tactile robot data, and separate visual and tactile processing rates.

8/12Wed
  1. Google Research72

    Google researchers advance AMIE to expert-level clinical interviews with audio and video

    Google Research has released AMIE (Video), which uses Gemini and Project Astra for real-time video clinical interviews. It can perceive nonverbal cues, guide virtual physical examinations, and reason about diagnoses in real time.

    Why it matters: AMIE extends from text to live video consultations, showing how an asynchronous multi-agent architecture can balance conversational latency with clinical reasoning.

7/23Thu
  1. Google Research62

    Google introduces SymptomAI, a conversational AI agent for everyday symptom assessment

    Google Research has published SymptomAI, a study in which five Gemini Flash 2.0-based conversational agents interviewed 13,917 participants and evaluated differential diagnoses (DDx).

    Why it matters: Google's randomized study compares five questioning strategies across 13,917 people and, for the first time, compares diagnoses with Fitbit physiological signals, offering evidence on real-world conversational triage.

6/5Fri
  1. Google Research67

    Google Research studies passive heart-health monitoring with a phone camera

    In a paper published in Nature, Google Research describes PHRM, a system that uses the front-facing camera to record a few seconds of video after face unlock and estimate heart rate and resting heart rate in the background using deep learning.

    Why it matters: Google passively measures heart rate with a phone's front camera after unlock and has released its largest phone-video dataset to date along with a pretrained model.

4/30Thu
  1. Google DeepMind62

    Google DeepMind launches AI co-clinician research program

    Google DeepMind has announced an AI co-clinician research program exploring a “triple-care” model in which AI agents assist with patient care under clinical supervision. In blind evaluation of 98 real primary-care queries, the system had no critical errors in 97 cases, and doctors preferred its responses to those from existing evidence-synthesis tools. It also outperformed other frontier models on open-ended medication questions in OpenFDA's RxQA.

    Why it matters: Google DeepMind reports results from physician blind reviews, RxQA, and simulated remote consultations, offering a view of current medical-AI capabilities.

You've reached the end