NVIDIA Introduces Cosmos3-H-Dreams for Interactive Generative Simulation of Clinical Surgery

What happened

NVIDIA introduces Cosmos3-H-Dreams, a surgical simulation model trained on clinical cholecystectomy video and robot kinematics from the CMR Surgical Versius platform. Powered by Cosmos 3 and accelerated with FlashDreams, it supports live instrument control on a single NVIDIA RTX PRO 6000 GPU, with separately trained four-step and two-step checkpoints balancing visual quality and inference speed. It is a research simulator, not a validated system for patient care.

The story so far

NVIDIA introduced Cosmos3-H-Dreams, a model that supports live control of simulated surgical instruments on a single NVIDIA RTX PRO 6000 GPU. It is a research simulator for cholecystectomy, or gallbladder removal, and is not validated for patient care. The model was trained on clinical cholecystectomy video and robot kinematics from CMR Surgical’s Versius platform. Built on Cosmos 3 and accelerated with FlashDreams, it offers separately trained four-step and two-step checkpoints that balance visual quality and inference speed. NVIDIA also provides a guide for training a real-time student model on a user’s own dataset through teacher fine-tuning and Self-Forcing distillation.

Keep reading

Trending now

1. 1DeepSeek Open-Sources DeepInfer and API Components, With Model and Hardware Limits
2. 2Mistral Releases Voxtral 3 Speech Models, Voice Agents API and LiveKit-Based SDK
3. 3OpenAI Acquires Orchestra Bio to Support Drug Development
4. 4OpenAI Rolls Out Locked Chats in ChatGPT With PIN and Biometric Access