NVIDIA Introduces Cosmos3-H-Dreams for Interactive Surgical Simulation

NVIDIA introduced Cosmos3-H-Dreams, a model that supports live control of simulated surgical instruments on a single NVIDIA RTX PRO 6000 GPU. It is a research simulator for cholecystectomy, or gallbladder removal, and is not validated for patient care. The model was trained on clinical cholecystectomy video and robot kinematics from CMR Surgical’s Versius platform. Built on Cosmos 3 and accelerated with FlashDreams, it offers separately trained four-step and two-step checkpoints that balance visual quality and inference speed. NVIDIA also provides a guide for training a real-time student model on a user’s own dataset through teacher fine-tuning and Self-Forcing distillation.

Generated by AI from reports · Updated 2 hours ago

There is not enough continuous observation data to plot a trend yet.