Skip to content
K = 0.731

AWS Details Deploying NVIDIA Nemotron Models on EKS and SageMaker HyperPod EKS

1 reports 1 reporting sources 1 hours agoNew

Understand the event

AI overview

AWS published a guide for deploying NVIDIA Nemotron 3.5 Super VL on Amazon EKS, EKS Auto Mode, and SageMaker HyperPod EKS using NVIDIA Dynamo and vLLM, with deployment architecture and validation on B200 and H200 instances. The model has 120B total parameters and 12B active parameters per token. The guide also shows how to run aiperf concurrency sweeps to compare aggregated and disaggregated deployments and plan capacity against latency targets.

Generated by AI from reports · Updated 44 minutes ago

Latest development10/30 00:11 (UTC+8)
Deploy NVIDIA Nemotron Models on Amazon EKS and SageMaker HyperPod EKSAWS Machine Learning Blog

Read next

More changes in today’s briefingGoogle DeepMind announces Gemini 4 Carbon with cybersecurity and long-horizon capabilities

Report timeline

Follow the reports to explore different sides of the event.

10/30
  1. AWS Machine Learning BlogPicks
    Deploy NVIDIA Nemotron Models on Amazon EKS and SageMaker HyperPod EKS

    AWS explains how to deploy NVIDIA Nemotron 3.5 Super VL on Amazon EKS, EKS Auto Mode, and SageMaker HyperPod EKS using NVIDIA Dynamo and vLLM. The guide covers the model’s 120B total parameters and 12B active parameters per token, deployment architecture, and validation on B200 and H200 instances. It also shows how to use aiperf concurrency sweeps to compare aggregated and disaggregated deployments and plan capacity against latency targets.

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.