Skip to content

AWS Introduces SageMaker HyperPod Global Inference Gateway

1 reports 1 reporting sources first reported Updated 6 hours ago

Understand the event

Report summary

AWS introduces the Amazon SageMaker HyperPod Global Inference Gateway, a SageMaker-managed endpoint that routes requests across registered HyperPod clusters in one or multiple Regions. It selects clusters using KV cache headroom, queue depth, Region proximity, and error rate, and automatically shifts traffic from failed clusters. The service is available in 13 AWS Regions and uses SigV4, IAM, and AWS PrivateLink.

From AWS Machine Learning Blog

Read next

More changes in today’s briefingHugging Face and Thinking Machines Lab Release Inkling 2 Mini

Report timeline

Follow the reports to explore different sides of the event.

11/21
  1. AWS Launches SageMaker HyperPod Global Inference Gateway

    AWS introduces the Amazon SageMaker HyperPod Global Inference Gateway, a SageMaker-managed endpoint that routes requests across registered HyperPod clusters in one or multiple Regions. It selects clusters using KV cache headroom, queue depth, Region proximity, and error rate, and automatically shifts traffic from failed clusters. The service is available in 13 AWS Regions and uses SigV4, IAM, and AWS PrivateLink.

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

Current within comparable coverage
9
Peak within comparable coverage
1011/21 08:00 (UTC+8)
24-hour change
–

Trends compare the same continuously observed participants, which may cover fewer sources than current heat. Point or click to inspect hourly heat, or use left and right arrow keys.