中文版本尚未就绪 · 显示原文

- 谁
- AWS
- 引文
Today, SageMaker HyperPod introduces the Global Inference Gateway.
发生了什么
AWS introduces the Amazon SageMaker HyperPod Global Inference Gateway, a SageMaker-managed endpoint that routes requests across registered HyperPod clusters in one or multiple Regions. It selects clusters using KV cache headroom, queue depth, Region proximity, and error rate, and automatically shifts traffic from failed clusters. The service is available in 13 AWS Regions and uses SigV4, IAM, and AWS PrivateLink.
推荐理由
The gateway lets teams route inference across HyperPod clusters in multiple Regions through one endpoint, with automatic failover and private connectivity handled by SageMaker. Teams can tune routing weights across capacity, queue depth, proximity, and errors.
