跳到正文

AWS Launches SageMaker HyperPod Global Inference Gateway

AWS Machine Learning Blog当事人· Dmitry Soldatkin·· 6 小时前精选Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters
打开原文
原文

中文版本尚未就绪 · 显示原文

图片来自 AWS Machine Learning Blog
谁
AWS
引文
Today, SageMaker HyperPod introduces the Global Inference Gateway.

发生了什么

AWS introduces the Amazon SageMaker HyperPod Global Inference Gateway, a SageMaker-managed endpoint that routes requests across registered HyperPod clusters in one or multiple Regions. It selects clusters using KV cache headroom, queue depth, Region proximity, and error rate, and automatically shifts traffic from failed clusters. The service is available in 13 AWS Regions and uses SigV4, IAM, and AWS PrivateLink.

推荐理由

The gateway lets teams route inference across HyperPod clusters in multiple Regions through one endpoint, with automatic failover and private connectivity handled by SageMaker. Teams can tune routing weights across capacity, queue depth, proximity, and errors.

接下来读什么

查看这件事的完整进展AWS Introduces SageMaker HyperPod Global Inference Gateway
这条收录于 11月21日 AI 日报看这一期日报的全部内容