Skip to content
Sign in
NewTechnologyReported 2026-11-21 06:35

Amazon SageMaker HyperPod Global Inference Gateway launched

AWS announced the Global Inference Gateway for SageMaker HyperPod, a single managed endpoint that routes inference requests across multiple clusters and Regions, enabling automatic failover and utilization of idle GPUs instead of queuing on saturated clusters.

Why it matters. AI model serving teams can replace dozens of model-specific endpoints with one gateway, reducing operational overhead and improving GPU utilization by routing traffic to available capacity across clusters and Regions.

01

Evidence

  • AAWS Machine Learning BlogCompany2026-11-21 06:35
    The Global Inference Gateway is available in 13 AWS Regions: US East (N. Virginia), US East (Ohio), US West (N. California), US West (Oregon), South America (São Paulo), Europe (Frankfurt), Europe (Ireland), Europe (London), Europe (Stockholm), Asia Pacific (Tokyo), Asia Pacific…
    View source