rillr
About Guidelines Privacy Terms Log in Join Rillr
← AI
aws.amazon.com · 6h

Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters

Amazon SageMaker HyperPod introduces the Global Inference Gateway, one managed endpoint that routes inference requests across your HyperPod clusters in one Region or across Regions. It picks the best cluster, fails over automatically, and authenticates every request with SigV4 and IAM over AWS PrivateLink.

Visit article ↗ ▲ 0 💬 0
Discussion

0 comments

No comments yet. Start the discussion.