Story
aws_ml_blog · Nov 17, 2026 · news
aws.amazon.comNov 17, 2026
original source linked
In brief
Amazon SageMaker HyperPod Inference now supports NVIDIA Dynamo for distributed inference, with multi-node and disaggregated serving, KV-aware routing, and automatic fault recovery. Serve large models across many nodes...