The Hallway Track
8 tracked signals on aws-sagemaker.
NVIDIA's open Nemotron 3 Ultra model launches day-zero on Amazon SageMaker JumpStart for agentic workloads.
“Nemotron 3 Ultra is an open model built for frontier reasoning and orchestration in long-running autonomous agents, delivering 5x faster inference and up to 30% lower cost for agentic workloads.”
Exowatt's fine-tuned edge models beat frontier LLMs at 49x lower cost using SageMaker
“achieving higher accuracy than frontier models at up to 49× lower cost”
Fundamental's NEXUS, a deterministic foundation model for tabular data, is now on Amazon SageMaker JumpStart.
“It's pre-trained on billions of real-world prediction tasks across structured datasets, so it arrives already knowing how to find signal in your data.”
AWS details kernel-level MoE optimizations on SageMaker targeting Hopper GPU decode-phase bottlenecks
“A fused MoE system merges token routing, data shuffling, and specialized network calculations into a single batched operation on the GPU.”
AWS released a WhisperX Deep Learning Container for deploying speaker-labeled, word-level transcription on SageMaker AI.
“WhisperX closes both gaps. It wraps OpenAI's Whisper with batched inference, adds wav2vec2 forced alignment for precise per-word timestamps, and adds speaker diarization to label who spoke.”
AWS details concurrency sweeps in SageMaker AI Inference Recommendations to right-size generative AI endpoints.
“A concurrency sweep is a systematic benchmarking approach that sends controlled, increasing levels of concurrent traffic to your Amazon SageMaker AI endpoint and analyzes its performance.”
AWS shows how to train Unitree H1 humanoid robot policies using NVIDIA Isaac Lab on SageMaker HyperPod and Training Jobs.
“GPU-accelerated simulation can compress months of learning into hours”
AWS demonstrates deploying ByteDance's open-source SeedVR2 video restoration model on SageMaker AI for scalable super resolution.
“An emerging and valuable application is upscaling AI-generated videos, which often start at lower resolutions because of the computational intensity of generation models.”