Announcing SOCI-indexed images for faster SageMaker AI jobs
AWS SageMaker now lazy-loads container images, cutting GPU idle time by up to 90%
“this reduced GPU idle time during image pulls by up to 90 percent in our benchmarks”
AWS announced SOCI (Seekable OCI) indexing for SageMaker AI training and processing jobs, enabling lazy-loading of container images so jobs start in seconds rather than minutes. The feature reduces GPU idle time during image pulls by up to 90% with no code changes required. While a meaningful MLOps efficiency improvement, this is an infrastructure optimization rather than a foundational AI signal.