AWS announces SOCI-indexed images for faster SageMaker AI jobs
Announcing SOCI-indexed images for faster SageMaker AI jobs
- Who
- Amazon Web Services
- What
- announced Seekable OCI indexing for Amazon SageMaker AI training and processing jobs
- When
What happened
AWS announced SOCI indexing for Amazon SageMaker AI training and processing jobs across all AWS Regions, enabling container images to load lazily. In AWS benchmarks, container readiness took 3–11 seconds, and training jobs finished 1–6 minutes sooner despite a first-epoch penalty of 3–16 seconds. Users can select pre-indexed Deep Learning Containers or index custom images; lazy loading requires Amazon ECR private repositories.
Why it matters
The benchmarks distinguish image download savings from first-epoch overhead, providing a concrete basis for assessing workloads whose startup code accesses different portions of a container image.
Read next
See the full storyAWS launches SOCI indexing for faster SageMaker AI training and processing jobsThe story so far
AWS launched Seekable OCI (SOCI) indexing for Amazon SageMaker AI training and processing jobs across all AWS Regions, allowing eligible container images to load lazily instead of downloading in full before a job starts. Users can choose pre-indexed Deep Learning Containers or index their own images. Lazy loading requires images in Amazon ECR private repositories; images in other registries or accessed through a private Docker registry with TrainingRepositoryAccessMode set to Vpc are not eligible. In AWS benchmarks, containers became ready in 3–11 seconds, and training jobs finished 1–6 minutes sooner, despite the first training epoch taking an additional 3–16 seconds.
Keep up with AI, one email a day
Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue · 2026-10-27