Skip to content
K = 0.731

AWS launches SOCI indexing for faster SageMaker AI training and processing jobs

1 reports 1 reporting sources 2 hours agoNew

Understand the event

AI overview

AWS launched Seekable OCI (SOCI) indexing for Amazon SageMaker AI training and processing jobs across all AWS Regions, allowing eligible container images to load lazily instead of downloading in full before a job starts. Users can choose pre-indexed Deep Learning Containers or index their own images. Lazy loading requires images in Amazon ECR private repositories; images in other registries or accessed through a private Docker registry with TrainingRepositoryAccessMode set to Vpc are not eligible. In AWS benchmarks, containers became ready in 3–11 seconds, and training jobs finished 1–6 minutes sooner, despite the first training epoch taking an additional 3–16 seconds.

Generated by AI from reports · Updated 2 hours ago

Latest development10/28 01:00 (UTC+8)
AWS announces SOCI-indexed images for faster SageMaker AI jobsAWS Machine Learning Blog

Read next

More changes in today’s briefingIntroducing GPT-6.1 Terra

Report timeline

Follow the reports to explore different sides of the event.

10/28
  1. AWS Machine Learning BlogPicks
    AWS announces SOCI-indexed images for faster SageMaker AI jobs

    AWS announced SOCI indexing for Amazon SageMaker AI training and processing jobs across all AWS Regions, enabling container images to load lazily. In AWS benchmarks, container readiness took 3–11 seconds, and training jobs finished 1–6 minutes sooner despite a first-epoch penalty of 3–16 seconds. Users can select pre-indexed Deep Learning Containers or index custom images; lazy loading requires Amazon ECR private repositories.

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.