Skip to content
K = 0.731Subscribe

AWS Adds Usage-Based Metering for SageMaker AI Bidirectional Streaming

2 reports 2 reporting sources first reported Updated 2 days ago

Understand the event

AI overview

AWS added usage-based metering for Amazon SageMaker AI bidirectional streaming inference, letting model providers report usage for AWS Marketplace software charges during live sessions. Deepgram is the launch partner, offering usage-based billing for Speech-to-Text and Text-to-Speech. SageMaker endpoint infrastructure charges remain separate. Providers send metering records over a companion WebSocket metadata stream, limited to one message per second per connection and 512 bytes per message. If the stream fails to connect or drops during a session, inference continues by default.

Generated by AI from reports · Updated 1 day ago

Latest development11/11 23:10 (UTC+8)
AWS Adds Usage-Based Metering for SageMaker AI Bidirectional StreamingAWS Machine Learning Blog

Read next

More changes in today’s briefingGoogle DeepMind Introduces Gemini 4 Hydrogen for Fast Agentic Workflows

Report timeline

Follow the reports to explore different sides of the event.

11/12
  1. Leiphone
    JD.com Separates JD Technology Into Cloud Technology and Fintech Divisions

    JD Technology has split into two divisions, Cloud Technology and Fintech, both on the same organizational level as JD Retail, according to market reports. The restructuring was announced internally last week. JD Technology’s JoyAI and AI algorithm departments have also moved into Cloud Technology and are listed as a C1 department. JD.com had not responded to the reports by publication time.

11/11
  1. AWS Machine Learning Blog
    AWS Adds Usage-Based Metering for SageMaker AI Bidirectional Streaming

    AWS announced usage-based metering for Amazon SageMaker AI bidirectional streaming inference, allowing model providers to report consumed units for AWS Marketplace software charges during live sessions. The integration uses a companion WebSocket for metering records, while endpoint infrastructure charges remain separate. Deepgram is the launch partner for usage-based Speech-to-Text and Text-to-Speech billing.

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

Current within comparable coverage
4
Peak within comparable coverage
1011/12 01:00 (UTC+8)
24-hour change
-49%

Trends compare the same continuously observed participants, which may cover fewer sources than current heat. Point or click to inspect hourly heat, or use left and right arrow keys.