Skip to content
K = 0.731

AWS Details Prompt Caching for OpenAI Agents on Amazon Bedrock

1 reports 1 reporting sources 3 hours agoNew

Understand the event

AI overview

AWS published guidance on prompt caching for agents using OpenAI models on Amazon Bedrock, reporting that implicit caching reduced input costs by about 62 percent in a six-turn GPT-6 Astra workload, while explicit rolling breakpoints saved about 61 percent in that workload. AWS’s Claudio Mazzoni explains how to combine implicit caching for growing conversations with explicit breakpoints for shared tools and instructions. The guide covers maintaining cache reuse when tools change, agents spawn subagents, or sessions change, and monitoring cache reads and writes. To qualify for caching, a reusable prefix must reach 1,024 tokens. Cached prefixes remain available for at least 30 minutes, with successful reuse refreshing that period, and may persist longer. Cache writes cost 1.25 times the normal input rate.

Generated by AI from reports · Updated 2 hours ago

Latest development10/27 01:27 (UTC+8)
Guide to prompt caching for AI agents using OpenAI models on Amazon BedrockAWS Machine Learning Blog

Read next

More changes in today’s briefingNvidia open-sources Flora with projected robot video labeling costs up to 125x lower than GPT-6 Astra

Models in this story

  • GPT-6 Astra#2 overall$10 input / $50 output per million tokens
API prices of all models

Report timeline

Follow the reports to explore different sides of the event.

10/27
  1. AWS Machine Learning BlogPicks
    Guide to prompt caching for AI agents using OpenAI models on Amazon Bedrock

    Claudio Mazzoni explains how to combine implicit caching for growing conversations with explicit breakpoints for shared tools and instructions when using OpenAI models on Amazon Bedrock. The guide covers preserving cache reuse across tool changes, subagents, and sessions, plus monitoring cache reads and writes. In a six-turn GPT-6 Astra workload, implicit caching lowered input cost by about 62 percent, while explicit rolling breakpoints saved about 61 percent.

Keep up with AI, one email a day

Model releases, price changes and compute developments, with original sources. Free, confirmed by email, and easy to unsubscribe. Read a past issue

Event heat trend

There is not enough continuous observation data to plot a trend yet.