feat: expose cache metrics#392

Closed

malte-aws wants to merge 15 commits intostrands-agents:mainfrom

malte-aws:expose-cache-metrics

Commits on Jul 9, 2025

Updates tests with cache tokens for the supported models
Workshop Participant
committed
Adds cache tokens to usage type
Workshop Participant
committed
Inits cache token usage
Workshop Participant
committed
Reads cache tokens from anthropic response
Workshop Participant
committed
Reads cache tokens from openai response
Workshop Participant
committed
Reads cache tokens from litellm response (openai, anthropic, bedrock)
Workshop Participant
committed
Fallback for model providers that do not support / expose cache token usage
Workshop Participant
committed
Reports cache token usage as metric
Workshop Participant
committed
Prints cache token usage in tracing
Workshop Participant
committed
Makes cache token metrics optional
Workshop Participant
committed
Removes optional cache metric
Workshop Participant
committed

Commits on Jul 10, 2025

Merge branch 'main' of github.com:malte-aws/sdk-python into bedrock-cache-metrics
Workshop Participant
committed

Commits on Jul 11, 2025

Resolves merge conflict litellm
Workshop Participant
committed

Commits on Jul 14, 2025

Merge branch 'main' into bedrock-cache-metrics
Workshop Participant
committed
Fix: openai cache tokens metric after format_chunk changes
Workshop Participant
committed