- Prompt caching: provider cache markers on content parts, preserved on routes that support them.
- Safe retries: failed calls are not charged.
Features
Efficiency
Cache repeated prefixes and retry without paying twice.
Cache repeated prefixes and retry without paying twice.