

Disclosure: I work on the APIGOTO team. APIGOTO is independent and not affiliated with OpenAI, Anthropic or Google.
APIGOTO is an LLM API gateway: you point any OpenAI-compatible client at one base_url (https://api.apigoto.com/v1) and call Claude, GPT and Gemini models through it. When an upstream call fails, the gateway fails over automatically, capped at 3 retries, and every request gets its own log entry. You can bring your own provider keys (BYOK), and billing is pay-per-use.
Question: retries on non-idempotent tool calls worry me. Would you want an opt-out header for retries on specific requests?