Maaz Zindani

Loading the index…

↑↓ move↵ openesc close4133 pages

Blog

LLM APIs Compared, Mechanism by Mechanism

Where the big LLM APIs behave differently for a developer, one mechanism at a time: structured output, caching, token counting, limits, batching and retries.

Moving a feature from one LLM API to another rarely fails on the big things. It fails on a keyword a schema does not accept, a cache entry that expires sooner than expected, or a token count that differs from the bill you assumed. The notes here compare how OpenAI, Anthropic and Google Gemini handle one mechanism at a time, so a developer can see where the same-looking feature differs before writing code around it.

Everything is read from the vendors' own documentation, fetched on the date shown under each page's Sources, and every vendor is described by the same yardstick. The pages contain no prices, no model rankings and no benchmark scores. APIs change quickly, so check the live documentation before you depend on a limit or a default, and treat these pages as a map of what each vendor said on the day it was read.

Output and tools

Tokens and limits

Batching and reliability

Next step

Have a project in mind?

Tell me about it. A discovery call within 48 hours.