#Tokens

A model does not look anything up and does not decide what is true. It estimates which token comes next. Almost everythi...

Models do not see characters or words. They see tokens — and once you know how text becomes tokens, several odd behaviou...

Bigger context windows did not give models memory. They gave you a larger envelope to fill on every single request — and...

If every request begins with the same two thousand tokens of instructions, you are paying full price to resend them. Ord...

Per-token pricing looks trivial until you multiply by retries, conversation history and the context you resend on every...