Working with LLMs

Bigger context windows did not give models memory. They gave you a larger envelope to fill on every single request — and...

Hallucination is not a glitch that a better model will one day remove. It is what generation does when it has nothing to...

A system prompt sets the rules for everything that follows. Written well it is the cheapest quality improvement availabl...

If your code needs a value from a model, ask for JSON and validate it. Regexing an answer out of a paragraph is a bug wa...

Most production traffic does not need the largest model available. Routing by task rather than defaulting to the top of...