Decoding

Structured Output

Constraining a language model to emit output that conforms to a specified schema (JSON, regex, grammar). The decoding-time technique behind …