Stop using JSON for LLM structured output
nehmeailabs.com
Stop using JSON for LLM structured output
1–2 of 2 posts
Re: Stop using JSON for LLM structured output
#2For simple extraction tasks, a delimiter-separated string uses 11 tokens vs 35 for JSON. Output tokens are the latency bottleneck.