LLM Optimization articles

5 articles about LLM Optimization, newest first.

• Inference Engineering: Baseten's Guide to DFlash and KV Compaction — Philip Kiely of Baseten explains the shift toward 'training for inference,' detailing DFlash speculation, TurboQuant trade-offs, and KV cache compaction.
• Anthropic's Strategy for Giving LLM Tokens Specific Jobs — Learn how Anthropic's Katelyn Lesse and Angela Jiang optimize agent performance by assigning tokens to roles like advising, grading, and dreaming.
• The Missing Layer: Why Your AI Agents are Failing at the Open Web — Stop wasting tokens on CAPTCHAs. Learn how to build a layered data strategy for Agentic AI using APIs, Markdown, and stealth browsers.
• ChatGPT's New Record Feature Is a Game‑Changer for AI Automation — ChatGPT just set a new performance record, delivering faster, more accurate responses for developers building AI automation.
• Stop Relying on the Cloud: How Local AI Scaffolding Beats the Giants — Learn how combining a local LLM core with a smart harness and math scaffolding can outperform massive cloud AI models on your own hardware.