Inference Engineering articles

1 articles about Inference Engineering, newest first.

• Inference Engineering: Baseten's Guide to DFlash and KV Compaction — Philip Kiely of Baseten explains the shift toward 'training for inference,' detailing DFlash speculation, TurboQuant trade-offs, and KV cache compaction.