Speculative Decoding articles

1 articles about Speculative Decoding, newest first.

• Inference Engineering: Baseten's Guide to DFlash and KV Compaction — Philip Kiely of Baseten explains the shift toward 'training for inference,' detailing DFlash speculation, TurboQuant trade-offs, and KV cache compaction.