Quantization articles

3 articles about Quantization, newest first.

• Inference Engineering: Baseten's Guide to DFlash and KV Compaction — Philip Kiely of Baseten explains the shift toward 'training for inference,' detailing DFlash speculation, TurboQuant trade-offs, and KV cache compaction.
• Run Qwen 3.8‑27B Locally with DeepSeek Harness – Full Setup Guide — Learn how to deploy Qwen 3.8‑27B locally using DeepSeek Harness, see vision bounding boxes, and tune reasoning effort on a DGX Spark.
• Shrinking Giants: How Model Compression Brings LLMs to the Edge — Discover how quantization and NVFP4 allow massive AI models to run on consumer hardware without losing their intelligence.