GPU Optimization articles
3 articles about GPU Optimization, newest first.
- Superlinked: Scaling a Fleet of Small Open-Source Models — Learn how Superlinked solves the infrastructure bottlenecks of serving multiple small AI models using a pull-based queue and a Rust sidecar architecture.
- Optimizing RMS Norm with FlashNorm and CUDA Streams — Learn how Filip Makraduli uses weight folding and CUDA stream synchronization to speed up RMS Norm in transformers by up to 35% while avoiding race conditions.
- Why TCP is Failing AI Clusters and How Homa Fixes It — Learn why Stanford's John Ousterhout argues that TCP's sender-side congestion control is stalling AI GPUs and how the Homa protocol solves it.