Model Optimization articles
2 articles about Model Optimization, newest first.
- Cactus Needle 3: High-Speed Function Calling Without an LLM — Learn how Cactus Needle 3 delivers 66ms function calling on a CPU with only 35MB of parameters, bypassing the need for GPUs and JSON parsers.
- Stop the Hack: Your Guide to LLM Security and Production Optimization — Learn how to protect your AI from prompt injection and optimize LLMs for production using guardrails, LoRA, and quantization.