Edge AI articles

2 articles about Edge AI, newest first.

• Needle: The Tiny, On-Device LLM for Private Automation — Learn how Cactus Compute's Needle brings ultra-small 8–29 MB LLMs directly to hardware like robot vacuums and smartwatches for private, reliable automation.
• Cactus Needle 3: High-Speed Function Calling Without an LLM — Learn how Cactus Needle 3 delivers 66ms function calling on a CPU with only 35MB of parameters, bypassing the need for GPUs and JSON parsers.