Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents
github.comanerli
Magnitude is a self-optimizing inference engine for AI agents that automatically adapts to run efficiently across Mac, Linux, and Windows. The tool achieves up to 2x speedup compared to llama.cpp and handles any hardware configuration without manual tuning.
Why it mattersFor builders deploying agents locally, Magnitude eliminates the friction of manually optimizing inference for different hardware setups, potentially cutting latency in half and reducing infrastructure costs.
From the source: Hey HN, Anders and Tom here. We're building Magnitude, an inference engine for agents that optimizes itself to run as fast as possible on your hardware. It works on Mac, Linux, and Windows on any hardware and is up to 2x faster than llama.cpp. We're both software engineers and previously built an…Read at github.com