Inference infrastructure for hardware you already own.

State-space models compute a sequential recurrence that defeats most mobile compilers. HELIX reassociates it into a chunked associative scan, so the work lands on Apple's matrix hardware instead of a serial loop, and keeps the carried state in threadgroup memory instead of spilling it to device memory on every chunk. It drops into llama.cpp behind one interception point and declines any shape it cannot serve, so it can never be a regression.

Sub-3-bit quantization usually stops a model being a model. FORGE is a post-training pipeline that decides per tensor rather than uniformly: it measures Hessian flatness to find the weights that cannot survive ternary, holds those at higher precision, and crushes the rest. On Falcon-H1-7B that is a 4.4x reduction to 3.48 GB with factual recall intact.