The Frozen Context Pattern: Adding State to Deep Equilibrium Models
rust
dev.to
DEQ models converge only if their update function is a contraction. We found a design pattern that lets you inject arbitrary external state — Mamba memory, attention, anything — without touching the Lipschitz bound. tags: rust, machinelearning, ai, webgpu We're building AIDEEN, an open-source AI engine in Rust that runs on consumer GPUs via WebGPU. The core is a Deep Equilibrium Model (DEQ) — a single parameter block iterated until it converges to a fixed point. DEQs have a hard constraint: