http://programmer.ie/tags/recurrent-neural-networks/ Recent content in Recurrent Neural Networks on Programmer.ie: Modern AI programming Hugo en-us Sat, 08 Aug 2026 14:48:00 +0100 http://programmer.ie/post/models-from-first-principles-04/ Sat, 08 Aug 2026 14:48:00 +0100 http://programmer.ie/post/models-from-first-principles-04/ <h1 id="hrm--hierarchical-reasoning-with-fast-and-slow-recurrent-state">HRM — Hierarchical Reasoning With Fast and Slow Recurrent State</h1> <p>The previous models in this series were mostly <strong>one-pass models</strong>.</p> <p>MR.Q took two embeddings and produced one score.</p> <p>EBT kept the same basic structure but added several heads.</p> <p>SICQL made those heads explicit components.</p> <p>The architecture grew, but the shape of the computation was still familiar:</p> <div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;"><code class="language-text" data-lang="text"><span style="display:flex;"><span>input </span></span><span style="display:flex;"><span> ↓ </span></span><span style="display:flex;"><span>encoder </span></span><span style="display:flex;"><span> ↓ </span></span><span style="display:flex;"><span>representation </span></span><span style="display:flex;"><span> ↓ </span></span><span style="display:flex;"><span>heads </span></span><span style="display:flex;"><span> ↓ </span></span><span style="display:flex;"><span>outputs </span></span></code></pre></div><p>HRM changes the question.</p>