http://programmer.ie/tags/symbolic-structure/ Recent content in Symbolic Structure on Programmer.ie: Modern AI programming Hugo en-us Sat, 05 Sep 2026 18:54:00 +0100 http://programmer.ie/books/models-from-first-principles/11-chapter/ Sat, 05 Sep 2026 18:54:00 +0100 http://programmer.ie/books/models-from-first-principles/11-chapter/ <h1 id="from-vectors-to-symbols--the-binding-problem-inside-neural-networks">From Vectors to Symbols — The Binding Problem Inside Neural Networks</h1> <p>The previous chapter changed our scale of analysis.</p> <p>We stopped asking only what architecture a model had and started asking where the computation lived.</p> <p>Was capability coming from new parameters?</p> <p>More recurrent steps?</p> <p>More sampled trajectories?</p> <p>A selector?</p> <p>A verifier?</p> <p>Different post-training?</p> <p>That wider view exposed a second question.</p> <p>Suppose the computation works.</p> <p>Suppose a neural network solves arithmetic, manipulates code, follows grammatical structure, or reasons over logical relations.</p>