3 projects
Research codebase exploring hierarchical predictive coding as a training principle for transformers (HERT and variants).
Neuron models that fire more readily given the right top-down context - a mechanism for mixing prediction with signal.
Notebook-driven exploration of free-energy minimization for perception, in pure NumPy.