#19 · Systems biology
Local normalization, pruning, and learning rules shape recurrent network computation
Three preprints from August 2026 examine how locally applied constraints shape the computations recurrent networks sustain. RDNN shows that divisive normalization produces stable continuous working-memory slow manifolds with low effective rank. Noise-prune, an unsupervised local pruning rule applied to task-trained recurrent networks, preserves performance under sampling and connection rescaling. The layered surprise cascade variant modifies the Forward-Forward objective in a recurrent setting, reporting predictive, cortex-like representations from local learning rules. The items differ in scale and method, so the shared thread is conceptual: normalization and locally applied rules are treated as variables determining which computations a network can readily perform, rather than connectivity alone.
Preprints
Divisive Normalization Shapes Low-Rank Slow Manifolds for Continuous Working Memory
RDNN: RNN with divisive normalization yields stable continuous working-memory slow manifolds and low effective rank.
Effective pruning of task-trained recurrent neural networks using noisy fluctuations and connection rescaling
Tests noise-prune, an unsupervised local pruning rule, on task-trained recurrent networks; sampling and rescaling preserve performance.
From Local Learning to Global Prediction Through Layered Surprise Cascades
Recurrent Forward-Forward variant with inverted objective yields predictive, cortex-like representations from local learning rules.
Topic history
| Date | Rank |
|---|---|
| #19 | |
| #19 | |
| #14 | |
| #18 | |
| #24 | |
| #27 | |
| #16 | |
| #40 | |
| #27 | |
| #26 | |
| #36 | |
| #36 |