#27 · ML / AI methods
Local learning and low-rank subspaces explain model-brain alignment
The dominant thread is mechanistic accounting for model-brain alignment. Two preprints show that predictive-coding and manifold-capacity networks trained with local learning rules match or exceed prior models in predicting ventral-stream responses, with the Layerwise Multiscale Manifold Capacity Maximization work matching baselines on macaque data. Separately, a preprint locates LLM-brain linear alignment during naturalistic listening in a low-rank subspace occupying 1-3% of embedding dimensions, assessed with ridge reduced-rank regression on ECoG and fMRI. A published study uses ECoG variance partitioning to show that speech-model alignment largely reflects interpretable features, and that adding them improves encoding. A neuronal-identity preprint is a related but distinct axis, proposing latent groupings from molecular, morphological and electrophysiological profiles to model transferable population dynamics. What is new is the shift from benchmark alignment scores toward identifying the biologically or interpretably meaningful components driving that alignment.
Published papers
Interpretable embeddings of speech explain and enhance the brain encoding performance of audio models.
ECoG variance partitioning shows speech model brain alignment largely reflects interpretable features; adding them improves encoding.
Preprints
Latent Prediction Yields Cross-Subject Alignable Representations in Sensory-Evoked fMRI
Self-supervised JEPA-based encoders trained on NSD fMRI alone achieve competitive decoding and enable unsupervised cross-participant alignment for captioning…
A Low-Rank Space Captures Linear Alignment Between LLM and Human Neural Activity During Naturalistic Language Listening
Shows LLM-brain alignment is carried by a low-rank subspace (1-3% of embedding dimensions) via ridge reduced-rank regression on ECoG and fMRI…
AVID: A 5T fMRI Dataset for Benchmarking Auditory-induced Visual Mental Imagery Decoding
AVID is a 67-hour 5T fMRI dataset from nine participants for auditory-induced visual mental imagery decoding, with a standardized evaluation protocol and…
Topic history
| Date | Rank |
|---|---|
| #27 |