#37 · Systems biology
Video model features and generative representations predict human visual cortex fMRI…
The three preprints share a focus on predicting human visual cortex fMRI responses from video-trained or video-generative representations. The first routes V-JEPA-2 video features across space and time through a cross-attention encoding model, targeting higher visual cortex and dynamic spatiotemporal structure. The second introduces RF-DiVE and RF-GO, population receptive field-constrained most-exciting-input frameworks for encoding models spanning V1 through hV4, with in-silico validation. The third reports that representations from future-frame generation in video diffusion models align better with fMRI responses than representations of observed video. Together they extend encoding-model work toward temporally resolved, receptive-field-aware, and generative representational spaces. The common thread is the use of video models as probes of cortical visual representation; the receptive-field and generative-alignment findings are the novel elements, with the scope of each limited to the reported in-silico and fMRI settings.
Preprints
Cross-attention encoding models reveal dynamic spatiotemporal routing across human higher visual cortex
Cross-attention encoding model routes V-JEPA-2 video features across space and time to predict fMRI responses in higher visual cortex.
Receptive-field-constrained stimulus optimization for human early and intermediate visual cortex
Introduces RF-DiVE and RF-GO, two pRF-constrained most-exciting-input frameworks for human V1-hV4 fMRI encoding models, with in-silico validation on the…
Future Video Generation Better Aligns with the Human Visual Cortex than Observed Video
Shows that video diffusion models' future-frame generation representations align better with human visual cortex fMRI than observed-video representations, with…
Recurrent network dynamics explain the time course of perceptual grouping in natural scenes
Brain-inspired recurrent neural network models how cortical dynamics group objects in natural scenes and predicts human reaction times.
Topic history
| Date | Rank |
|---|---|
| #37 |