#13 · ML / AI methods
Deep generative and contrastive models integrate heterogeneous omics and text data
The common thread is learning shared representations from heterogeneous, partially observed biological measurements. PlantBiMoE combines bidirectional Mamba with sparse mixture-of-experts for plant genome language modeling, evaluated on a 31-dataset benchmark. mmContext contrastively embeds omics (AnnData .obsm) and text, enabling zero-shot cell type and disease prediction. CytoOne applies a Bayesian deep generative framework to CyTOF data spanning batch correction, differential analysis, and visualization. AUTOENCODIX standardizes autoencoder training and evaluation, and Scouter uses LLM gene embeddings to predict responses to unassayed perturbations. Explicit transfer is most evident in Prompt-CBP, which reports cross-species promoter prediction under leave-one-species-out evaluation. DSSMReg addresses regulon inference from scRNA-seq and does not share this transfer aim.
Preprints
Self-Supervised Learning on Molecular Graphs: A Systematic Investigation of Masking Design
Systematic controlled study of masking design for self-supervised pretraining on molecular graphs; finds uniform masking matches sophisticated distributions,…
When do cheap embeddings beat protein language models? A theoretically-grounded hashing sketch for biological sequence classification
Murmur2Vec: training-free k-mer hash sketch embedding with theoretical bias/variance bounds; matches or beats LoRA-tuned ESM-2 on sequence classification tasks.
When Task-Specific Learning Outperforms Transfer Learning: A Benchmark of Gene and Expression Encoding Strategies
Controlled from-scratch benchmark of gene and expression encoding strategies for single-cell transformers at 10M cells; ESM-2 embeddings underperform…
Topic history
| Date | Rank |
|---|---|
| #13 | |
| #9 | |
| #1 | |
| #10 | |
| #8 | |
| #9 | |
| #33 | |
| #7 | |
| #6 | |
| #15 | |
| #4 | |
| #3 | |
| #8 | |
| #15 | |
| #3 | |
| #7 | |
| #6 | |
| #18 | |
| #15 | |
| #6 | |
| #23 | |
| #12 | |
| #15 | |
| #6 | |
| #8 | |
| #5 | |
| #21 |