#14 · ML / AI methods
Sequence models predict viral evolution, RNA structure and protein mutational effects
The dominant thread is learned representations of biological sequences, using pretrained transformers, attention, or diffusion objectives, applied to distinct prediction targets. PETRA pretrains an evolutionary transformer to forecast SARS-CoV-2 mutations, while USP-ddG uses a dual-channel structural model with mixture-of-experts to estimate binding free energy changes from protein-protein interface mutations. SCISOR applies discrete diffusion to delete residues from protein sequences and fits evolutionary data competitively. In RNA, a PDB-curated benchmark tests whether deep learning secondary structure predictors generalize, and HydraRNA combines bidirectional state space and multi-head attention in a full-length RNA foundation model pretrained on mRNAs and ncRNAs. What is new is the breadth of targets: viral escape, protein sequence compression, structural generalization, and interface energetics are addressed within one family of sequence-learning approaches rather than a single shared task.
Published papers
HydraRNA: a hybrid architecture based full-length RNA language model.
HydraRNA is a full-length RNA foundation model combining bidirectional state space and multi-head attention, pre-trained on mRNAs and ncRNAs; it outperforms…
Preprints
PETRA: Pretrained Evolutionary Transformer for SARS-CoV-2 Mutation Prediction
Since its emergence, SARS-CoV-2 has demonstrated a rapid and unpredictable evolutionary trajectory, characterized by the continual emergence of immune-evasive v
A Diffusion Model to Shrink Proteins While Maintaining Their Function
SCISOR, a discrete diffusion model that learns to delete residues from protein sequences, fits evolutionary data competitively, leads ProteinGym…
Deep Learning for RNA Secondary Structure Determination: Gauging Generalizability and Broadening the Scope of Traditional Methods
Perspective on deep learning for RNA secondary structure prediction, introducing a PDB-curated benchmark to assess generalization gaps.
USP-ddG: A Unified Structural Paradigm with Data Efficacy and Mixture-of-Experts for Predicting Mutational Effects on Protein-Protein Interactions
USP-ddG predicts binding free energy changes from mutations in protein-protein interactions using a dual-channel structural model with MoE, CFO data ordering,…
Topic history
| Date | Rank |
|---|---|
| #14 | |
| #36 | |
| #7 | |
| #4 | |
| #9 | |
| #6 | |
| #5 | |
| #4 |