#27 · ML / AI methods
Computational models align and infer across spatial omics and imaging modalities
The dominant thread is computational inference that bridges measurement modalities. An AI pipeline registers NanoSIMS chemical images to electron microscopy ultrastructure, mapping organelle-level distribution of therapeutics within cells. SPOmiAlign uses a feature-matching foundation model to align multimodal spatial omics sections in a modality-agnostic manner, while ST2HE generates virtual H&E images from high-resolution spatial transcriptomics data. The lung digital twin is a separate application of model-based inference: built from the largest clinical ex vivo lung perfusion dataset, it models over 75 parameters and predicts alteplase therapeutic efficacy. What is new is reuse of learned or physics-based models to extract additional information from data already collected.
Published papers
Digital twins of ex vivo human lungs enable accurate and personalized evaluation of therapeutic efficacy.
Builds human lung digital twins from the largest clinical ex vivo lung perfusion dataset, modeling over 75 parameters and predicting alteplase therapeutic…
ST2HE: enhancing spatial transcriptomics interpretability via virtual staining for histological annotation.
ST2HE is a cross-platform one-step diffusion framework that generates virtual H&E images from high-resolution spatial transcriptomics data, integrating nuclei…
SPOmiAlign: a modality-agnostic computational framework for multimodal spatial omics alignment enabled by a feature matching foundation model.
SPOmiAlign is a modality-agnostic framework using a feature-matching foundation model to align multimodal spatial omics sections, outperforming existing…
Preprints
Automated Multimodal Correlative Registration for Organelle-Specific Molecular Imaging
AI pipeline registers NanoSIMS chemical images to EM ultrastructure, mapping organelle-level distribution of therapeutics in cells.
Topic history
| Date | Rank |
|---|---|
| #27 | |
| #8 | |
| #32 | |
| #23 | |
| #24 | |
| #33 | |
| #35 | |
| #16 | |
| #27 |