#19 · ML / AI methods
LLM agents and biological models are being tested and constrained against explicit…
The common thread is constraining and auditing language-model-based systems in biology against explicit evidence rather than fluency. EDB-Bio (96k episodes from drug transcriptomics, CRISPR screens and GWAS) tests whether LMs weigh biological evidence. Two agent preprints locate performance in scaffolding: a prompting harness, not model tier, drives hypothesis quality in ABCD-Stack, and DTDR scaffolding lifts a bioinformatics sandbox agent from 0% to 9.09% accuracy while cutting steps 66%. AutoSPECTRA uses a coding-agent protocol to audit generalizability of foundation models across protein, perturbation and pathology tasks. PPI-Caliper adds conformal calibration to protein language model interaction scores, controlling false discovery rate without retraining across five species. New here is pairing evaluation with explicit procedural and statistical controls.
Preprints
Do Language Models Know What Compelling Scientific Evidence Looks Like?
Introduces EDB-Bio, a 96k-episode benchmark from drug transcriptomics, CRISPR screens and GWAS testing whether LMs weigh biological evidence; post-training…
Harness engineering enables a multi-agent LLM system to generate cross-domain hypotheses beyond single-investigator reach
Prompting harness, not model tier, drives quality of a biology multi-agent LLM hypothesis generator; introduces ABCD-Stack.
The Reasoning Paradox in Scientific Sandboxes: Why Extended Reasoning Fails in Autonomous Bioinformatics and How to Fix It.
DTDR scaffolding fixes reasoning-LLM failures in bioinformatics agent sandboxes, lifting accuracy from 0% to 9.09% and cutting steps 66%.
Autonomous generalizability auditing of scientific foundation models
AutoSPECTRA, a coding-agent protocol that systematically audits generalizability of biological foundation models across protein, perturbation, pathology and…
Error-Controlled Discovery of Protein Interactions via Conformal Calibration
PPI-Caliper applies conformal calibration to protein language model interaction scores, controlling false discovery rate without retraining across five species…
Topic history
| Date | Rank |
|---|---|
| #19 | |
| #14 | |
| #8 | |
| #18 | |
| #22 | |
| #28 | |
| #37 | |
| #33 | |
| #30 | |
| #30 | |
| #30 | |
| #17 | |
| #30 | |
| #31 |