Research papers · Paper
Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
Outline · 79 pages
- Introductionp. 1
- Problem statementp. 2
- Methodp. 3
- Experimental resultsp. 5
- ChemBench: discovering enzyme-kinetic rate lawsp. 6
- GlucoseBench: discovering latent ODE modelsp. 6
- NeuronBench: discovering mechanisms with stochastic latent dynamicsp. 7
- Discussionp. 9
- AI use statementp. 10
- Method: further detailsp. 19
- The agent-environment interfacep. 19
- Evaluationp. 19
- Main MDA loopp. 20
- Priorsp. 23
- Computing the likelihoodp. 24
- Particle filteringp. 25
- Bayesian synthetic likelihoodp. 25
- Computing the marginal likelihoodp. 26
- Tempered SMCp. 26
- Recursive parameter and evidence updatesp. 27
- BIC approximationp. 28
- Prior sensitivityp. 30
- Computing the model posteriorp. 30
- Algorithms for experiment designp. 32
- Chemistryp. 36
- Benchmark and metricsp. 36
- MDA model and experimental protocolp. 36
- Baselinep. 37
- Resultsp. 37
- GlucoseBench: a partially observed ODE domainp. 40
- Domain and experimental protocolp. 40
- MDAp. 41
- Baselinesp. 43
- Resultsp. 44
- NeuronBench: further detailsp. 47
- Backgroundp. 47
- Our benchmarkp. 49
- MDAp. 53
- Resultsp. 55
- BoxingGymp. 59
- Details on the benchmarkp. 59
- Priors and likelihoodsp. 60
- Results on GLMsp. 60
- Inference over latent variable models using a PPLp. 60
- Results on Item Response Theoryp. 61
- Results on Locationp. 64
- Further related workp. 66
- Other interactive learning benchmarksp. 66
- Other ``AI-scientist'' systemsp. 66
- LLM promptsp. 70
- ChemBench (enzyme rate laws, §4.1)p. 70
- MDA proposerp. 70
- LLM-AutoSciLab agentp. 70
- MDA proposerp. 72
- Apprentice agentp. 73
- ICL forecasterp. 75
- Electrophysiology (ion channels, §4.3)p. 75
- MDA proposerp. 76
- ICL forecasterp. 77
- GlucoseBench: compartment models and direct forecastingp. 77
- MDA model proposerp. 78
- ICL forecasting and designp. 78