Skip to content

Model-Divergence Taxonomy: survey behind ModelDivergenceTypeEnum (2026-09-02)

Purpose. Fix the value set of a typed model-divergence taxonomy from evidence rather than invention, in the way projects/PATHOPHYSIOLOGY_SCALE_FEASIBILITY.md fixed BiologicalScaleEnum at four values.

Method. Every modeled_mechanisms link in kb/disorders/ + kb/modules/ was extracted with its limitations prose, relationship and fidelity. All 50 computational-model limitations were read in full and clustered by hand; the animal and NAM sets were probed by keyword only, to establish which kinds are shared and which are modality-specific. Keyword counts below are a probe, not a classification — they over- and under-count, and are quoted only to show which kinds recur.


1. Coverage

Measured 2026-09-02, against the KB as it stood when the 50 computational-model strings below were read and clustered. These are a snapshot of the derivation input, not a live count — the KB grows, and the ratio has since moved (1,662 links / 80% on main at 3b1ba68c3, 2026-09-03). The clustering in section 3 is what the value set rests on; re-measuring the totals does not change it.

links with limitations
animal_models 603 577
experimental_models 446 204
computational_models 82 50
total 1131 831 (73%)

So the caveat is nearly always written — it is simply written as unstructured prose, in one slot, with no type, no per-item granularity, and no way to ask "which models are limited by calibration provenance rather than by species".

2. Modality profiles differ sharply

Keyword probe, per section:

candidate kind comp exp animal
species divergence 5 26 276
genotype / allele mismatch 6 33 123
incomplete phenotype 2 10 53
missing compartment / cell type 1 21 29
scale extrapolation 3 27 20
context mismatch 1 27 13
supraphysiological expression 0 14 20
static / no kinetics 6 2 17
proxy / surrogate quantity 5 11 9
parameterisation / calibration 11 1 5

The animal set is dominated by species and allele divergence — the classic translational caveats. The computational set is dominated by calibration provenance, absent dynamics, and proxy quantities, and species divergence is nearly absent. A single undifferentiated fidelity: LOW tier is doing very different work in the two cases, which is the core argument for typing the divergence.

3. The computational taxonomy, from 50 read limitations

Counts are hand-clustered; a limitation usually carries more than one kind, which is why the divergence slot is multivalued.

Kind n Representative evidence
BOUNDARY_OMISSION ~20 Asthma: "airflow, heterogeneous airway branching, neural control, mucus obstruction … are outside the single-airway-wall formulation". RA-FLS: "does not represent the immune-cell compartment".
CALIBRATION_PROVENANCE ~14 ASPS: "parameterized from mouse fibroblast experiments rather than human pacemaker neurons". PD: "parameterised from cohort-level miRNA and transcriptomic data rather than from direct measurement of autophagic flux".
PROXY_QUANTITY ~11 MS: "FLAIR lesion fraction is an imaging proxy, not a direct measure of myelin thickness". Glioblastoma: "ADC is an imperfect proxy for tumor cellularity".
CAUSE_UNREPRESENTED ~10 Brugada: "sodium-channel reduction is prescribed phenomenologically rather than generated by an SCN5A allele". ASPS: "does not encode a heterozygous human allele or allele dosage".
STRUCTURAL_IDEALIZATION ~8 Brugada: "a homogeneous one-dimensional generic epicardial ventricular strand, not an anatomically reconstructed RVOT". Asthma: "idealized axisymmetric elastic cylinder".
TEMPORAL_SCOPE ~7 DMD: "only represents a small muscle cross-section over 28 days"; "years-long human disease evolution are not represented". COVID-19: "qualitative reachability … rather than its magnitude or timing".
CONTESTED_ASSUMPTION ~4 ASPS: 2026 knockout evidence "identified MARK2 as physiologically significant", displacing the model's CK1delta/epsilon assignment. Sickle cell: "HbS nucleus structure is not experimentally known".
SCALE_EXTRAPOLATION ~4 RA-FLS: "bone and cartilage loss are represented as output nodes of the synoviocyte network rather than as tissue-level processes". Already derivable from model_scale.
SPECIES_MISMATCH ~4 DMD: "mdx disease is substantially milder than the human disorder". The bridge to the animal set, where it is the dominant kind.
POPULATION_MISMATCH ~4 Glioblastoma: "19 IDH-wildtype and two IDH-mutant tumors, so it is not a pure match to this disease entry". ASPS: "validation cohorts comprised 56 healthy adults … not people with ASPS".

Boundary cases considered and folded in. Confounded perturbation (Cystic fibrosis: "CF required simultaneous parameter changes in chloride, sodium, and potassium transport; CFTR loss is therefore not an isolated disease arm") has one clear instance and is folded into CAUSE_UNREPRESENTED. Unvalidated (8 keyword hits) is not a separate kind: every instance also names what the validation failed to cover, which is one of the kinds above — usually CALIBRATION_PROVENANCE or POPULATION_MISMATCH.

PROXY_QUANTITY vs BOUNDARY_OMISSION is the distinction to get right, and it is the one a scale comparison alone cannot make. In a boundary omission the thing is simply not in the model. In a proxy divergence the thing is in the model, but as a stand-in of a different quantity — transcriptional regulation of dopamine synthesis standing in for striatal dopamine concentration. Both can occur at the same scale, so neither is recoverable from model_scale.

4. Generalization to NAM and animal models

Deliberately out of scope for the first implementation, but the taxonomy was chosen so it extends rather than forks. BOUNDARY_OMISSION (organoid without vasculature or immune compartment), PROXY_QUANTITY, CALIBRATION_PROVENANCE, POPULATION_MISMATCH and SPECIES_MISMATCH all apply unchanged. Extending to the animal set would likely add SUPRAPHYSIOLOGICAL_EXPRESSION, INCOMPLETE_PHENOTYPE, and a genotype-level sibling of CAUSE_UNREPRESENTED — each already visible in the keyword probe at 20–123 hits, so each would be evidenced the same way rather than assumed.

5. Prior art

The ask is standard practice in regulatory computational modeling. ASME V&V 40, an FDA-recognized standard, and the FDA's Assessing the Credibility of Computational Modeling and Simulation guidance anchor every credibility activity in a stated question of interest, context of use, and quantity of interest, and require an applicability analysis — the relevance of the validation evidence to the context of use. A dismech ModelMechanismLink is a context-of-use statement ("this model is informative for this mechanism"), and a typed divergence list is its applicability analysis. Two of the enum values map almost directly: PROXY_QUANTITY is a quantity-of-interest mismatch, and POPULATION_MISMATCH / CALIBRATION_PROVENANCE are applicability gaps.

The framework also grades credibility requirements by model risk = model influence × decision consequence. materiality is the dismech analogue at the level of a single divergence: does this particular gap bear on this particular claim?