index / Jiadalee/jev-vs-llm-tb-amr
jev-vs-llm-tb-amr
Benchmark: a System One decision model (Jev) vs a generative LLM (Qwen3.8-27B) answering the same 27 TB drug-resistance questions per isolate — 98% agreement, 178–392× faster. Catalog-grounded AMR prediction with judgment = model, facts = code
Research and EvalsExtractionListedPython
Repository
Stars0
LanguagePython
LicenseMIT
Created2026-09-24
Last pushed2026-09-24
Officialno
Judgment
Genuine Jev project0.91
gate 0.5
Uses Jev at runtime0.87
Is a meta list0.03
Is a reimplementation0.12
Quality scales
Substance1.76 / 3
gate 0.5
Docs2.66 / 3
Novelty2.37 / 3
Composite score0.72
Category distribution
Research and Evals1.00
Agent and Dev Tooling0.00
Other0.00
Games and Simulation0.00
Integrations0.00
SDKs and Clients0.00
Learning0.00
Applications0.00
Assigned categoryResearch and Evals
Category probability1.00
Category confidence1.00
PatternExtraction
Pattern confidence0.26
Curation
StatusListed
Reasongate passed
README pickno
Overridenone
Sources
- search:"system one" jev
- search:jev in:name,description,readme created:2026-09-24
Provenance
Modeljev-1.13.0
Question setv2
Judged at2026-09-24 11:54 UTC