index / vclic/smoking-extraction-benchmark
smoking-extraction-benchmark
Synthetic smoking-history extraction benchmark comparing TypeSafe Jev and OpenAI structured outputs, with reproducible accuracy, cost, and latency results.
Research and EvalsExtractionListedPython
Repository
Stars0
LanguagePython
License—
Created2026-09-18
Last pushed2026-09-18
Officialno
Judgment
Genuine Jev project0.94
gate 0.5
Uses Jev at runtime0.79
Is a meta list0.04
Is a reimplementation0.06
Quality scales
Substance2.00 / 3
gate 0.5
Docs2.56 / 3
Novelty2.34 / 3
Composite score0.75
Category distribution
Research and Evals1.00
Other0.00
Games and Simulation0.00
Learning0.00
Agent and Dev Tooling0.00
SDKs and Clients0.00
Applications0.00
Integrations0.00
Assigned categoryResearch and Evals
Category probability1.00
Category confidence1.00
PatternExtraction
Pattern confidence1.00
Curation
StatusListed
Reasongate passed
README pickno
Overridenone
Sources
- search:jev typesafe
- search:jev in:name,description,readme created:2026-09-18
- list:AnotiaWang/awesome-jev
Provenance
Modeljev-1.13.0
Question setv2
Judged at2026-09-18 14:05 UTC