index / dd2003-460/jev-structured-bench
jev-structured-bench
JEV-style decision-task benchmark on local 4xV100: 3 output-constraint mechanisms compared on Qwen3.8-27B, two evaluation-methodology bugs found and corrected, full raw outputs
Research and EvalsUnclearReviewHTML
Repository
Stars0
LanguageHTML
LicenseMIT
Created2026-10-25
Last pushed2026-10-25
Officialno
Judgment
Genuine Jev project0.34
gate 0.5
Uses Jev at runtime0.04
Is a meta list0.03
Is a reimplementation0.85
Quality scales
Substance1.91 / 3
gate 0.5
Docs2.64 / 3
Novelty2.57 / 3
Composite score0.76
Category distribution
Research and Evals1.00
SDKs and Clients0.00
Integrations0.00
Agent and Dev Tooling0.00
Applications0.00
Games and Simulation0.00
Learning0.00
Other0.00
Assigned categoryResearch and Evals
Category probability1.00
Category confidence1.00
PatternUnclear
Pattern confidence0.23
Curation
StatusReview
Reasongenuine 0.34 below 0.5
README pickno
Overridenone
Sources
- search:jev in:name,description,readme created:2026-10-25
Provenance
Modeljev-1.14.0
Question setv2
Judged at2026-10-26 12:08 UTC