Awesome Jev

index / nikkoxgonzales/jev-certify

jev-certify

Finite-sample guarantees for Jev (TypeSafe's System One). Conformal risk control turns calibrated probabilities into certified routing thresholds; prediction-powered inference audits them. 2,412 decisions on CLINC150 for $0.23 — including the shift and prevalence cases where the guarantee breaks.

Research and EvalsRoutingListedPython

Repository

Stars0
LanguagePython
LicenseMIT
Created2026-09-21
Last pushed2026-09-21
Officialno

Judgment

Genuine Jev project0.95
gate 0.5
Uses Jev at runtime0.85
Is a meta list0.03
Is a reimplementation0.07

Quality scales

Substance2.38 / 3
gate 0.5
Docs2.96 / 3
Novelty2.98 / 3
Composite score0.90

Category distribution

Research and Evals0.95
Agent and Dev Tooling0.05
Games and Simulation0.00
SDKs and Clients0.00
Applications0.00
Integrations0.00
Other0.00
Learning0.00
Assigned categoryResearch and Evals
Category probability0.95
Category confidence0.93
PatternRouting
Pattern confidence1.00

Curation

StatusListed
Reasongate passed
README pickno
Overridenone

Sources

Provenance

Modeljev-1.13.0
Question setv2
Judged at2026-09-22 11:45 UTC