Awesome Jev

index / zhuyansen/jev-search-rerank-eval

jev-search-rerank-eval

Does a TypeSafe Jev rerank beat embedding search? Graded relevance eval (9,831 pairs, 164 zh/en queries) over the Agent Skills Hub catalog, with the judge-circularity bias measured.

Research and EvalsRankingListedPython

Repository

Stars3
LanguagePython
LicenseMIT
Created2026-09-18
Last pushed2026-09-18
Officialno

Judgment

Genuine Jev project0.94
gate 0.5
Uses Jev at runtime0.78
Is a meta list0.04
Is a reimplementation0.06

Quality scales

Substance2.01 / 3
gate 0.5
Docs2.36 / 3
Novelty2.87 / 3
Composite score0.81

Category distribution

Research and Evals1.00
Agent and Dev Tooling0.00
Games and Simulation0.00
Applications0.00
Other0.00
Integrations0.00
SDKs and Clients0.00
Learning0.00
Assigned categoryResearch and Evals
Category probability1.00
Category confidence1.00
PatternRanking
Pattern confidence0.89

Curation

StatusListed
Reasongate passed
README pickno
Overridenone

Sources

Provenance

Modeljev-1.13.0
Question setv2
Judged at2026-09-18 16:04 UTC