Spaces:
Running
Running
Static leaderboard snapshot JevBench v1.6.1
Browse files- README.md +1 -1
- index.html +67 -67
- snapshot.json +0 -0
README.md
CHANGED
|
@@ -26,7 +26,7 @@ JevBench is Benchmark Heaven's own open benchmark for Jev-class decision models.
|
|
| 26 |
This Space is a fully static, crawlable snapshot of the published board: the
|
| 27 |
ranking table is rendered into `index.html` at build time (no JavaScript needed
|
| 28 |
to read it) and regenerated at every JevBench release.
|
| 29 |
-
Data: JevBench v1.6.
|
| 30 |
|
| 31 |
The headline metric is the **JevBench Capability Score** — the arithmetic mean
|
| 32 |
of Intelligence and Calibration — ranked only for systems inside the official
|
|
|
|
| 26 |
This Space is a fully static, crawlable snapshot of the published board: the
|
| 27 |
ranking table is rendered into `index.html` at build time (no JavaScript needed
|
| 28 |
to read it) and regenerated at every JevBench release.
|
| 29 |
+
Data: JevBench v1.6.1, generated 2026-10-05.
|
| 30 |
|
| 31 |
The headline metric is the **JevBench Capability Score** — the arithmetic mean
|
| 32 |
of Intelligence and Calibration — ranked only for systems inside the official
|
index.html
CHANGED
|
@@ -4,16 +4,16 @@
|
|
| 4 |
<meta charset="utf-8">
|
| 5 |
<meta name="viewport" content="width=device-width,initial-scale=1">
|
| 6 |
<title>JevBench — Jev-class model leaderboard | Benchmark Heaven</title>
|
| 7 |
-
<meta name="description" content="JevBench Capability Score leaderboard for Jev-class decision models by Benchmark Heaven: Intelligence, Calibration, Speed and Cost for every published system, revision v1.6.
|
| 8 |
<link rel="canonical" href="https://benchmarkheaven.com/jev-models">
|
| 9 |
<meta property="og:type" content="website">
|
| 10 |
<meta property="og:url" content="https://huggingface.co/spaces/benchmarkheaven/JevBench">
|
| 11 |
<meta property="og:site_name" content="JevBench by Benchmark Heaven">
|
| 12 |
<meta property="og:title" content="JevBench — Jev-class model leaderboard">
|
| 13 |
-
<meta property="og:description" content="JevBench Capability Score leaderboard for Jev-class decision models by Benchmark Heaven: Intelligence, Calibration, Speed and Cost for every published system, revision v1.6.
|
| 14 |
<meta name="twitter:card" content="summary">
|
| 15 |
<meta name="twitter:title" content="JevBench — Jev-class model leaderboard">
|
| 16 |
-
<meta name="twitter:description" content="JevBench Capability Score leaderboard for Jev-class decision models by Benchmark Heaven: Intelligence, Calibration, Speed and Cost for every published system, revision v1.6.
|
| 17 |
<script type="application/ld+json">
|
| 18 |
{
|
| 19 |
"@context": "https://schema.org",
|
|
@@ -74,11 +74,11 @@
|
|
| 74 |
<div class="fact"><b>92</b><span>ranked systems</span></div>
|
| 75 |
<div class="fact"><b>94</b><span>systems listed in total</span></div>
|
| 76 |
<div class="fact"><b>4</b><span>axes · 25% each in the Composite</span></div>
|
| 77 |
-
<div class="fact"><b>v1.6.
|
| 78 |
</div>
|
| 79 |
|
| 80 |
<h2>Current leaderboard — JevBench Capability Score</h2>
|
| 81 |
-
<p class="note">Data: JevBench v1.6.
|
| 82 |
<div class="table-wrap">
|
| 83 |
<table id="board">
|
| 84 |
<thead>
|
|
@@ -96,70 +96,70 @@
|
|
| 96 |
</thead>
|
| 97 |
<tbody>
|
| 98 |
<tr><span class="rank">1.</span><td><a class="sys-name" href="https://huggingface.co/chinhnc/Quyet-1.0-Large" target="_blank" rel="noopener">Quyet-1.0-Large (Chinh Nguyen, Gemma-4-31B decoder, option-letter logits)</a></td><td class="score">81.7</td><td>73.4</td><td>90.0</td><td>86.9</td><td>50.5</td><td>$0.0445 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 99 |
-
<tr><span class="rank">2.</span><td><a class="sys-name" href="https://
|
| 100 |
-
<tr><span class="rank">3.</span><td><a class="sys-name" href="https://
|
| 101 |
-
<tr><span class="rank">4.</span><td><a class="sys-name" href="https://
|
| 102 |
-
<tr><span class="rank">5.</span><td><a class="sys-name" href="https://huggingface.co/
|
| 103 |
-
<tr><span class="rank">6.</span><td><a class="sys-name" href="https://huggingface.co/
|
| 104 |
-
<tr><span class="rank">7.</span><td><a class="sys-name" href="https://
|
| 105 |
-
<tr><span class="rank">8.</span><td><a class="sys-name" href="https://
|
| 106 |
-
<tr><span class="rank">9.</span><td><a class="sys-name" href="https://
|
| 107 |
-
<tr><span class="rank">10.</span><td><a class="sys-name" href="https://
|
| 108 |
-
<tr><span class="rank">11.</span><td><a class="sys-name" href="https://huggingface.co/
|
| 109 |
-
<tr><span class="rank">12.</span><td><a class="sys-name" href="https://
|
| 110 |
-
<tr><span class="rank">13.</span><td><a class="sys-name" href="https://github.com/
|
| 111 |
-
<tr><span class="rank">14.</span><td><a class="sys-name" href="https://
|
| 112 |
-
<tr><span class="rank">15.</span><td><a class="sys-name" href="https://
|
| 113 |
-
<tr><span class="rank">16.</span><td><a class="sys-name" href="https://github.com/
|
| 114 |
-
<tr><span class="rank">17.</span><td><a class="sys-name" href="https://github.com/
|
| 115 |
-
<tr><span class="rank">18.</span><td><a class="sys-name" href="https://
|
| 116 |
-
<tr><span class="rank">19.</span><td><a class="sys-name" href="https://
|
| 117 |
-
<tr><span class="rank">20.</span><td><a class="sys-name" href="https://
|
| 118 |
-
<tr><span class="rank">21.</span><td><a class="sys-name" href="https://
|
| 119 |
-
<tr><span class="rank">22.</span><td><a class="sys-name" href="https://
|
| 120 |
-
<tr><span class="rank">23.</span><td><a class="sys-name" href="https://github.com/
|
| 121 |
-
<tr><span class="rank">24.</span><td><a class="sys-name" href="https://
|
| 122 |
-
<tr><span class="rank">25.</span><td><a class="sys-name" href="https://
|
| 123 |
-
<tr><span class="rank">26.</span><td><a class="sys-name" href="https://
|
| 124 |
-
<tr><span class="rank">27.</span><td><a class="sys-name" href="https://github.com/
|
| 125 |
-
<tr><span class="rank">28.</span><td><a class="sys-name" href="https://github.com/
|
| 126 |
-
<tr><span class="rank">29.</span><td><a class="sys-name" href="https://
|
| 127 |
-
<tr><span class="rank">30.</span><td><a class="sys-name" href="https://
|
| 128 |
-
<tr><span class="rank">31.</span><td><a class="sys-name" href="https://
|
| 129 |
-
<tr><span class="rank">32.</span><td><a class="sys-name" href="https://
|
| 130 |
-
<tr><span class="rank">33.</span><td><a class="sys-name" href="https://github.com/
|
| 131 |
-
<tr><span class="rank">34.</span><td><a class="sys-name" href="https://github.com/
|
| 132 |
-
<tr><span class="rank">35.</span><td><a class="sys-name" href="https://github.com/
|
| 133 |
-
<tr><span class="rank">36.</span><td><a class="sys-name" href="https://
|
| 134 |
-
<tr><span class="rank">37.</span><td><a class="sys-name" href="https://huggingface.co/
|
| 135 |
-
<tr><span class="rank">38.</span><td><a class="sys-name" href="https://huggingface.co/
|
| 136 |
-
<tr><span class="rank">39.</span><td><a class="sys-name" href="https://
|
| 137 |
-
<tr><span class="rank">40.</span><td><a class="sys-name" href="https://
|
| 138 |
-
<tr><span class="rank">41.</span><td><a class="sys-name" href="https://
|
| 139 |
-
<tr><span class="rank">42.</span><td><a class="sys-name" href="https://
|
| 140 |
-
<tr><span class="rank">43.</span><td><a class="sys-name" href="https://
|
| 141 |
-
<tr><span class="rank">44.</span><td><a class="sys-name" href="https://
|
| 142 |
-
<tr><span class="rank">45.</span><td><a class="sys-name" href="https://huggingface.co/
|
| 143 |
-
<tr><span class="rank">46.</span><td><a class="sys-name" href="https://huggingface.co/
|
| 144 |
-
<tr><span class="rank">47.</span><td><a class="sys-name" href="https://huggingface.co/
|
| 145 |
-
<tr><span class="rank">48.</span><td><a class="sys-name" href="https://
|
| 146 |
-
<tr><span class="rank">49.</span><td><a class="sys-name" href="https://
|
| 147 |
<tr><span class="rank">50.</span><td><a class="sys-name" href="https://github.com/Manavarya09/verdict" target="_blank" rel="noopener">verdict-small (Manavarya09, multilingual-e5-small 118M)</a></td><td class="score">37.6</td><td>2.3</td><td>72.9</td><td>89.5</td><td>100.0</td><td>$0.000866 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 148 |
<tr><span class="rank">51.</span><td><a class="sys-name" href="https://github.com/jaredpalmer/kev" target="_blank" rel="noopener">kev 0.6B (research preview)</a></td><td class="score">36.9</td><td>7.6</td><td>66.3</td><td>91.5</td><td>80.1</td><td>$0.00461 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 149 |
<tr><span class="rank">52.</span><td><a class="sys-name" href="https://huggingface.co/microsoft/Phi-4-mini-instruct" target="_blank" rel="noopener">Raw Phi-4 mini direct logits</a></td><td class="score">35.3</td><td>13.7</td><td>57.0</td><td>91.9</td><td>53.2</td><td>$0.0363 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 150 |
-
<tr><span class="rank">53.</span><td><a class="sys-name" href="https://
|
| 151 |
-
<tr><span class="rank">54.</span><td><a class="sys-name" href="https://
|
| 152 |
-
<tr><span class="rank">55.</span><td><a class="sys-name" href="https://
|
| 153 |
-
<tr><span class="rank">56.</span><td><a class="sys-name" href="https://huggingface.co/chinhnc/Quyet-1.0-
|
| 154 |
-
<tr><span class="rank">57.</span><td><a class="sys-name" href="https://
|
| 155 |
-
<tr><span class="rank">58.</span><td><a class="sys-name" href="https://github.com/
|
| 156 |
-
<tr><span class="rank">59.</span><td><a class="sys-name" href="https://github.com/
|
| 157 |
-
<tr><span class="rank">60.</span><td><a class="sys-name" href="https://
|
| 158 |
-
<tr><span class="rank">61.</span><td><a class="sys-name" href="https://huggingface.co/
|
| 159 |
-
<tr><span class="rank">62.</span><td><a class="sys-name" href="https://huggingface.co/
|
| 160 |
-
<tr><span class="rank">63.</span><td><a class="sys-name" href="https://huggingface.co/Qwen/Qwen3-
|
| 161 |
-
<tr><span class="
|
| 162 |
-
<tr><span class="muted" aria-label="not within official caps">—</span> title="
|
| 163 |
<tr><span class="muted" aria-label="not within official caps">—</span> title="cost 2.6× Jev (v1.5 reference)"<td><a class="sys-name" href="https://github.com/blockbrain-ai/swanone-recipe" target="_blank" rel="noopener">swanOne (blockbrain, Qwen3.8-Flash-Next NVFP4)</a></td><td class="score">72.4</td><td>56.2</td><td>88.6</td><td>82.6</td><td>42.2</td><td>$0.0848 <span class="est">est.</span></td><td>0.3</td></tr>
|
| 164 |
<tr><span class="muted" aria-label="not within official caps">—</span> title="cost 2.5× Jev (v1.5 reference)"<td><a class="sys-name" href="https://github.com/igorls/ninfer" target="_blank" rel="noopener">NInfer Qwen3.8-Flash-Next mixed</a></td><td class="score">69.7</td><td>49.0</td><td>90.4</td><td>89.3</td><td>42.5</td><td>$0.0823 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 165 |
<tr><span class="muted" aria-label="not within official caps">—</span> title="cost 2.0× Jev (v1.5 reference)"<td><a class="sys-name" href="https://huggingface.co/jsaurabh/qwen3.5-9b-jev-data-mix-v2" target="_blank" rel="noopener">Qwen3.5-9B Jev-like data-mix v2</a></td><td class="score">60.9</td><td>41.9</td><td>79.8</td><td>85.4</td><td>45.7</td><td>$0.0646 <span class="est">est.</span></td><td>0.2</td></tr>
|
|
@@ -192,7 +192,7 @@
|
|
| 192 |
</div>
|
| 193 |
|
| 194 |
<h2>Best Jev alternatives</h2>
|
| 195 |
-
<p class="lede" style="font-size:15px">The strongest non-Jev systems on the current board, by Capability Score: <a href="https://huggingface.co/chinhnc/Quyet-1.0-Large" target="_blank" rel="noopener">Quyet-1.0-Large</a> (81.7) · <a href="https://
|
| 196 |
|
| 197 |
<h2>How the score works</h2>
|
| 198 |
<div class="method">
|
|
|
|
| 4 |
<meta charset="utf-8">
|
| 5 |
<meta name="viewport" content="width=device-width,initial-scale=1">
|
| 6 |
<title>JevBench — Jev-class model leaderboard | Benchmark Heaven</title>
|
| 7 |
+
<meta name="description" content="JevBench Capability Score leaderboard for Jev-class decision models by Benchmark Heaven: Intelligence, Calibration, Speed and Cost for every published system, revision v1.6.1.">
|
| 8 |
<link rel="canonical" href="https://benchmarkheaven.com/jev-models">
|
| 9 |
<meta property="og:type" content="website">
|
| 10 |
<meta property="og:url" content="https://huggingface.co/spaces/benchmarkheaven/JevBench">
|
| 11 |
<meta property="og:site_name" content="JevBench by Benchmark Heaven">
|
| 12 |
<meta property="og:title" content="JevBench — Jev-class model leaderboard">
|
| 13 |
+
<meta property="og:description" content="JevBench Capability Score leaderboard for Jev-class decision models by Benchmark Heaven: Intelligence, Calibration, Speed and Cost for every published system, revision v1.6.1.">
|
| 14 |
<meta name="twitter:card" content="summary">
|
| 15 |
<meta name="twitter:title" content="JevBench — Jev-class model leaderboard">
|
| 16 |
+
<meta name="twitter:description" content="JevBench Capability Score leaderboard for Jev-class decision models by Benchmark Heaven: Intelligence, Calibration, Speed and Cost for every published system, revision v1.6.1.">
|
| 17 |
<script type="application/ld+json">
|
| 18 |
{
|
| 19 |
"@context": "https://schema.org",
|
|
|
|
| 74 |
<div class="fact"><b>92</b><span>ranked systems</span></div>
|
| 75 |
<div class="fact"><b>94</b><span>systems listed in total</span></div>
|
| 76 |
<div class="fact"><b>4</b><span>axes · 25% each in the Composite</span></div>
|
| 77 |
+
<div class="fact"><b>v1.6.1</b><span>current revision</span></div>
|
| 78 |
</div>
|
| 79 |
|
| 80 |
<h2>Current leaderboard — JevBench Capability Score</h2>
|
| 81 |
+
<p class="note">Data: JevBench v1.6.1, generated 2026-10-05 · 92 ranked systems · only system-level aggregates are published. Rows inside the official caps first, in Capability rank order; the other ranked rows follow, in Composite order. Click a column header to sort.</p>
|
| 82 |
<div class="table-wrap">
|
| 83 |
<table id="board">
|
| 84 |
<thead>
|
|
|
|
| 96 |
</thead>
|
| 97 |
<tbody>
|
| 98 |
<tr><span class="rank">1.</span><td><a class="sys-name" href="https://huggingface.co/chinhnc/Quyet-1.0-Large" target="_blank" rel="noopener">Quyet-1.0-Large (Chinh Nguyen, Gemma-4-31B decoder, option-letter logits)</a></td><td class="score">81.7</td><td>73.4</td><td>90.0</td><td>86.9</td><td>50.5</td><td>$0.0445 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 99 |
+
<tr><span class="rank">2.</span><td><a class="sys-name" href="https://levanto.ai" target="_blank" rel="noopener">Sage 1.3.0 (Levanto Labs)</a></td><td class="score">78.6</td><td>65.6</td><td>91.6</td><td>93.6</td><td>58.2</td><td>$0.0247 <span class="est">est.</span></td><td>0.2</td></tr>
|
| 100 |
+
<tr><span class="rank">3.</span><td><a class="sys-name" href="https://github.com/krishna-gogineni-765/deck31b" target="_blank" rel="noopener">deck-31B (krishna765, frozen Gemma-4-31B-it, TorchAO FP8 dynamic)</a></td><td class="score">77.6</td><td>73.0</td><td>82.2</td><td>86.7</td><td>49.7</td><td>$0.0475 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 101 |
+
<tr><span class="rank">4.</span><td><a class="sys-name" href="https://docs.typesafe.ai" target="_blank" rel="noopener">Jev 1.13.0 (TypeSafe AI)</a></td><td class="score">77.1</td><td>63.6</td><td>90.6</td><td>91.5</td><td>54.7</td><td>$0.0323</td><td>0.2</td></tr>
|
| 102 |
+
<tr><span class="rank">5.</span><td><a class="sys-name" href="https://huggingface.co/torchcast-ai/torchcast-decision-12b" target="_blank" rel="noopener">torchcast-decision-12b (Torchcast AI, Gemma-4-12B fine-tune, option-letter logprob readout)</a></td><td class="score">71.7</td><td>60.5</td><td>82.9</td><td>91.7</td><td>56.4</td><td>$0.0285 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 103 |
+
<tr><span class="rank">6.</span><td><a class="sys-name" href="https://huggingface.co/akhilaaa3/Jev-Omni" target="_blank" rel="noopener">Jev-Omni (akhilaaa3, Gemma-4-12B merged)</a></td><td class="score">71.3</td><td>55.5</td><td>87.0</td><td>85.4</td><td>56.1</td><td>$0.0292 <span class="est">est.</span></td><td>0.2</td></tr>
|
| 104 |
+
<tr><span class="rank">7.</span><td><a class="sys-name" href="https://huggingface.co/EldanRing/Winnow-12B" target="_blank" rel="noopener">Winnow-12B Q8</a></td><td class="score">71.2</td><td>59.5</td><td>83.0</td><td>86.7</td><td>56.6</td><td>$0.0281 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 105 |
+
<tr><span class="rank">8.</span><td><a class="sys-name" href="https://github.com/blockbrain-ai/cygnet-recipe" target="_blank" rel="noopener">Cygnet (blockbrain, frozen Gemma-4-12B-it)</a></td><td class="score">70.9</td><td>54.8</td><td>87.0</td><td>91.8</td><td>56.4</td><td>$0.0283 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 106 |
+
<tr><span class="rank">9.</span><td><a class="sys-name" href="https://huggingface.co/crh225/plumb-4b" target="_blank" rel="noopener">Plumb-4B (crh225, JevK5 v0.2 + LoRA)</a></td><td class="score">65.4</td><td>43.0</td><td>87.9</td><td>93.8</td><td>63.1</td><td>$0.017 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 107 |
+
<tr><span class="rank">10.</span><td><a class="sys-name" href="https://github.com/Mapika/decider" target="_blank" rel="noopener">decider-4b v2 (Mapika)</a></td><td class="score">64.9</td><td>40.1</td><td>89.6</td><td>91.8</td><td>64.5</td><td>$0.0152 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 108 |
+
<tr><span class="rank">11.</span><td><a class="sys-name" href="https://huggingface.co/alibiserikbay/JevK5" target="_blank" rel="noopener">JevK5 v0.3 (4B)</a></td><td class="score">64.2</td><td>38.5</td><td>89.9</td><td>93.9</td><td>63.1</td><td>$0.017 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 109 |
+
<tr><span class="rank">12.</span><td><a class="sys-name" href="https://huggingface.co/Cloudflare/clef-flash" target="_blank" rel="noopener">Clef-Flash (Cloudflare, Qwen3.5-9B post-train with a joint schema head, multimodal, measured on text)</a></td><td class="score">63.8</td><td>42.2</td><td>85.5</td><td>88.4</td><td>46.8</td><td>$0.0593 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 110 |
+
<tr><span class="rank">13.</span><td><a class="sys-name" href="https://github.com/krishna-gogineni-765/deck" target="_blank" rel="noopener">deck-4B v1.0 (krishna765, JevK5 + LoRA, FP8 weight-only)</a></td><td class="score">63.6</td><td>38.6</td><td>88.6</td><td>89.9</td><td>63.5</td><td>$0.0165 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 111 |
+
<tr><span class="rank">14.</span><td><a class="sys-name" href="https://github.com/allebee/jevk5" target="_blank" rel="noopener">JevK5 v0.2.0</a></td><td class="score">62.8</td><td>36.3</td><td>89.4</td><td>91.6</td><td>63.1</td><td>$0.017 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 112 |
+
<tr><span class="rank">15.</span><td><a class="sys-name" href="https://huggingface.co/HopitAI/hopper" target="_blank" rel="noopener">Hopper</a></td><td class="score">62.4</td><td>34.7</td><td>90.1</td><td>91.1</td><td>62.3</td><td>$0.0181 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 113 |
+
<tr><span class="rank">16.</span><td><a class="sys-name" href="https://github.com/fstandhartinger/jevbench/issues/110" target="_blank" rel="noopener">Imajev-4B (RTX 5090)</a></td><td class="score">61.9</td><td>34.6</td><td>89.2</td><td>90.5</td><td>63.3</td><td>$0.0168 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 114 |
+
<tr><span class="rank">17.</span><td><a class="sys-name" href="https://github.com/Octalab-Inc/jqv" target="_blank" rel="noopener">jqv (Qwen3-32B zero-shot)</a></td><td class="score">61.9</td><td>33.9</td><td>89.9</td><td>83.1</td><td>51.2</td><td>$0.0424 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 115 |
+
<tr><span class="rank">18.</span><td><a class="sys-name" href="https://github.com/metask-ai/metask-jev" target="_blank" rel="noopener">metask-jev-4b</a></td><td class="score">61.8</td><td>39.2</td><td>84.4</td><td>90.8</td><td>57.7</td><td>$0.0256 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 116 |
+
<tr><span class="rank">19.</span><td><a class="sys-name" href="https://huggingface.co/interfaze-ai/lev" target="_blank" rel="noopener">lev (Interfaze AI, Qwen3.5-4B + LoRA r32, label-token readout + candidate-path head, per-bucket temperatures)</a></td><td class="score">61.7</td><td>41.1</td><td>82.3</td><td>88.0</td><td>61.8</td><td>$0.0188 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 117 |
+
<tr><span class="rank">20.</span><td><a class="sys-name" href="https://github.com/newfull5/malkuth" target="_blank" rel="noopener">Malkuth-4B (newfull5, Kev post-train)</a></td><td class="score">61.1</td><td>33.8</td><td>88.4</td><td>89.5</td><td>55.8</td><td>$0.0297 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 118 |
+
<tr><span class="rank">21.</span><td><a class="sys-name" href="https://benchmarkheaven.com/jev-models/decision-4b-v12" target="_blank" rel="noopener">Decision 4B v1.2 (FlyMyJev, Qwen3.5-4B + LoRA)</a></td><td class="score">60.4</td><td>32.4</td><td>88.4</td><td>93.9</td><td>63.1</td><td>$0.017 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 119 |
+
<tr><span class="rank">22.</span><td><a class="sys-name" href="https://huggingface.co/chinhnc/Quyet-1.0-Medium" target="_blank" rel="noopener">Quyet-1.0-Medium (Chinh Nguyen, Qwen3.5-4B decoder, option-letter logits)</a></td><td class="score">59.2</td><td>41.7</td><td>76.8</td><td>89.5</td><td>63.4</td><td>$0.0166 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 120 |
+
<tr><span class="rank">23.</span><td><a class="sys-name" href="https://github.com/nschlaepfer/manchego-serve" target="_blank" rel="noopener">Manchego v2.1</a></td><td class="score">58.3</td><td>32.5</td><td>84.0</td><td>90.7</td><td>64.3</td><td>$0.0155 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 121 |
+
<tr><span class="rank">24.</span><td><a class="sys-name" href="https://github.com/us/jev-local" target="_blank" rel="noopener">jev-local (Qwen3.5-9B)</a></td><td class="score">57.5</td><td>41.9</td><td>73.1</td><td>75.6</td><td>58.9</td><td>$0.0235 <span class="est">est.</span></td><td>0.4</td></tr>
|
| 122 |
+
<tr><span class="rank">25.</span><td><a class="sys-name" href="https://benchmarkheaven.com/jev-models/decision-4b-v11" target="_blank" rel="noopener">Decision 4B v1.1 (FlyMyJev, Qwen3.5-4B + LoRA)</a></td><td class="score">57.2</td><td>29.1</td><td>85.2</td><td>94.0</td><td>63.1</td><td>$0.017 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 123 |
+
<tr><span class="rank">26.</span><td><a class="sys-name" href="https://huggingface.co/WIlfLin/JEV-Qwen3.5-9B-Base-NVFP4" target="_blank" rel="noopener">JEV Qwen3.5-9B Base NVFP4</a></td><td class="score">57.1</td><td>29.3</td><td>85.0</td><td>93.6</td><td>47.6</td><td>$0.0558 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 124 |
+
<tr><span class="rank">27.</span><td><a class="sys-name" href="https://github.com/mihail-gribov/typecastlm" target="_blank" rel="noopener">typecastlm (Mikhail Gribov, Qwen3.5-4B computed head)</a></td><td class="score">56.5</td><td>29.8</td><td>83.3</td><td>92.8</td><td>64.0</td><td>$0.0159 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 125 |
+
<tr><span class="rank">28.</span><td><a class="sys-name" href="https://github.com/TheoLeeCJ/openjev" target="_blank" rel="noopener">SemIf, formerly OpenJev (Qwen3.5-4B, TheoLeeCJ)</a></td><td class="score">55.4</td><td>27.1</td><td>83.6</td><td>90.8</td><td>63.1</td><td>$0.017 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 126 |
+
<tr><span class="rank">29.</span><td><a class="sys-name" href="https://github.com/amithgc/local-jev" target="_blank" rel="noopener">local-jev Qwen3.5-4B</a></td><td class="score">55.0</td><td>24.1</td><td>85.8</td><td>86.1</td><td>59.3</td><td>$0.0228 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 127 |
+
<tr><span class="rank">30.</span><td><a class="sys-name" href="https://huggingface.co/flymy-ai/decision-2b-preview" target="_blank" rel="noopener">Decision 2B (FlyMy.AI, v59)</a></td><td class="score">54.8</td><td>22.9</td><td>86.8</td><td>90.4</td><td>66.4</td><td>$0.0132 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 128 |
+
<tr><span class="rank">31.</span><td><a class="sys-name" href="https://github.com/abhishek085/open-spark-jev" target="_blank" rel="noopener">spark-s1-4b-v6 (Open Spark Jev, abhishek085)</a></td><td class="score">54.0</td><td>43.2</td><td>64.8</td><td>87.0</td><td>60.4</td><td>$0.0209 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 129 |
+
<tr><span class="rank">32.</span><td><a class="sys-name" href="https://huggingface.co/zeroentropy/zerank-2-reranker" target="_blank" rel="noopener">ZeroEntropy zerank-2</a></td><td class="score">49.4</td><td>15.6</td><td>83.2</td><td>82.9</td><td>48.4</td><td>$0.0525 <span class="est">est.</span></td><td>0.2</td></tr>
|
| 130 |
+
<tr><span class="rank">33.</span><td><a class="sys-name" href="https://github.com/ikermoel/open-alternative-jev" target="_blank" rel="noopener">open-alternative-jev (Qwen3.5-4B, IkerMoel)</a></td><td class="score">49.1</td><td>22.3</td><td>75.9</td><td>91.3</td><td>63.3</td><td>$0.0168 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 131 |
+
<tr><span class="rank">34.</span><td><a class="sys-name" href="https://github.com/sabeel111/OpenSourceJev" target="_blank" rel="noopener">OpenSourceJev (Qwen3.5-4B Q4_K_M, native llama.cpp)</a></td><td class="score">48.6</td><td>23.2</td><td>73.9</td><td>77.1</td><td>69.1</td><td>$0.0107 <span class="est">est.</span></td><td>0.3</td></tr>
|
| 132 |
+
<tr><span class="rank">35.</span><td><a class="sys-name" href="https://github.com/newfull5/malkuth" target="_blank" rel="noopener">Malkuth-2B (newfull5, Kev post-train)</a></td><td class="score">47.6</td><td>15.9</td><td>79.3</td><td>92.0</td><td>65.6</td><td>$0.0141 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 133 |
+
<tr><span class="rank">36.</span><td><a class="sys-name" href="https://github.com/pst2154/Nemotron_Jev" target="_blank" rel="noopener">Nemotron Diffusion 8B (pst2154, optimized vLLM)</a></td><td class="score">47.5</td><td>20.4</td><td>74.5</td><td>93.8</td><td>55.5</td><td>$0.0305 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 134 |
+
<tr><span class="rank">37.</span><td><a class="sys-name" href="https://huggingface.co/Qwen/Qwen3-Reranker-4B" target="_blank" rel="noopener">Qwen3-Reranker-4B</a></td><td class="score">44.7</td><td>16.3</td><td>73.2</td><td>82.1</td><td>48.4</td><td>$0.0525 <span class="est">est.</span></td><td>0.2</td></tr>
|
| 135 |
+
<tr><span class="rank">38.</span><td><a class="sys-name" href="https://huggingface.co/Mapika/decider-2b" target="_blank" rel="noopener">decider-2b (Mapika)</a></td><td class="score">44.6</td><td>20.7</td><td>68.5</td><td>94.6</td><td>64.9</td><td>$0.0148 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 136 |
+
<tr><span class="rank">39.</span><td><a class="sys-name" href="https://huggingface.co/BAAI/bge-reranker-v2-m3" target="_blank" rel="noopener">BAAI bge-reranker-v2-m3</a></td><td class="score">44.1</td><td>0.1</td><td>88.1</td><td>93.9</td><td>59.3</td><td>$0.0227 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 137 |
+
<tr><span class="rank">40.</span><td><a class="sys-name" href="https://github.com/jaredpalmer/kev" target="_blank" rel="noopener">kev 4B (research preview)</a></td><td class="score">44.0</td><td>19.5</td><td>68.5</td><td>90.5</td><td>65.8</td><td>$0.0138 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 138 |
+
<tr><span class="rank">41.</span><td><a class="sys-name" href="https://huggingface.co/mixedbread-ai/mxbai-rerank-base-v2" target="_blank" rel="noopener">Mixedbread mxbai-rerank-base-v2</a></td><td class="score">43.9</td><td>1.1</td><td>86.6</td><td>92.6</td><td>60.3</td><td>$0.021 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 139 |
+
<tr><span class="rank">42.</span><td><a class="sys-name" href="https://github.com/franckverrot/lev" target="_blank" rel="noopener">lev-350m (Franck Verrot, LFM2.5-350M)</a></td><td class="score">43.3</td><td>4.8</td><td>81.9</td><td>94.0</td><td>80.0</td><td>$0.00463 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 140 |
+
<tr><span class="rank">43.</span><td><a class="sys-name" href="https://huggingface.co/altslate/certo-decision-model" target="_blank" rel="noopener">Certo v1 (AltSlate Labs)</a></td><td class="score">43.2</td><td>0.2</td><td>86.1</td><td>92.5</td><td>96.9</td><td>$0.00127 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 141 |
+
<tr><span class="rank">44.</span><td><a class="sys-name" href="https://github.com/isHeSatoshi/smalljev" target="_blank" rel="noopener">smalljev semantic-v9</a></td><td class="score">43.0</td><td>8.7</td><td>77.2</td><td>90.2</td><td>60.8</td><td>$0.0203 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 142 |
+
<tr><span class="rank">45.</span><td><a class="sys-name" href="https://huggingface.co/Alibaba-NLP/gte-reranker-modernbert-base" target="_blank" rel="noopener">Alibaba GTE Reranker ModernBERT-base</a></td><td class="score">41.7</td><td>0.0</td><td>83.5</td><td>93.8</td><td>69.3</td><td>$0.0106 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 143 |
+
<tr><span class="rank">46.</span><td><a class="sys-name" href="https://huggingface.co/flymy-ai/decision-fast-preview" target="_blank" rel="noopener">Decision Fast (FlyMy.AI, v53a)</a></td><td class="score">40.6</td><td>6.1</td><td>75.1</td><td>91.5</td><td>80.1</td><td>$0.00461 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 144 |
+
<tr><span class="rank">47.</span><td><a class="sys-name" href="https://huggingface.co/heman10x/rlcd-modernbert-151m" target="_blank" rel="noopener">openJev Verdict 1.4</a></td><td class="score">40.4</td><td>5.0</td><td>75.7</td><td>81.5</td><td>86.6</td><td>$0.00279 <span class="est">est.</span></td><td>0.3</td></tr>
|
| 145 |
+
<tr><span class="rank">48.</span><td><a class="sys-name" href="https://huggingface.co/chinhnc/Quyet-1.0-Small-EN" target="_blank" rel="noopener">Quyet-1.0-Small-EN (Chinh Nguyen, ModernBERT-base encoder with fixed heads)</a></td><td class="score">39.5</td><td>6.1</td><td>73.0</td><td>94.9</td><td>89.1</td><td>$0.00231 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 146 |
+
<tr><span class="rank">49.</span><td><a class="sys-name" href="https://github.com/deepanwadhwa/OpenDecision" target="_blank" rel="noopener">OpenDecision (ModernBERT-large zero-shot)</a></td><td class="score">38.0</td><td>7.4</td><td>68.6</td><td>87.1</td><td>79.1</td><td>$0.00497 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 147 |
<tr><span class="rank">50.</span><td><a class="sys-name" href="https://github.com/Manavarya09/verdict" target="_blank" rel="noopener">verdict-small (Manavarya09, multilingual-e5-small 118M)</a></td><td class="score">37.6</td><td>2.3</td><td>72.9</td><td>89.5</td><td>100.0</td><td>$0.000866 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 148 |
<tr><span class="rank">51.</span><td><a class="sys-name" href="https://github.com/jaredpalmer/kev" target="_blank" rel="noopener">kev 0.6B (research preview)</a></td><td class="score">36.9</td><td>7.6</td><td>66.3</td><td>91.5</td><td>80.1</td><td>$0.00461 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 149 |
<tr><span class="rank">52.</span><td><a class="sys-name" href="https://huggingface.co/microsoft/Phi-4-mini-instruct" target="_blank" rel="noopener">Raw Phi-4 mini direct logits</a></td><td class="score">35.3</td><td>13.7</td><td>57.0</td><td>91.9</td><td>53.2</td><td>$0.0363 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 150 |
+
<tr><span class="rank">53.</span><td><a class="sys-name" href="https://fastino.ai/" target="_blank" rel="noopener">Fastino GLiNER-2.5-Decide (hosted API)</a></td><td class="score">34.6</td><td>7.0</td><td>62.1</td><td>84.7</td><td>45.8</td><td>$0.064</td><td>0.4</td></tr>
|
| 151 |
+
<tr><span class="rank">54.</span><td><a class="sys-name" href="https://huggingface.co/Qwen/Qwen3-4B-Instruct-2507" target="_blank" rel="noopener">Raw Qwen3 4B Instruct 2507 direct logits</a></td><td class="score">34.6</td><td>34.0</td><td>35.2</td><td>91.2</td><td>63.4</td><td>$0.0166 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 152 |
+
<tr><span class="rank">55.</span><td><a class="sys-name" href="https://github.com/jaredpalmer/kev" target="_blank" rel="noopener">kev 0.5B</a></td><td class="score">32.9</td><td>4.6</td><td>61.2</td><td>92.4</td><td>80.1</td><td>$0.00461 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 153 |
+
<tr><span class="rank">56.</span><td><a class="sys-name" href="https://huggingface.co/chinhnc/Quyet-1.0-Small" target="_blank" rel="noopener">Quyet-1.0-Small (Chinh Nguyen, SEA-LION-ModernBERT-300M encoder with fixed heads)</a></td><td class="score">32.5</td><td>4.0</td><td>61.0</td><td>94.9</td><td>79.6</td><td>$0.0048 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 154 |
+
<tr><span class="rank">57.</span><td><a class="sys-name" href="https://huggingface.co/chinhnc/Quyet-1.0-Tiny" target="_blank" rel="noopener">Quyet-1.0-Tiny (Chinh Nguyen, mmBERT-small encoder (16 layers kept) with fixed heads)</a></td><td class="score">31.1</td><td>3.7</td><td>58.5</td><td>95.1</td><td>88.4</td><td>$0.00243 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 155 |
+
<tr><span class="rank">58.</span><td><a class="sys-name" href="https://github.com/JoshuaSP/open-jev" target="_blank" rel="noopener">Open Jev JSON Canvas (JoshuaSP)</a></td><td class="score">30.6</td><td>61.2</td><td>0.0</td><td>85.5</td><td>49.3</td><td>$0.049 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 156 |
+
<tr><span class="rank">59.</span><td><a class="sys-name" href="https://github.com/Heman10x-NGU/openJev-verdict-2.0" target="_blank" rel="noopener">openJev Verdict (heman10x, ModernBERT-base 151M)</a></td><td class="score">26.6</td><td>4.1</td><td>49.1</td><td>79.4</td><td>86.6</td><td>$0.00279 <span class="est">est.</span></td><td>0.3</td></tr>
|
| 157 |
+
<tr><span class="rank">60.</span><td><a class="sys-name" href="https://github.com/Contrastive-LM/CLM" target="_blank" rel="noopener">CLM-8B (Contrastive-LM, clm-latest)</a></td><td class="score">20.1</td><td>0.1</td><td>40.0</td><td>92.6</td><td>50.5</td><td>$0.0447 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 158 |
+
<tr><span class="rank">61.</span><td><a class="sys-name" href="https://huggingface.co/LibertAIDAI/deem-0.8-v1" target="_blank" rel="noopener">Deem 0.8B v1</a></td><td class="score">18.1</td><td>6.5</td><td>29.6</td><td>85.4</td><td>80.3</td><td>$0.00454 <span class="est">est.</span></td><td>0.2</td></tr>
|
| 159 |
+
<tr><span class="rank">62.</span><td><a class="sys-name" href="https://huggingface.co/convaiinnovations/laya/tree/1c5edc17a7acd8701df6fc341c0d179f1c62c982/multilingual" target="_blank" rel="noopener">Laya multilingual</a></td><td class="score">17.0</td><td>0.3</td><td>33.7</td><td>77.8</td><td>82.2</td><td>$0.00393 <span class="est">est.</span></td><td>0.4</td></tr>
|
| 160 |
+
<tr><span class="rank">63.</span><td><a class="sys-name" href="https://huggingface.co/Qwen/Qwen3-1.7B" target="_blank" rel="noopener">Raw Qwen3 1.7B direct logits</a></td><td class="score">8.3</td><td>5.1</td><td>11.5</td><td>93.2</td><td>68.5</td><td>$0.0112 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 161 |
+
<tr><span class="rank">64.</span><td><a class="sys-name" href="https://huggingface.co/Qwen/Qwen3-0.6B" target="_blank" rel="noopener">Raw Qwen3 0.6B direct logits</a></td><td class="score">8.2</td><td>5.6</td><td>10.9</td><td>93.5</td><td>77.6</td><td>$0.00559 <span class="est">est.</span></td><td>0.0</td></tr>
|
| 162 |
+
<tr><span class="muted" aria-label="not within official caps">—</span> title="latency 2.6× Jev (v1.5 reference)"<td><a class="sys-name" href="https://wity.alphanimble.com/" target="_blank" rel="noopener">wity-1 (Wity, reasoning auto)</a></td><td class="score">79.1</td><td>70.3</td><td>87.9</td><td>71.8</td><td>58.8</td><td>$0.0236</td><td>1.6</td></tr>
|
| 163 |
<tr><span class="muted" aria-label="not within official caps">—</span> title="cost 2.6× Jev (v1.5 reference)"<td><a class="sys-name" href="https://github.com/blockbrain-ai/swanone-recipe" target="_blank" rel="noopener">swanOne (blockbrain, Qwen3.8-Flash-Next NVFP4)</a></td><td class="score">72.4</td><td>56.2</td><td>88.6</td><td>82.6</td><td>42.2</td><td>$0.0848 <span class="est">est.</span></td><td>0.3</td></tr>
|
| 164 |
<tr><span class="muted" aria-label="not within official caps">—</span> title="cost 2.5× Jev (v1.5 reference)"<td><a class="sys-name" href="https://github.com/igorls/ninfer" target="_blank" rel="noopener">NInfer Qwen3.8-Flash-Next mixed</a></td><td class="score">69.7</td><td>49.0</td><td>90.4</td><td>89.3</td><td>42.5</td><td>$0.0823 <span class="est">est.</span></td><td>0.1</td></tr>
|
| 165 |
<tr><span class="muted" aria-label="not within official caps">—</span> title="cost 2.0× Jev (v1.5 reference)"<td><a class="sys-name" href="https://huggingface.co/jsaurabh/qwen3.5-9b-jev-data-mix-v2" target="_blank" rel="noopener">Qwen3.5-9B Jev-like data-mix v2</a></td><td class="score">60.9</td><td>41.9</td><td>79.8</td><td>85.4</td><td>45.7</td><td>$0.0646 <span class="est">est.</span></td><td>0.2</td></tr>
|
|
|
|
| 192 |
</div>
|
| 193 |
|
| 194 |
<h2>Best Jev alternatives</h2>
|
| 195 |
+
<p class="lede" style="font-size:15px">The strongest non-Jev systems on the current board, by Capability Score: <a href="https://huggingface.co/chinhnc/Quyet-1.0-Large" target="_blank" rel="noopener">Quyet-1.0-Large</a> (81.7) · <a href="https://levanto.ai" target="_blank" rel="noopener">Sage 1.3.0</a> (78.6) · <a href="https://github.com/krishna-gogineni-765/deck31b" target="_blank" rel="noopener">deck-31B</a> (77.6). The Jev reference row (TypeSafe AI) is excluded from this list. For the full comparison — open-weight options, use-case fit and per-row evidence — see the <a href="https://benchmarkheaven.com/jev-models/alternatives" target="_blank" rel="noopener">Jev alternatives page</a>.</p>
|
| 196 |
|
| 197 |
<h2>How the score works</h2>
|
| 198 |
<div class="method">
|
snapshot.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|