Benchmarks

granite-4.2

Granite 4.2, a stock instruct model read zero-shot in the chat layout.

Model page
ardana pull granite-4.2

granite-4.2:3b

hf.co/ibm-granite/granite-4.2-3b-GGUF at c40945d7

ardana pull granite-4.2:3b

Not measured yet.

granite-4.2:8b

hf.co/ibm-granite/granite-4.2-8b-GGUF at 93f3f6a8

ardana pull granite-4.2:8b

Not measured yet.

Accuracy is correct answers over attempted items, and a request that failed or timed out counts as wrong; the interval is a 95% bootstrap over items, resampling paraphrase pairs together. Brier and ECE (top-label, ten equal bins) run over the items with a valid probability distribution, whose count sits beside every ECE. Every figure is computed by JevBench’s own scorer.

Only JevBench’s public items are used (only the public half of the hard tier), so these numbers are not comparable with its published leaderboard, which includes held-out items.