Zelda evaluations
21 games · six Score dimensions · two pairwise Choice models
Leaderboard and rubric
Value:
At α=1, use returned Score / 4; otherwise transform the normalized five-level vector.
Normalized weights: . Slider values are renormalized to sum to 1.
Choice Δ is pairwise rank minus the current five-axis rubric rank; positive values place a title lower in Choice. Pareto * marks a game not dominated on all five rubric axes.
Pairwise tie and link geometry
Pairwise probability geometry
Jev interior slope +0.022; Gemini -0.366. Zero-containing Jev vectors are omitted; the dashed ε ray is a clipping artifact, not observed geometry.
○ Jev interior · ● Gemini · solid/dashed fit lines · dotted ε-clipped [1,0,0] illustration
Rubric dimension correlations
Off-diagonal Pearson correlations across 21 games. Cell tone represents |r|; each cell prints signed r.
Instrument comparison
| Measurement | Gemini | Jev |
|---|---|---|
| Reported cost / calls / answers | $0.0262553 / 5 calls / 1,218 | not reported / 842 calls / 1,092 |
| Exact repeat, Score | 0.000 MAE; 0/126 flips | 0.034 MAE; 7/126 flips |
| Catalog-order Score MAE (0–4) | 0.075 | 0.059 |
| Choice option-order shift | +4.63 pp in p(A) when A is opt_1 | +4.37 pp in p(A) when A's criterion is listed second |
| Probability output | float64 JSON values; 0 exact Score/Choice zeros | 0.01 Hamilton grid; 597 exact Score/Choice zeros |
| Pairwise target entropy H(q) | 0.8581 | 0.4042 |
| Davidson OOF KL | 0.01445 | 0.03112 |
| Davidson OOF R²_KL | 0.9375 | 0.9464 |
| Logistic-threshold OOF R²_KL | 0.9539 | not fitted in this comparison |
| Hodge gradient / cycle energy | 97.4% / 2.6% | not computed: exact-zero probabilities |
| Nested cycle CV Δ loss (cycle − Davidson) | +0.0000196 nats | +0.0000013 nats |
| Rubric mean absolute correlation | 0.400 | 0.725 |
| Rubric standardized condition | 4.87 | 8.72 |
Pairwise R²_KL is normalized against each model's own training-fold mean vector. Cycle CV values are cycle-minus-Davidson soft loss.