Benchmark run log
Every time we run an AI model against a benchmark set, the row is recorded here exactly as it happened. Not a rollup like the /benchmark leaderboards, but one row per call, so any summary figure on this site can be traced back to the actual run that produced it.Read more
197 test runs23 models tested6 benchmark setsMost recent run
GitHub11 runs
- 07:49Claude Sonnet 5.5Arti kata Jawa langkaword meaning34/43
- 07:45Claude Sonnet 5.5Arti kata Jawa sehari-hariword meaning122/135
- 07:31Claude Sonnet 5.5Normalisasi teks Indonesiaopen answerPrompt stating the key's rule32/49
- 07:25Claude Sonnet 5.5Normalisasi teks Indonesiaopen answerDetailed prompt forbidding word swaps31/49
- 07:19Claude Sonnet 5.5Normalisasi teks Indonesiaopen answerBuilt-in prompt20/49
- 07:15Claude Sonnet 5.5Koreksi ejaan Indonesiaopen answer28/38
- 07:09Claude Sonnet 5.5Tingkat tutur bahasa Jawaopen answer6/6
- 07:08Claude Sonnet 5.5Tingkat tutur bahasa Jawamultiple choice26/27
- 07:05Claude Sonnet 5.5Pemahaman slang Indonesiamultiple choice40/42
- 06:57Claude Haiku 5.5Normalisasi teks Indonesiaopen answerPrompt stating the key's rule36/49
- 06:51Claude Haiku 5.5Normalisasi teks Indonesiaopen answerDetailed prompt forbidding word swaps32/49
7 runs
- 16:58Claude Haiku 5.5Arti kata Jawa langkaword meaning23/43
- 16:54Claude Haiku 5.5Arti kata Jawa sehari-hariword meaning108/135
- 16:41Claude Haiku 5.5Normalisasi teks Indonesiaopen answerBuilt-in prompt25/49
- 16:37Claude Haiku 5.5Koreksi ejaan Indonesiaopen answer25/38
- 16:31Claude Haiku 5.5Tingkat tutur bahasa Jawaopen answer5/6
- 16:30Claude Haiku 5.5Tingkat tutur bahasa Jawamultiple choice24/27
- 16:28Claude Haiku 5.5Pemahaman slang Indonesiamultiple choice40/42
7 runs
- 21:00MiMo-V2.6-FlashArti kata Jawa sehari-hariword meaning100/135
- 20:36MiMo-V2.6-FlashNormalisasi teks Indonesiaopen answerBuilt-in prompt37/49
- 20:26MiMo-V2.6-FlashKoreksi ejaan Indonesiaopen answer26/38
- 20:15MiMo-V2.6-FlashTingkat tutur bahasa Jawaopen answer5/6
- 20:14MiMo-V2.6-FlashTingkat tutur bahasa Jawamultiple choice22/27
- 19:29MiMo-V2.6-FlashArti kata Jawa langkaword meaning15/43
- 19:27MiMo-V2.6-FlashPemahaman slang Indonesiamultiple choice40/42
5 runs
- 22:08DeepSeek V4.1 FlashArti kata Jawa langkaword meaning22/43
- 21:54DeepSeek V4.1 FlashPemahaman slang Indonesiamultiple choice41/42
- 21:36DeepSeek V4.1 FlashTingkat tutur bahasa Jawaopen answer6/6
- 21:36DeepSeek V4.1 FlashTingkat tutur bahasa Jawamultiple choice26/27
- 21:22Mercury 2.5Arti kata Jawa langkaword meaning13/43
The number at the far right of each row is the score: correct answers out of items scored. It can be smaller than the set's full item count when some items are held back or still awaiting human judgment.
This page is the raw list, not the analysis. For results per set with their limits, see the benchmark leaderboard. For how scoring works, see our methodology.