Z-aiModel

GLM 5.3 Flash

How GLM 5.3 Flash performed across every Indonesian and regional-language benchmark we publish.Read more
Last runon Arti kata Jawa langkaversion not pinnedKeterangan

Benchmarks tested

6

of 6 benchmarks we publish

This model has been run on every benchmark we publish.

Runs completed

9

complete runs on record

One run means the model answered every item in a set, start to finish. A set run more than once contributes more than one.

Total cost

$0.0686

for every run above

The real amount billed by the provider, summed, not an estimate from per-token pricing. Not yet divided by correct answers.

Total tokens

303,387

input and output combined

Counted only from runs that recorded tokens. Runs on the older path did not store them, and the figure is not guessed.

How many answers were correct

Each bar is one benchmark: how many items it answered correctly out of every item in that set. We wrote the questions and answer keys ourselves and had them checked by two native speakers, and every model answers exactly the same items.

9 benchmarks
Pemahaman slang Indonesia38/42 90.5%
Tingkat tutur bahasa Jawaopen answer5/6 83.3%
Tingkat tutur bahasa Jawamultiple choice22/27 81.5%
Arti kata Jawa sehari-hari97/135 71.9%
Normalisasi teks Indonesiaquestion version 3Keterangan34/49 69.4%
Koreksi ejaan Indonesia25/38 65.8%
Normalisasi teks Indonesiaquestion version 2Keterangan30/49 61.2%
Normalisasi teks Indonesiaquestion version 1Keterangan25/49 51.0%
Arti kata Jawa langka11/43 25.6%
Share of items answered correctly across 9 benchmarks

How far the cost pays off

Sorted by the cheapest correct answer first. The left column shows how many items were answered correctly, so a top row with a long left bar means both cheap and accurate.

9 with cost on record
Correct answersCost per correct answer
Pemahaman slang Indonesia90.5%$0.000079
Arti kata Jawa sehari-hari71.9%$0.000122
Tingkat tutur bahasa Jawamultiple choice81.5%$0.000130
Normalisasi teks Indonesiaquestion version 2Keterangan61.2%$0.000146
Normalisasi teks Indonesiaquestion version 3Keterangan69.4%$0.000209
Tingkat tutur bahasa Jawaopen answer83.3%$0.000232
Normalisasi teks Indonesiaquestion version 1Keterangan51.0%$0.000235
Koreksi ejaan Indonesia65.8%$0.000248
Arti kata Jawa langka25.6%$0.000590
Correct answers against cost per correct answer

Tokens used

Input and output are kept apart because they are priced differently, often tenfold. A long output bar means the model talks a lot, and that is where nearly all the cost difference comes from.

78,441 in, 224,946 out
inputoutput
Pemahaman slang Indonesia12,628 · 11,864
Tingkat tutur bahasa Jawaopen answer1,213 · 4,831
Tingkat tutur bahasa Jawamultiple choice5,656 · 11,291
Arti kata Jawa sehari-hari8,458 · 62,966
Normalisasi teks Indonesiaquestion version 3Keterangan12,339 · 33,395
Koreksi ejaan Indonesia12,726 · 30,195
Normalisasi teks Indonesiaquestion version 2Keterangan12,960 · 22,326
Normalisasi teks Indonesiaquestion version 1Keterangan10,614 · 29,703
Arti kata Jawa langka1,847 · 18,375
Tokens for one full run, per benchmark

Wait time per call

Median wait for a single call on each benchmark. Median rather than mean, so one stalled call does not move the number.

9 with wait time on record
Normalisasi teks Indonesiaquestion version 2Keterangan6.89 s
Pemahaman slang Indonesia6.97 s
Normalisasi teks Indonesiaquestion version 1Keterangan8.07 s
Tingkat tutur bahasa Jawamultiple choice8.16 s
Normalisasi teks Indonesiaquestion version 3Keterangan8.17 s
Arti kata Jawa langka9.49 s
Arti kata Jawa sehari-hari10.61 s
Koreksi ejaan Indonesia11.37 s
Tingkat tutur bahasa Jawaopen answer13.48 s
Median wait for one call, per benchmark

Test coverage

This model has been tested on all 6 benchmarks we publish.

6 of 6 benchmarks we publish
Log9 calls to this model, spread across 2 days.

This model is called through a provider id that may not pin a version, so the dates below state which weights were actually tested. Rows marked with a hyphen have a date we inferred from file history rather than recorded at call time, so we do not show a clock time for them.

7 runs
  1. 23:30Arti kata Jawa langkaword meaning11/43
  2. 22:44Arti kata Jawa sehari-hariword meaning97/135
  3. 20:48Normalisasi teks Indonesiaopen answerDetailed prompt forbidding word swaps30/49
  4. 20:29Normalisasi teks Indonesiaopen answerBuilt-in prompt25/49
  5. 18:50Normalisasi teks Indonesiaopen answerPrompt stating the key's rule34/49
  6. 17:48Koreksi ejaan Indonesiaopen answer25/38
  7. 00:48Tingkat tutur bahasa Jawaopen answer5/6
2 runs
  1. 23:56Tingkat tutur bahasa Jawamultiple choice22/27
  2. 23:32Pemahaman slang Indonesiamultiple choice38/42
See the whole panel's run log →

← See all models