Measured Collection

Articles

We test how well AI actually understands Indonesian and its regional languages, map the words that trip up native speakers, and publish the numbers along with the raw data and their limits, including when the results are not what we hoped for.

2 articlesEvery article links to its raw data

FilteredGlmClear filter

2 articles

SortNewest Oldest

EmpiricalSeptember 6, 2026

Evaluating ox-alpha before Z.ai revealed it as GLM-5.3-Flash

We tested the stealth model ox-alpha while it was free, then tested the official model Z.ai declared as its identity, GLM-5.3-Flash, on the same question sets. Scores rose from 49 to 54 of 60 on Indonesian slang and from 27 to 32 of 38 on Javanese speech levels. The rest stayed similar: answer match of 88% and 79%.

Benchmark Model stealth Glm Bahasa indonesia Javanese

54/60id-B score49/60Trial score88%Answer match

EmpiricalAugust 24, 2026

GLM-5.3 outperforms ox-alpha, the mystery model going viral, across three benchmark measurements

We tested ox-alpha and GLM-5.3 on Javanese speech levels and Indonesian slang in a trial lane separate from the official leaderboard. GLM-5.3 led on all four measurements, and a 71% answer match shows the two are not the same model.

Benchmark Javanese Model stealth Glm

57/60GLM-5.349/60ox-alpha34/60hy-mt2 (1.8B)

About

We measure what AI can and cannot do with Indonesian, then publish the numbers together with the raw data and the limits of what they show.

2 articles published

Trust labels

Who writes this

M. Khoirul Huda

Fullstack engineer. I build the dictionary and the tooling on this site myself, so when something is wrong, that is on me too. Every article links to its raw data so you can check it yourself.

mkhuda.com