We test how well AI actually understands Indonesian and its regional languages, map the words that trip up native speakers, and publish the numbers along with the raw data and their limits, including when the results are not what we hoped for.
Six of our 40 Javanese test items were dropped. Not because models answered them wrongly, but because the textbook rule contradicted what speakers actually accept.
We matched 72,454 lemmas against two million Indonesian sentences. Half never appear, and our own counter-list turned out to be flawed.
A map of our five internal tools and how each one verifies Indonesian, including how we test AI, with a link to the raw data.