94.2% of Wikipedia corrections fail to become test fixtures
A 5.8% pass rate. That number is the real price of verification, and the reason "just let AI handle it" is not an answer.
744Corrections mined43Passed verification5.8%Pass rate
Measured Collection
Articles
We test how well AI actually understands Indonesian and its regional languages, map the words that trip up native speakers, and publish the numbers along with the raw data and their limits, including when the results are not what we hoped for.
19 articlesEvery article links to its raw data
Our correction engine failed on real text, then dropped 27% in two days
We pointed our own spelling checker at writing people actually produced, not at test sentences. It flagged 3,740 things, and most were not errors. This is the record of eight rounds of fixing it.
3,740Flags, round 12,554Flags, round 732%Drop
When the grammar book is wrong and the native speaker is right
Six of our 40 Javanese test items were dropped. Not because models answered them wrongly, but because the textbook rule contradicted what speakers actually accept.
6Javanese items dropped40Total Javanese items1Dialect variants tested