Benchmark Nusantara
We test AI models on Indonesian and its regional languages ourselves, using questions and answer keys we wrote and had checked by two native speakers. The numbers are published as they are, limits included.Read more
The only regional language measured so far is Javanese. Others such as Sundanese, Madurese, Balinese, Batak, Buginese and Minangkabau are still being collected: the sets do not exist yet, so there are no figures. We publish numbers only for what has actually been tested.
Indonesian spelling correction
Accepting or rejecting spell-checker suggestions on real text.
Indonesian text normalisation
Turning text-message style writing into standard Indonesian.
Indonesian slang comprehension
Explaining what Indonesian slang words mean inside a sentence.
Rare Javanese word meanings
Explaining 43 Javanese words absent from every open source.
Everyday Javanese word meanings
Explaining everyday Javanese word meanings verified by native speakers, part of it held back.
Javanese speech levels
Choosing the Javanese register that fits the person being addressed.
Every figure here comes from the same questions for every model, and the key does not change mid-test.