Measured Collection

Articles

We test how well AI actually understands Indonesian and its regional languages, map the words that trip up native speakers, and publish the numbers along with the raw data and their limits, including when the results are not what we hoped for.

2 articlesEvery article links to its raw data

FilteredSlangClear filter

2 articles

SortNewest Oldest

EmpiricalAugust 26, 2026

This tiny AI model tried to Google our exam answers

The two smallest models we have ever tested, LFM2.5 at 2.6 billion parameters and hy-mt2 at 1.8 billion, faced off on 60 Indonesian slang questions. The scores ended in a dead heat, but the two failed in opposite ways, and one of them tried calling Google mid-exam.

Benchmark Model kecil Slang Liquid ai Tencent

34/60hy-mt2 (1.8B)32/60LFM2.5 (2.6B)358xToken ratio

EmpiricalAugust 10, 2026

How AI models miss free answers across 38 slang items

Our slang test offered free answers to anyone reading options. Yet, AI models grabbed at most 1.00 out of 4.1 items.

AI benchmark Slang Methodology

38 questionsSlang set tested4.1 questionsFree answers available1.00 questionActually taken by model