Indus Script: A Falsification-Oriented Analysis

A machine built to doubt its own best result. A promising pattern in the ancient Indus inscriptions looked like real structure, until the test was redone so a repeated inscription couldn't pass just by recognizing a copy of itself. Then the pattern flipped and disappeared.

The same test, scored three ways

How much it helped to know the two symbols before a gap, instead of just the one right before it, when guessing what comes next. Above zero means it helped. Below zero means it didn't.

The first, ordinary way of running the test

Corpus 1
Corpus 2

After making sure a repeated inscription can't appear on both sides of the test

Corpus 1
Corpus 2

After counting each repeated inscription only once

Corpus 1
Corpus 2
Numbers are from the paper. Corpus 1 and Corpus 2 are two separate digital copies of the same ancient inscriptions, typed up independently by different people. Corpus 1 is the classic reference collection used in the most cited earlier studies of the script.

This project does not decipher the script, and it makes no claim to have read a single sign. Its question is narrower: which statistical claims about the script survive being attacked?

Why the result flips

Between 23 and 33 percent of the inscriptions in both collections are exact copies of another one in the same collection, which makes sense since many seals were stamped over and over into wet clay. That repetition is a real feature of the ancient material, not a mistake in the data. But if a copy of the same short phrase ends up both in the part the computer learns from and the part it's quizzed on, the test can look successful just because the computer already saw the answer, not because it learned anything general.

A separate check split the inscriptions into same-sized groups without keeping copies together, and that check still came out strongly positive. So the flip isn't simply because there was less material to learn from once repeats were handled properly. It's specifically about the repeated phrases. The paper treats working out exactly why as its main open question.

What else the tests found

A positive result doesn't prove it's language
The same pattern also showed up in a fake, deliberately non-language system built just to test the test, a kind of bureaucratic filing code. So on its own, this kind of result can't tell language apart from a clever non-language system.
The test gets shaky with this little text
Run on two real, undisputed ancient languages, Sumerian and Sanskrit, the same test mostly failed to find the pattern once the amount of text was cut down to match how little Indus material survives. That makes the Indus result a bit more notable, but it also means the test itself isn't very trustworthy at this small a scale.
Probably not a serial-number system
One popular alternative idea is that the inscriptions are something like one-of-a-kind ID codes. Real Indus inscriptions repeat far too often for that to be likely, though a more complicated numbering scheme can't be ruled out.
A bug the tests themselves caught
One of the two digital copies had its symbols recorded back to front. The check that caught this relied on a known pattern: the last symbol in a line is usually easier to guess than the first one.

How would we know if someone did crack it?

A companion article turns the same attitude on decipherment claims. It proposes three questions, asked in order, and a claim has to clear each before the next is worth asking.

  1. Is there any sign of language at all?Do the symbols follow each other the way a real language's letters or words would, rather than the way a simpler system, like a set of family crests or trade marks, would? This is a first hurdle, not proof of anything on its own.
  2. Does that pattern survive being tested properly?Not just glanced at, but checked so repeated phrases can't fake a result, checked against real languages shrunk to the same small size, and checked so it doesn't depend on how symbols happen to be grouped. This is exactly the kind of testing behind the flip above.
  3. Does a specific proposed reading survive independent evidence?A real decipherment makes a specific, risky prediction that could fail, and then gets checked against evidence the person proposing it never saw. That's what happened when Michael Ventris's Linear B readings were confirmed by a tablet dug up in Pylos in 1953, years after he proposed them.

The article's reading of the record is that none of the published Indus proposals has yet passed the third test, and that this is not the same as the script being unreadable. It ends with a sentence worth keeping: not yet, but here is exactly what would change my mind.

The gap: what an actual decipherment would need

Statistics can tell us what kind of structure is in the sign sequences. It cannot, by itself, tell us what the signs say. Three facts about the evidence explain why the gap is so wide.

Two next steps follow directly from the work so far. They are proposals, not results.

Read and reuse