The Convergence Test
A repeatable measurement of how alike AI products are becoming. Pilot run of eight products; results so far are specimens.
my bet: H is the interesting one
the numbers below are placeholders, not results
trying to answer →Why do AI products converge?What is a moat in an AI world?
one shapesame shapeagainand againsee?Biologists call it convergent evolution: unrelated lineages arriving at the same form because the environment rewards it. Haeckel’s anemones are a hundred species solving the same problem the same way. The claim that AI products are converging is easy to make and hard to check. This benchmark is an attempt to check it.
Protocol
Eight AI products in the same category, anonymised as A to H, are measured on four surfaces:
- Onboarding. The first five screens a new user sees, embedded and compared.
- Feature set. A 60-item checklist, scored present or absent.
- Answers. The same 40 prompts, with pairwise similarity of the responses.
- Positioning. The homepage copy, embedded and compared.
Each pair gets a similarity score from 0 to 1, averaged across the four surfaces. The run repeats every quarter, so the interesting output is not one matrix but the change between them.
Results (specimen)
The shape the pilot is looking for is already visible in the placeholder data: a tight cluster of five near-identical products, two cousins, and one outlier. If the real run looks like this, the more interesting product to study is H.
Limitations
Similarity of surfaces is not similarity of businesses. Two products can look identical and have completely different distribution, data or customers. Those are exactly the things the other pieces on this site argue matter most. This benchmark measures the part that is converging, which is also the part that matters least.