A single lit doorway in a long wall, representing legitimate access to a closing web
All Posts

The Web Needs a Front Door

Ryan Turner
Ryan Turner · Head of Innovation
Open markdown

The companies that got rich on an open web are the ones now deciding who else gets in.

That is the argument at the center of a new essay by Jason Grad, Massive's CEO. It is the best short account we have read of how web access quietly concentrated, and it is worth your ten minutes rather than our summary of it.

Read it here: The Web Needs a Front Door

The argument, briefly

CERN released the web's core technology royalty-free, and anyone with a connection could publish, link, and build without permission. Nobody voted to end that. It ended one reasonable decision at a time, as hosting consolidated and security vendors positioned themselves between sites and their readers.

Jason's sharpest section is about what came next: incumbents who built on open access and then closed it behind them. He works through Google's proprietary index, Cloudflare selling both the protection and the crawler, and Amazon's stance on comparison agents, and lands on the line that gives the essay its edge. These companies "enjoy every benefit of a machine-readable web while working to make sure nobody else does."

We would add one thing, since he is more pointed than we would be. Gating traffic is a legitimate business and none of these companies are villains. The problem is that the rules are being written by the parties with the most to gain from writing them narrowly.

The part worth reading in full

Two sections we are deliberately not summarizing.

The first is his explanation of why an industry this size still has no standards, which turns on a major provider, 46 million users, and the difference between consent and a legal defense. The second is his read on New York's Stealth Crawler Prohibition Act, now passed by both chambers, as a preview of what happens when legislatures fill a vacuum the industry left open.

He closes with what a legitimate front door would actually require. Consent, blocklists, KYC, and the harder question of who enforces any of it.

Why we are posting this

Because we have skin in it, and pretending otherwise would be worse.

Massive started as a consent network. We have never resold another provider's IP pool, we run blocklists, and we KYC clients, which is the ethical sourcing argument we have made here before. Jason is explicit that he is not nominating us as the standard. His point is narrower: someone has to start the conversation in public, and the companies with a record of breaking the rules cannot be the ones to write them.

Read the full essay →