A robot did
your browsing

Something quiet changed this year. People stopped visiting websites and started sending an agent instead. Perplexity's Comet, OpenAI's Atlas, Claude in the browser, ChatGPT's own agent. You ask, it goes, it reads twenty pages, it comes back with the answer. You never see the sites. The browsing happened. You just were not the one doing it.

For thirty years the deal was simple. You put content on the open web, a search engine read it, and in return it sent you a human. That human was the payment. The whole economy of the web, the ads, the leads, the sales, sat on top of that one exchange. Reads in, visitors out. The agent broke the deal. It still reads everything. It just keeps the visitor.

01The trade collapsed

Cloudflare sits in front of a large slice of the web, so it can count both sides of the exchange. It measured how many pages each AI company reads for every visitor it sends back. The numbers are not close.

Anthropic's crawler read roughly thirty eight thousand pages for every single visitor it referred. Perplexity's read about a hundred and ninety five. OpenAI's about a thousand. Compare that to the old bargain, where a traditional search crawler read a handful of your pages for every person it sent to your door. The web used to trade reads for visits at close to parity. Now it trades tens of thousands of reads for one. Your content is being consumed at industrial scale and the footfall it used to buy has all but stopped arriving.

02Even the summary is disappearing

You may have made peace with the search box answering for you. Pew Research followed nine hundred real people through a month of searching and found that when Google showed an AI summary, they clicked a result 8% of the time, against 15% without. The summary roughly halves the visit. Click a link inside the summary itself, and it is 1%. One in a hundred.

The agent is the next step, and it is worse for you. There is no summary sitting on a results page for anyone to scroll past and maybe click. The agent reads the page in the background, lifts what it needs, and hands your customer a finished answer in its own words, in its own window. Your site did all the work. Your name may not even be in the room.

03So do you give up on the website? No. You change its job

Here is the mistake almost everyone is about to make. They see the traffic charts falling and decide the website is finished, that the future is all feeds and agents and there is no point owning the thing anymore. Wrong, and expensively wrong.

Your website is now the one piece of media you own outright while every other channel gets disintermediated. The agent still has to read something, and that something is you. If your site is a vague, bloated mess, the machine quotes you badly, or quotes a sharper competitor instead. If it is clear, structured and correct, you shape the answer millions of people receive without ever clicking. Ranking used to earn you a visit. Now it earns you the right to be the source the machine trusts. That is not a smaller job. It is a more important one.

04What we'd build instead

Two things, at the same time. First, a site built to be read by a machine as well as a person. Clean structure, honest facts, the claims you actually want repeated stated plainly so an agent lifts them cleanly. Treat your own website as your press release to every AI on earth, because that is now what it is.

Second, a destination worth the trip. An agent can summarise a paragraph. It cannot do the transaction, the booking, the login, the tool, the community, the actual product experience. Put the thing that has to happen on your turf behind a front that a summary can never replace, and build a brand people, and their agents, ask for by name. Branded demand is the traffic that survived the cull. It comes from being known, not from being found.

The open web did not die. It got a new majority reader, and that reader is not human. Build for the machine that reads you, and own the one thing it can hand back but never replace.