Cloudflare

Cloudflare operates internet infrastructure and publishes primary data and product decisions about AI crawlers, content access, bot controls and pay-per-crawl experiments.

Original profile or publication ↗

Description comes from Cloudflare's public product and research posts; image comes from its official GitHub organization. Checked September 19, 2026.

Referenced in 101

1. Agent-led growth 101

   Content Independence Day ↗

   AI crawling creates a distribution and bargaining problem for publishers because content consumption can increase while referral traffic disappears.

2. Agent-led growth 101

   Introducing Pay Per Crawl ↗

   Pay Per Crawl experiments with a machine-readable price on AI access, turning an invisible fetch into an explicit economic transaction.

3. Agent-led growth 101

   The crawl before the fall of referrals ↗

   Crawler request volume varies sharply by bot and does not reveal whether an assistant cited, recommended or transacted with a product.

4. Agent-led growth 101

   The crawl-to-click gap ↗

   More AI crawling can coincide with fewer referrals, so publishers need separate measures for access, inclusion, citation, action and value.

About this page

This is a Mudpie reference profile, not an account, endorsement or claim that Cloudflare contributed to Mudpie. The profile identifies an author, editor, maintainer, speaker or source publication connected to the linked work; it is not necessarily the article byline. Summaries are Mudpie's; the linked work remains the source of truth.