Digiday Daily
March 19, 2026
img
Logo

Cloudflare is pushing to create a market for licensed AI content, offering a compliant crawler aimed at giving publishers more control and reducing inefficient site crawls — even as some question the irony of the company that once blocked scrapers now building one itself.

Last week, the company released a crawl API (its crawl endpoint within Cloudflare’s browser rendering API) that can scrape an entire website with one request.

Advertisement

TOP STORY

AI Revenue Generation
img
Cloudflare’s compliant crawler highlights tension – and opportunity – in the emerging AI content market 

Cloudflare faces tension in its new role: sitting in the middle between publishers and AI companies while balancing trust, control and monetization. 

OTHER THINGS TO KNOW

MARKETING

The Creator Economy
Brands turn niche news creators into a new earned media engine

Brands are shifting earned media strategies to tap niche news creators on social platforms.

Brands in Culture
The real winners of March Madness? Brands that move fast on NIL deals

Companies across sectors, from footwear to personal care, are racing to sign college basketball players.

PARTNER INSIGHTS FROM SEEDTAG

How neuro-contextual intelligence shifts media planning strategies

MEDIA & PLATFORMS

AI Revenue Generation
Media Briefing: What to expect at the Digiday Publishing Summit, March 2026 edition 

Execs from The Atlantic, Arena Group, Bloomberg, Business Insider, The Guardian, New York Post, People Inc., Washington Post, and more, will share their strategies on everything from zero-click audience strategy, to AI licensing deals and RAG readiness, to how they’re embracing creator strategies to help boost engagement with younger audiences.

PARTNER INSIGHTS FROM VIASAT ADS

In-flight sets up retargeting for continuous campaigns with high engagement

Advertisement

PARTNER INSIGHTS FROM THE WEATHER COMPANY

Video: How weather universally drives consumer behavior