Distributed Readings

How to enable AI agents to access and interact with web content while allowing publishers to monetize agent traffic and prevent resource abuse, without blocking legitimate agent-driven customer access.

Detecting unauthorized or malicious behavior from users and AI agents accessing enterprise applications in real-time to prevent insider threats and data exfiltration.

As AI agents and bots now generate over half of web traffic, websites lack visibility into how well these machines can discover, crawl, and understand their content compared to traditional search engine optimization.

Cloudflare needed to enforce consistent engineering standards and practices across their development lifecycle without relying solely on manual code reviews.

Making complex global Internet traffic and trend data accessible to non-technical users without requiring deep knowledge of data querying or analytics systems.

Developers lacked a unified way to observe, bill, and route AI requests across both Cloudflare's managed GPU infrastructure and external AI provider APIs.

Real-time AI agents with long-lived stateful bidirectional streams cannot be effectively load-balanced using traditional request-response metrics because server capacity is obscured by the nature of continuous conversations.

Meta needed to double the training efficiency of GEM, its LLM-scale ads foundation model, while scaling training compute 4x across thousands of GPUs without proportional increases in training time and cost.

How to build trustworthy Generative AI products when traditional software testing assumptions break down due to non-deterministic LLM outputs.

Migrating a massive open-source CDN serving 9 billion requests per day from legacy infrastructure to Cloudflare's own Developer Platform while maintaining reliability and performance.

Cloudflare needed to track, measure, and analyze Internet disruptions caused by natural disasters, government-mandated shutdowns, and DNS infrastructure events to understand their global impact on connectivity.

Developers lack a consistent, standardized way to measure and evaluate the quality of AI agents across both local development and production environments.

Engineers need a systematic way to diagnose performance bottlenecks in TPU-based machine learning workloads to understand whether they are constrained by compute, memory, or network resources.

AI projects struggle to move from prototype to production-ready agents due to fragmented tooling and complex infrastructure requirements across multiple consoles and IAM systems.

Netflix needed to simplify their complex, hand-crafted recommendation system with thousands of features and specialized architectures to make it more maintainable while leveraging large language models.

Netflix needed to accurately model and track heterogeneous device capabilities across millions of devices to determine which features and content types each device could support.