Distributed Readings

Simplifying the deployment and scheduling of machine learning inference workloads across multiple instances and instance types on Amazon SageMaker HyperPod.

AI coding assistants were ineffective at making useful edits in large-scale data pipelines because they lacked sufficient understanding of complex, multi-repository codebases spanning multiple languages and thousands of files.

Detecting safety hazards in real-time across hundreds of distributed operational sites using video feeds while maintaining low latency and managing the computational complexity of processing multiple camera streams.

Aigen needed to scale machine learning pipelines across hundreds of distributed edge solar robots while managing data labeling and model training challenges in agricultural robotics.

Detecting sophisticated client-side security threats like zero-day exploits while minimizing false positives in real-time across millions of requests.

Training and evaluating AI models is resource-intensive, requiring significant human effort to generate quality training data and assess model outputs.

Advancing AI research requires collaboration between industry and academia, but funding and partnership models need structured programs.

Data science teams need diverse skill sets that blend mathematical rigor with creative problem-solving to build effective ML systems.

LinkedIn's Feed needed to evolve to handle increasing content diversity, real-time ranking signals, and personalization at massive scale.

LinkedIn's LLM-based ranking systems faced latency and throughput challenges when serving personalized results at scale.

Building personalized generative AI features at LinkedIn's scale required a robust and reliable application infrastructure that could serve millions of users.

Designing high-quality, sustainable concrete mixes that are produced in the United States while optimizing for performance characteristics.

Meta needed to automatically optimize low-level infrastructure and kernel-level parameters for AI ranking models to improve performance without manual tuning.

Meta needed to scale their ads ranking models to LLM-scale complexity and size while maintaining inference latency requirements for real-time ad serving.