Meta

Meta’s AI Storage Blueprint at Scale

Ensuring reliable and fast storage access to support exponential growth in model capabilities and training dataset sizes while maintaining computational efficiency during rapid AI innovation cycles.

storage-systems distributed-systems
5 min
Meta

SilverTorch: Index as Model — A New Retrieval Paradigm for Recommendation Systems

Meta needed to improve the throughput and compute efficiency of retrieval systems for recommendation engines that process user-generated content at massive scale.

search ml-systems
5 min
Meta

Labyrinth 1.1: Making End-to-End Encrypted Backups Even More Reliable

Ensuring end-to-end encrypted messages and conversation history survive device loss, device switches, and extended offline periods without compromising encryption guarantees.

storage-systems security
5 min
Meta

Migrating Data Ingestion Systems at Meta Scale

Meta needed to migrate their legacy data ingestion system to a new architecture while maintaining reliability and consistency for real-time social graph snapshots at massive scale.

distributed-systems storage-systems
5 min
Meta

How Meta Is Strengthening End-to-End Encrypted Backups

How to enable end-to-end encrypted backups for messaging applications while ensuring recovery codes remain inaccessible to Meta, cloud providers, and other third parties.

security storage-systems
5 min
Meta

FFmpeg at Meta: Media Processing at Scale

Meta needed to handle massive-scale media processing (encoding, transcoding, filtering) across its family of apps, requiring efficient orchestration of complex audio/video pipelines using FFmpeg at an unprecedented scale.

storage-systems distributed-systems
5 min
Meta

Investing in Infrastructure: Meta’s Renewed Commitment to jemalloc

Meta's large-scale infrastructure relies on jemalloc for memory allocation, but the codebase had accumulated maintenance burden and needed modernization to keep pace with evolving hardware and workload demands.

storage-systems distributed-systems
5 min