Meta Engineering·1w ago·11 read·seniorIntelligent Delivery: Making Every Unit of Compute Serve Better Ads
Meta engineers developed Intelligent Delivery, a system that optimizes compute resource allocation for ads ranking by predicting the marginal utility of inference tasks. The system dynamically shifts resources across models, hardware fleets, and ranking stages to maintain global efficiency despite increasing model complexity and strict latency constraints. This approach has yielded a 10% performance gain in ranking effectiveness since 2017.
AI summary