4004 news

Tag

Elastic Inference

1 article tagged Elastic Inference.

  1. · Latent Space: The AI Engineer Podcast · 4 min read

    Modal's AI Infrastructure Strategy: Agents, Inference, and Elastic Compute

    Modal CTO Akshat discusses the platform's evolution from serverless runtime to AI infrastructure leader. Key insights include the strategic pivot to Agent Experience, open-source speculative decoding via DFLASH, and multi-cloud capacity management for bursty workloads.