Tag
6 articles tagged LLM Optimization.
ThoughtWorks Technology Radar Volume 35 identifies four critical themes for AI-driven development: multi-agent orchestration, model cost optimization, AI factory infrastructure, and harness engineering. This analysis provides actionable strategies for managing inference costs, ensuring agent accountability, and scaling AI workflows effectively within enterprise environments.
An executive analysis of Recursive Language Models (RLMs) and the strategic shift from brute-force compute to opinionated harness design. This brief explores how compositional generalization and code-based context management are redefining AI agent capabilities, offering actionable frameworks for optimizing multi-agent systems and reducing inference costs.
Databricks executives outline a strategic shift toward unified agent harnesses, contextual security policies, and LTAP storage architecture. The analysis covers open-source ecosystem growth, enterprise AI governance, and the transition from frontier models to specialized, cost-efficient AI systems.
Exa CEO Will Brick discusses how AI agents require comprehensive, high-precision search distinct from human-centric engines, predicting agentic search will surpass Google's scale by the 2030s while solving token efficiency crises.
Superhuman CTO Loic Goussier discusses the architectural and organizational challenges of integrating LLMs into a product defined by sub-100ms latency. Key strategies include a 'smart-to-cheap' model optimization pipeline, dimension-based evaluation frameworks, and maintaining human-in-the-loop controls to mitigate agent risk.
Analysis of emerging AI infrastructure trends, focusing on memory compression techniques, standardized agent protocols, and critical supply chain vulnerabilities. Explores implications for enterprise adoption, cost stabilization, and developer security workflows.
