The Hallway Track
Engineering Insights

Skills are the New SDKs - Elvin Aghammadzada, DataRobot

AI Engineer · Jul 20, 2026 · Engineering Insights

LLM performance degrades after 25% context window usage, making 'infinite context' a dangerous myth

“if we consider that there's infinite context window, we just think that we can dump the whole list of documents to the context and expect it to magically work”

DataRobot's Elvin Aghammadzada argues that the 'infinite context window' promise from frontier model vendors is a harmful misconception that leads engineers to naively stuff tools and documents into context. A paper on 'context rot' shows performance degrades past 25% context usage, meaning 100-tool MCP setups and long agentic sessions degrade to poor-model behavior. The talk positions 'skills' as a more composable, context-efficient architecture alternative to bloated SDKs and tool lists.

context-rot MCP RAG agent-architecture context-window skills

Watch / read the original source →