Intelligence is Free, Now What? Data Systems for, of, and by Agents

Aditya G. Parameswaran and colleagues at UC Berkeley note that with inference prices falling 9x to 900x per year (median roughly 50x), GPT-4-level capability now costs under $1 per million tokens, down from about $30 in early 2023.