How To Define CPU And Software Stack Performance For Agentic AI
Arm proposes a use-case-driven framework for measuring the CPU's performance contribution in Agentic AI. The framework splits CPU-visible work into generic agent framework functions and use-case-specific tool workloads, uses five representative workload archetypes, and combines component-level with end-to-end benchmarking methods. It also proposes a replayable agent trajectory scheme to isolate CPU work from model and network effects, reducing variance from non-determinism.