Google Research·· 2026-08-12AI score59
Empty shelves or lost keys? Recall is the bottleneck for parametric factuality
Empty shelves or lost keys? Recall is the bottleneck for parametric factuality
AI introduction
Google Research released the WikiProfile benchmark (2,150 Wikipedia facts, each with 10 tasks) and a knowledge profiling framework. After evaluating 13 LLMs, it found that frontier models have 95–98% of facts encoded but still fail to directly recall 26–34%, and 11–12% still fail even with thinking enabled.
Source: Google Research · research.google