Empty shelves or lost keys? Recall is the bottleneck for parametric factuality
Google Research released the WikiProfile benchmark (2,150 Wikipedia facts, each with 10 tasks) and a knowledge profiling framework. After evaluating 13 LLMs, it found that frontier models have 95–98% of facts encoded but still fail to directly recall 26–34%, and 11–12% still fail even with thinking enabled.