Skip to content
Google Research·· 2026-08-12AI score59

Empty shelves or lost keys? Recall is the bottleneck for parametric factuality

Empty shelves or lost keys? Recall is the bottleneck for parametric factuality

AI introduction

Google Research released the WikiProfile benchmark (2,150 Wikipedia facts, each with 10 tasks) and a knowledge profiling framework. After evaluating 13 LLMs, it found that frontier models have 95–98% of facts encoded but still fail to directly recall 26–34%, and 11–12% still fail even with thinking enabled.

A summary is available. Open the original source for the full article. Read source

Source: Google Research · research.google