Clearing chat history helps AI agents find better solutions
Microsoft Research found that Autoresearch agents get trapped in "idea basins" due to accumulated conversational context, stalling on similar solutions even when more compute is added.
#Microsoft
Today 0 items
The DecoderAI score5656 Microsoft ResearchAI score4040 Simulating student learning for better AI tutoring
Microsoft Research released StudentSim, a research system for evaluating and improving AI tutoring tools before testing with real learners, training a personalized simulator for each student based on publicly available de-identified learner records. It also introduces the StudentSimEval benchmark, which evaluates along two dimensions, behavioral fidelity and instructional responsiveness, across three domains: chess, second-language English writing, and math, outperforming leading baselines. The system is for research-stage use only, is not a product, has not been deployed in classrooms, and is not intended to replace teachers.
GitHub Blog · AI & MLAI score5757 ReviewBench: An open benchmark for AI code review
GitHub has released ReviewBench, an open offline benchmark for evaluating AI code review agents. The benchmark is modeled on the distribution of 103.9 million GitHub pull requests.
Hugging Face BlogSelectedAI score6969 The Agent Said It Was Done. The Database Disagreed.
Microsoft and Hugging Face released the ThinkingBox agent sandbox and ThinkingBox-Bench benchmark, with 507 stateful business workflows and 20 runs per task, using executable checks to evaluate end-state database state and side effects, now open on Hugging Face via OpenEnv.
Why it matters: The article uses executable backend-state checks to distinguish surface success from real outcomes, and provides consistency and cost data for each model, a directly useful reference for evaluating agents.
Microsoft ResearchAI score4949 Offloaded inference for real-world physical AI robotics
A Microsoft Research study shows that running physical AI inference solely on robots' onboard GPUs limits performance, battery life and scalability, and offloading inference to edge or cloud GPUs can significantly improve it.
Microsoft ResearchAI score4444 MindTopo reveals VLMs’ spatial reasoning abilities
Microsoft Research introduced the MindTopo benchmark, evaluating multimodal large models' ability to reason about and plan with topological concepts such as connectivity, closure, ordering, separation, and knots. Testing shows models perform markedly better on static image recognition than on interactive planning tasks, and both fall far short of human level, with errors mostly involving lost structural relations during planning or physically infeasible actions. The benchmark aims to provide a controlled diagnostic tool for research on agents in robotics and interactive environments.