Study: Web Research Agents Read User Priorities Differently
Two researchers, Robin Sharma and Parisa Suchdev, reported that web research agents can follow a user's stated priority and still judge it in different ways. Their paper, posted to the arXiv preprint server on Nov. 17, tested two agents, one built on OpenAI models and one on Anthropic models.
In 36 runs, the agents compared Microsoft and Alphabet as businesses. Some prompts asked for special attention to growth or to resilience. Others gave no priority. According to the paper's abstract, 21 of the 24 reports that got a priority focused on it. But the criteria they used varied.
The growth prompt showed the gap most clearly. The OpenAI-based agent's reports that ranked the companies took risk or predictability into account and favored Microsoft. The Anthropic-based agent's reports judged growth by its pace and favored Alphabet. Under the resilience prompt, the criteria again differed in part, and most reports named Microsoft the more resilient company.
The authors also looked at searches, returned sources and cited sources. Of the measures they tested, only the wording of the Anthropic agent's searches differed in a detectable way between conditions. The paper does not claim that either agent was wrong.
For people who use these tools, the point is simple. Asking an agent to focus on "growth" does not tell it what growth means. The agent fills that in on its own, and the answer can change with the system behind it. A report can be well cited and on topic while resting on a standard you never chose. You can compare the systems in our list of AI models.
The authors suggest that evaluations should check the criteria behind a report's judgments, not just its focus or accuracy. They also say interfaces could let users see and adjust those criteria. The abstract does not say whether the findings hold beyond this one comparison of two companies and two agents. It also does not say whether any product has adopted such controls.
Sources
Cite this
Study: Web Research Agents Read User Priorities Differently, New Mind Museum, November 17, 2026. https://newmindmuseum.com/research/2026/11/web-research-agents-user-priorities-study/
New Mind Museum. (2026, November 17). Study: Web Research Agents Read User Priorities Differently. https://newmindmuseum.com/research/2026/11/web-research-agents-user-priorities-study/
“Study: Web Research Agents Read User Priorities Differently.” New Mind Museum, 17 Nov. 2026, https://newmindmuseum.com/research/2026/11/web-research-agents-user-priorities-study/.
@misc{new-mind-museum-2026-study-web-research-agents-read-user-prio,
author = {{New Mind Museum}},
title = {Study: Web Research Agents Read User Priorities Differently},
year = {2026},
url = {https://newmindmuseum.com/research/2026/11/web-research-agents-user-priorities-study/}
}Free to quote and cite with a link to this page.