爆料王

false

  • News & opinion false false
  • News false false
  • February false false
  • OpenAI deep research agent a fallible tool true true

/content/dam/corporate/images/news-and-opinion/news/2025/february/ai-robot-studying.jpeg

50%

OpenAI鈥檚 new 鈥榙eep research鈥� agent is still just a fallible tool 鈥� not a human-level expert

For knowledge workers, it鈥檚 more important than ever to invest in skills that AI can鈥檛 replicate.

12 February 2025

m-hero--style-left-aligned cmp-teaser--featured m-content-w-image--sandstone

1440.962.2x.jpeg 2880w, 800.534.2x.jpeg 1600w, 2000.1335.2x.jpeg 4000w, 1280.1280.jpeg 1280w, 220.147.2x.jpeg 440w, 440.294.2x.jpeg 880w

false

OpenAI鈥檚 鈥溾�� is the latest artificial intelligence (AI) tool听听and promising to do in minutes what would take hours for a human expert to complete.

Bundled as a feature in ChatGPT Pro and听听as a research assistant that can match a trained analyst, it autonomously searches the web, compiles sources and delivers structured reports. It even听听26.6% on Humanity鈥檚 Last Exam (HLE), a tough AI benchmark,听听many models.

But deep research doesn鈥檛 quite live up to the hype. While it produces polished reports, it also has serious flaws.听听, deep research can miss key details, struggle with recent information and sometimes invents facts.

OpenAI flags this when listing the limitations of its tool.听听鈥渃an sometimes hallucinate facts in responses or make incorrect inferences, though at a notably lower rate than existing ChatGPT models, according to internal evaluations鈥�.

It鈥檚 no surprise that unreliable data can slip in, since AI models don鈥檛 鈥渒now鈥� things in the same way humans do.

The idea of an AI 鈥渞esearch analyst鈥� also raises a slew of questions. Can a machine 鈥� no matter how powerful 鈥� truly replace a trained expert? What would be the implications for knowledge work? And is AI really helping us think better, or just making it easier to stop thinking altogether?

What is 鈥榙eep research鈥� and who is it for?

Marketed towards professionals in finance, science, policy, law and engineering, as well as academics, journalists and business strategists, deep research is the latest 鈥溾�� OpenAI has rolled out in ChatGPT. It promises to do the heavy lifting of research in minutes.

Currently, deep research is only available to ChatGPT Pro users in the United States, at a cost of US$200 per month. OpenAI听听it will roll out to Plus, Team and Enterprise users in the coming months, with a more cost-effective version planned for the future.

welp, I paid for chatgpt pro deep research (it does work via vpn). often impressive, but it doesn't show its work so it's hard to trust, at least when starting out, whether it's actual built the computational model that it claims it has to answer the question or just hallucinated it

— Theo Sanderson ()

Unlike a standard chatbot that provides quick responses, deep research follows a multi-step process to produce a structured report:

  1. The user submits a request. This could be anything from a market analysis to a legal case summary.
  2. The AI clarifies the task. It may ask follow-up questions to refine the research scope.
  3. The agent searches the web. It autonomously browses hundreds of sources, including news articles, research papers and online databases.
  4. It synthesises its findings. The AI extracts key points, organises them into a structured report and cites its sources.
  5. The final report is delivered. Within five to 30 minutes, the user receives a multi-page document 鈥撎�� summarising the findings.

At first glance, it sounds like a dream tool for knowledge workers. A closer look reveals significant limitations.

听听听have exposed shortcomings:

  • It lacks context.听AI can summarise, but it doesn鈥檛 fully understand what鈥檚 important.
  • It ignores new developments.听It has missed major legal rulings and scientific updates.
  • It makes things up.听Like other AI models, it can confidently generate false information.
  • It can鈥檛 tell fact from fiction.听It doesn鈥檛 distinguish authoritative sources from unreliable ones.

While OpenAI claims its tool rivals human analysts, AI inevitably lacks the judgement, scrutiny and expertise that make good research valuable.

I've done a in-depth evaluation of ChatGPT Deep Research. Top-line finding: It's much better than 4o, but 4o was terrible at research. I still get the sense that no scientists were consulted in the design, or if they were, they weren't listened to. It gives answers rather than discussing evidence. 馃И

— William Gunn ()

What AI can鈥檛 replace

ChatGPT isn鈥檛 the only AI tool that can scour the web and produce reports with just a few prompts. Notably, a mere听, Hugging Face released a free, open-source version that nearly matches its performance.

The biggest risk of deep research and other AI tools marketed for 鈥渉uman-level鈥� research is the illusion that AI can replace human thinking. AI can summarise information, but it can鈥檛 question its own assumptions, highlight knowledge gaps, think creatively or understand different perspectives.

And AI-generated summaries don鈥檛 match the听听of a听听human researcher.

Any AI agent, no matter how fast, is still just a tool, not a replacement for human intelligence. For knowledge workers, it鈥檚 more important than ever to invest in skills that AI can鈥檛 replicate: critical thinking, fact-checking, deep expertise and creativity.

If you do want to use AI research tools, there are ways to do so responsibly. Thoughtful use of AI can enhance research without sacrificing accuracy or depth. You might use AI for efficiency, like summarising documents, but retain human judgement for making decisions.

Always verify sources, as AI-generated citations can be misleading. Don鈥檛 trust conclusions blindly, but apply critical thinking and cross-check information with reputable sources. For high-stakes topics 鈥� such as听,听听and听听鈥� supplement AI findings with expert input.

Despite prolific marketing that tries to tell us otherwise, generative AI still has plenty of limitations. Humans who can creatively synthesise information, challenge assumptions and think critically will remain in demand 鈥� AI can鈥檛 replace them just yet.

This article was originally published in . Written by听Raffaele F Ciriello,听Senior Lecturer in Business Information Systems at the 爆料王 Business School.

The Conversation

Manual Name :

Manual Description :

Manual Address :

Manual Addition Info Title :

Manual Addition Info Content :

Profile image :

Manual Type : contact

alt

_self

Auto Type : contact

Auto Addition Title :

Auto Addition Content :

Auto Name : true

Auto Position : true

Auto Profile image :

Auto Phone Number : false

Auto Mobile Number : true

Auto Email Address : true

Auto Address : false

UUID : H-VESEY