Anthropic: los expertos siguen a la IA el 86 % de las veces sin darse cuenta

Anthropic: los expertos siguen a la IA el 86 % de las veces sin darse cuenta

Anthropic: Experts follow the AI 86% of the time without realizing it

Title history
  • Anthropic: los expertos siguen a la IA el 86 % de las veces sin darse cuenta — observed on 20261104-0821 UTC (YouTube)
🎙 El Test de Turing 👥 9K 📅 November 4, 2026 ⏱ 10 min 👁 5 📄 expert opinion 🧭 2026-11-04
Available in: English (current) Français

Keywords

AI persuasionexpert judgmentautomation biascritical thinkingdecision making

Summary

The video discusses a study by Anthropic where expert analysts used an AI agent to make a decision. The study found that experts chose the AI’s preferred option 86% of the time, even when they were unaware that the option was AI-generated, and only 15% recognized the AI’s influence. The presenter highlights the concerning implications for automation bias and critical thinking, especially when decisions lack clear right or wrong answers. He introduces a personal method called ‘judgment call’ to counter this bias, which involves asking the AI to argue equally for all reasonable options to allow the user to decide independently. The speaker also shares his experience using Obsidian to document his own reasoning, separating his original thoughts from AI-generated content. He emphasizes the importance of maintaining critical evaluation of AI outputs and avoiding over-reliance on persuasive but potentially flawed arguments. The video concludes with a call for deliberate reflection when using AI tools.

154 words

Critical Evaluation

Value of the Information & Strength of the Argument

The video provides a valuable perspective on a real and relevant study, highlighting the subtle ways AI can influence decision-making. The argumentation is personal and reflective, connecting the study’s findings to everyday AI use. It offers a practical solution (the ‘judgment call’ method) to mitigate automation bias. However, the presenter does not critically engage with the study’s limitations beyond noting the small sample size, and his argument would benefit from more rigorous statistical and methodological questioning. The discussion is engaging but relies heavily on anecdotal experience.

Scientific Rigor, Source Quality, Title Accuracy

The video cites the primary source (Anthropic research page) and links to the full episode. The title accurately represents the video’s focus on the 86% result and the lack of awareness. The presenter’s interpretation is subjective but transparently so. No external contradicting sources are mentioned, and the video does not provide a thorough scientific breakdown, though it remains honest about uncertainties. The overall rigor is moderate, consistent with an expert opinion piece.

173 words

Title / Content Match

The title accurately reflects the main finding discussed (86% adherence) and the unnoticed influence, matching the content.

Quality & Reliability

7/10

The video references a specific study by Anthropic and provides a link, but the analysis is subjective and includes personal opinions. It lacks rigorous statistical critique and generalizes from a small sample.

Key Moments

Cited Sources

Concurring Sources

Contribution & Novelties

The video offers a unique personal perspective on automation bias in AI use and proposes a concrete, actionable method (‘judgment call’) to mitigate it. This contribution goes beyond simply summarizing the study, as it integrates the findings into a practical workflow for AI-assisted decision-making. The speaker also highlights the phenomenon of ‘verborrea’ (verbal diarrhea) as a persuasive technique used by AI, which is an insightful observation.

Pour aller plus loin :

112 words

Radar Profile

The profile shows a moderate level of information quantity and quality, with a relatively balanced technical level. The reliability is decent given the reference to a real study, but the subjective analysis and lack of deep statistical scrutiny slightly reduce the overall score. The video offers practical value despite its limited depth.

Reliability 6/10