Main Logo
Logo

Society for Pediatric Radiology – Poster Archive

  2
  0
  0
 
 


Final ID: Poster #: EDU-002

Friendly but Flawed: Understanding Chatbot Risks in Pediatric Imaging

Purpose or Case Report: Artificial intelligence (AI) chatbots powered by large language models (LLMs) are beginning to appear in pediatric radiology workspace: as assistants for reporting, learning, and patient communication. Their fluency, speed, and apparent intelligence have sparked enthusiasm, yet beneath their polished prose lie subtle but consequential pitfalls that can mislead radiologists if unrecognized.

This educational exhibit highlights the cognitive, behavioral, and system-level risks of using AI chatbots in pediatric radiology practice. Key reliability issues include hallucinations, where models fabricate confident but false information, and sycophantic agreement, where they align with a user’s incorrect assumptions (“yes-man” behavior). These errors are often cloaked in convincing medical language, amplifying risk for trainees and non-experts. Bias propagation from skewed or adult-dominant training data may reinforce inequities, while emergent misalignment can produce unpredictable or unsafe outputs following system updates or fine-tuning.

Human-AI interaction adds another layer of concern. The ELIZA effect refers to our instinct to anthropomorphize machines, creating misplaced trust, as users perceive the chatbot as a knowledgeable colleague rather than a probability engine. This illusion of “seeming consciousness” can breed overconfidence and automation bias, where clinicians accept AI outputs uncritically. Over time, over-reliance can contribute to deskilling, as repetitive dependence on automated summaries erodes critical reasoning and vigilance.

Beyond technical flaws, chatbots also lack true creativity and problem-solving ability. Their responses mirror patterns from prior data, limiting originality and leading to formulaic, conventional outputs. In pediatric imaging education, this can hinder the cultivation of innovative clinical thinking.

Educational goals of this poster:
1. Illustrate common and emerging pitfalls of radiology chatbot use, including hallucination, bias, and misalignment.
2. Explain cognitive effects such as the ELIZA effect, automation bias, and deskilling.
3. Present real-world studies and simulated examples, where chatbot errors could influence pediatric imaging decision-making.
4. Offer practical guidelines for safe, critical, and educationally constructive chatbot use.
Methods & Materials:
Results:
Conclusions:
  • Gupta, Amit  ( All India Institute of Medical Sciences New Delhi , New Delhi , Delhi , India )
Meeting Info:
Session Info:

Posters - Educational

Artificial Intelligence/Informatics

IPR Posters - Educational

More abstracts on this topic:
Convolutional Neural Network for Diagnosis of Pediatric Developmental Dysplasia of the Hip on Conventional Radiography

Cho Yeon Jin, Park Hyoung Suk, Jeon Kiwan, Choi Young Hun, Choi Gayoung, Lee Seul Bi, Lee Seunghyun, Cheon Jung-eun, Kim Woo Sun, Ryu Young Jin, Hwang Jae-yeon

An Object Detection Machine Learning Model to Identify Rickets on Pediatric Wrist Radiographs

Meda Karthik, Milla Sarah, Rostad Bradley

More abstracts from these authors:
Transperineal Ultrasound in Ambiguous Genitalia in Children: A Pictorial Review

Jana Manisha, Jain Rupali, Gupta Amit, Kandasamy Devasenathipathy

Hepatic Artery Pseudo-aneurysm: A Rare Complication of Visceral Larva Migrans

Gupta Amit, Naranje Priyanka, Kandasamy Devasenathipathy, Jana Manisha

Preview
Poster____EDU-002.pdf
You have to be authorized to contact abstract author. Please, Login or Signup.

Please note that this is a separate login, not connected with your credentials used for the SPR main website.

Not Available

Comments

We encourage you to join the discussion by posting your comments and questions below.

Presenters will be notified of your post so that they can respond as appropriate.

This discussion platform is provided to foster engagement, and stimulate conversation and knowledge sharing.

Please click here to review the full terms and conditions for engaging in the discussion, including refraining from product promotion and non-constructive feedback.

 

You have to be authorized to post a comment. Please, Login or Signup.

Please note that this is a separate login, not connected with your credentials used for the SPR main website.


   Rate this abstract  (Maximum characters: 500)