Preliminary exploration of ChatGPT-assisted pediatric diagnosis, treatment and doctor-patient communication_West China Medical Journal

Authors：

 FENG Wenhua ¹ , REN Chaonan ¹ , LUO Ping ¹ , PENG Xiqi ^2,3 , LIANG Rui ² , PENG Lei ² ,  ZHANG Shaohua ²

1. Department of Pediatrics, West China Hospital Mianzhu, Sichuan University, Mianzhu People’s Hospital, Deyang, Sichuan 618200, P. R. China;
2. Institute of Motor Robotics, South China Hospital, Shenzhen University, Shenzhen, Guangdong 518000, P. R. China;
3. Department of Biochemistry and Molecular Medicine, University of California Davis, Sacramento 95817, USA;

Corresponding author：

FENG Wenhua, Email: Drfengwenhua@163.com; ZHANG Shaohua, Email: zhangshaohua@szu.edu.com

Keywords：

Pediatrics; large language model; artificial intelligence; clinical decision support

DOI：

10.7507/1002-0179.202311251

Video：

Export PDF Favorites Scan Get Citation

Abstract Full text Figures/Tables Video References Cited by

Objective To explore the use of ChatGPT (Chat Generative Pre-trained Transformer) in pediatric diagnosis, treatment and doctor-patient communication, evaluate the professionalism and accuracy of the medical advice provided, and assess its ability to provide psychological support. Methods The knowledge databases of ChatGPT 3.5 and 4.0 versions as of April 2023 were selected. A total of 30 diagnosis and treatment questions and 10 doctor-patient communication questions regarding the pediatric urinary system were submitted to ChatGPT versions 3.5 and 4.0, and the answers to ChatGPT were evaluated. Results The answers to the 40 questions answered by ChatGPT versions 3.5 and 4.0 all reached the qualified level. The answers to 30 diagnostic and treatment questions in ChatGPT 4.0 version were superior to those in ChatGPT 3.5 version (P=0.024). There was no statistically significant difference in the answers to the 10 doctor-patient communication questions answered by ChatGPT 3.5 and 4.0 versions (P=0.727). For prevention, single symptom, and disease diagnosis and treatment questions, ChatGPT’s answer scores were relatively high. For questions related to the diagnosis and treatment of complex medical conditions, ChatGPT’s answer scores were relatively low. Conclusion ChatGPT has certain value in assisting pediatric diagnosis, treatment and doctor-patient communication, but the medical advice provided by ChatGPT cannot completely replace the professional judgment and personal care of doctors.

Citation： FENG Wenhua, REN Chaonan, LUO Ping, PENG Xiqi, LIANG Rui, PENG Lei, ZHANG Shaohua. Preliminary exploration of ChatGPT-assisted pediatric diagnosis, treatment and doctor-patient communication. West China Medical Journal, 2024, 39(8): 1273-1276. doi: 10.7507/1002-0179.202311251 Copy

1.	Singhal K, Azizi S, Tu T, et al. Large language models encode clinical knowledge. Nature, 2023, 620(7972): 172-180.
2.	Peng Y, Rousseau JF, Shortliffe EH, et al. AI-generated text may have a role in evidence-based medicine. Nat Med, 2023, 29(7): 1593-1594.
3.	Moor M, Banerjee O, Abad ZSH, et al. Foundation models for generalist medical artificial intelligence. Nature, 2023, 616(7956): 259-265.
4.	李璇, 李凯峰, 张桂菊. 中医儿科基层从业人员临床工作能力现状分析及提升策略研究. 中国中医药现代远程教育, 2023, 21(12): 178-180.
5.	刘宇春, 杜雪平, 丁静, 等. 0~3 岁儿童社区儿科门诊就诊需求研究. 中国全科医学, 2020, 23(16): 1996-2001.
6.	钱丹红, 倪双, 何海颖. 沉浸式情景游戏对儿科发热门诊患儿及家长心理弹性、依从性的影响. 齐鲁护理杂志, 2023, 29(13): 9-13.
7.	European Association Urology. EAU Guidelines. Milan: EAU Annual Congress, 2023.
8.	Rush AJ, Trivedi MH, Ibrahim HM, et al. The 16-Item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression. Biol Psychiatry, 2003, 54(5): 573-583.
9.	Snaith RP. The Hospital Anxiety And Depression Scale. Health Qual Life Outcomes, 2003, 1: 29.
10.	Zhavoronkov A. Caution with AI-generated content in biomedicine. Nat Med, 2023, 29(3): 532.
11.	Zhu L, Mou W, Chen R. Can the ChatGPT and other large language models with internet-connected database solve the questions and concerns of patient with prostate cancer and help democratize medical knowledge?. J Transl Med, 2023, 21(1): 269.
12.	Yeo YH, Samaan JS, Ng WH, et al. Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma. Clin Mol Hepatol, 2023, 29(3): 721-732.
13.	Gabrielson AT, Odisho AY, Canes D. Harnessing generative artificial intelligence to improve efficiency among urologists: welcome ChatGPT. J Urol, 2023, 209(5): 827-829.
14.	Huang H, Zheng O, Wang D, et al. ChatGPT for shaping the future of dentistry: the potential of multi-modal large language model. Int J Oral Sci, 2023, 15(1): 29.
15.	Davis R, Eppler M, Ayo-Ajibola O, et al. Evaluating the effectiveness of artificial intelligence-powered large language models application in disseminating appropriate and readable health information in urology. J Urol, 2023, 210(4): 688-694.
16.	Cocci A, Pezzoli M, Lo Re M, et al. Quality of information and appropriateness of ChatGPT outputs for urology patients. Prostate Cancer Prostatic Dis, 2024, 27(1): 159-160.
17.	Piazza P, Checcucci E, Puliatti S, et al. The long but necessary journey towards optimization of the cause-effect relationship between input and output for accountable use of ChatGPT for academic purposes. Eur Urol Focus, 2023, 9(6): 1065-1067.
18.	马武仁, 弓孟春, 戴辉, 等. 以 ChatGPT 为代表的大语言模型在临床医学中的应用综述. 医学信息学杂志, 2023, 44(7): 9-17.
19.	李东洋, 刘秦民. 论 ChatGPT 在医学领域可能带来的伦理风险与防范路径. 中国医学伦理学, 2023, 36(10): 1067-1073, 1096.
20.	李佩芳, 陈佳丽, 宁宁, 等. ChatGPT 在医学领域的应用进展及思考. 华西医学, 2023, 38(10): 1456-1460.

1. Singhal K, Azizi S, Tu T, et al. Large language models encode clinical knowledge. Nature, 2023, 620(7972): 172-180.
2. Peng Y, Rousseau JF, Shortliffe EH, et al. AI-generated text may have a role in evidence-based medicine. Nat Med, 2023, 29(7): 1593-1594.
3. Moor M, Banerjee O, Abad ZSH, et al. Foundation models for generalist medical artificial intelligence. Nature, 2023, 616(7956): 259-265.
4. 李璇, 李凯峰, 张桂菊. 中医儿科基层从业人员临床工作能力现状分析及提升策略研究. 中国中医药现代远程教育, 2023, 21(12): 178-180.
5. 刘宇春, 杜雪平, 丁静, 等. 0~3 岁儿童社区儿科门诊就诊需求研究. 中国全科医学, 2020, 23(16): 1996-2001.
6. 钱丹红, 倪双, 何海颖. 沉浸式情景游戏对儿科发热门诊患儿及家长心理弹性、依从性的影响. 齐鲁护理杂志, 2023, 29(13): 9-13.
7. European Association Urology. EAU Guidelines. Milan: EAU Annual Congress, 2023.
8. Rush AJ, Trivedi MH, Ibrahim HM, et al. The 16-Item Quick Inventory of Depressive Symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression. Biol Psychiatry, 2003, 54(5): 573-583.
9. Snaith RP. The Hospital Anxiety And Depression Scale. Health Qual Life Outcomes, 2003, 1: 29.
10. Zhavoronkov A. Caution with AI-generated content in biomedicine. Nat Med, 2023, 29(3): 532.
11. Zhu L, Mou W, Chen R. Can the ChatGPT and other large language models with internet-connected database solve the questions and concerns of patient with prostate cancer and help democratize medical knowledge?. J Transl Med, 2023, 21(1): 269.
12. Yeo YH, Samaan JS, Ng WH, et al. Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma. Clin Mol Hepatol, 2023, 29(3): 721-732.
13. Gabrielson AT, Odisho AY, Canes D. Harnessing generative artificial intelligence to improve efficiency among urologists: welcome ChatGPT. J Urol, 2023, 209(5): 827-829.
14. Huang H, Zheng O, Wang D, et al. ChatGPT for shaping the future of dentistry: the potential of multi-modal large language model. Int J Oral Sci, 2023, 15(1): 29.
15. Davis R, Eppler M, Ayo-Ajibola O, et al. Evaluating the effectiveness of artificial intelligence-powered large language models application in disseminating appropriate and readable health information in urology. J Urol, 2023, 210(4): 688-694.
16. Cocci A, Pezzoli M, Lo Re M, et al. Quality of information and appropriateness of ChatGPT outputs for urology patients. Prostate Cancer Prostatic Dis, 2024, 27(1): 159-160.
17. Piazza P, Checcucci E, Puliatti S, et al. The long but necessary journey towards optimization of the cause-effect relationship between input and output for accountable use of ChatGPT for academic purposes. Eur Urol Focus, 2023, 9(6): 1065-1067.
18. 马武仁, 弓孟春, 戴辉, 等. 以 ChatGPT 为代表的大语言模型在临床医学中的应用综述. 医学信息学杂志, 2023, 44(7): 9-17.
19. 李东洋, 刘秦民. 论 ChatGPT 在医学领域可能带来的伦理风险与防范路径. 中国医学伦理学, 2023, 36(10): 1067-1073, 1096.
20. 李佩芳, 陈佳丽, 宁宁, 等. ChatGPT 在医学领域的应用进展及思考. 华西医学, 2023, 38(10): 1456-1460.

West China Medical Journal

Preliminary exploration of ChatGPT-assisted pediatric diagnosis, treatment and doctor-patient communication

Abstract Full text Figures/Tables Video References Cited by

Previous Article

Next Article

Format

Content