With the rapid development of critical care medicine (CCM), the particularity and professionalism of critical clinical thinking has become increasingly apparent. To grasp critical clinical thinking quickly and accurately is a key and difficult point in clinical training for young doctors. The CCM team of Peking Union Medical College Hospital summarized the CITE(Case characteristic, Index, Target, Execute) mode of ward rounds. This mode integrated the training of critical clinical thinking into daily bedside rounds and tried to rapidly develop the ability of critical clinical thinking of the young doctors and to achieve continuous and high-quality medical services.
- Article type
- Year
Generative artificial intelligence (GAI) represents a prominent research focus in medicine, with medical education being a key application area. GAI demonstrates potential to enhance residency training efficacy through personalized instruction, automated assessment item generation, question bank updating, and intelligent scoring systems. However, current limitations exist regarding output accuracy and content consistency. To address these constraints, strategic measures are required: continuous GAI model refinement, development of standardized usage guidelines, enhanced data quality control, and implementation of human verification protocols for generated content. Concurrently, residents should proactively acquire GAI utilization skills to strengthen the practical application of theoretical knowledge. With these advancements, GAI is anticipated to evolve into a valuable asset for improving the efficiency and quality of residency training programs.
To explore the application effectiveness of generative artificial intelligence(GAI) in the standardized training assessment of critical care medicine residents.
The study subjects included residents undergoing standardized training in the critical care medicine departments of Peking Union Medical College Hospital and Beijing Friendship Hospital from June to September 2024, as well as teaching physicians qualified for standardized training instruction. Two sets of GAI-generated examination papers (using Tongyi Qianwen 2.5) and one set of human-generated examination papers were administered to all residents. The answers were graded separately by teaching physicians and Tongyi Qianwen 2.5. The grading results from human and GAI evaluations were compared, and feedback from both residents and teaching physicians on the GAI-generated and human-generated papers was collected.
A total of 35 residents and 11 teaching physicians were included in the study. The scores of residents on single-choice questions from the two GAI-generated papers were significantly higher than those from the human-generated paper(both P < 0.05), while the scores on multiple-choice questions were significantly lower(both P < 0.05). There were no statistically significant differences in the grading of short-answer questions among the three papers(all P > 0.05). In terms of subjective evaluations, both teaching physicians(P=0.007) and residents(P=0.008) perceived the GAI-generated papers as less difficult. However, there were no significant differences in content accuracy or alignment with the training syllabus between the GAI-generated and human-generated papers(all P > 0.05).
GAI performs comparably to human-generated papers in terms of examination paper creation and grading, but further optimization is needed regarding question difficulty. GAI holds promise as a valuable tool for enhancing the efficiency of resident teaching assessments.
The application of various bedside imaging monitoring techniques in critical care department makes the necessity of imaging ward round increasingly prominent. In terms of medical treatment, it is beneficial to increase the accuracy of intervention, improve the consistency of team working mode, and enhance the level of individualized and organ-targeted treatment. In terms of teaching, it helps to deepen the understanding of the physiological mechanism of diseases, promote the cultivation of critical clinical thinking, and improve the use of the monitoring equipment. In the aspect of scientific research, it facilitates the summary of image data and the development of scientific research ideas. At the same time, it is necessary to pay attention to data security, patient privacy and limitations of imaging data when ward rounds are conducted.
京公网安备11010802044758号