Next Article in Journal
Theoretical and Numerical Simulation Research on Fire of Large-Span Spatial Structures
Previous Article in Journal
Video-Biomechanical Analysis of the Shoulder Kinematics of Impact from Sode-Tsurikomi-Goshi and Tsurikomi-Goshi Judo Throws in Elite Adult Judoka
Previous Article in Special Issue
Fetal Radiation Dose in Common Diagnostic Radiology Procedures for Pregnant Patients: Findings from In-Phantom Measurements
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Applied Sciences
Volume 15
Issue 3
10.3390/app15031153
applsci-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
This is an early access version, the complete PDF, HTML, and XML versions will be available soon.
Article

Application of Artificial Intelligence as an Aid for the Correction of the Objective Structured Clinical Examination (OSCE)

by
Davide Luordo
1,2,
Marta Torres Arrese
3,
Cristina Tristán Calvo
1,
Kirti Dayal Shani Shani
1,
Luis Miguel Rodríguez Cruz
4,
Francisco Javier García Sánchez
1,2,
Alfonso Lagares Gómez-Abascal
5,
Rafael Rubio García
5,
Juan Delgado Jiménez
5,
Mercedes Pérez Carreras
5,
Ramiro Diez Lobato
5,
Juan José Granizo Martínez
5,
Yale Tung-Chen
6,* and
Mª Victoria Villena Garrido
5
1
Infanta Cristina University Hospital, 28981 Madrid, Spain
2
Department of Medicine, Complutense University of Madrid, 28040 Madrid, Spain
3
Alcorcón Foundation Hospital, 28922 Alcorcón, Spain
4
Independent Researcher, 28945 Madrid, Spain
5
12 de Octubre University Hospital, 28041 Madrid, Spain
6
Department of Medicine, Autonomous University of Madrid, 29040 Madrid, Spain
*
Author to whom correspondence should be addressed.
Appl. Sci. 2025, 15(3), 1153; https://doi.org/10.3390/app15031153
Submission received: 3 December 2024 / Revised: 23 December 2024 / Accepted: 21 January 2025 / Published: 23 January 2025
(This article belongs to the Special Issue Advances and Applications of Medical Imaging Physics)
Versions Notes

Abstract

The assessment of clinical competencies is essential in medical training, and the Objective Structured Clinical Examination (OSCE) is an essential tool in this process. There are multiple studies exploring the usefulness of artificial intelligence (AI) in medical education. This study explored the use of the GPT-4 AI model to grade clinical reports written by students during the OSCE at the Teaching Unit of the 12 de Octubre and Infanta Cristina University Hospitals, part of the Faculty of Medicine at the Complutense University of Madrid, comparing its results with those of human graders. Ninety-six (96) students participated, and their reports were evaluated by two experts, an inexperienced grader, and the AI using a checklist designed during the OSCE planning by the teaching team. The results show a significant correlation between the AI and human graders (ICC = 0.77 for single measures and 0.91 for average measures). AI was more stringent, assigning scores on an average of 3.51 points lower (t = −15.358, p < 0.001); its correction was considerably faster, completing the analysis in only 24 min compared to the 2–4 h required by human graders. These results suggest that AI could be a promising tool to enhance efficiency and objectivity in OSCE grading.
Keywords: artificial intelligence; objective structured clinical examination (OSCE); medical education; clinical competency assessment; AI in healthcare; AI-assisted grading; human–AI comparison in grading; digital OSCE evaluation; medical report evaluation artificial intelligence; objective structured clinical examination (OSCE); medical education; clinical competency assessment; AI in healthcare; AI-assisted grading; human–AI comparison in grading; digital OSCE evaluation; medical report evaluation

Share and Cite

MDPI and ACS Style

Luordo, D.; Torres Arrese, M.; Tristán Calvo, C.; Shani Shani, K.D.; Rodríguez Cruz, L.M.; García Sánchez, F.J.; Lagares Gómez-Abascal, A.; Rubio García, R.; Delgado Jiménez, J.; Pérez Carreras, M.; et al. Application of Artificial Intelligence as an Aid for the Correction of the Objective Structured Clinical Examination (OSCE). Appl. Sci. 2025, 15, 1153. https://doi.org/10.3390/app15031153

AMA Style

Luordo D, Torres Arrese M, Tristán Calvo C, Shani Shani KD, Rodríguez Cruz LM, García Sánchez FJ, Lagares Gómez-Abascal A, Rubio García R, Delgado Jiménez J, Pérez Carreras M, et al. Application of Artificial Intelligence as an Aid for the Correction of the Objective Structured Clinical Examination (OSCE). Applied Sciences. 2025; 15(3):1153. https://doi.org/10.3390/app15031153

Chicago/Turabian Style

Luordo, Davide, Marta Torres Arrese, Cristina Tristán Calvo, Kirti Dayal Shani Shani, Luis Miguel Rodríguez Cruz, Francisco Javier García Sánchez, Alfonso Lagares Gómez-Abascal, Rafael Rubio García, Juan Delgado Jiménez, Mercedes Pérez Carreras, and et al. 2025. "Application of Artificial Intelligence as an Aid for the Correction of the Objective Structured Clinical Examination (OSCE)" Applied Sciences 15, no. 3: 1153. https://doi.org/10.3390/app15031153

APA Style

Luordo, D., Torres Arrese, M., Tristán Calvo, C., Shani Shani, K. D., Rodríguez Cruz, L. M., García Sánchez, F. J., Lagares Gómez-Abascal, A., Rubio García, R., Delgado Jiménez, J., Pérez Carreras, M., Diez Lobato, R., Granizo Martínez, J. J., Tung-Chen, Y., & Villena Garrido, M. V. (2025). Application of Artificial Intelligence as an Aid for the Correction of the Objective Structured Clinical Examination (OSCE). Applied Sciences, 15(3), 1153. https://doi.org/10.3390/app15031153

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop