Next Article in Journal
Exploring the Experience of Breathlessness with the Common-Sense Model of Self-Regulation (CSM)
Previous Article in Journal
An International Non-Inferiority Study for the Benchmarking of AI for Routine Radiology Cases: Chest X-ray, Fluorography and Mammography
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Survey on Perceptions of the Direction of Korean Medicine Education and National Licensing Examination

1
Department of Neuropsychiatry, Graduate School, College of Korean Medicine, Dongguk University, Seoul 04620, Republic of Korea
2
Department of Acupuncture & Moxibustion, Dongguk University Bundang Oriental Hospital, Seongnam-si 13601, Republic of Korea
3
Teaching & Learning, 7 Days Inc., Seoul 06247, Republic of Korea
4
Department of Medical History, College of Korean Medicine, Wonkwang University, Iksan-si 54538, Republic of Korea
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Healthcare 2023, 11(12), 1685; https://doi.org/10.3390/healthcare11121685
Submission received: 5 May 2023 / Revised: 4 June 2023 / Accepted: 6 June 2023 / Published: 8 June 2023
(This article belongs to the Section Nursing)

Abstract

:
Recent changes in medical education and assessment led to a focus on occupational competency, and this study investigated the perceptions of Korean medicine doctors (KMDs) on the national licensing examination for KMDs (NLE-KMD). The survey aimed to understand KMDs’ recognition of the current situation, items to improve, and items to emphasize in the future. We conducted the web-based survey from 22 February to 4 March 2022, and 1244 among 23,338 KMDs answered voluntarily. Through this study, we found the importance of competency-related clinical practice and Korean standard classification of disease (KCD), and the presence of a generation gap. KMDs considered clinical practice (clinical tasks and clinical work performance) and the item related to the KCD important. They valued (1) the focus on KCD diseases that are frequently seen in clinical practice and (2) the readjustment and introduction of the clinical skills test. They also emphasized KCD-related knowledge and skills for the assessment and diagnosis of KCD diseases, especially those frequently treated at primary healthcare institutes. We confirmed the generation gap in the subgroup analysis according to the license acquisition period, and the ≤5-year group emphasized clinical practice and the KCD, while the >5-year group stressed traditional KM theory and clinical practice guidelines. These findings could be used to develop the NLE-KMD by setting the direction of Korean medicine education and guiding further research from other perspectives.

1. Introduction

Republic of Korea, China, and Japan have their own types of traditional medicine, and each country has its own system of education [1,2]. Mainland China has two education courses. One consists of a five-year bachelor’s degree and one year of clinical training, while the other consists of a seven-year master’s degree only. After completing these courses, students are eligible to select and obtain the following licenses: traditional Chinese medicine (TCM), Western medicine, and TCM/Western medicine. In contrast, Japan does not have its own license for Kampo medicine (the name of traditional Japan medicine). Kampo medicine training is provided as an optional and additional education after graduation from medical university, and the Japan Society for Oriental Medicine grants students who completed the training the authority to perform Kampo treatment.
Republic of Korea has two education pathways (six-year program and four-year postbaccalaureate program), and (prospective) graduates are eligible to apply for the national licensing examination for Korean medicine doctors (NLE-KMD). The Korea Health Personnel Licensing Examination Institute (KHPLEI) oversees NLE-KMD in Korea. Based on the KHPLEI, a Korean medicine doctor (KMD) is responsible for diagnosing the patients based on the theory of Korean medicine (KM), conducting KM treatments (e.g., acupuncture, herbal medicine), and overseeing rehabilitation and public health prevention [3].
The KHPLEI established the current frame of the NLE-KMD in 1990 based on the following KM college subjects: internal medicine 1 and 2 (including Sasang constitutional medicine (SCM)), acupuncture and moxibustion, medical law, dermatology and surgery, neuropsychiatry, ophthalmology and otorhinolaryngology, gynecology, pediatrics, preventive medicine, physiology, and herbology [4]. The KHPLEI continuously implemented the subject-centered paper examination system without significant changes, with pass criteria of at least 60% for the total score and at least 40% for each subject [4].
However, the current medical education and examination system is being replaced with a clinical occupational competency-centered approach [5]. The Korean medical licensing examination (KMLE) went through several revisions, and the clinical skills test was introduced in 2009. This test contains history taking, physical examination, physician and patient interaction, attitude toward patients, and basic technical skills, and it aims to evaluate doctors’ clinical competence [6]. These changes are progressing domestically and internationally in several fields, including medicine, dentistry, and nursing [7,8].
In line with these changes, this study investigates KMDs’ recognition of the current state of the NLE-KMD, perceptions of the items that need to be urgently improved, and thoughts on the items that must be emphasized in NLE-KMD development in terms of overall and occupational competency. These results will serve as an essential reference for examination improvement.

2. Materials and Methods

2.1. Study Design

This study’s design recognizes KMDs’ opinions on NLE-KMD. The survey contained 16 questions with the following sections; (1) consent to voluntary participation, (2) characteristics of the KMD respondent, (3) the recognition of the current NLE-KMD, (4) the perception of what needs improvement, (5) what needs emphasis, and (6) the agreement of clinical occupational competency-related items.
We developed the initial draft using literature research and focus group interviews (FGI). For the literature study, we targeted previous and related studies on the NLE-KMD using the following databases: MEDLINE, KoreaMed, the Korean Medical Database, the Korean Studies Information Service System, ScienceOn, Korea Institute of Science and Technology Information, and the Oriental Medicine Advanced Searching Integrated System.
We conducted FGI to clarify the draft’s direction. As a result, seven KMDs who experienced the NLE-KMD within the last five years and are currently in charge of KM education participated as the representative of each KM subject. These subjects included acupuncture and moxibustion medicine, neuropsychiatry of Korean medicine, ophthalmology and otorhinolaryngology and dermatology of Korean medicine, internal medicine of Korean medicine, pediatrics of Korean medicine, rehabilitation medicine of Korean medicine, and SCM. Through this process, we identified and derived problems in KM education.
We created the actual draft through discussion with internal experts. Four researchers (EJK, HBC, JSH and YSK) held five meetings. As a result, they confirmed: (1) whether the KMD is aware of the current state of the national licensing examination, (2) which items KMDs want improved first, (3) which items KMDs want emphasized in the NLE-KMD, and (4) which clinical occupational competencies KMDs considered important from a future-oriented perspective.
After that, several meetings and subsequent revisions by external researchers (six professors at KM college and three researchers at the Institute of Korean Medicine Education and Evaluation) developed a draft. Lastly, external experts and the panel completed the final draft.

2.2. Participants and Procedures

We prepared a web version of the questionnaire to ensure complete answers, prevent omissions, and facilitate statistical analysis. We set an algorithm that sounded an alarm when there was an omission and prevented the respondent from moving on to the next question if the respondent did not complete the answer. This cross-sectional survey targeted participants who (1) were qualified to take the NLE-KMD after completing the official education pathway and (2) passed the NLE-KMD and obtained a KMD license. Those who qualified to take the examination but never obtained a KMD license were excluded. After obtaining a list of subjects who satisfied these criteria from the Association of Korean Medicine, we sent an e-mail to 22,338 KMDs twice at an interval of one week (22 and 28 February 2022) under the association’s approval. There was no minimum sample size due to the nature of the survey, but we tried to recruit as many respondents as possible. In addition, we gathered survey responses using the “Moaform” online survey platform from 22 February to 4 March 2022. There were no conflicts of interest in sending the e-mail or collecting the survey data.

2.3. Ethics

This study was approved by the Institutional Review Board of Dongguk University Bundang Oriental Hospital (DUBOH 2022-0002). When we sent the e-mail, we provided the following information: the purpose of the survey, the survey response method, required time, the e-mail address to which inquiries could be sent, the data collection method, and the academic use of survey results. We also informed the KMDs of the survey’s confidentiality regarding personal information and their right to withdraw from the study. Before the KMDs responded to the survey, we rechecked their voluntary participation by asking them to confirm their consent in the first question.

2.4. Statistical Methods

The online survey platform provided the raw data in Microsoft Excel format, and the researcher checked the number of responses to each question. The categorical variables included frequencies and percentages, while Likert scale variables were converted into continuous variables (i.e., five scales into 1–5 points) and presented as means ± standard deviations. Considering the statistical significance in the subgroup analysis and response proportion, we divided the participants into two subgroups based on the license acquisition period of five years. To compare the two groups, we used the Chi-square test for categorical variables and the Wilcoxon rank sum test or two-sample t-test for continuous variables. We assumed significance when p value < 0.05 using STATA version 15.0 (STATA Corp, LP. College Station, TX, USA). Lastly, one independent researcher reviewed these data repeatedly.

3. Results

3.1. Participants

Among the 1281 online questionnaire users, 1244 respondents (97.1%) agreed to voluntary participation. This stat means 5.56% of the response rate among total KMDs (22,338). Regarding the license acquisition year, 30.47% (n = 379), the majority, acquired their licenses within the last five years. In the other fields, the relative majority had clinical experience within five years (n = 483, 38.83%) and worked at a KM clinic (n = 648, 62.49%) (Table 1). For this reason, we divided two subgroups based on the license acquisition period of five years.

3.2. Recognition of the Current NLE-KMD

We measured KMDs’ awareness of the NLE-KMD update on a four-point scale (strongly agree/agree/disagree/strongly disagree) and counted the number of strongly agree and agree. Among 1244 respondents, 721 KMDs (57.95%) recognized that the NLE-KMD gradually changed over the past decade. In particular, KMDs with ≤5 years of license acquisition (UFLA) showed remarkable awareness, with 89.45% (n = 339) strongly agreeing or agreeing compared to 44.16% (n = 382) of KMDs with >5 years of license acquisition (OFLA) (Table 2).

3.3. Items for Improvement in the NLE-KMD

We investigated the NLE-KMD items that KMDs thought should be improved first. We provided eight items and asked respondents to select their top four priorities. Among them, “Focus on Korean standard classification of diseases (KCD) that are critical and highly frequent in clinical practice” was ranked first (n = 890, 18.53%), followed by “Focus on the clinical tasks, not subjects” (n = 767, 15.97%) and “The introduction of clinical skills tests to evaluate the clinical work performance” (n = 734, 15.28%).
Regarding the subgroup analysis, there was a large difference between the two groups on “The introduction of clinical skill tests to evaluate the clinical work performance”, with the UFLA group ranking this item first (18.36%) and the OFLA group ranking it fourth (13.94%) (Table 3).

3.4. Items for Emphasis in the NLE-KMD (Overall)

We asked the participants about the NLE-KMD items they would emphasize considering the job skill level of the KMDs who recently obtained a license. We gave the KMDs nine items with a 10-point Likert scale and compared each item by calculating the average.
As a result, the first- and second-ranked items were all related to the KCD. The most emphasized item was “The knowledge and skills related to the assessment and diagnosis of diseases (KCD)” with 8.25 points, followed by “The knowledge and skills regarding the diseases (KCD) frequently treated at primary healthcare institutes” with 8.15 points. Both subgroups gave these items high scores.
In the subgroup analysis, we identified significant differences between the two groups in the nine items, with the largest being “The knowledge and its’ application of traditional KM theories”. The OFLA group rated the item 6.12 points, while the UFLA group rated it only 4.63 points (p < 0.001) (Table 4).

3.5. Items for Emphasis in the NLE-KMD (Related to Occupational Competency)

In this section, we proposed a clinical occupational competency-related NLE-KMD system consisting of three major categories (preventive and public health activities, diagnosis and treatment of disease, and management of treatment methods). In addition, we suggested two or three items within each major category and provide a detailed explanation for each item.
Then, we asked the KMDs for agreement on (1) this proposed system and (2) each item in the three major categories in a future-oriented perspective with a five-point Likert scale and calculated the agreement by average. While overall consent was 3.75 out of 5, with insignificant differences between the two subgroups, we investigated the agreement of each item in the three major categories.
In the preventive and public health activities section, three items ranged from 3.70 to 3.93. In the subgroup, there was a difference in disease prevention and health promotion activities (p = 0.007).
In the diagnosis and treatment of disease section, two items (diagnosis and treatment of symptomatic disease, diagnosis and treatment based on KCD) showed a high level of agreement (>4.3). In the subgroup, we found that the OFLA group emphasized the Sasang constitution-based diagnosis and treatment while the UFLA group valued KCD (p < 0.001).
The area of management of treatment methods consisted of two items (management of acupuncture and other medical devices, management of herbal medications). The management of herbal medications item showed a significant difference between the two groups (Table 5).

3.6. Keywords for Subjective Responses

To understand individual opinions, we provided an opportunity to give subjective answers. We analyzed 558 subjective responses by setting keywords and calculating their frequency. The most referenced keywords were Sasang constitution (n = 252), clinical trials (n = 243), and prevention (n = 193). The combination of keywords related to the words analyzed with frequency is as follows: Participants related diagnosis to terms such as clinical, KCD, competency, and diagnostic devices. In the SCM category, respondents highlighted words such as objective, base, and standard, and simultaneously selected conflicting words such as unique and characteristics. Regarding prevention, keywords included public health, responsibility, health promotion, and COVID-19 (Figure 1).

4. Discussion

KM is one type of complementary and alternative medicine (CAM) that shares aspects of Chinese and Japanese medicine [9], and it is recognized as an essential contributor to CAM development [10]. The representative academic difference between KM and TCM is the existence of SCM. SCM is characterized by the quadrant diagram, including four major organs (lungs, spleen, liver, and kidneys), and the theory that structural and functional changes occur due to deviations in constitutional properties. Through this, it emphasizes individual idiosyncrasies [11]. KM was the first CAM to be covered by national health insurance, and it became an axis of the national health system of South Korea [12]. With patients’ diverse needs and the growing demand for CAM [13,14], the importance of KM is emerging. Thus, KM college students should take the required education course to qualify for the NLE-KMD. While the KHPLEI continues to address NLE-KMD challenges and developments [15], we conducted our survey to refer to the recognition and perception of existing KMDs more systematically and scientifically.
The results of Table 3 and Table 4 show that most KMDs defended the changes based on clinical practice rather than KM theory. This result is consistent with recent studies focusing on clinical practice. According to Dewey, a pioneer of experiential learning, learners can achieve proper education when it is connected to or integrated into their experience, and they can learn by reflecting on their experiences [16]. Im contends that clinical practice is an essential part of basic medical education, allowing students to acquire crucial clinical and communication skills necessary for patient treatment based on the knowledge learned in related lectures. Therefore, students can seek help in preparing for practice, clinical professors can provide opportunities and feedback for students to participate deeply in treatment, and operating institutions can design and support clinical practice curricula and resources so that students can achieve their goals while actively practicing [17].
In this context, the Institute of Korean Medicine Education and Evaluation reorganized the written tests to examine applicants’ abilities in various areas. The KM education accreditation standards were published in 2022, and they emphasized active clinical practice [18]. They also introduced the objective structured clinical examination (OSCE) and clinical practice examination (CPX) to test students’ clinical abilities. This addition enabled the competency evaluation of Korean medical school examinees and improved the education system [6]. In recent years, 12 KM colleges in Korea were also striving to improve education and evaluation. Among them, Pusan National University dramatically upgraded its KM education by introducing the following: clinical symptoms study courses integrating diverse clinical specialties, problem-based learning, the OSCE, the CPX, clinical skills tests, training and testing with standardized patients, etc. [19]. As such, the results of this survey suggest the need for a competency evaluation method and education system for examinees to improve clinical performance and professionalism.
This trend can also be seen in other countries. German medical education consists of a two-year preclinical segment and a four-year clinical segment similar to Korea [20], and the current trend is to favor education in practical settings rather than theory-based lectures [21]. Although the medical education courses in the USA differ from those in Germany, its occupational competency-centered trends are similar [20]. Since the need for a curriculum type that more effectively solves patients’ problems was suggested in 2001 [22], one study interpreted the various changes in American medical education as reflecting the intention of focusing on skills rather than knowledge [23]. Looking at the previous studies, competency-based medical education might be a method that has a positive effect on patients and communities [24].
Another notable result was the absolute agreement of the disease approach based on the standard classification of disease. Korea developed and stipulated the KCD, based on the International Classification of Diseases (ICD) and related health problems, to capture the clinical picture and produce statistics on KM [9]. After continuous revisions, Korea published the KM volume of the KCD in 1973. In 2010, the third edition of the Korean Classification of Diseases of Oriental Medicine (KCDOM3) was incorporated into the Korean modification of the ICD-10, or KCD 6, using U codes (U20–U99) [25]. In this aspect, the KCD 6 was groundbreaking, as it was the first publication in which Western medicine and traditional medicine shared a common platform [26]. In Korea, KMDs are advised to use the KCD 6, based on Western medicine, as their primary code system; however, when doctors cannot correlate a diagnosis specifically to the KCD 6, they are to supplement the diagnosis with a U code [9].
For this reason, our survey used KCD-related items, including knowledge and skills, differential diagnoses, and diagnosis and treatment. Each item received a high score of 8 or more out of 10. The KCD ranks outpatients as follows: first are those with diseases of the musculoskeletal system (52.44%), second are those with injury and poisoning (19.56%), third are those with diseases with KM names not matched with a Western medicine disease classification (7.60%), fourth are those with diseases of the nervous system (4.43%), and lastly are those with diseases of the digestive system (4.24%) [12]. Based on this, our survey’s results indicate that the current tests and education do not sufficiently reflect frequently seen KCD diseases and thus require improvement.
At the same time, it is difficult to code a diagnosis when there is little agreement on its reasons. For instance, Hua et al. [27] asked TCM practitioners to diagnose knee osteoarthritis using four TCM diagnostic methods (inquiry, (visual) inspection, auscultation/olfaction, and palpation) and found low agreement using inspection and palpation parameters. In addition, there are no codes for the diseases unique to KM, such as blood stasis syndrome and cold hypersensitivity of the hands and feet [28,29]. Therefore, to solve these problems, a more objective tool to understand and utilize each disease must be developed. In addition, improving the quality of and access to reasonable primary medical care should be possible by moving to evidence-based medicine through clinical practice guidelines (CPGs).
TCM studies also confirmed the above direction of KM pursued by KMDs. For example, Lam et al. [30] analyzed the impact of the TCM inclusion in the ICD-11 and expected that the ICD-11 would trigger TCM to provide standardized terminology, develop the CPGs, and expand education. However, Ren et al. [31] reported that only 12% of previous Western medicine guidelines in China included TCM and treated it as a low recommendation. Therefore, the authors considered that the popularity of TCM was not reflected fully due to inadequate evidence and conducting of relevant studies, systematic reviews, and meta-analyses. Finally, regarding modernization, Xu et al. [32] summarized the history of change in TCM from 1950 to 2012 and advised that TCM needed to achieve integrity, integration, and innovation to play a more significant part in future medicine.
Our study also showed two interesting results. First, there was a distinct difference in participants according to the license acquisition period. The OFLA group focused on CPG usage, new health technology, traditional theory, and other CAM. In contrast, the UFLA group emphasized clinical examination, CBT, and diagnosis and treatment based on the KCD. We could interpret this difference as the younger group being interested in the current problems they face in the field. It also suggests evaluating integrated clinical competencies beyond written tests limited to factual knowledge. This interpretation is in line with Yim’s evaluation, including that a greater proportion of problem-solving items reflects the practical situation that medical graduates face in the field. In addition, introducing case studies helps measure the ability of examinees to cope with real-world problems [6].
On the other hand, the older group is interested in applying a wide range of techniques and a practical approach to the clinical field. The generation gap in the medical field was described in several articles as a “lack of professionalism” [33] or “failure of instruction from the older generation (the Silent Generation or Baby Boomers) to the younger generation (Generation X or Millennials)” [34]. The differences between generations are likely to result from the characteristics of the sociocultural environment and the influence of other elements characterizing an era (such as industrialization and democratization) [35]. It was reported that the older generation tends to “respect the system” while the younger generation tends to “respect expertise” [36], which is in line with our results. Understanding intergenerational differences was described as an essential task.
Second, our study allowed respondents to present their opinions in subjective responses so we could understand their thoughts in depth. In these opinions, we found frequent mentions of public healthcare, such as KMDs playing a role in COVID-19. Several studies reported the effect of KM on COVID-19, but KMDs cannot play an active role due to institutional reasons. These mentions are related to the desire to expand the social role of KMDs to evaluate social competencies [37,38,39].
On the topic of the NLE-KMD, to our knowledge, our study is the latest to investigate and analyze the current perceptions of KMDs and the first to gather more than 1000 KMD opinions. Because of our survey’s significant number of respondents, our study potentially provides a more representative justification than previous surveys in which KMDs participated [40]. However, there are some limitations. First, as we conducted this survey using e-mail, it is unlikely that we guaranteed access to all KMDs. Second, more than 1000 KMDs participated in this survey, but the sample was not equally distributed in terms of age or license acquisition period. Therefore, this study does not represent the opinions of all KMDs. Third, we did not include the opinions of other specialists, such as pedagogists.
Nevertheless, the data can facilitate the development of a national examination. As previous studies revealed, evaluating clinical occupational competency based on core competencies in the framework of disciplinary education is not easy. Therefore, based on the perceptions of the KMDs in this study, it is necessary to establish a long-term plan for the systematic flow between the curriculum and evaluation by researching detailed evaluation standards and practices to apply to KMDs with clinical occupational competency.

5. Conclusions

This was the first survey to officially investigate the perceptions of KMDs on the NLE-KMD. More than 1000 KMDs participated, and we were able to identify the items KMDs wanted to improve. Moreover, they emphasized (1) clinical practice including clinical tasks and clinical work performance and (2) KCD-related items. Regarding the KCD, KCD diseases frequently seen in clinical practice and related diagnostic knowledge and skills were considered important. Although there were some discrepancies according to the year of license acquisition and limitations, these results suggest an emphasis on clinical occupational competency.
It is hoped that this study induces future research on educational subjects. This survey was conducted with KMDs who already passed the NLE-KMD, and they were not directly affected by the current KM education. Thus, a further survey on the perceptions of KM college students, as educated subjects, is needed. Each KM college has an academic committee established by students, and through various types of research involving this population, including qualitative research or surveys, a more comprehensive direction of the NLE-KMD should be established. Moreover, an investigation into the perceptions of professors should be conducted. This survey investigated only the general direction and did not check the opinions on each KM college subject. However, this process would help set the direction and development of the future NLE-KMD.

Author Contributions

Conceptualization, Y.K. and E.-J.K.; methodology, J.H. and Y.K.; investigation, H.-B.C. and W.-S.S.; writing—original draft preparation, H.-B.C. and W.-S.S.; writing—review and editing, J.H., Y.K. and E.-J.K.; supervision, E.-J.K.; project administration, E.-J.K.; funding acquisition, E.-J.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the research grant of the Korea Health Personnel Licensing Examination (2022, RE02-2233-03). Funder only provided the financial support and did not in-volve in this article including the review, editing, or the submission for publication.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of Dongguk University Bundang Oriental Hospital (DUBOH 2022-0002).

Informed Consent Statement

Not applicable.

Data Availability Statement

Data are available from the corresponding author upon reasonable request.

Acknowledgments

We thank to Eunbyul Cho, Jaehoon Lee, Hyun Kyung Sung, Sungyoul Choi, Seong-Soo Roh, and Eun-Young Lee for supporting this study.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Park, H.L.; Lee, H.S.; Shin, B.C.; Liu, J.P.; Shang, Q.H.; Yamashita, H.; Lim, B.M. Traditional medicine in China, Korea, and Japan: A brief introduction and comparison. Evid.-Based Complement. Altern. Med. 2012, 2012, 429103. [Google Scholar] [CrossRef] [PubMed]
  2. Wang, F. A Comparative Study on Qualification System of Korean Medicine Doctors and Traditional Chinese Medicine Doctors. HUFS Law Rev. 2021, 45, 455. [Google Scholar]
  3. Kim, G.B. A Study on the 2nd Job Analysis of Oriental Medicine Doctors; Korea Health Personnel Licensing Examination Institute: Seoul, Republic of Korea, 2012; Available online: https://url.kr/gpi9je (accessed on 20 January 2023).
  4. Park, Y.L.; Huang, C.W.; Sasaki, Y.; Ko, Y.; Park, S.J.; Ko, S.G. Comparative Study on the Education System of Traditional Medicine in China, Japan, Korea, and Taiwan. Explore 2016, 12, 375–383. [Google Scholar] [CrossRef] [PubMed]
  5. Korean Association of Medical Colleges. Learning Outcomes of Basic Medical Education: Clinical Competency-Centered, 2nd ed.; Gabwoomunhwa Press Co.: Paju, Republic of Korea, 2016. [Google Scholar]
  6. Yim, M.K. Reforms of the Korean Medical Licensing Examination regarding item development and performance evaluation. J. Educ. Eval. Health Prof. 2015, 12, 6. [Google Scholar] [CrossRef]
  7. Ji, Y.A.; Lee, J.I.; Baek, S.H. Developing a Competency-based Dental Curriculum in Korea. J. Korean Dent. Assoc. 2019, 57, 437–447. [Google Scholar]
  8. Shin, S.J.; Kim, G.S.; Song, J.A.; Lee, I.Y. Development of examination objectives based on nursing competency for the Korean Nursing Licensing Examination: A validity study. J. Educ. Eval. Health Prof. 2022, 19, 19. [Google Scholar] [CrossRef]
  9. Yin, C.S.; Ko, S.G. Introduction to the History and Current Status of Evidence-Based Korean Medicine: A Unique Integrated System of Allopathic and Holistic Medicine. Evid. Based Complement. Alternat. Med. 2014, 2014, 740515. [Google Scholar] [CrossRef] [Green Version]
  10. Huang, L.; Xu, G.; Sun, M.; Yang, C.; Luo, Q.; Tian, H.; Zhou, Z.; Liu, Y.; Huang, F.; Liang, F.; et al. Recent trends in acupuncture for chronic pain: A bibliometric analysis and review of the literature. Complement. Ther. Med. 2023, 72, 102915. [Google Scholar] [CrossRef]
  11. Lee, J.H.; Jung, Y.J.; Yoo, J.H.; Lee, E.J.; Koh, B.H. Perspective of the Human Body in Sasang Constitutional Medicine. Evid. Based Complement. Alternat. Med. 2009, 6 (Suppl. 1), 31–41. [Google Scholar] [CrossRef] [Green Version]
  12. Lim, B.M. Korean medicine coverage in the National Health Insurance in Korea: Present situation and critical issues. Integr. Med. Res. 2013, 3, 81–88. [Google Scholar] [CrossRef] [Green Version]
  13. Costa, D. Diversity and Health: Two Sides of the Same Coin. Ital. Sociol. Rev. 2023, 13, 69–90. [Google Scholar]
  14. Hong, C.D. Complementary and Alternative Medicine in Korea: Current Status and Future Prospects. J. Altern Complement. Med. 2001, 7 (Suppl. 1), S33–S40. [Google Scholar] [CrossRef]
  15. National Health Personnel Licensing Examination Board. Collection of Research 2012 (1999~2011); Korea Health Personnel Licensing Examination Institute: Seoul, Republic of Korea, 2012; Available online: https://vo.la/P1lio4 (accessed on 20 January 2023).
  16. Dewey, J. Democracy and Education: An Introduction to the Philosophy of Education, 1st ed.; Kyoyook Book: Seoul, Republic of Korea, 2007; pp. 227–245. [Google Scholar]
  17. Im, S.J. Strategies for Effective Teaching in Clinical Clerkship. Hanyang Med. Rev. 2012, 32, 51–58. [Google Scholar] [CrossRef] [Green Version]
  18. Institute of Korean Medicine Education and Evaluation. Korean Medicine Education Accreditation Standards 2022; Institute of Korean Medicine Education & Evaluation: Seoul, Republic of Korea, 2022; Available online: https://www.ikmee.or.kr/board5/bbs/board.php?bo_table=02_06&wr_id=9 (accessed on 20 January 2023).
  19. Han, S.Y.; Kim, H.Y.; Lim, J.H.; Cheon, J.H.; Kwon, Y.K.; Kim, H.W.; Yang, G.Y.; Chae, H. The past, present, and future of traditional medicine education in Korea. Integr. Med. Res. 2016, 5, 73–82. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  20. Zavlin, D.; Jubbal, K.T.; Noé, J.G.; Gansbacher, B. A comparison of medical education in Germany and the United States: From applying to medical school to the beginnings of residency. Ger. Med. Sci. 2017, 15, Doc15. [Google Scholar] [PubMed]
  21. Cate, O.T.; Durning, S. Peer teaching in medical education: Twelve reasons to move from theory to practice. Med. Teach 2007, 29, 591–599. [Google Scholar] [CrossRef] [PubMed]
  22. Enarson, C.; Cariaga-Lo, L. Influence of curriculum type on student performance in the United States Medical Licensing Examination Step 1 and Step 2 exams: Problem-based learning vs. lecture-based curriculum. Med. Educ. 2001, 35, 1050–1055. [Google Scholar] [CrossRef]
  23. Dezee, K.J.; Artino, A.R.; Elnicki, D.M.; Hemmer, P.A.; Durning, S.J. Medical education in the United States of America. Med. Teach. 2012, 34, 521–525. [Google Scholar] [CrossRef]
  24. Lee, G.B.; Chiu, A.M. Assessment and feedback methods in competency-based medical education. Ann. Allergy Asthma Immunol. 2022, 128, 256–262. [Google Scholar] [CrossRef]
  25. Gao, P.F.; Watanabe, K. Introduction of the World Health Organization project of the International Classification of Traditional Medicine. Zhong Xi Yi Jie He Xue Bao 2011, 9, 1161–1164. [Google Scholar] [CrossRef]
  26. Lee, Y.S.; Lee, Y.R.; Chae, Y.; Park, S.Y.; Oh, I.H.; Jang, B.H. Translation of Korean Medicine Use to ICD-Codes Using National Health Insurance Service-National Sample Cohort. Evid.-Based Complement. Altern. Med. 2016, 2016, 8160838. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Hua, B.; Abbas, E.; Hayes, A.; Ryan, P.; Nelson, L.; O’Brien, K. Reliability of Chinese medicine diagnostic variables in the examination of patients with osteoarthritis of the knee. J. Altern. Complement. Med. 2012, 18, 1028–1037. [Google Scholar] [CrossRef] [PubMed]
  28. Park, B.K.; Yun, K.J.; Jung, J.Y.; You, S.S.; Lee, J.A.; Choi, J.A.; Kang, B.K.; Alraek, T.; Birch, S.; Lee, M.S. Conceptualization and utilization of blood stasis syndrome among doctors of Korean medicine: Results of a web-based survey. Am. J. Transl. Res. 2014, 6, 857–868. [Google Scholar]
  29. The Society of Sasang Constitutional Medicine. Korean Medicine Clinical Practice Guideline for Cold Hypersensitivity of Hands and Feet; National Institute for Korean Development: Seoul, Republic of Korea, 2021; p. 10. [Google Scholar]
  30. Lam, W.C.; Lyu, A.; Bian, Z. ICD-11: Impact on Traditional Chinese Medicine and World Healthcare Systems. Pharmaceut. Med. 2019, 33, 373–377. [Google Scholar] [CrossRef] [PubMed]
  31. Ren, J.; Li, X.; Sun, J.; Han, M.; Yang, G.Y.; Li, W.Y.; Robinson, N.; Lewith, G.; Liu, J.P. Is traditional Chinese medicine recommended in Western medicine clinical practice guidelines in China? A systematic analysis. BMJ Open 2015, 5, e006572. [Google Scholar] [CrossRef] [Green Version]
  32. Xu, Q.; Bauer, R.; Hendry, B.M.; Fan, T.P.; Zhao, Z.; Duez, P.; Simmonds, M.S.; Witt, C.M.; Lu, A.; Robinson, N.; et al. The quest for modernisation of traditional Chinese medicine. BMC Complement. Altern. Med. 2013, 13, 132. [Google Scholar] [CrossRef] [Green Version]
  33. Smith, L.G. Medical professionalism and the generation gap. Am. J. Med. 2005, 118, 439–442. [Google Scholar] [CrossRef]
  34. Murakami, M.; Matoba, K.; Hyodoh, H.; Takahashi, M. Generation gaps in medical education: An exploratory qualitative study. J. Pak. Med. Assoc. 2021, 71, 1476–1478. [Google Scholar]
  35. Jauregui, J.; Watsjold, B.; Welsh, L.; Ilgen, J.S.; Robins, L. Generational ‘othering’: The myth of the Millennial learner. Med. Educ. 2020, 54, 60–65. [Google Scholar] [CrossRef] [Green Version]
  36. Zemke, R.; Raines, C.; Filipczak, B. Generations at Work; American Management Association: New York, NY, USA, 2000. [Google Scholar]
  37. Kim, D.S.; Chu, H.; Min, B.K.; Moon, Y.J.; Park, S.J.; Kim, K.H.; Park, S.H.; Kim, Y.D.; Song, M.D.; Choi, G.H.; et al. Telemedicine Center of Korean Medicine for treating patients with COVID-19: A retrospective analysis. Integr. Med. Res. 2020, 9, 100492. [Google Scholar] [CrossRef]
  38. Ang, L.; Lee, H.W.; Kim, A.; Lee, M.S. Herbal medicine for the management of COVID-19 during the medical observation period: A review of guidelines. Integr. Med. Res. 2020, 9, 100465. [Google Scholar] [CrossRef] [PubMed]
  39. Jang, S.B.; Kim, D.S.; Yi, E.H.; Choi, G.H.; Song, M.D.; Lee, E.K. Telemedicine and the Use of Korean Medicine for Patients With COVID-19 in South Korea: Observational Study. JMIR Public Health Surveill. 2021, 7, e20236. [Google Scholar] [CrossRef] [PubMed]
  40. Sung, W.S.; Choi, S.K.; Jo, H.R.; Park, S.H.; Lee, S.H.; Lee, Y.J.; Ha, I.H.; Seo, B.K.; Yang, H.C.; Hong, S.U.; et al. A survey of the clinical practice followed by Korean medicine doctors for scoliosis: Preliminary data for clinical practice guidelines. Medicine 2022, 101, e30047. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The process of clustering keyword according to frequency.
Figure 1. The process of clustering keyword according to frequency.
Healthcare 11 01685 g001
Table 1. Characteristics of respondents.
Table 1. Characteristics of respondents.
QuestionClassificationn (%)
The acquisition year of Korean medicine doctor license2018–2022379 (30.47)
2013–2017267 (21.46)
2003–2012336 (27.01)
<2003262 (21.06)
Total1244 (99.9)
The year of clinical experience of Korean medicine083 (6.67)
≤5400 (32.15)
5 < x ≤ 10261 (20.98)
10 < x ≤ 20316 (25.40)
20<184 (14.79)
Total1244 (99.9)
Whether working at educational institutionNoClinical, clinics (director of the clinic or assistant director of the clinic)648 (62.49)
Clinical, hospitals (director, paid-doctor, or specialist at Korean medicine hospital, convalescent hospital, or medical center)182 (17.55)
Clinical, public health doctor or military doctor145 (13.98)
Non-clinical (alternative military service, personal business, parenting, studying other fields)44 (4.24)
Others18 (1.74)
Total1037 (83.36)
YesClinical, hospital affiliated with college of Korean medicine (resident, fellow, professor, others)169 (81.64)
Non-clinical, college of Korean medicine (teaching assistant, researcher, professor, others)38 (18.36)
Total207 (16.64)
Total1244 (100.0)
Table 2. The awareness of the recent changes in the NLE-KMD.
Table 2. The awareness of the recent changes in the NLE-KMD.
QuestionClassificationOFLA
n (%)
UFLA
n (%)
Total (OFLA + UFLA) n (%)p Value
Whether recognizing the recent changes in the NLE-KMDStrongly agree80 (9.25)114 (30.08)194 (15.59)<0.001 *
Agree302 (34.91)225 (59.37)527 (42.36)
Disagree342 (39.54)36 (9.50)378 (30.39)
Strongly disagree141 (16.30)4 (1.05)145 (11.66)
Total865 (100.0)379 (100.0)1244 (100.0)
NLE-KMD: national licensing examination for Korean medicine doctors, OFLA: >5 years of license acquisition, and UFLA: ≤5 years of license acquisition. * Chi-square test.
Table 3. The items to be improved in the NLE-KMD.
Table 3. The items to be improved in the NLE-KMD.
QuestionClassificationOFLA
n (%)
UFLA
n (%)
Total (OFLA + UFLA) n (%)p Value
Which items should be improved regarding the current NLE-KMD?
(Please select within 4 items to prioritize)
Non-essential or memorization questions should be removed from the question bank.484 (14.45)185 (12.72)669 (13.93)<0.001 *
The scope of the various subjects with overlapping questions should be readjusted.292 (8.72)136 (9.35)428 (8.91)
New questions should be updated to reflect a new medical technology.319 (9.53)96 (6.60)415 (8.64)
New questions should be developed based on the Korean medicine clinical practice guideline.423 (12.63)180 (12.38)603 (12.55)
The scope of the examination should be focused on the clinical tasks, not subjects.538 (16.06)229 (15.75)767 (15.97)
The scope of the examination should focus on disease (KCD) that are critical and highly frequent in clinical practice.630 (18.81)260 (17.88)890 (18.53)
Clinical skills test should be introduced to evaluate the clinical work performance.467 (13.94)267 (18.36)734 (15.28)
A variety of forms of new questions should be developed to be used on a computer-based test (CBT).196 (5.85)101 (6.95)297 (6.18)
Total3349 (100.0)1454 (100.0)4803 (100.0)
NLE-KMD: national licensing examination for Korean medicine doctors, OFLA: >5 years of license acquisition, UFLA: ≤5 years of license acquisition, and KCD: Korean standard classification of disease. * Chi-square test.
Table 4. The items to be emphasized in the NLE-KMD.
Table 4. The items to be emphasized in the NLE-KMD.
QuestionClassificationOFLA
(n = 865)
UFLA
(n = 379)
Total (OFLA + UFLA)
(n = 1244)
p Value
Which items should be emphasized first in the NLE-KMD? (Please check with a 10-point Likert scale)Knowledge and its’ application of traditional Korean medicine theories.6.12 ± 2.644.63 ± 2.515.66 ± 2.69<0.001 *
Knowledge and its’ application of biomedical sciences.6.81 ± 2.216.79 ± 2.246.80 ± 2.220.868
Knowledge and communication skill to collaborate with various public health experts.7.36 ± 2.177.76 ± 2.117.48 ± 2.160.001 *
Knowledge and skills in conventional treatments such as acupuncture, moxibustion, and herbal medicines.7.83 ± 2.147.93 ± 2.057.86 ± 2.120.499
Knowledge and skills of medical technology such as pharmacopuncture, chuna, thread-embedding therapy, and new herbal medicinal preparations (e.g., new pharmaceutical preparations).7.30 ± 2.237.72 ± 2.237.43 ± 2.240.001 *
Knowledge and skills in various overseas traditional medicine or complementary and alternative medicine. 5.19 ± 2.344.56 ± 2.395.00 ± 2.37<0.001 **
Knowledge and application of evidence-based Korean medicine (e.g., medical articles).6.97 ± 2.287.31 ± 2.267.07 ± 2.280.008 *
Knowledge and skills regarding the disease (KCD) frequently treated at primary healthcare institutes. 8.06 ± 2.058.36 ± 1.978.15 ± 2.030.006 *
Knowledge and skills related to assessment and diagnosis of diseases (KCD).8.15 ± 2.058.48 ± 2.048.25 ± 2.060.001 *
NLE-KMD: national licensing examination for Korean medicine doctors, OFLA: >5 years of license acquisition, UFLA: ≤5 years of license acquisition, and KCD: Korean standard classification of disease. * Wilcox rank sum test. ** Two-sample t-test.
Table 5. The items to be emphasized in the NLE-KMD related to occupational competency.
Table 5. The items to be emphasized in the NLE-KMD related to occupational competency.
QuestionClassificationOFLA
(n = 865)
UFLA
(n = 379)
Total (OFLA + UFLA)
(n = 1244)
p Value
Overall
(three categories)
Degree of agreement on the following three proposed system (preventive and public health activities/diagnosis and treatment of disease/management of treatment methods).3.74 ± 0.843.76 ± 0.823.75 ± 0.840.868
Each three categoriesPreventive and public health activitiesDisease prevention and health promotion activities.3.98 ± 0.963.83 ± 0.973.93 ± 0.970.007 *
Carrying out social responsibilities.3.70 ± 1.003.67 ± 0.993.69 ± 1.000.540
Public health management.3.66 ± 1.033.78 ± 0.983.70 ± 1.010.112
Diagnosis and treatment of diseaseDiagnosis and treatment of symptomatic disease.4.36 ± 0.814.31 ± 0.884.34 ± 0.830.612
Diagnosis and treatment based on Sasang constitution.3.09 ± 1.112.77 ± 1.132.99 ± 1.12<0.001 **
Diagnosis and treatment based on KCD. 4.32 ± 0.844.50 ± 0.784.37 ± 0.83<0.001 *
Management of treatment methodsManagement of acupuncture and other medical devices.4.10 ± 0.984.15 ± 0.994.11 ± 0.990.246
Management of herbal medications (including medicinal herbs).3.98 ± 1.013.78 ± 1.083.92 ± 1.040.003 *
NLE-KMD: national licensing examination for Korean medicine doctors, OFLA: >5 years of license acquisition, and UFLA: ≤5 years of license acquisition, KCD: Korean standard classification of disease. * Wilcox rank sum test. ** Two-sample t-test.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Cho, H.-B.; Sung, W.-S.; Hong, J.; Kang, Y.; Kim, E.-J. A Survey on Perceptions of the Direction of Korean Medicine Education and National Licensing Examination. Healthcare 2023, 11, 1685. https://doi.org/10.3390/healthcare11121685

AMA Style

Cho H-B, Sung W-S, Hong J, Kang Y, Kim E-J. A Survey on Perceptions of the Direction of Korean Medicine Education and National Licensing Examination. Healthcare. 2023; 11(12):1685. https://doi.org/10.3390/healthcare11121685

Chicago/Turabian Style

Cho, Han-Byul, Won-Suk Sung, Jiseong Hong, Yeonseok Kang, and Eun-Jung Kim. 2023. "A Survey on Perceptions of the Direction of Korean Medicine Education and National Licensing Examination" Healthcare 11, no. 12: 1685. https://doi.org/10.3390/healthcare11121685

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop