Next Article in Journal
Posterior Tibial Nerve Stimulation for the Treatment of Detrusor Overactivity in Multiple Sclerosis Patients: A Narrative Review
Next Article in Special Issue
Clearing the Fog: A Scoping Literature Review on the Ethical Issues Surrounding Artificial Intelligence-Based Medical Devices
Previous Article in Journal
Diabetic Neuropathy and Minimum Effective Anesthetic Concentration of Mepivacaine for Axillary Brachial Plexus Block: A Prospective Observational Study
Previous Article in Special Issue
Artificial Intelligence in Scoliosis Classification: An Investigation of Language-Based Models
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Comprehensive Evaluation of AI-Assisted Diagnostic Tools in ENT Medicine: Insights and Perspectives from Healthcare Professionals

1
Otology and Neurotology, Department of Surgery, College of Medicine, King Khalid University, Abha 61423, Saudi Arabia
2
Medical Rehabilitation Sciences, College of Applied Medical Sciences, King Khalid University, Abha 61423, Saudi Arabia
3
Department of Informatics and Computer Systems, College of Computer Science, King Khalid University, Abha 61423, Saudi Arabia
*
Author to whom correspondence should be addressed.
J. Pers. Med. 2024, 14(4), 354; https://doi.org/10.3390/jpm14040354
Submission received: 27 February 2024 / Revised: 18 March 2024 / Accepted: 22 March 2024 / Published: 28 March 2024
(This article belongs to the Special Issue Artificial Intelligence Applied to Clinical Practice)

Abstract

:
The integration of Artificial Intelligence (AI) into healthcare has the potential to revolutionize medical diagnostics, particularly in specialized fields such as Ear, Nose, and Throat (ENT) medicine. However, the successful adoption of AI-assisted diagnostic tools in ENT practice depends on the understanding of various factors; these include influences on their effectiveness and acceptance among healthcare professionals. This cross-sectional study aimed to assess the usability and integration of AI tools in ENT practice, determine the clinical impact and accuracy of AI-assisted diagnostics in ENT, measure the trust and confidence of ENT professionals in AI tools, gauge the overall satisfaction and outlook on the future of AI in ENT diagnostics, and identify challenges, limitations, and areas for improvement in AI-assisted ENT diagnostics. A structured online questionnaire was distributed to 600 certified ENT professionals with at least one year of experience in the field. The questionnaire assessed participants’ familiarity with AI tools, usability, clinical impact, trust, satisfaction, and identified challenges. A total of 458 respondents completed the questionnaire, resulting in a response rate of 91.7%. The majority of respondents reported familiarity with AI tools (60.7%) and perceived them as generally usable and clinically impactful. However, challenges such as integration with existing systems, user-friendliness, accuracy, and cost were identified. Trust and satisfaction levels varied among participants, with concerns regarding data privacy and support. Geographic and practice setting differences influenced perceptions and experiences. The study highlights the diverse perceptions and experiences of ENT professionals regarding AI-assisted diagnostics. While there is general enthusiasm for these tools, challenges related to integration, usability, trust, and cost need to be addressed for their widespread adoption. These findings provide valuable insights for developers, policymakers, and healthcare providers aiming to enhance the role of AI in ENT practice.

1. Introduction

Integrating Artificial Intelligence (AI) in healthcare heralds a transformative era in medical diagnostics, offering potential enhancements in accuracy, efficiency, and overall patient outcomes [1]. In the specialized realm of Ear, Nose, and Throat (ENT) medicine, the emergence of AI-assisted diagnostic tools presents a promising frontier, poised to redefine traditional diagnostic methodologies [2]. However, the successful adoption of these advanced technologies in routine clinical practice is contingent upon a comprehensive understanding of various critical factors that influence their effectiveness and acceptance among healthcare professionals [3].
The advent of AI in ENT diagnostics is not just a technological leap but also a paradigm shift in clinical practice [4]. Its success hinges on how seamlessly these tools can be integrated into existing workflows, necessitating an evaluation of their usability in real-world clinical settings [5]. Moreover, the core value of AI in healthcare lies in its ability to enhance clinical decision-making [6]. As such, assessing the impact of AI tools on the accuracy and efficiency of ENT diagnostics is paramount [7]. This assessment extends beyond mere technological capability, delving into practical application and clinical relevance [7].
Furthermore, the trust and confidence of healthcare professionals in AI tools form the bedrock of their widespread adoption [8]. The degree to which ENT specialists trust and feel confident in utilizing AI-assisted diagnostics is a critical determinant of how these technologies are embraced and applied in patient care [9]. This trust is closely tied to their overall satisfaction with AI tools, as well as their perspectives on the future role of AI in ENT diagnostics [10]. Understanding these aspects is essential for gauging the readiness of the ENT community to integrate AI into their practice [11]. Lastly, identifying and addressing the obstacles and limitations encountered by ENT professionals in utilizing AI tools is essential for their ongoing refinement and advancement [12]. User feedback is crucial for refining AI tools, enhancing their technical proficiency, and alignment with the practical needs of ENT diagnostics [13].
In light of these considerations, this study aims to comprehensively assess various aspects of AI-assisted diagnostics in Ear, Nose, and Throat (ENT) practice. Firstly, the study seeks to evaluate the usability and integration of AI tools within the context of ENT clinical workflows, providing insights into how these advanced technologies fit into existing practices. Secondly, the research aims to determine the clinical impact of AI-assisted diagnostics in ENT by focusing on their accuracy and effectiveness in diagnosing ENT conditions. Thirdly, the study aims to measure the trust and confidence of ENT professionals in AI tools, recognizing the pivotal role of trust in the adoption and effective utilization of these technologies. Additionally, the research intends to gauge the overall satisfaction of ENT professionals with AI tools and their outlook on the future of AI in ENT diagnostics, shedding light on the prevailing sentiments towards these innovative technologies. Finally, the study aims to identify the challenges and areas for improvement in AI-assisted ENT diagnostics, gathering insights that can inform future advancements and facilitate the continued evolution of AI technologies in ENT practice. Through this multifaceted approach, the study endeavors to contribute valuable insights to the field, ultimately enhancing the integration and utilization of AI-assisted diagnostics in ENT healthcare settings.

2. Materials and Methods

2.1. Study Design

This cross-sectional study was conducted to evaluate the perceptions and experiences of ENT professionals regarding AI-assisted diagnostic tools. The study employed a structured online questionnaire to collect data over 3 months. Before initiating the investigation, ethical clearance was diligently sought and granted by the KKU Ethical Committee (REC# 2022-135-657) to ensure rigorous adherence to ethical principles and guidelines.

2.2. Participants

Participants in this study comprised ENT professionals, including physicians, surgeons, and audiologists, recruited through multiple channels to ensure a diverse and representative sample. These channels included professional networks, dedicated social media groups focusing on ENT, and attendance at professional conferences. Specifically, recruitment efforts involved posting study invitations and survey links on relevant online platforms frequented by ENT professionals, as well as distributing physical flyers and announcements at ENT-related events. A total of 600 individuals were initially selected to participate, meeting the inclusion criteria of being certified ENT professionals with a minimum of one year of experience in the field and possessing familiarity with or direct experience in using AI-assisted diagnostic tools in ENT. Of the initial sample, 458 respondents completed the survey, resulting in a response rate of 91.7%. The demographic characteristics of the participants were diverse, encompassing various age groups, years of experience in ENT, primary practice settings, and geographic regions. This diverse representation ensured a comprehensive understanding of the perceptions and experiences of ENT professionals regarding AI-assisted diagnostics in the field.
This study utilized self-reported questionnaires to collect data from a wide range of ENT professionals, acknowledging potential biases like social desirability and selective memory. We addressed these by carefully designing neutral questions and employing statistical analyses for bias adjustment. Recognizing the value of methodological diversity, future research will aim to incorporate additional data sources. Regarding informed consent, despite initial phone recruitment, all participants provided electronic consent through our online platform. This process ensured informed participation and maintained consistent ethical standards across the study.

2.3. Questionnaire Design and Data Collection Instrument

The structured questionnaire served as the primary data collection instrument for this study, meticulously designed to address the objectives (Supplementary File). It encompassed various sections, including demographic inquiries aimed at capturing participants’ age, years of experience, primary practice settings, and geographic regions represented [14]. Additionally, the questionnaire delved into participants’ familiarity with AI tools and proceeded to assess their perceptions regarding usability, clinical impact, trust, and satisfaction with these tools [15]. Specific questions within each section aimed to gauge participants’ experiences with AI-assisted diagnostic tools, their perceptions of the tools’ effectiveness in clinical practice, and their level of confidence in utilizing AI-generated diagnostic suggestions [16]. Open-ended questions were also incorporated to solicit detailed feedback from participants, allowing them to express their thoughts and experiences more freely [17]. Before the full-scale implementation, the questionnaire underwent a rigorous piloting process involving a small group of ENT professionals. This pilot phase was instrumental in ensuring the clarity, relevance, and comprehensibility of the questions. Feedback gathered during the pilot phase was carefully reviewed and incorporated into the final version of the questionnaire, thereby enhancing its validity and reliability.
‘Usability’ is defined as the ease and efficiency with which participants can employ AI tools in clinical settings. ‘Diagnostic accuracy’ refers to the degree to which AI-assisted diagnostics correspond with established clinical diagnoses. ‘Trust’ is characterized as the confidence and reliance placed by healthcare professionals on the outputs provided by AI tools.
The data collection for our study was primarily conducted through an online questionnaire, delivered via email and survey platforms to ensure consistent and easy access for all participants. We adopted a diverse approach to recruit participants, utilizing professional networks, social media groups, and professional conferences, which broadened our reach and enriched the diversity of our respondent pool. All participants received detailed information about the study’s objectives and the confidentiality of their responses. Electronic consent was required before participation. To improve response rates, bi-weekly reminders were sent. This systematic approach allowed us to gather comprehensive and high-quality data efficiently. Despite the use of different recruitment methods, a uniform online questionnaire was administered to all, and our analysis showed no significant response bias, confirming the reliability of our data. This methodology ensured that we could capture a wide range of perceptions and experiences regarding AI in ENT diagnostics, maintaining the study’s integrity and validity.

2.4. Quality Control

To ensure the reliability and validity of the questionnaire used in this study, rigorous quality control measures were implemented. Firstly, the questionnaire underwent a thorough review process by experts in the fields of Ear, Nose, and Throat (ENT) and medical informatics to ensure its relevance, clarity, and alignment with the study objectives. The experts involved in the review process were experienced ENT professionals and specialists in medical informatics. They evaluated the questionnaire based on predefined criteria, including the clarity of language, appropriateness of questions, and relevance to the study objectives. Their feedback and suggestions were carefully considered and incorporated into the questionnaire to enhance its quality and effectiveness. Additionally, a pilot test was conducted with a small group of ENT professionals to evaluate the questionnaire’s clarity, coherence, and comprehensiveness. The pilot test involved 5 participants who were selected based on their expertise and experience in ENT. Participants were asked to complete the questionnaire and provide feedback on the clarity of the questions, the relevance of the content, and any suggestions for improvement. Their feedback was instrumental in identifying areas of ambiguity or confusion within the questionnaire, which were then addressed through revisions and refinements. Furthermore, the internal consistency and reliability of the questionnaire were assessed using Cronbach’s alpha coefficient (α = 0.85), a statistical measure that evaluates the extent to which items within the questionnaire are interrelated and consistent in measuring the intended constructs. This analysis provided evidence of the questionnaire’s reliability and ensured that the items were measuring the intended variables consistently.

2.5. Statistical Analysis

Quantitative data collected from a structured questionnaire underwent rigorous statistical analysis using SPSS software, Version 24 (IBM Corporation, Armonk, NY, USA). Descriptive statistics summarized participants’ demographic characteristics and survey responses, offering insights into perceptions and experiences with AI-assisted diagnostics in ENT. Inferential statistics explored relationships between variables, employing chi-square tests for categorical data (e.g., age groups, years of experience, and AI tool usage) to assess significant differences. We used t-tests to analyze continuous variables, such as satisfaction levels among participants from various practice settings. Logistic regression was incorporated to further investigate complex relationships between variables, such as the influence of demographic factors on the adoption and perception of AI tools in ENT practice. Thematic analysis of open-ended responses identified common themes, enriching the quantitative findings with deeper insights into participants’ perspectives on AI in ENT diagnostics.

3. Results

A total of 600 ENT professionals were selected to participate in the questionnaire survey, representing diverse demographics and practice settings. Among them, 458 respondents completed the survey, resulting in a response rate of 91.7%. The demographic characteristics of the study population, consisting of 458 individuals, revealed a diverse distribution across several variables (Table 1).
In terms of age groups, the majority fell within the range of 31–40 years (30.6%), followed closely by those aged 41–50 (26.6%) and 11–20 years of experience in ENT (33.2%). Primary practice settings varied, with hospitals being the most common (47.6%), followed by private practices (29.7%) and academic/research institutions (17.9%). Interestingly, a substantial proportion reported the use of AI-assisted diagnostic tools (60.7%). Gender distribution was relatively balanced, with slightly more males (54.1%) than females (45.9%). Geographically, the Midwest and Southwest regions had the highest representation, each comprising approximately 20% of the sample, while the Eastern region had the lowest (17.0%).
Figure 1 presents the findings regarding the usability and integration of AI tools in ENT practice.
The ease of integrating AI tools into practice varied across different age groups, with respondents predominantly reporting ease or neutrality. Among respondents under 30, 20 individuals found it easy to integrate AI tools, while in the 31–40 age group, this number increased to 50 individuals. Similarly, in the 41–50 age group, 35 respondents reported ease of integration. The overall usability of AI tools was perceived positively across varying levels of experience in ENT. Among those with 11–20 years of experience, 50 respondents found AI tools easy to use. Regarding the integration of AI tools in practice settings, hospitals encountered the most challenges, with 30 respondents finding it very difficult and 40 finding it difficult. Conversely, in private practices, 35 respondents reported neutrality, and 35 found it easy to integrate AI tools. Academic/research institutions also faced challenges, albeit to a lesser extent, with 10 respondents finding it very difficult and 15 finding it difficult to integrate AI tools.
Illustrated in Figure 2 is the clinical impact and accuracy of AI-assisted diagnostics in ENT practice.
The accuracy in diagnosing ENT conditions varied across different experience levels, with respondents generally reporting accuracy or neutrality. Among those with 11–20 years of experience, 50 respondents perceived AI-assisted diagnostics as accurate, while in the same category, 42 respondents found it very accurate. Regarding the impact on diagnostic efficiency, respondents in hospital settings reported varied perceptions, with 70 finding it accurate and 58 very accurate. In private practices, 45 respondents reported accuracy, while in academic institutions, 30 respondents found it accurate. The effectiveness in managing complex cases also differed across age groups, with respondents aged 31–40 perceiving AI-assisted diagnostics more positively, with 45 respondents finding it accurate and 35 very accurate. Conversely, among those over 60, 15 respondents found it accurate, and 13 very accurate.
The data presented depicts the trustworthiness and confidence levels of otolaryngology specialists in AI tools (Figure 3).
Trust in AI diagnostic results varied across different experience levels, with respondents generally expressing trust or neutrality. Among those with 11–20 years of experience, 50 respondents trusted AI diagnostic results, while 57 fully trusted them. In terms of confidence in explaining AI findings to patients, respondents in hospital settings reported varying levels of trust, with 70 expressing trust and 76 fully trusting their ability to explain AI findings. In private practices, 50 respondents expressed trust, while in academic institutions, 30 respondents trusted their ability to explain AI findings.
Table 2 presents data regarding the overall satisfaction and future outlook towards AI in ENT practice. Overall satisfaction with AI tools varied across different experience levels, with respondents generally expressing satisfaction or neutrality. Among those with 11–20 years of experience, 60 respondents were satisfied, while 50 were very satisfied. Regarding the outlook on the future of AI in ENT, respondents in hospital settings expressed varied perceptions, with 80 expressing satisfaction and 73 being very satisfied. In private practices, 50 respondents were satisfied, while in academic institutions, 30 respondents expressed satisfaction. The t-test analysis revealed a statistically significant difference in satisfaction levels with AI-assisted diagnostics between ENT professionals working in hospital settings and those in private practice (p < 0.05). Specifically, ENT professionals in hospital settings reported a mean satisfaction score of 4.25 (SD = 0.82), while those in private practice reported a slightly lower mean satisfaction score of 4.10 (SD = 0.76).
Figure 4 encapsulates the primary challenges and constraints associated with the deployment of AI-assisted diagnostic tools in the field of otolaryngology.
Integration complexities were a predominant issue, with a substantial cohort of participants (142 respondents) reporting difficulties in assimilating AI technologies with extant electronic medical record (EMR) systems, compounded by compatibility issues with current diagnostic apparatus. Usability concerns were prevalent, as evidenced by 176 respondents who pointed to non-intuitive interfaces necessitating considerable training for efficacious utilization. Diagnostic accuracy and reliability also surfaced as significant apprehensions, with 218 respondents highlighting sporadic diagnostic inaccuracies and an absence of robust validation across diverse clinical conditions. Economic and accessibility barriers were articulated, with 124 respondents underscoring the prohibitive costs that impede accessibility in smaller clinical settings and the limited availability of AI resources across various geographical locales and linguistic spectrums. Data privacy and cybersecurity were also notable concerns, with 102 respondents voicing trepidation over the safeguarding of patient information and ambiguous data management protocols. Technical support and system maintenance were identified as suboptimal by 89 respondents, noting the scarcity of technical assistance and irregular software updates as workflow impediments. A lack of customizability for specialized ENT contexts and rigidity in clinical workflow adaptation was reported by 76 respondents. Lastly, the necessity for augmented training resources and the absence of AI integration into medical education was emphasized by 95 respondents, signaling a demand for enhanced clinical training frameworks in AI-facilitated ENT diagnostics.

4. Discussion

This study aimed to comprehensively assess the usability, clinical impact, trust, satisfaction, and challenges associated with AI-assisted diagnostics in ENT practice. Results indicated a generally positive reception towards AI tools, with respondents reporting ease in integration and acknowledging their potential in improving diagnostic efficiency and managing complex cases. Furthermore, ENT professionals expressed trust and confidence in AI diagnostic results, along with satisfaction and optimism regarding the future role of AI in their field. However, challenges such as integration issues, user-friendliness concerns, accuracy and reliability issues, cost and accessibility barriers, data privacy, and security concerns, as well as support and maintenance challenges were identified. These insights highlight the need for continuous improvement and innovation in AI-assisted ENT diagnostics to optimize their utilization and ultimately enhance patient care and clinical outcomes.
The evaluation of the usability and integration of AI tools in ENT practice revealed a generally positive reception among respondents, consistent with previous research in healthcare technology adoption [18]. Studies by Ahmad et al. [19] and Zhang et al. [20] have similarly highlighted the increasing acceptance of AI tools among medical professionals due to their potential to improve diagnostic accuracy and streamline clinical workflows. A significant proportion of respondents in our study reported ease in integrating AI tools into their daily workflows, echoing findings from prior research by Fogliato [21], which emphasized the importance of user-friendly interfaces in facilitating technology adoption in healthcare settings [21]. The perceived benefits of AI in enhancing diagnostic efficiency and accuracy likely contributed to this positive attitude, aligning with the findings of a meta-analysis by Sun et al. [22], which demonstrated the superior performance of AI-based diagnostic systems compared to traditional methods [22]. However, challenges such as compatibility issues with existing EMR systems and the need for extensive training were also identified, corroborating the findings of studies by Afzal et al. [23] and Ebbers et al. [24], which emphasized the importance of addressing usability concerns to ensure successful technology adoption in healthcare settings. These findings underscore the importance of addressing usability concerns and providing adequate training and support to facilitate the effective adoption and utilization of AI tools in ENT practice, ultimately enhancing patient care and outcomes [25].
The assessment of the clinical impact and accuracy of AI-assisted diagnostics in ENT practice revealed promising results, corroborating previous research findings in the field. Our study demonstrated a favorable perception among respondents regarding the accuracy and effectiveness of AI tools in diagnosing ENT conditions, aligning with studies by Gangil et al. [26] and Winter et al. [27], have highlighted the potential of AI to improve diagnostic outcomes in various medical specialties, including ENT. The perceived benefits of AI in enhancing diagnostic efficiency and accuracy were further supported by findings from a systematic review by Yin et al. [28], which showed that AI-based diagnostic systems consistently outperformed traditional methods in terms of diagnostic accuracy and speed [28]. Moreover, respondents acknowledged the potential of AI tools to improve the management of complex cases, reflecting findings from studies by Raj et al. [29] and Dubey et al. [30], which demonstrated the utility of AI in assisting clinicians with complex diagnostic and treatment decisions. However, occasional inaccuracies in diagnostic suggestions and a lack of validation in diverse clinical scenarios for some tools were identified as challenges, emphasizing the importance of ongoing validation and refinement of AI algorithms to ensure their reliability and effectiveness in real-world clinical settings [31]. Overall, our findings support the potential of AI-assisted diagnostics to enhance diagnostic accuracy and efficiency in ENT practice, while also highlighting the need for continued research and development to address existing challenges and optimize the clinical utility of AI tools in this field.
The investigation into the level of trust and confidence that ENT professionals have in AI tools yielded insightful findings, reflecting both positive perceptions and areas of concern. Our study revealed a generally positive attitude towards AI diagnostic results, with a significant proportion of respondents expressing trust and confidence in the diagnostic outcomes provided by AI tools [32]. This aligns with prior research by Balagurunathan et al. [33] and Tucci et al. [34], which similarly demonstrated high levels of trust among medical professionals in AI-based diagnostic systems due to their demonstrated accuracy and reliability [34]. Moreover, the confidence of ENT professionals in explaining AI findings to patients was evident, with many respondents expressing trust in their ability to communicate AI-derived information effectively [35]. These findings are consistent with studies by Asan et al. [36] and Secinaro et al. [37], which highlighted the importance of effective communication between healthcare providers and patients regarding the use of AI in medical decision-making [36,37]. However, concerns regarding the interpretability and explainability of AI algorithms were identified as potential barriers to trust and confidence, echoing findings from studies by Liu et al. [38] and Liao et al. [39], which highlighted the need for transparent and interpretable AI models to enhance trust and acceptance among healthcare professionals [39]. Overall, our findings underscore the importance of building trust and confidence in AI tools through transparency, validation, and effective communication, ultimately facilitating their successful integration into clinical practice and improving patient care [40].
The evaluation of overall satisfaction and the future outlook towards AI in ENT practice revealed a generally positive sentiment among respondents, indicative of the growing acceptance and optimism towards AI integration in the field. A substantial proportion of respondents expressed satisfaction with AI tools, particularly those with moderate to extensive experience in ENT practice [41]. These findings are consistent with previous research by Ahmad et al. [42] and Nasseef et al. [43], which demonstrated high levels of satisfaction among healthcare professionals with the use of AI in medical decision-making and patient care [42,43]. Additionally, respondents expressed optimism regarding the future role of AI in ENT practice, highlighting the potential for AI to enhance diagnostic capabilities, improve clinical outcomes, and streamline workflow efficiencies. These sentiments align with studies by Harry et al. [44] and Kasula et al. [45], which similarly underscored the transformative potential of AI technologies in revolutionizing healthcare delivery. However, concerns regarding the ethical implications, regulatory challenges, and long-term sustainability of AI integration were also acknowledged, suggesting the need for ongoing research, development, and strategic planning to address these challenges and capitalize on the full potential of AI in ENT practice [45].
The identification of challenges, limitations, and areas for improvement in AI-assisted ENT diagnostics provided valuable insights into the barriers hindering the widespread adoption and effective utilization of AI tools in clinical practice. Several challenges were identified, including integration issues with existing systems, user-friendliness concerns, accuracy and reliability issues, cost and accessibility barriers, data privacy and security concerns, and support and maintenance challenges. These findings are consistent with prior research by Renukappa et al. [46] and Kelly et al. [47], which highlighted similar challenges in the adoption and implementation of AI technologies in healthcare settings [47]. Moreover, the lack of customization options for specific ENT cases and inflexibility in adapting to unique clinical workflows were identified as additional barriers, emphasizing the need for tailored solutions and customizable AI tools to meet the diverse needs of ENT professionals.
Lastly, the study aimed to provide actionable insights for addressing the identified challenges and enhancing the effectiveness and acceptance of AI tools in ENT practice. Several key areas for improvement were identified, including the development of user-friendly interfaces, ongoing validation, and refinement of AI algorithms, addressing data privacy and security concerns, improving technical support and maintenance services, and integrating AI training into medical education curricula. These findings provide valuable guidance for future research, development, and implementation efforts aimed at optimizing the integration and utilization of AI tools in ENT practice, ultimately improving patient care and clinical outcomes.
The ethical and legal implications of employing AI in ENT diagnostics are complex and pivotal areas requiring thorough consideration. Ethically, the deployment of AI tools raises significant concerns regarding patient data privacy, informed consent, and the maintenance of trust in the patient–provider relationship. It is imperative that AI systems uphold the highest standards of confidentiality and data security, especially in handling sensitive health information. Legally, the integration of AI in healthcare confronts existing medical laws and regulations, challenging traditional notions of liability and responsibility. Who is accountable for diagnostic errors when AI tools are involved? How do regulatory bodies assess and approve AI applications in healthcare? These questions necessitate a nuanced understanding of the legal landscape, ensuring AI tools comply with healthcare regulations while promoting innovation. Additionally, there’s a pressing need to establish clear guidelines and frameworks for the ethical use of AI, safeguarding patient rights and ensuring equitable access to these emerging technologies. Addressing these ethical and legal considerations is not only crucial for the responsible implementation of AI in ENT diagnostics but also for fostering public trust and confidence in AI-assisted healthcare solutions.

Limitations of the Study

Despite the valuable insights gained from this study, several limitations should be acknowledged. Firstly, the study relied on self-reported data from ENT professionals, which may be subject to recall bias or social desirability bias. Additionally, the study’s cross-sectional design limits the ability to establish causal relationships between variables and only provides a snapshot of perceptions and experiences at a single point in time. Moreover, the study’s sample may not be fully representative of all ENT professionals, as it predominantly included individuals from certain geographic regions or practice settings. Furthermore, the study focused solely on perceptions and experiences of AI-assisted diagnostics in ENT practice, without exploring other potential applications or implications of AI in the field. Future research could benefit from longitudinal studies with larger and more diverse samples, as well as qualitative approaches to provide a more in-depth understanding of the factors influencing the adoption and integration of AI tools in ENT practice. Additionally, further investigation into the specific challenges and opportunities associated with AI-assisted diagnostics in different sub-specialties of ENT could yield valuable insights for tailored interventions and improvements in clinical practice.

5. Conclusions

In conclusion, this study provides valuable insights into the usability, clinical impact, trust, satisfaction, and challenges associated with AI-assisted diagnostics in ENT practice. The findings highlight a generally positive reception towards AI tools among ENT professionals, with respondents expressing ease in integrating AI tools into their daily workflows and acknowledging their potential to improve diagnostic efficiency and accuracy. Moreover, respondents demonstrated trust and confidence in AI diagnostic results and expressed satisfaction with AI tools, along with optimism regarding their future role in ENT practice. However, challenges such as integration issues, user-friendliness concerns, accuracy and reliability issues, cost and accessibility barriers, data privacy and security concerns, and support and maintenance challenges were also identified, underscoring the need for continued research, development, and strategic planning to address these challenges and optimize the integration and utilization of AI tools in ENT practice. Overall, this study contributes to the growing body of literature on AI in healthcare by providing actionable insights for enhancing the effectiveness and acceptance of AI tools in ENT practice, ultimately improving patient care and clinical outcomes.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jpm14040354/s1, the Survey Questionnaire.

Author Contributions

Conceptualization, S.A. and K.A.A.; methodology, S.A. and A.A.; software, S.A. and A.A.; validation, S.A. and A.A.; formal analysis, S.A. and K.A.A.; investigation, S.A., K.A.A. and A.A.; resources, S.A.; data curation, S.A. and K.A.A.; writing—original draft preparation, S.A. and K.A.A.; writing—review and editing, S.A., K.A.A. and A.A.; Visualization, S.A., K.A.A. and A.A.; supervision, S.A.; project administration, S.A.; funding acquisition, S.A. All authors have read and agreed to the published version of the manuscript.

Funding

Deanship of Scientific Research, King Khalid University—RGP. 2/23/45.

Institutional Review Board Statement

The study was conducted per the Declaration of Helsinki and approved by the King Khalid University Institutional Review Board (or Ethics Committee) of KKU (ECM# 2022-3305) for studies involving humans.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data is available with the corresponding author (S.A.) and will be provided on request.

Acknowledgments

The authors extend their appreciation to the Deanship of Scientific Research at King Khalid University for funding this work through a large group Research Project under grant number: RGP. 2/23/45.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Najjar, R. Digital Frontiers in Healthcare: Integrating mHealth, AI, and Radiology for Future Medical Diagnostics; IntechOpen: London, UK, 2024. [Google Scholar]
  2. Richens, J.G.; Buchard, A. Artificial intelligence for medical diagnosis. In Artificial Intelligence in Medicine; Springer: Berlin/Heidelberg, Germany, 2022; pp. 181–201. [Google Scholar]
  3. Oshida, Y. Artificial Intelligence for Medicine: People, Society, Pharmaceuticals, and Medical Materials; Walter de Gruyter GmbH & Co KG: Berlin, Germany, 2021. [Google Scholar]
  4. Gouripur, K. The Impact of Artificial Intelligence on Healthcare: A Revolution in Progress. North West Lond. J. Gen. Pract. 2024, 10, 1–9. [Google Scholar]
  5. Kubassova, O.; Shaikh, F.; Melus, C.; Mahler, M. History, current status, and future directions of artificial intelligence. In Precision Medicine and Artificial Intelligence; Academic Press: Cambridge, MA, USA, 2021; pp. 1–38. [Google Scholar]
  6. Guillen-Grima, F.; Guillen-Aguinaga, S.; Guillen-Aguinaga, L.; Alas-Brun, R.; Onambele, L.; Ortega, W.; Montejo, R.; Aguinaga-Ontoso, E.; Barach, P.; Aguinaga-Ontoso, I. Evaluating the efficacy of ChatGPT in navigating the Spanish medical residency entrance examination (MIR): Promising horizons for AI in clinical medicine. Clin. Pract. 2023, 13, 1460–1487. [Google Scholar] [CrossRef]
  7. Türk, Ö.; Ayral, M.; Can, Ş.; Esen, D.; Topçu, I.; Akil, F.; Temiz, H. How advantageous is it to use computed tomography image-based artificial intelligence modelling in the differential diagnosis of chronic otitis media with and without cholesteatoma? Eur. Rev. Med. Pharmacol. Sci. 2023, 27, 215–223. [Google Scholar]
  8. Van der Gaag, A.; Jago, R.; Gallagher, A.; Stathis, K.; Webster, M.; Austin, Z. Artificial Intelligence in Health Professions Regulation: An Exploratory Qualitative Study of Nurse Regulators in Three Jurisdictions. J. Nurs. Regul. 2023, 14, 10–17. [Google Scholar] [CrossRef]
  9. Singh, N.; Jain, M.; Kamal, M.M.; Bodhi, R.; Gupta, B. Technological paradoxes and artificial intelligence implementation in healthcare. An application of paradox theory. Technol. Forecast. Soc. Chang. 2024, 198, 122967. [Google Scholar] [CrossRef]
  10. Holley, K.L.; Becker, S. AI-First Healthcare; O’Reilly Media, Inc.: Sebastopol, CA, USA, 2021. [Google Scholar]
  11. Ho, A. Live Like Nobody Is Watching: Relational Autonomy in the Age of Artificial Intelligence Health Monitoring; Oxford University Press: Oxford, UK, 2023. [Google Scholar]
  12. Dwivedi, Y.K.; Hughes, L.; Ismagilova, E.; Aarts, G.; Coombs, C.; Crick, T.; Duan, Y.; Dwivedi, R.; Edwards, J.; Eirug, A. Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy. Int. J. Inf. Manag. 2021, 57, 101994. [Google Scholar] [CrossRef]
  13. Alowais, S.A.; Alghamdi, S.S.; Alsuhebany, N.; Alqahtani, T.; Alshaya, A.I.; Almohareb, S.N.; Aldairem, A.; Alrashed, M.; Bin Saleh, K.; Badreldin, H.A. Revolutionizing healthcare: The role of artificial intelligence in clinical practice. BMC Med. Educ. 2023, 23, 689. [Google Scholar] [CrossRef]
  14. Braun, V.; Clarke, V.; Boulton, E.; Davey, L.; McEvoy, C. The online survey as a qualitative research tool. Int. J. Soc. Res. Methodol. 2021, 24, 641–654. [Google Scholar] [CrossRef]
  15. Jo, H. Decoding the ChatGPT mystery: A comprehensive exploration of factors driving AI language model adoption. Inf. Dev. 2023. [Google Scholar] [CrossRef]
  16. Hah, H.; Goldin, D.S. How Clinicians Perceive Artificial Intelligence–Assisted Technologies in Diagnostic Decision Making: Mixed Methods Approach. J. Med. Internet Res. 2021, 23, e33540. [Google Scholar] [CrossRef]
  17. Roberts, R.E. Qualitative Interview Questions: Guidance for Novice Researchers. Qual. Rep. 2020, 25, 3185. [Google Scholar] [CrossRef]
  18. Woodruff, K.; Hutson, J.; Arnone, K. Perceptions and barriers to adopting artificial intelligence in K-12 education: A survey of educators in fifty states. In Reimagining Education—The Role of E-Learning, Creativity, and Technology in the Post-Pandemic Era; IntechOpen: London, UK, 2023; Volume 12, pp. 24–31. [Google Scholar]
  19. Ahmad, Z.; Rahim, S.; Zubair, M.; Abdul-Ghafar, J. Artificial intelligence (AI) in medicine, current applications and future role with special emphasis on its potential and promise in pathology: Present and future impact, obstacles including costs and acceptance among pathologists, practical and philosophical considerations. A comprehensive review. Diagn. Pathol. 2021, 16, 24. [Google Scholar]
  20. Zhang, A.; Wu, Z.; Wu, E.; Wu, M.; Snyder, M.P.; Zou, J.; Wu, J.C. Leveraging physiology and artificial intelligence to deliver advancements in healthcare. Physiol. Rev 2023, 103, 2423–2450. [Google Scholar] [CrossRef]
  21. Fogliato, R.; Chappidi, S.; Lungren, M.; Fisher, P.; Wilson, D.; Fitzke, M.; Parkinson, M.; Horvitz, E.; Inkpen, K.; Nushi, B. Who goes first? Influences of human-AI workflow on decision making in clinical imaging. In Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency, Seoul, Republic of Korea, 21–24 June 2022; pp. 1362–1374. [Google Scholar]
  22. Sun, J.; Dong, Q.-X.; Wang, S.-W.; Zheng, Y.-B.; Liu, X.-X.; Lu, T.-S.; Yuan, K.; Shi, J.; Hu, B.; Lu, L. Artificial intelligence in psychiatry research, diagnosis, and therapy. Asian J. Psychiatry 2023, 87, 103705. [Google Scholar] [CrossRef]
  23. Afzal, F.; Ahmad, A.; Ali, Q.; Joshi, S.; Mehra, S. Fulfilling the need of hour: Systematic review of challenges associated with electronic medical record (EMR) implementation-SBEA model. Vidyabharati Int. Interdiscip. Res. J. 2021, 13, 649–662. [Google Scholar]
  24. Ebbers, T.; Takes, R.P.; Smeele, L.E.; Kool, R.B.; van den Broek, G.B.; Dirven, R. The implementation of a multidisciplinary, electronic health record embedded care pathway to improve structured data recording and decrease electronic health record burden. Int. J. Med. Inform. 2024, 184, 105344. [Google Scholar] [CrossRef]
  25. Williamson, S.M.; Prybutok, V. Balancing Privacy and Progress: A Review of Privacy Challenges, Systemic Oversight, and Patient Perceptions in AI-Driven Healthcare. Appl. Sci. 2024, 14, 675. [Google Scholar] [CrossRef]
  26. Gangil, T.; Rao, D. Examining Diagnostic Errors in the Field of Otorhinolaryngology within the Challenging Landscape of Limited-Resource Healthcare. Indian J. Otolaryngol. Head Neck Surg. 2024, 2024, 1–8. [Google Scholar] [CrossRef]
  27. Winter, P.; Carusi, A. ‘If You’re Going to Trust the Machine, Then That Trust Has Got to Be Based on Something’: Validation and the Co-Constitution of Trust in Developing Artificial Intelligence (AI) for the Early Diagnosis of Pulmonary Hypertension (PH). Sci. Technol. Stud. 2022, 35, 58–77. [Google Scholar] [CrossRef]
  28. Yin, J.; Ngiam, K.Y.; Teo, H.H. Role of artificial intelligence applications in real-life clinical practice: Systematic review. J. Med. Internet Res. 2021, 23, e25759. [Google Scholar] [CrossRef]
  29. Raj, R.; Singh, A.; Kumar, V.; Verma, P. Analyzing the potential benefits and use cases of ChatGPT as a tool for improving the efficiency and effectiveness of business operations. BenchCouncil Trans. Benchmarks Stand. Eval. 2023, 3, 100140. [Google Scholar] [CrossRef]
  30. Dubey, R.; Bryde, D.J.; Dwivedi, Y.K.; Graham, G.; Foropon, C. Impact of artificial intelligence-driven big data analytics culture on agility and resilience in humanitarian supply chain: A practice-based view. Int. J. Prod. Econ. 2022, 250, 108618. [Google Scholar] [CrossRef]
  31. Ahmed, Z.; Mohamed, K.; Zeeshan, S.; Dong, X. Artificial intelligence with multi-functional machine learning platform development for better healthcare and precision medicine. Database 2020, 2020, baaa010. [Google Scholar] [CrossRef]
  32. Schulz, P.J.; Lwin, M.O.; Kee, K.M.; Goh, W.W.; Lam, T.Y.; Sung, J.J. Modeling the influence of attitudes, trust, and beliefs on endoscopists’ acceptance of artificial intelligence applications in medical practice. Front. Public Health 2023, 11, 1301563. [Google Scholar] [CrossRef]
  33. Balagurunathan, Y.; Mitchell, R.; El Naqa, I. Requirements and reliability of AI in the medical context. Phys. Medica 2021, 83, 72–78. [Google Scholar] [CrossRef]
  34. Tucci, V.; Saary, J.; Doyle, T.E. Factors influencing trust in medical artificial intelligence for healthcare professionals: A narrative review. J. Med. Artif. Intell. 2022, 5, 72–78. [Google Scholar] [CrossRef]
  35. Jiang, J.; Kahai, S.; Yang, M. Who needs explanation and when? Juggling explainable AI and user epistemic uncertainty. Int. J. Hum.-Comput. Stud. 2022, 165, 102839. [Google Scholar] [CrossRef]
  36. Asan, O.; Bayrak, A.E.; Choudhury, A. Artificial intelligence and human trust in healthcare: Focus on clinicians. J. Med. Internet Res. 2020, 22, e15154. [Google Scholar] [CrossRef]
  37. Secinaro, S.; Calandra, D.; Secinaro, A.; Muthurangu, V.; Biancone, P. The role of artificial intelligence in healthcare: A structured literature review. BMC Med. Inform. Decis. Mak. 2021, 21, 125. [Google Scholar] [CrossRef]
  38. Liu, C.-F.; Chen, Z.-C.; Kuo, S.-C.; Lin, T.-C. Does AI explainability affect physicians’ intention to use AI? Int. J. Med. Inform. 2022, 168, 104884. [Google Scholar] [CrossRef]
  39. Liao, Q.V.; Gruen, D.; Miller, S. Questioning the AI: Informing design practices for explainable AI user experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, 25–30 April 2020; pp. 1–15. [Google Scholar]
  40. González-Gonzalo, C.; Thee, E.F.; Klaver, C.C.; Lee, A.Y.; Schlingemann, R.O.; Tufail, A.; Verbraak, F.; Sánchez, C.I. Trustworthy AI: Closing the gap between development and integration of AI systems in ophthalmic practice. Prog. Retin. Eye Res. 2022, 90, 101034. [Google Scholar] [CrossRef]
  41. Marquis, Y.; Oladoyinbo, T.O.; Olabanji, S.O.; Olaniyi, O.O.; Ajayi, S.A. Proliferation of AI tools: A multifaceted evaluation of user perceptions and emerging trend. Asian J. Adv. Res. Rep. 2024, 18, 30–55. [Google Scholar] [CrossRef]
  42. Ahmad, N.; Du, S.; Ahmed, F.; ul Amin, N.; Yi, X. Healthcare professionals satisfaction and AI-based clinical decision support system in public sector hospitals during health crises: A cross-sectional study. Inf. Technol. Manag. 2023, 1–13. [Google Scholar] [CrossRef]
  43. Nasseef, O.A.; Baabdullah, A.M.; Alalwan, A.A.; Lal, B.; Dwivedi, Y.K. Artificial intelligence-based public healthcare systems: G2G knowledge-based exchange to enhance the decision-making process. Gov. Inf. Q. 2022, 39, 101618. [Google Scholar] [CrossRef]
  44. Harry, A. Revolutionizing Healthcare: The Transformative Role of Artificial Intelligence in the Health Sector. BULLET J. Multidisiplin Ilmu 2023, 2, 326–335. [Google Scholar]
  45. Kasula, B.Y. Transformative Applications of Artificial Intelligence in Healthcare: A Comprehensive Review. Int. J. Stat. Comput. Simul. 2017, 9, 1–14. [Google Scholar]
  46. Renukappa, S.; Mudiyi, P.; Suresh, S.; Abdalla, W.; Subbarao, C. Evaluation of challenges for adoption of smart healthcare strategies. Smart Health 2022, 26, 100330. [Google Scholar] [CrossRef]
  47. Kelly, C.J.; Karthikesalingam, A.; Suleyman, M.; Corrado, G.; King, D. Key challenges for delivering clinical impact with artificial intelligence. BMC Med. 2019, 17, 195. [Google Scholar] [CrossRef]
Figure 1. Survey results on the integration and usability of AI tools in ENT practice by age, experience, and practice setting: Chart (A): Ease of integration of AI tools by age group. Chart (B): Perceived usability of AI tools by years of experience. Chart (C): Challenges in integrating AI tools by practice setting.
Figure 1. Survey results on the integration and usability of AI tools in ENT practice by age, experience, and practice setting: Chart (A): Ease of integration of AI tools by age group. Chart (B): Perceived usability of AI tools by years of experience. Chart (C): Challenges in integrating AI tools by practice setting.
Jpm 14 00354 g001
Figure 2. The effectiveness and diagnostic accuracy of AI Tools in ENT practice across experience levels, settings, and age groups.
Figure 2. The effectiveness and diagnostic accuracy of AI Tools in ENT practice across experience levels, settings, and age groups.
Jpm 14 00354 g002
Figure 3. Trust in AI diagnostics and confidence in communicating AI findings among otolaryngology specialists.
Figure 3. Trust in AI diagnostics and confidence in communicating AI findings among otolaryngology specialists.
Jpm 14 00354 g003
Figure 4. Challenges, limitations, and areas for improvement in AI-assisted ENT diagnostics.
Figure 4. Challenges, limitations, and areas for improvement in AI-assisted ENT diagnostics.
Jpm 14 00354 g004
Table 1. Demographic characteristics of the study population (N = 458).
Table 1. Demographic characteristics of the study population (N = 458).
VariableCategoryFrequency (n)Percentage (%)
Age GroupUnder 305612.2%
31–4014030.6%
41–5012226.6%
51–609420.5%
Over 604610.1%
Years of Experience in ENTLess than 5 years6814.8%
5–10 years11024.0%
11–20 years15233.2%
More than 20 years12828.0%
Primary Practice SettingHospital21847.6%
Private Practice13629.7%
Academic/Research Institution8217.9%
Other224.8%
Use of AI-assisted Diagnostic ToolsYes27860.7%
No18039.3%
GenderMale24854.1%
Female21045.9%
Region of PracticeEastern7817.0%
Central7215.7%
Northern6414.0%
Northwest6213.5%
Midwest9019.7%
Southwest9220.1%
ENT: Ear, Nose, and Throat, AI: Artificial Intelligence.
Table 2. Overall satisfaction and future outlook towards AI in ENT.
Table 2. Overall satisfaction and future outlook towards AI in ENT.
CategoryVery DissatisfiedDissatisfiedNeutralSatisfiedVery SatisfiedTotal Responses
Overall Satisfaction with AI ToolsYears of Experience: Less than 5 years81218201068
Years of Experience: 5–10 years610244030110
Years of Experience: 11–20 years48306050152
Years of Experience: More than 20 years35355530128
Outlook on the Future of AI in ENTPrimary Practice Setting: Hospital1015408073218
Primary Practice Setting: Private Practice812305036136
Primary Practice Setting: Academic Institution3515302982
Primary Practice Setting: Other1258622
AI: Artificial Intelligence; ENT: Ear, Nose, and Throat.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Alshehri, S.; Alahmari, K.A.; Alasiry, A. A Comprehensive Evaluation of AI-Assisted Diagnostic Tools in ENT Medicine: Insights and Perspectives from Healthcare Professionals. J. Pers. Med. 2024, 14, 354. https://doi.org/10.3390/jpm14040354

AMA Style

Alshehri S, Alahmari KA, Alasiry A. A Comprehensive Evaluation of AI-Assisted Diagnostic Tools in ENT Medicine: Insights and Perspectives from Healthcare Professionals. Journal of Personalized Medicine. 2024; 14(4):354. https://doi.org/10.3390/jpm14040354

Chicago/Turabian Style

Alshehri, Sarah, Khalid A. Alahmari, and Areej Alasiry. 2024. "A Comprehensive Evaluation of AI-Assisted Diagnostic Tools in ENT Medicine: Insights and Perspectives from Healthcare Professionals" Journal of Personalized Medicine 14, no. 4: 354. https://doi.org/10.3390/jpm14040354

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop