Next Article in Journal
Factors Associated with Device, Internet and Videoconferencing Use Amongst Individuals with Moderate-to-Severe Traumatic Brain Injury
Previous Article in Journal
Sex Disparities in the Direct Cost and Management of Stroke: A Population-Based Retrospective Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Translation and Validation of Digital Competence Indicators in Greek for Health Professionals: A Cross-Sectional Study

by
Alexandra Karvouniari
1,*,
Dimitrios Karabetsos
2,
Christos F. Kleisiaris
3,
Savvato Karavasileiadou
4,*,
Nadiah Baghdadi
5,
Virginia-Athanasia Kyrarini
6,
Evangelia Kasagianni
7,
Afroditi Tsalkitzi
8,
Maria Malliarou
3 and
Christos Melas
1
1
Department of Nursing, School of Health Science, Hellenic Mediterranean University, 71410 Heraklion Crete, Greece
2
Department of Neurosurgery, University Hospital of Heraklion, 71500 Heraklion Crete, Greece
3
Department of Nursing, University of Thessaly, Gaiopolis, 41500 Larissa, Greece
4
Department of Community Health Nursing, College of Nursing, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
5
Nursing Management and Education Department, College of Nursing, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
6
Department of Mathematics, University of Patras, 26504 Rio, Greece
7
424 General Army Training Hospital, 56429 Thessaloniki, Greece
8
401 General Military Hospital of Athens, 11525 Athens, Greece
*
Authors to whom correspondence should be addressed.
Healthcare 2024, 12(14), 1370; https://doi.org/10.3390/healthcare12141370 (registering DOI)
Submission received: 5 June 2024 / Revised: 5 July 2024 / Accepted: 5 July 2024 / Published: 9 July 2024
(This article belongs to the Section Nursing)

Abstract

:
Background: it is widely accepted that living in the digital transformation era, the need to develop and update new professional skills and tools in health sectors is crucially important. Therefore, this study aimed to explore the reliability and validity of the Digital Competence Indicators tool in assessing the digital skills of Greek health professionals. Methods: in this cross-sectional study, 494 health professionals, including doctors (175) and registered nurses (319) working in four Greek hospitals were recruited and willingly participated using a convenience-sampling method. The original framework of Digital Competence Indicators was translated from English to Greek based on guidelines for cross-cultural adaptation of questionnaires. The validity of the tool was explored using confirmatory factor analysis (CFA) to verify the fit of the model using inductive techniques. The instrument reliability was confirmed using Cronbach’s alpha (α) and McDonald’s Omega coefficients. Results: the reliability was estimated at 0.826 (Cronbach’s-α) and 0.850 (McDonald’s Omega-ω). The indicators of CFA were all calculated within an ideal range of acceptance. Specifically, the CFA comparative fit index produced the following adjustment indices: x2/df = 1.152 (p = 0.037), CFI = 0.997, Lewis index (TLI) = 0.966, and root mean square error of approximation (RMSEA) = 0.018. Conclusions: The present study demonstrated that the Digital Competence Indicator instrument has high reliability, internal consistency, and construct validity and, therefore, it is suitable for measuring digital skills of health professionals.

1. Introduction

The rapid improvement of technology in the health sector results in the development of new skills for professionals and their continuous updating, which will allow the meeting of contemporary demands [1]. While managing the recent pandemic COVID-19, one of the biggest challenges has been to ensure that health workers have sufficient capabilities and skills to meet the digital demands of healthcare. Weaknesses in health professionals were identified and skills shortages were highlighted [2], especially in digital skills that are considered necessary to respond to the challenges of today’s Digital Revolution through medical diagnosis, decision-making and identification of processes and available resources [3]. Digital competence is a mix of skills, capabilities and behaviors, which health professionals need to develop in order to integrate information technology into their professional careers and improvement [4,5].
Assessing the digital skills of professionals working in the field of health is therefore a need and requirement, while the literature supports the view that existing measurement tools prove particularly poor. In mapping the scientific field, we identified validated tools that have been used in studies such as the Digi-HealthCom [6,7], the e-HEALS tool [8], the Canadian Nurse Informatics Competency Assessment Scale [9], the Pre-test for Attitudes Towards Computers in Healthcare Assessment tools, the Multicomponent Assessment of Computer Literacy [9,10], the Awareness, Knowledge, Attitude, and Skills tool [11], the Health Literacy Questionnaire [12], and the Digital Health Literacy Instrument [13,14]. However, these instruments were designed more to evaluate healthcare professionals’ beliefs and digital literacy than to measure their digital skills. It is worth noting that the majority of researchers focus on studying specific areas for digital skills: for example, digital skills required in digital applications [6,15], digital skills and telemedicine awareness [16], digital skills and correlation with digital stress in psychiatric hospitals [17], and digital skills related to clinical practice nurses [18], using the corresponding measurement scales.
In Greece, to the best of our knowledge, there are no competence-related tools available to assess digital skills of healthcare professionals or, in fact, for workers in a hospital environment including all health professionals and not only specific specialties such as, for example, nurses or physiotherapists, etc. Given the workload that characterizes Greek hospitals due to understaffing of health personnel, the extraneous duties that health workers are charged with, due to a lack of other non-health specialties, and the mostly negative attitude of staff to participate in surveys due to lack of time, we wanted to use a measurement tool that is easy to understand, short to complete, suitable for all health professionals, and which is able to assess the levels of necessary digital skills in their entirety.
Taking into account the particularities of the Greek National Healthcare System, as well as the possibility given by the Digital Competence framework to analyze its structure in distinct dimensions depending on the points of interest [4], we chose to use this framework for our research. Thus, it was possible to isolate from the framework the competency domains and their available indicators, which provide a more simplified overview of the framework, which can be used as a measuring scale in this research. Within a framework, we consider providing an effective validity of the Digital Competence Indicators (domain) to fill this gap. The selection of the tool was based on the fact that it captures digital skills in specific activities and practices, is based on the main ideas of the framework, is comprehensible and concise, and, finally, it seems to better reflect the Greek data. Consequently, the present study aims to translate and validate the selected instrument into the Greek language and test it among health professionals in Greece to measure their digital competences.

2. Materials and Methods

2.1. Study Design

This study took place in two stages in a cross-sectional design. During the 1st phase, an extensive literature review was carried out in order to search for methods that have been used to measure digital skills. The used methods include surveys that require the use of the internet or online applications, surveys through self-assessment of digital skills and performance tests in controlled environments [19]. We chose to use a questionnaire because of the strong points of this method, such as the ability to present a large number of questions on a wide range of skills in a short period of time, simple scoring, quick processing, cost-effectiveness and cost efficiency [20]. The international literature was then searched for the selection of the instrument as well as its translation and cultural adoption. The second phase includes the statistical processing we performed in order to validate the measurement tool.
This study is a part of the research activities of the Nursing Department of the Hellenic Mediterranean University and, therefore, was ethically approved by the Review Board protocol number (IRB 4634/29-03-2021). Before conducting the study, all necessary permissions were obtained from the respective services and, specifically, by the Scientific Committees of all participating hospitals (protocol No: 5584/1973/26-06-2021). Data collection was carried out in the form of a self-assessment questionnaire, which was voluntarily completed by the participants. Access to the questionnaires was the responsibility of the principal investigator, while the use of the data was carried out exclusively for the research. During the conducting of the study, all ethical principles governing scientific research were observed. The procedures and purpose of the research were explained to the participants, their assent and consent was obtained, and anonymity was respected, as well as the right to voluntarily withdraw from the research at any time.
All those involved in the process of collecting and processing research data are bound by the obligation to comply with the provisions of the General Data Protection Regulation of the European Union (679/2016) for the protection of personal data [21]. Furthermore, the research was conducted in accordance with the Declaration of Helsinki and the elements described by the Code of Ethics for Nurses developed by the ICN (International Council of Nurses, Geneva, Switzerland, 2021) were applied [22].

2.2. Participants and Settings

The sample of the study is representative of doctors and registered nurses from four Greek tertiary-care hospitals. Specifically, 251 Hellenic Air Force General Hospital and Athens Naval Hospital in terms of the military, and Asklepieio Voulas General Hospital and Henry Dunant Hospital Center in terms of the civilian hospitals. The minimum sample size for Confirmatory Factor Analysis was calculated as equal to 289, according to R package lavaan [23]. Participation in the research presupposed the fulfillment of certain criteria, namely, (a) the participants had to work in the hospital with the professional status of doctor or nurse, (b) the nurses had to be registered nurses (European Qualification Framework—EQF 6), and (c) the participants had to be willing to take part in the research. Exclusion criteria from the study were the following: (a) students in hospitals, (b) practitioner nurses (EQF 5), and (c) health professionals with specialties other than doctors and nurses. No subjects were excluded from the study, as all met the criteria we set.
We recruited the sample from different types of hospital units during their staff meetings. Access to the participants was a responsibility of the principal investigator, while the use of the data was carried out exclusively for the purposes of the research. Consent was obtained from all participants, after receiving explanations of the objectives of this study as well as clarifications for completing the questionnaire from researchers. In addition, all participants were informed that they could withdraw from the study at any time. The time period for data collection lasted from June through September 2021, using the convenience sampling method.

2.3. Instrument

As a tool for the study, we used a questionnaire which, in the first part, includes questions about the demographics of the participants and, in the second part, questions on the self-assessment of health professionals’ computer skills.
The European Union, wanting to create a common umbrella of digital competencies for its citizens, created the European Digital Competence Framework, commonly referred to as DigComp [24,25]. DigComp includes five dimensions and its structure can be quite complex, but, because of this complexity, we were able to isolate the domains of interest, specifically the competence areas with their respective indicators. Thus, the original text with the available competency indicators was translated from English to Greek.
In this light, 26 items were chosen, so that each skill is signified by one item. The skills are divided into five competency categories that refer to information, communication, content creation, problem-solving and security. Health professionals are asked to choose the item that reflects the degree to which they use computers for each activity, following a Likert scale consisting of five points, ranging from 1, representing not at all, to 5, representing very much.
In addition, for the tool’s external validation, the variables that can be studied for their correlation with the levels of digital skills were sought through the literature review. The results of the review indicate that factors associated with levels of digital skills are age [26,27,28,29], type of profession [26], gender [28,29], professional experience [26,27], and educational level [28,29]. However, it is worth noting that, although studies show that demographic factors indicate a large number of non-significant determinants, they do emerge as important factors for technical and informational digital skills with high frequency [27]. In this context, the questionnaire included 11 items related to demographic information of the research population. The sociodemographic variables were the following: gender, age, education level, profession, specialty, faculty, department of the working hospital, duration of the specific profession in years, period of work in the specific hospital in years, duties in an administrative position and possession of a computer literacy certificate.

2.4. Translation Procedure

A translation procedure and a cultural adoption of the digital skills scale were performed, according to the cross-cultural adaptation of self-report measure guidelines [30]. The term “cross-cultural adaptation” includes a process that can be used when a questionnaire is prepared for use in a different setting, in order to address issues of linguistic as well as cultural adaptation. The method described by Beaton et al. recognizes a total of six stages: (a) initial translation, (b) synthesis of the translations, (c) back translation, (d) pre-final form, (e) pre-testing and (f) final form [31].
At stage 1, two translations from the original language (English) to the target language (Greek) were carried out by two bilingual translators, in particular, by a medical doctor with experience in translating medical books written in English and by a ministry administrative officer with professional experience in managing English documents.
In the next stage, results of the previous translations were composed by the two translators and a common translation was produced. Subsequently, the common translation was back-translated by a third translator, this time from Greek to English. This person was a Greek medical doctor, translator and author of Greek and English books (stage 3). The specific stage is a validation process to confirm that the content of the translated version reflects content identical to that of the original version.
During the fourth stage of the process, the three translators, in collaboration with three other researchers (a medical doctor and two registered nurses with excellent knowledge of English) compared the back-translation form with the original one. After completing a review of the translations that resulted from the above stages, these six translators, after collaborating, came up with the unification of the scale, forming its pre-final form.
The fifth stage was pre-testing the scale before it took its final form. The trial was carried out on 30 healthcare professionals (medical doctors and registered nurses working in hospitals), to whom the scale was distributed in order to explore the understanding of its data and to identify possible incomprehensible expressions that may have influenced the collection of the study’s primary data.
Following the above steps, the final form of the scale was agreed upon by the translators as the last phase in the translation procedure. In essence, this is the result of all the iterations described above. The few differences found among all the forms of the scale that resulted from the mentioned stages led to the last arrangements of the Greek translation, for which all the translators involved collaborated. Through the final stage, the whole process was checked to verify that the recommended steps mentioned in the guidelines for the intercultural process used to adapt a questionnaire had been respected.
It should be noted that although the procedure performed provides some qualitative index of content validity as well as some useful information about how the individual interprets the scale items, it does not offer a valid and reliable measure of the scale, which is performed with additional tests throughout further statistical analysis.

2.5. Data Analysis

Data were analyzed with IBM SPSS (Statistical Package for Social Sciences) version 25 software and Jamovi software (version 2.4.11), which is a free, open-source, standalone software offering a point-and-click interface for R scripts. We used descriptive statistics to characterize subjects, as well as the scale distribution of DigComp scores. Numbers and percentages were used to express categorical variables, and mean standard deviation was used to express continuous variables.
Evaluation of the construct validity of the measurement tool was carried out using factor analysis. Confirmatory factor analysis (CFA) was used to verify the fit of the model to the population under study. As our hypothesis is based on a framework, CFA determines which variables will be related to which factors, as well as which factors will be related to each other. In all analyses, model fit was evaluated with standard indices of model fit, namely the comparative fit index (CFI), standardized root means square residual (SRMR), and root mean square error of approximation (RMSEA). A CFI index greater than 0.90 is acceptable, and greater than 0.95 is desirable. The RMSEA index takes values between 0 and 1, where a value of 0 indicates that the model exhibits perfect fit. The RMSEA should be less than 0.08. The significance level for accepting or rejecting the hypotheses was set at a p coefficient of 0.05. Finally, the index SRMR should be <0.08.
Instrument reliability, which refers to the measurement results of a scale rather than the scale itself, was based on internal consistency in order to evaluate the homogeneity of the scale’s questions [32]. Cronbach’s alpha (α) and McDonald’s Omega (ω) coefficients were used to define the internal consistency validity of the digital skills scale. We chose to use Cronbach’s alpha index, as it is a measure of reliability, widely used in many research studies to objectively measure the reliability of a measurement tool. In the case of developing a new measurement scale, reliability coefficient values exceeding 0.7 are usually considered acceptable and indicate that the items exhibit interdependence and homogeneity with respect to the scale being measured. Values above 0.80 are desirable and acceptable for clinical applications [33].

3. Results

3.1. Participants’ Characteristics

The sample was composed of medical doctors and registered nurses from two military and two civilian hospitals. Out of the total of 494 participants, 291 were female (58.9%) and 203 (41.1%) were male. Their mean age was 38.7 (10.04). Table 1 presents the demographic profile of the study participants. A total of 175 (35.43%) participants were medical doctors and 319 (64.57%) were registered nurses. Overall, 297 (60.12%) had only a BSc degree, while 166 (33.6%) had, in addition, an MSc degree and 31 (6.28%) a PhD degree. In addition, Table 2 shows the distribution of responses for each scale item expressed in percentages. Finally, Table 3 lists the results of the correlations between the subscales of the measurement tool. No statistically significant correlation was found between the subscales of the questionnaire.

3.2. Construct Validity

From the validation of the factorial structure performed by CFA, a five-factor model was conducted. Table 4 and Table 5 list the results obtained from the construct validity, all of which are within acceptable limits. The fit indices resulting from the CFA are as follows: χ2/df = 1.152 (p = 0.038), comparative fit index (CFI) = 0.997, Tucker–Lewis index (TLI) = 0.966, and root mean square error of approximation (RMSEA) = 0.018. These excellent results for all calculations indicate that the construction of the 5-factor measurement scale which we proposed for healthcare professionals could be accepted.

3.3. Reliability

With respect to scale reliability, the following Cronbach’s alpha values were observed: the Cronbach’s alpha value for all items of the scale was 0.823, as well as greater than 0.7 for each item of the scale separately (Table 6). More specifically, the Cronbach’s alpha value was 0.950 for factor 1 (Information), 0.949 for factor 2 (Communication), 0.956 for factor 3 (Content creation), 0.966 for factor 4 (Problem-solving), and 0.920 for factor 5 (Safety), as shown in more detail in Table 7.

4. Discussion

In this study, we demonstrate that the concepts incorporated in the measurement tool can be applied to the health staff of Greek hospitals, representing a validated and objective tool to measure digital skills for health professionals, which is considered beneficial and necessary. It is worth mentioning that we found no studies conducted on health professionals using DigComp worldwide to compare our results.
In contrast to our study, which validates a tool that measures the digital skills of health professionals, other studies validate tools that measure digitalization skills and digital health [34], electronic health literacy levels [8], information technology, and computer skills [16] of health professionals. Also, while our measurement tool focused on digital skills per se, other tools measure the digital skills required for certain specialized digital technologies such as telemedicine [12,35] and digital applications [15]. Regarding the specialty of health professionals to which the measurement tool is addressed, our tool is addressed to both doctors and nurses. The literature mentions several tools specific to nurses such as the Canadian Nurse Informatics Competency Assessment Scale [9], tools for the digital skills of clinical practice nurses [18], the Nursing Informatics Competency-Based Assessment for Nursing Personnel in Primary Healthcare [36], and the Nursing Informatics Competency Assessment Tool [37].
However, studies that used a very similar instrument to the one in the present study, as regards the digital skills of health professionals, have shown comparative results. In particular, e-health competence does not only depend on personal digital skills, but also on the development of new work processes and practices [38]; teaching digital literacy skills can be performed through didactic and experiential approaches [39], while internet use and e-health literacy of health care professionals seems to be significantly good [26]. Information literacy and digital competence are considered essential for managing the volume of information available [40].
As a result of our research, we could find only a few surveys carried out in Greece among health professionals which investigate the digital skills between doctors and nurses and the differences in their levels. To the best of our knowledge, the general findings are that doctors, compared to nurses, have higher levels of knowledge in topics that require digital skills, such as big data [41], as well as knowledge about the use of Information and Communication Technologies in the field of their work [42].
Further studies focus on the critical role that education and learning digital skills play. Special emphasis is placed on training health professionals, due to their modest levels of technological skills [43], training undergraduate healthcare students for both the safe and effective use of electronic patient records [44], and for the development of digital literacies in general [45]. The majority of researchers stress the need to integrate the learning of digital skills into the curriculum of healthcare professionals [46], as well as continuing education in the healthcare workplace [47]. Likewise, some indicate that teaching computer programming to hospital doctors and nurses is possible, providing them with an introductory skill level [48], while the development of an online learning resource appears to be useful [48].
Moreover, the data studied reveal that digital skills are directly related to both policy-making and educational planning of health professionals. This fact is vital for a society that is within the Knowledge Society. Thus, taking into consideration the existing relevant studies, testing new tools that prove to be valid and reliable, as well as relevant for the study of digital skills in the field of health, can be useful. In addition, these tools need to be adapted to the context in which they are used.

4.1. Future Implications

We believe that the questionnaire of the current research is a reliable and valid measurement tool which will be useful and can be easily used in future research studies. It can also be tested in other health professional specialties besides doctors and nurses, such as pharmacists, physiotherapists, etc., as well as proving useful in other countries with similar hospital environments to those of Greece. The results of these studies may prove particularly beneficial for health policy makers who make decisions about measures and interventions needed to provide quality healthcare services, such as improving the digital skills of health personnel.
Additionally, the tool used is a starting point for the development of similar tools that can be used by health professionals. Perhaps the greatest challenge facing any healthcare system is finding ways to adapt to the growing pace of change. What can be done for patients is also changing, with the development of new and advanced technological interventions. Some of them require new skills. Health professionals play a crucial role in meeting these challenges through the many decisions they make about diagnosing and treating patients and determining both the procedures and the resources that will be used.

4.2. Limitations

The present study is affected by some limitations. First, the participants were intentionally sampled from hospitals in the prefecture of Attica and not from hospitals located in the wider region of Greece, and, therefore, the above restriction may affect the generalization of the results. Second, in the measurement tool test, the participating nurses were all registered nurses (European Qualification Framework—EQF 6) and not practitioner nurses (EQF 5), and thus this tool is validated and reliable only for professional nursing staff. Third, the participants self-assessed, and as the questionnaire is a measurement method that carries the risk of subjectivity, this may lead to an overestimation or underestimation of the skills possessed by the study population.

5. Conclusions

In conclusion, the current research revealed that the study questionnaire based on the DigComp framework seems to be a proven reliable and valid instrument, usable to investigate the digital skills of healthcare professionals. This self-assessment, easy-to-use instrument can be completed quickly and seems to provide a brief and effective assessment of the digital skills of hospital doctors and nurses. It is planned to be used by the researchers of this article in a larger population sample to investigate the digital skill levels of health professionals in other military and civilian hospitals, as well as the factors associated with them. Similarly, it can be used in the future by other researchers as a tool that fulfills quite strong characteristics. In the hospital environment, dominated by an increased workload and minimal time available for consultations, the short completion time of an instrument is crucial. Overall, the results of the present study demonstrate that the concepts incorporated in the questionnaire can be feasibly applied to Greek health professionals.

Author Contributions

Conceptualization, A.K. and C.M.; methodology A.K., C.F.K. and C.M.; validation, A.K., C.F.K., M.M. and C.M.; formal analysis, S.K., N.B. and V.-A.K.; investigation, data curation, A.K., E.K., A.T. and C.M.; writing—original draft preparation, A.K.; writing—review and editing, A.K., D.K., C.F.K., S.K., N.B., V.-A.K., E.K., A.T. and C.M.; supervision, C.M., D.K., M.M. and C.F.K. All authors have read and agreed to the published version of the manuscript.

Funding

This study was funded by the Princess Nourah bint Abdulrahman University Researchers, Supporting Project number (PNURSP2024R293), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.

Institutional Review Board Statement

This study was ethically approved by the Hellenic Mediterranean University Ethics Committee (Nursing Department’s Executive Board 4634/29-03-2021).

Informed Consent Statement

The research procedures were explained to the participants and their consent was obtained.

Data Availability Statement

The data that support the findings of the present study are available on request from the corresponding author.

Acknowledgments

The authors express their gratitude to Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.

Conflicts of Interest

All authors declared no conflict of interest with other person or organization that might influence the work of this study.

References

  1. Commission of the European Communities. Green Paper on the European Workforce for Health. In Human Resources for Health; Commission of the European Communities: Brussels, Belgium, 2008; p. 14. [Google Scholar]
  2. Morris, M.E.; Brusco, N.K.; Jones, J.; Taylor, N.F.; East, C.E.; Semciw, A.I.; Edvardsson, K.; Thwaites, C.; Bourke, S.L.; Raza Khan, U.; et al. The Widening Gap between the Digital Capability of the Care Workforce and Technology-Enabled Healthcare Delivery: A Nursing and Allied Health Analysis. Healthcare 2023, 11, 994. [Google Scholar] [CrossRef] [PubMed]
  3. Dubois, C.-A.; Nolte, E.; McKee, M. Human Resources for Health in Europe. Eur. Obs. Health Syst. Policies Ser. 2006, 12, 1–12. [Google Scholar]
  4. Janssen, A.J.; Stoyanov, S. Online Consultation on Experts’ Views on Digital Competence; Publications Office of the European Union: Luxembourg, 2012. [Google Scholar] [CrossRef]
  5. Cantabrana, J.L.L.; Rodríguez, M.U.; Cervera, M.G. Assessing Teacher Digital Competence: The Construction of an Instrument for Measuring the Knowledge of Pre-Service Teachers. J. New Approaches Educ. Res. 2019, 8, 73–78. [Google Scholar] [CrossRef]
  6. Jarva, E.; Oikarinen, A.; Andersson, J.; Tomietto, M.; Kääriäinen, M.; Mikkonen, K. Healthcare Professionals’ Digital Health Competence and Its Core Factors; Development and Psychometric Testing of Two Instruments. Int. J. Med. Inform. 2023, 171, 104995. [Google Scholar] [CrossRef] [PubMed]
  7. Jarva, E.; Oikarinen, A.; Andersson, J.; Pramila-Savukoski, S.; Hammarén, M.; Mikkonen, K. Healthcare Professionals Digital Health Competence Profiles and Associated Factors: A Cross- Sectional Study. J. Adv. Nurs. 2024; 1–17, 7. [Google Scholar]
  8. Kritsotakis, G.; Andreadaki, E.; Linardakis, M.; Manomenidis, G.; Bellali, T.; Kostagiolas, P. Nurses’ Ehealth Literacy and Associations with the Nursing Practice Environment. Int. Nurs. Rev. 2021, 68, 365–371. [Google Scholar] [CrossRef] [PubMed]
  9. Kleib, M.; Nagle, L. Development of the Canadian Nurse Informatics Competency Assessment Scale and Evaluation of Alberta’s Registered Nurses’ Self-Perceived Informatics Competencies. CIN Comput. Inform. Nurs. 2018, 36, 350–358. [Google Scholar] [CrossRef] [PubMed]
  10. Longhini, J.; Rossettini, G.; Palese, A. Digital Health Competencies Among Health Care Professionals: Systematic Review. J. Med. Internet Res. 2022, 24, e36414. [Google Scholar] [CrossRef] [PubMed]
  11. Gürdaş Topkaya, S.; Kaya, N. Nurses’ Computer Literacy and Attitudes towards the Use of Computers in Health Care. Int. J. Nurs. Pract. 2015, 21, 141–149. [Google Scholar] [CrossRef]
  12. Dijkman, E.M.; ter Brake, W.W.M.; Drossaert, C.H.C.; Doggen, C.J.M. Assessment Tools for Measuring Health Literacy and Digital Health Literacy in a Hospital Setting: A Scoping Review. Healthcare 2023, 12, 11. [Google Scholar] [CrossRef] [PubMed]
  13. van der Vaart, R.; Drossaert, C.D. Development of the Digital Health Literacy Instrument: Measuring a Broad Spectrum of Health 1.0 and Health 2.0 Skills. J. Med. Internet Res. 2017, 19, e27. [Google Scholar] [CrossRef]
  14. Shudayfat, T.; Hani, S.B.; Al Qadire, M. Assessing Digital Health Literacy Level among Nurses in Jordanian Hospitals. Electron. J. Gen. Med. 2023, 20, em525. [Google Scholar] [CrossRef] [PubMed]
  15. Qin, S.; Zhang, J.; Sun, X.; Meng, G.; Zhuang, X.; Jia, Y.; Shi, W.-X.; Zhang, Y.-P. A Scale for Measuring Nursing Digital Application Skills: A Development and Psychometric Testing Study. BMC Nurs. 2024, 23, 366. [Google Scholar] [CrossRef] [PubMed]
  16. Elhadi, M.; Elhadi, A.; Bouhuwaish, A.; Bin Alshiteewi, F.; Elmabrouk, A.; Alsuyihili, A.; Alhashimi, A.; Khel, S.; Elgherwi, A.; Alsoufi, A.; et al. Telemedicine Awareness, Knowledge, Attitude, and Skills of Health Care Workers in a Low-Resource Country during the COVID-19 Pandemic: Cross-Sectional Study. J. Med. Internet Res. 2021, 23, e20812. [Google Scholar] [CrossRef] [PubMed]
  17. Golz, C.; Peter, K.A.; Müller, T.J.; Mutschler, J.; Zwakhalen, S.M.; Hahn, S. Technostress and Digital Competence Among Health Professionals in Swiss Psychiatric Hospitals: Cross-Sectional Study. JMIR Ment. Health 2021, 8, e31408. [Google Scholar] [CrossRef] [PubMed]
  18. Golz, C.; Hahn, S.; Zwakhalen, S.M.G. Content Validation of a Questionnaire to Measure Digital Competence of Nurses in Clinical Practice. CIN Comput. Inform. Nurs. 2023, 41, 949–956. [Google Scholar] [CrossRef] [PubMed]
  19. van Deursen, A.J.; Helsper, E.; Eynon, R. Measuring Digital Skills: From Digital Skills to Tangible Outcomes Project Report; University of Twente: Enschede, The Netherlands, 2014. [Google Scholar]
  20. Kuhlemeier, H.; Hemker, B. The Impact of Computer Use at Home on Students’ Internet Skills. In Computers and Education; Elsevier: Amsterdam, The Netherlands, 2007; pp. 460–480. [Google Scholar] [CrossRef]
  21. Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016. Off. J. Eur. Union 2016, 679, 2016.
  22. Janssen, J.; Stoyanov, S. Luxembourg:International Council of Nurses. In The ICN Code of Ethics for Nurses: Revised 2021; International Council of Nurses: Geneva, Switzerland, 2021. [Google Scholar]
  23. Rosseel, Y. Lavaan: An R Package for Structural Equation Modeling. J. Stat. Softw. 2012, 48, 1–34. [Google Scholar] [CrossRef]
  24. Ferrari, A. DIGCOMP: A Framework for Developing and Understanding Digital Competence in Europe; Publications Office of the European Union: Brussels, Belgium, 2013. [Google Scholar] [CrossRef]
  25. Kluzer, S.; Priego, L.P. DigComp into Action: Get Inspired, Make It Happen. A User Guide to the European Digital Competence Framework; Publications Office of the European Union, EU: Brussels, Belgium, 2018. [Google Scholar] [CrossRef]
  26. Shiferaw, K.B.; Mehari, E.A. Internet Use and Ehealth Literacy among Health-Care Professionals in a Resource Limited Detting: A Cross-Sectional Survey. In Advances in Medical Education and Practice; Dovepress; New York, NY, USA, 2019; pp. 563–570. [Google Scholar] [CrossRef]
  27. Rodríguez, M.U.; Cantabrana, J.L.L.; Cervera, M.G. Validation of a Tool for Self-Evaluating Teacher Digital Competence. Educ. XX1 2021, 24, 353–373. [Google Scholar] [CrossRef]
  28. Osei Asibey, B.; Agyemang, S.; Boakye Dankwah, A. The Internet Use for Health Information Seeking among Ghanaian University Students: A Cross-Sectional Study. Int. J. Telemed. Appl. 2017, 2017, 1756473. [Google Scholar] [CrossRef]
  29. Van Laar, E.; Van Deursen, A.J.A.M.; Van Dijk, J.A.G.M.; De Haan, J. Determinants of 21st-Century Skills and 21st-Century Digital Skills for Workers: A Systematic Literature Review. SAGE Open 2020, 10, 2158244019900176. [Google Scholar] [CrossRef]
  30. Beaton, D.E.; Bombardier, C.; Guillemin, F.; Ferraz, M.B. Guidelines for the Process of Cross-Cultural Adaptation of Self-Report Measures. Spine 2000, 25, 3186–3191. [Google Scholar] [CrossRef] [PubMed]
  31. Helminen, S.E.; Vehkalahti, M.; Ketomäki, T.M.; Murtomaa, H. Dentists’ Selection of Measures for Assessment of Oral Health Risk Factors for Finnish Young Adults. Acta Odontol. Scand. 1999, 57, 225–230. [Google Scholar] [CrossRef] [PubMed]
  32. Tang, W.; Cui, Y.; Babenko, O. Internal Consistency: Do We Really Know What It Is and How to Assess It? J. Psychol. Behav. Sci. 2014, 2, 205–220. [Google Scholar]
  33. Viladrich, C.; Angulo-Brunet, A.; Doval, E. A Journey around Alpha and Omega to Estimate Internal Consistency Reliability. An. Psicol. 2017, 33, 755–782. [Google Scholar] [CrossRef]
  34. Zayapragassarazan, Z.; Kumar, S. Awareness, Knowledge, Attitude and Skills of Telemedicine among Health Professional Faculty Working in Teaching Hospitals. J. Clin. Diagn. Res. 2016, 10, JC01–JC04. [Google Scholar] [CrossRef]
  35. Al-Balawi, Z.E.; Salman Taie, E.; Alsesei, N. Nursing Informatics Competency Based Assessment for Nursing Personnel in Primary Healthcare Centers in Tabuk. Am. Res. J. Nurs. 2020, 6, 1–17. [Google Scholar] [CrossRef]
  36. Rahman, A. Development of a Nursing Informatics Competency Assessment Tool (NICAT). Ph.D. Thesis, Walden University, Minneapolis, MN, USA, 2011. [Google Scholar]
  37. Kujala, S.; Rajalahti, E.; Heponiemi, T.; Hilama, P. Health Professionals’ Expanding EHealth Competences for Supporting Patients’ Self-Management. Stud. Health Technol. Inform. 2018, 247, 181–185. [Google Scholar] [CrossRef]
  38. Terry, J.; Davies, A.; Williams, C.; Tait, S.; Condon, L. Improving the Digital Literacy Competence of Nursing and Midwifery Students: A Qualitative Study of the Experiences of NICE Student Champions. Nurse Educ. Pract. 2019, 34, 192–198. [Google Scholar] [CrossRef] [PubMed]
  39. Cumming, I.; Davies, J. Health Education England. Improv. Digit. Lit. 2017, 1–11. [Google Scholar]
  40. Minou, J.; Mantas, J.; Malamateniou, F.; Kaitelidou, D. Health Professionals’ Perception about Big Data Technology in Greece. Acta Inform. Medica 2020, 28, 48–51. [Google Scholar] [CrossRef]
  41. Vozikis, A.; Ypofanti, M.; Papadopoulos, I. Attitudes Towards the Use of Information and Communication Technologies (Ict) At Work: Findings From the Health Care Sector in Greece. Spoud. J. Econ. Bus. 2010, 60, 82–96. [Google Scholar]
  42. Pontefract, S.K.; Wilson, K. Using Electronic Patient Records: Defining Learning Outcomes for Undergraduate Education. BMC Med. Educ. 2019, 19, 30. [Google Scholar] [CrossRef] [PubMed]
  43. MacLure, K.; Stewart, D. A Qualitative Case Study of Ehealth and Digital Literacy Experiences of Pharmacy Staff. Res. Soc. Adm. Pharm. 2018, 14, 555–563. [Google Scholar] [CrossRef] [PubMed]
  44. Theron, M.; Borycki, E.M.; Redmond, A. Developing Digital Literacies in Undergraduate Nursing Studies: From Research to the Classroom. In Health Professionals’ Education in the Age of Clinical Information Systems, Mobile Computing and Social Networks; Academic Press: Cambridge, MA, USA, 2017. [Google Scholar]
  45. Usha Kiran, T.S.; Shylasree, T.S.; Jayawickrama, N.S. Computer Skills among Trainee Doctors. J. Obstet. Gynaecol. 2004, 24, 81–82. [Google Scholar] [CrossRef] [PubMed]
  46. Konstantinidis, S.T.; Li, S.; Traver, V.; Zary, N.; Bamidis, P.D. Actions to Empower Digital Competences in Healthcare Workforce: A Qualitative Approach. Stud. Health Technol. Inform. 2017, 238, 253–256. [Google Scholar] [CrossRef]
  47. Kubben, P. Teaching Computer Programming to Medical Doctors, Nurses and Hospital Staff: A Pilot Study. Open Access J. Neurol. Neurosurg. 2017, 4, 555632. [Google Scholar] [CrossRef]
  48. Røsvik, K.; Haukedal, T.A. Wikis as Digital Learning Resources in Nursing Education. Nord. J. Digit. Lit. 2017, 12, 31–46. [Google Scholar] [CrossRef]
Table 1. Demographic profile of participants (n = 494).
Table 1. Demographic profile of participants (n = 494).
nn%
GenderFemale29158.91%
Male20341.09%
FacultyMedical doctor17535.43%
Registered nurse31964.57%
Educational levelBSc29760.12%
MSc16633.60%
PhD316.28%
Age 138.7 (10.04)
1 Age expressed as mean (standard deviation).
Table 2. Percentage distribution of responses by instrument scale item.
Table 2. Percentage distribution of responses by instrument scale item.
Not at AllA Little BitPartlyEnoughVery Much
n%n%n%n%n%
item 119.64%22.47%19.03%20.85%18.02%
item 219.84%21.86%21.05%17.21%20.04%
item 320.04%20.85%21.46%20.04%17.61%
item 421.46%19.23%22.87%18.42%18.02%
item 519.03%22.47%20.65%18.42%19.43%
item 621.46%20.85%22.87%18.02%16.80%
item 721.46%22.47%21.05%18.42%16.60%
item 819.84%21.66%20.04%22.06%16.40%
item 923.48%20.24%21.66%19.23%15.38%
item 1022.47%20.85%19.64%22.27%14.78%
item 1120.04%20.04%21.46%17.00%21.46%
item 1222.67%17.21%18.83%21.05%20.24%
item 1320.45%19.43%18.22%20.45%21.46%
item 1422.06%20.45%18.42%17.41%21.66%
item 1520.65%20.45%20.65%17.00%21.26%
item 1619.84%19.23%21.05%23.08%16.80%
item 1718.02%21.26%22.27%21.26%17.21%
item 1817.41%19.43%24.90%21.46%16.80%
item 1920.45%20.04%19.43%21.26%18.83%
item 2018.42%20.85%22.27%19.23%19.23%
item 2119.23%20.24%23.89%18.02%18.62%
item 2220.04%20.24%22.67%18.42%18.62%
item 2317.61%21.05%20.45%22.27%18.62%
item 2420.04%20.04%21.46%20.45%18.02%
item 2519.03%20.04%19.23%20.65%21.05%
item 2617.00%22.47%18.83%21.66%20.04%
Table 3. Correlations between the subscales of the questionnaire.
Table 3. Correlations between the subscales of the questionnaire.
InformationCommunicationContent CreationProblem-SolvingSafety
InformationPearson
Correlation
10.046−0.0060.0180.007
Sig. (2-tailed) 0.1750.8620.5900.827
N857857857857857
CommunicationPearson
Correlation
0.0461−0.025−0.061−0.005
Sig. (2-tailed)0.175 0.4730.0770.888
N857857857857857
Content
creation
Pearson
Correlation
−0.006−0.02510.011−0.009
Sig. (2-tailed)0.8620.473 0.7510.795
N857857857857857
Problem-
solving
Pearson
Correlation
0.018−0.0610.01110.059
Sig. (2-tailed)0.5900.0770.751 0.082
N857857857857857
SafetyPearson
Correlation
0.007−0.005−0.0090.0591
Sig. (2-tailed)0.8270.8880.7950.082
N857857857857857
Table 4. Test for Exact Fit.
Table 4. Test for Exact Fit.
χ2dfp
3332890.038
Table 5. Fit Measures.
Table 5. Fit Measures.
RMSEA 90% CI
CFITLIRMSEALowerUpper
0.9970.9660.01760.004570.0256
Table 6. Full-scale reliability results.
Table 6. Full-scale reliability results.
Corrected Total-Item CorrelationCronbach’s Alpha if Item Deleted
item 10.3220.819
item 20.2920.820
item 30.3210.819
item 40.2740.821
item 50.3520.818
item 60.2570.821
item 70.2350.822
item 80.2400.822
item 90.2330.822
item 100.2230.823
item 110.2920.820
item 120.2400.822
item 130.2760.821
item 140.2820.821
item 150.2520.822
item 160.6150.807
item 170.5490.810
item 180.4980.812
item 190.4940.812
item 200.5570.809
item 210.5620.809
item 220.5580.809
item 230.5180.811
item 240.5240.811
item 250.1300.826
item 260.1520.825
Table 7. Reliability results for the five factors of the scale.
Table 7. Reliability results for the five factors of the scale.
Corrected Total-Item CorrelationCronbach’s Alpha if Item Deleted
Factor 1: Informationα = 0.950
item 10.9520.922
item 20.8520.940
item 30.8380.942
item 40.8290.944
item 50.8400.942
Factor 2: Communicationα = 0.949
item 60.9570.919
item 70.8350.941
item 80.8370.940
item 90.8430.940
item 100.8250.943
Factor 3: Content creationα = 0.956
item 110.958.931
item 120.849.950
item 130.857.948
item 140.865.947
item 150.852.949
Factor 4: Problem-solvingα = 0.966
item 160.9790.957
item 170.8400.963
item 180.8340.963
item 190.8410.963
item 200.8470.963
item 210.8390.963
item 220.8350.963
item 230.8480.963
item 240.8420.963
Factor 5: Safetyα = 0.920
item 250.851.
item 260.851.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Karvouniari, A.; Karabetsos, D.; Kleisiaris, C.F.; Karavasileiadou, S.; Baghdadi, N.; Kyrarini, V.-A.; Kasagianni, E.; Tsalkitzi, A.; Malliarou, M.; Melas, C. Translation and Validation of Digital Competence Indicators in Greek for Health Professionals: A Cross-Sectional Study. Healthcare 2024, 12, 1370. https://doi.org/10.3390/healthcare12141370

AMA Style

Karvouniari A, Karabetsos D, Kleisiaris CF, Karavasileiadou S, Baghdadi N, Kyrarini V-A, Kasagianni E, Tsalkitzi A, Malliarou M, Melas C. Translation and Validation of Digital Competence Indicators in Greek for Health Professionals: A Cross-Sectional Study. Healthcare. 2024; 12(14):1370. https://doi.org/10.3390/healthcare12141370

Chicago/Turabian Style

Karvouniari, Alexandra, Dimitrios Karabetsos, Christos F. Kleisiaris, Savvato Karavasileiadou, Nadiah Baghdadi, Virginia-Athanasia Kyrarini, Evangelia Kasagianni, Afroditi Tsalkitzi, Maria Malliarou, and Christos Melas. 2024. "Translation and Validation of Digital Competence Indicators in Greek for Health Professionals: A Cross-Sectional Study" Healthcare 12, no. 14: 1370. https://doi.org/10.3390/healthcare12141370

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Article metric data becomes available approximately 24 hours after publication online.
Back to TopTop