Development and Evaluation of a Massive Open Online Course on Healthcare Redesign: A Novel Method for Engaging Healthcare Workers in Quality Improvement
Abstract
:1. Introduction
2. Materials and Methods
2.1. Designing the Course and Methods
2.2. MOOC Evaluation
2.2.1. User Analytics
2.2.2. Participant Experience Survey
2.2.3. Data Analysis
3. Results
3.1. Participant Characteristics
3.2. Participants’ Attempts at Completing Module Quizzes
3.3. Participant Experience Survey
3.4. Participants’ Satisfaction with the MOOC
“I was very Satisfied with the MOOC because it was very well explained and descriptive by the tutors and professionals in the area of Healthcare Redesign. It was an excellent course!!!!! The videos were excellent in teaching the subject”.P13
“I found the balance of written and video presentation of information very user friendly. I appreciated the flexibility in how I timed the completion of the course”.P18
“It has given me a better understanding of the process of which the health system can continually improve and work together as a team to resolve issues in the workplace but also improve in different areas but we all are on the same page to have a harmonious workflow by working together no matter which area we work in”.P53
“It was a very informative MOOC however is it not as engaging with the audience. Including for user input activities would in my opinion make it better”.P78
“How easy the course is to navigate through due to the layout and course information provided”.P82
“Quick, free access to relevant knowledge to help make change in TAS Health that benefits patients and makes better use of existing resources”.P20
“Stakeholder engagement—the previous work I did didn’t really involve that, so I found it really helpful having tips for successful engagement”.P24
“Module 2: Theories for Re-designing Healthcare. I especially liked the Lean Thinking 5 Core Principles and the focus on reducing waste and improving flow”.P74
“Sustainability. I have already been involved in clinical redesign processes however they haven’t all been sustainable”.P66
“Would be nice to have more situations as an example. At least two or three of different settings”.P15
“It was appropriate it would be great to compliment this Program with an Excellence in Pathways Program through the RHH Centre for Education and Research Nursing and Midwifery. This would be beneficial for every manager in Health care. The length and timeframe perfect, I would have loved a booklet of the pages of the program that I could use as a reference nothing major just a little prompt—I am planning of making my own and using it as a prompt”.P28
“I would have like one or two more examples of a completed plan from developing the idea to implementing and assessing the outcomes”.P65
“Video clips assisted me greatly in having a clear view and picture of how clinicians deal with everyday life at a Clinic in helping the work to better flow and focusing on do their best to help the patients and provide the best service for them”.P13
“Examples of different health settings, e.g., a lot of examples were hospital based”.P31
3.5. Motivation for Enrolling in the MOOC
“Currently have a large turnover of staff in the department I work, this is very disappointing considering the stable workforce, we had 5–10 years ago. It has highlighted to me that patient care has changed but work processes currently don’t align with these significant changes”.P74
“Want to effect major change in addressing adaptive health issues in primary healthcare, ambulance service and hospital services. I thought this might help understand how to effect change and get buy in”.P20
“The fact it was free but also that I do notice things that could be improved in the hospital and do bring them up but I was interested in learning how to approach implementing improvement initiatives”.P36
“Personal interest I would like to do this work”.P56
“Wanting to understand clinical redesign. Also working within XXX frustrated with inefficiencies and lack of change”.P85
3.6. Translation of Learning
4. Discussion
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Productivity Commission. Efficiency in Health; Productivity Commission Research Paper; Productivity Commission: Melbourne, VIC, Australia, 2015. [Google Scholar]
- Gautam, A. Tackling Wasteful Spending on Health; OECD: Paris, France, 2017.
- Locock, L. Healthcare Redesign: Meaning, Origins and Application. BMJ Qual. Saf. 2003, 12, 53–60. [Google Scholar] [CrossRef] [Green Version]
- Manos, A.; Sattler, M.; Alukal, G. Make Healthcare Lean. Qual. Prog. 2006, 39, 24. [Google Scholar]
- Appleby, J.; Raleigh, V.; Frosini, F.; Bevan, G.; Gao, H.; Lyscom, T. Variations in Health Care: The Good, the Bad and the Inexplicable; King’s Fund: London, UK, 2011. [Google Scholar]
- Australian Commission on Safety Quality in Health Care. Medical Practice Variation. Background Paper. 2013. Available online: https://www.safetyandquality.gov.au/sites/default/files/migrated/SAQ110_Medical_Practice_variation_V10_WEB.pdf (accessed on 15 July 2022).
- University of Tasmania. Graduate Certificate (Clinical Redesign) (M5V). 2022. Available online: https://www.utas.edu.au/courses/chm/courses/m5v-graduate-certificate-clinical-redesign (accessed on 10 May 2022).
- Guest, C.; Wainwright, P.; Herbert, M.; Smith, I.M. Driving Quality Improvement with a Massive Open Online Course (Mooc). BMJ Open Qual. 2021, 10, e000781. [Google Scholar] [CrossRef] [PubMed]
- Bond University. Graduate Certificate in Health Systems. 2022. Available online: https://bond.edu.au/program/graduate-certificate-health-systems (accessed on 10 May 2022).
- Van Dam, P.J.; Griffin, P.; Peterson, G.M.; Reeves, N.S.; Kirkwood, L.; Prior, S.J. Organizational Support in Healthcare Redesign Education: A Mixed-Methods Exploratory Study of Expert Coach and Executive Sponsor Experiences. Int. J. Environ. Res. Public Health 2020, 17, 5308. [Google Scholar] [CrossRef] [PubMed]
- Dyumin, A.A.; Andrianova, S.V. (Eds.) Moocs and Vendor Trainings in Academic Curriculum: Yet Another Step Towards Global University. In Proceedings of the 2016 International Conference on Engineering and Telecommunication (EnT), Moscow, Russia, 29–30 November 2016. [Google Scholar]
- Australian Health Practitioner Regulation Agency. What We Do: Australian Health Practitioner Regulation Agency. 2022. Available online: https://www.ahpra.gov.au/About-Ahpra/What-We-Do.aspx (accessed on 21 July 2022).
- National Health Practitioner Ombudsman. Ahprah and the Boards: National Health Practitioner Ombudsman. 2022. Available online: https://www.nhpo.gov.au/ahpra-and-the-boards (accessed on 21 July 2022).
- Australian Health Practitioner Regulation Agency. Fact Sheet: Continuing Professional Development. 2022. Available online: https://ahpra-search.clients.funnelback.com/s/redirect?collection=ahpra-websites-web&url=https%3A%2F%2Fwww.nursingmidwiferyboard.gov.au%2Fdocuments%2Fdefault.aspx%3Frecord%3DWD16%252f19495%26dbid%3DAP%26chksum%3DglBIRNUIK27TneX%252bdJRYzg%253d%253d&auth=frePbY1PC3HTsNoXNMUYiQ&profile=nursingmidwifery&rank=7&query=continuing+professional+development+%7Cd%3D2022 (accessed on 25 July 2022).
- Shah, D. By the Numbers: Moocs in 2021: Class Central. 2021. Available online: https://www.classcentral.com/report/mooc-stats-2021/ (accessed on 10 April 2022).
- Yuan, L.; Powell, S. Moocs and Open Education: Implications for Higher Education; JISC CETIS: Mountain View, CA, USA, 2013. [Google Scholar]
- Zhu, M.; Sari, A.R.; Lee, M.M. A Comprehensive Systematic Review of Mooc Research: Research Techniques, Topics, and Trends from 2009 to 2019. Educ. Technol. Res. Dev. 2020, 68, 1685–1710. [Google Scholar] [CrossRef]
- Jordan, K. Initial Trends in Enrolment and Completion of Massive Open Online Courses. Int. Rev. Res. Open Distrib. Learn. 2014, 15, 133–160. [Google Scholar] [CrossRef] [Green Version]
- Farrow, M.; Fair, H.; Klekociuk, S.Z.; Vickers, J.C. Educating the Masses to Address a Global Public Health Priority: The Preventing Dementia Massive Open Online Course (Mooc). PLoS ONE 2022, 17, e0267205. [Google Scholar] [CrossRef]
- Goldberg, L.R.; Bell, E.; King, C.; O’Mara, C.; McInerney, F.; Robinson, A.; Vickers, J. Relationship between Participants’ Level of Education and Engagement in Their Completion of the Understanding Dementia Massive Open Online Course. BMC Med. Educ. 2015, 15, 60. [Google Scholar] [CrossRef] [Green Version]
- Limesurvey GmbH. Limesurvey: An Open Source Survey Tool. 2022. Available online: http://www.limesurvey.org (accessed on 10 April 2022).
- Healy, J. Improving Health Care Safety and Quality: Reluctant Regulators; Routledge: London, UK, 2016. [Google Scholar]
- Quarmby, C.; Peterson, G.; Van Dam, P.; O’Brien, L.; Maree, P. (Eds.) Evidence-Based Clinical Redesign Education as a Vehicle for Health Service Improvement. In Proceedings of the 5th APAC Forum Exploring New Frontiers, Sydney, NSW, Australia, 12–14 September 2016. [Google Scholar]
- Andreatos, A.S. The Use of Moocs in the Continuing Education of Individuals and Organisations. In Furthering Higher Education Possibilities through Massive Open Online Courses; IGI Global: Hershey, PA, USA, 2015; pp. 49–79. [Google Scholar]
- Karnouskos, S. Massive Open Online Courses (Moocs) as an Enabler for Competent Employees and Innovation in Industry. Comput. Ind. 2017, 91, 1–10. [Google Scholar] [CrossRef]
- Bogdan, R.; Holotescu, C.; Andone, D.; Grosseck, G. How Moocs Are Being Used for Corporate Training? E Learn. Softw. Educ. 2017, 2, 254–261. [Google Scholar]
- Hew, K.F.; Cheung, W.S. Students’ and Instructors’ Use of Massive Open Online Courses (Moocs): Motivations and Challenges. Educ. Res. Rev. 2014, 12, 45–58. [Google Scholar] [CrossRef]
- Zhu, M.; Bonk, C.J.; Sari, A.R. Instructor Experiences Designing Moocs in Higher Education: Pedagogical, Resource, and Logistical Considerations and Challenges. Online Learn. 2018, 22, 203–241. [Google Scholar] [CrossRef]
- Eynon, R.; Hjorth, I.; Gillani, N.; Yasseri, T. ‘Vote Me up If You Like My Ideas!’. Experiences of Learning in a Mooc. Exp. Learn. A MOOC 2014, 2014. [Google Scholar]
- Bakayev, V.; Vasilyeva, V.; Kalmykova, S.; Razinkina, E. Theory of Physical Culture-a Massive Open Online Course in Educational Process. J. Phys. Educ. Sport 2018, 18, 293–300. [Google Scholar]
- Goopio, J.; Cheung, C. The Mooc Dropout Phenomenon and Retention Strategies. J. Teach. Travel Tour. 2021, 21, 177–197. [Google Scholar] [CrossRef]
- Hone, K.S.; El Said, G.R. Exploring the Factors Affecting Mooc Retention: A Survey Study. Comput. Educ. 2016, 98, 157–168. [Google Scholar] [CrossRef] [Green Version]
- Sujatha, R.; Kavitha, D. Learner Retention in Mooc Environment: Analyzing the Role of Motivation, Self-Efficacy and Perceived Effectiveness. Int. J. Educ. Dev. Using ICT 2018, 14, 2. [Google Scholar]
- Li, H.; Kim, M.K.; Xiong, Y. Individual Learning Vs. Interactive Learning: A Cognitive Diagnostic Analysis of Mooc Students’ Learning Behaviors. Am. J. Distance Educ. 2020, 34, 121–136. [Google Scholar] [CrossRef]
- Su, B.; Zhang, T.; Yan, L.; Huang, C.; Cheng, X.; Cai, C.; Cui, D. Online Medical Teaching in China During the COVID-19 Pandemic: Tools, Modalities, and Challenges. Front. Public Health 2021, 9, 797694. [Google Scholar] [CrossRef]
- Hung, D.Y.; Gray, C.P.; Truong, Q.A.; Harrison, M.I. Sustainment of Lean Redesigns for Primary Care Teams. Qual. Manag. Healthc. 2019, 28, 15–24. [Google Scholar] [CrossRef]
- Lyson, H.C.; Ackerman, S.; Lyles, C.; Schillinger, D.; Williams, P.; Gourley, G.; Gupta, R.; Handley, M.; Sarkar, U. Redesigning Primary Care in the Safety Net: A Qualitative Analysis of Team-Based Care Implementation. Healthcare 2019, 7, 22–29. [Google Scholar] [CrossRef] [PubMed]
- Wu, L.; Low, M.; Tan, K.; López, V.; Liaw, S.Y. Why Not Nursing? A Systematic Review of Factors Influencing Career Choice among Healthcare Students. Int. Nurs. Rev. 2015, 62, 547–562. [Google Scholar] [PubMed]
- Van Dam, P.J.; Griffin, P.; Reeves, N.S.; Prior, S.J.; Paton, B.; Verma, R.; Giles, A.; Kirkwood, L.; Peterson, G.M. Learning in Practice: Collaboration Is the Way to Improve Health System Outcomes. Healthcare 2019, 7, 90. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Alturkistani, A.; Lam, C.; Foley, K.; Stenfors, T.; Blum, E.R.; Van Velthoven, M.H.; Meinert, E. Massive Open Online Course Evaluation Methods: Systematic Review. J. Med. Internet Res. 2020, 22, e13851. [Google Scholar] [CrossRef] [PubMed]
Modules | Intended Learning Outcomes |
---|---|
Welcome | Course introduction, glossary of terms, pathways to further study |
Module One: The Case for Change |
|
Module Two: Theories for redesigning Healthcare | |
Module Three: Techniques for Engaging People |
|
Module Four: Understanding the Problem |
|
Module Five: Addressing the Problem |
|
Module Six: Evaluation and Sustainability |
|
Participants yet to Complete the MOOC N = 460 | Participants who Completed the MOOC N = 118 | |||||
---|---|---|---|---|---|---|
Variable | Frequency | Percent | Frequency | Percent | p-Value | |
Gender | ||||||
Female | 375 | 81.5% | 83 | 70.0% | ||
Male | 85 | 18.0% | 35 | 30.0% | 0.010 | |
Age Group † | ||||||
0–19 years | 7 | 1.5% | 1 | 0.8% | ||
20–29 years | 72 | 15.7% | 23 | 19.5% | ||
30–39 years | 142 | 30.9% | 29 | 24.6% | ||
40–49 years | 125 | 27.2% | 36 | 30.5% | ||
50–59 years | 85 | 18.5% | 20 | 16.9% | ||
60–69 years | 26 | 5.7% | 4 | 3.4% | ||
70–79 years | 1 | 0.2% | 2 | 1.7% | 0.286 | |
Country | ||||||
Australia | 401 | 87.2% | 105 | 89.0% | ||
New Zealand | 11 | 2.4% | 2 | 1.69% | ||
India | 5 | 1.1% | 1 | 0.85% | ||
Great Britain | 3 | 0.7% | 2 | 1.69% | ||
Other | 40 | 8.7% | 8 | 6.78% | 0.738 | |
Employer * †† | (N = 148) | (N = 37) | ||||
Tasmanian Health Service | 47 | 31.8% | 12 | 32.4% | ||
No answer | 30 | 20.3% | 6 | 16.2% | ||
Other | 28 | 18.9% | 8 | 21.6% | ||
Calvary Care | 11 | 7.4% | - | - | ||
Withheld | 32 | 21.6% | 11 | 29.7% | 0.421 | |
Certificate Purchases | ||||||
None | - | - | 85 | 72.0% | ||
Digital | - | - | 31 | 26.3% | ||
Printed | - | - | 2 | 1.7% | - |
Quiz | Participants Attempting | Attempts | Successful Attempts (n, %) | Mean No. of Attempts Per Participant |
---|---|---|---|---|
Module 1 | 220 | 601 | 409 (68.1) | 2.73 |
Module 2 | 179 | 229 | 203 (88.6) | 1.28 |
Module 3 | 161 | 249 | 221 (88.8) | 1.55 |
Module 4 | 148 | 168 | 163 (97) | 1.14 |
Module 5 | 139 | 247 | 199 (80.6) | 1.78 |
Module 6 | 118 | 167 | 147 (88) | 1.42 |
Question | Strongly Disagree | Disagree | Neutral | Agree | Strongly Agree | No Answer | Total Respondents (N = 118) |
---|---|---|---|---|---|---|---|
I was satisfied with my MOOC learning experience | 3 (4%) | 0 | 1 (1%) | 35 (42%) | 32 (39%) | 12 (15%) | 84 (71%) |
I would recommend the MOOC to others | 1 (1%) | 0 | 1 (1%) | 27 (33%) | 40 (48%) | 14 (17%) | 83 (70%) |
My understanding of healthcare redesign methodology has improved | 1 (1%) | 0 | 1 (1%) | 34 (41%) | 33 (40%) | 14 (17%) | 83 (70%) |
I plan to apply the knowledge I have gained from the MOOC | 1 (1%) | 0 | 0 | 33 (40%) | 35 (42%) | 14 (17%) | 83 (70%) |
I would like to do further online university study | 1 (1%) | 1 (1%) | 16 (19%) | 27 (33%) | 24 (29%) | 14 (17%) | 83 (70%) |
Poor or very poor | Average | Good | Very good | Excellent | No answer | Total Respondents (N = 118) | |
How would you rate the quality of this MOOC overall? | 0 (0%) | 0 (0%) | 13 (16%) | 22 (27%) | 32 (39%) | 16 (19%) | 83 (70%) |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Dwyer, M.; Prior, S.J.; Van Dam, P.J.; O’Brien, L.; Griffin, P. Development and Evaluation of a Massive Open Online Course on Healthcare Redesign: A Novel Method for Engaging Healthcare Workers in Quality Improvement. Nurs. Rep. 2022, 12, 850-860. https://doi.org/10.3390/nursrep12040082
Dwyer M, Prior SJ, Van Dam PJ, O’Brien L, Griffin P. Development and Evaluation of a Massive Open Online Course on Healthcare Redesign: A Novel Method for Engaging Healthcare Workers in Quality Improvement. Nursing Reports. 2022; 12(4):850-860. https://doi.org/10.3390/nursrep12040082
Chicago/Turabian StyleDwyer, Mitchell, Sarah J. Prior, Pieter Jan Van Dam, Lauri O’Brien, and Phoebe Griffin. 2022. "Development and Evaluation of a Massive Open Online Course on Healthcare Redesign: A Novel Method for Engaging Healthcare Workers in Quality Improvement" Nursing Reports 12, no. 4: 850-860. https://doi.org/10.3390/nursrep12040082
APA StyleDwyer, M., Prior, S. J., Van Dam, P. J., O’Brien, L., & Griffin, P. (2022). Development and Evaluation of a Massive Open Online Course on Healthcare Redesign: A Novel Method for Engaging Healthcare Workers in Quality Improvement. Nursing Reports, 12(4), 850-860. https://doi.org/10.3390/nursrep12040082