myBeST—A Web-Based Survival Prognostic Tool for Women with Breast Cancer in Malaysia: Development Process and Preliminary Validation Study
Abstract
:1. Introduction
2. Materials and Methods
2.1. Initial Development Stage
2.1.1. Literature Review
2.1.2. Need Assessment
2.1.3. Design and Content Development
2.1.4. First Iteration Prototype
2.2. Expert Content Validity Stage
2.2.1. Content Validity
2.2.2. Expert Feedback
2.2.3. Second Iteration Prototype
2.3. User Face Validity Stage
2.3.1. Face Validity
2.3.2. User Feedback
2.3.3. Third Iteration Prototype
2.4. Final Prototype
2.5. Ethical Approval
3. Results
3.1. Initial Development Stage
3.1.1. Literature Review
- Involvement of target users and stakeholders: In our case, all the research team members and participants in every stage of the development process were healthcare professionals;
- Simple and various presentations of the survival prediction outputs.
3.1.2. Need Assessment
3.1.3. Design and Content Development
3.1.4. First Iteration Prototype
3.2. Expert Content Validity Stage
3.2.1. Content Validity
3.2.2. Expert Feedback
3.2.3. Second Iteration Prototype
3.3. User Face Validity Stage
3.3.1. Face Validity
3.3.2. User Feedback
3.3.3. Third Iteration Prototype
3.4. Final Prototype
3.4.1. Website—myBeST
3.4.2. The Web-Based Prediction Tool
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
References
- National Cancer Institute Ministry of Health (NCI MOH) Malaysia. Malaysia National Cancer Registry Report 2012–2016; NCI MOH: Putrajaya, Malaysia, 2019.
- Rajaram, N.; Lim, Z.Y.; Song, C.V.; Kaur, R.; Mohd Taib, N.A.; Muhamad, M.; Ong, W.L.; Schouwenburg, M.; See, M.H.; Teo, S.-H.H.; et al. Patient-Reported Outcome Measures among Breast Cancer Survivors: A Cross-Sectional Comparison between Malaysia and High-Income Countries. Psychooncology 2019, 28, 147–153. [Google Scholar] [CrossRef] [PubMed]
- Nasution, A.; Yusuf, A.; Iskandar, Y.H.P.; Soon, L.K.; Ab Hadi, I.S. Mobile Health Application Applying the Health Belief Model for Breast Cancer Awareness: What Is Missing? Malays. J. Med. Health Sci. 2021, 17, 384–398. [Google Scholar]
- Phung, M.T.; Tin Tin, S.; Elwood, J.M. Prognostic Models for Breast Cancer: A Systematic Review. BMC Cancer 2019, 19, 1–18. [Google Scholar] [CrossRef] [PubMed]
- Rabin, B.A.; Gaglio, B.; Sanders, T.; Nekhlyudov, L.; Dearing, J.W.; Bull, S.; Glasgow, R.E.; Marcus, A. Predicting Cancer Prognosis Using Interactive Online Tools: A Systematic Review and Implications for Cancer Care Providers. Cancer Epidemiol. Biomark. Prev. 2013, 22, 1645–1656. [Google Scholar] [CrossRef]
- Shachar, S.S.; Muss, H.B. Internet Tools to Enhance Breast Cancer Care. NPJ Breast Cancer 2016, 2, 16011. [Google Scholar] [CrossRef]
- Zhao, A.; Larbi, M.; Miller, K.; O’Neill, S.; Jayasekera, J. A Scoping Review of Interactive and Personalized Web-Based Clinical Tools to Support Treatment Decision Making in Breast Cancer. Breast 2022, 61, 43–57. [Google Scholar] [CrossRef]
- Candido dos Reis, F.J.; Wishart, G.C.; Dicks, E.M.; Greenberg, D.; Rashbass, J.; Schmidt, M.K.; van den Broek, A.J.; Ellis, I.O.; Green, A.; Rakha, E.; et al. An Updated PREDICT Breast Cancer Prognostication and Treatment Benefit Prediction Model with Independent Validation. Breast Cancer Res. 2017, 19, 58. [Google Scholar] [CrossRef]
- Michaelson, J.S.; Chen, L.L.; Bush, D.; Fong, A.; Smith, B.; Younger, J. Improved Web-Based Calculators for Predicting Breast Carcinoma Outcomes. Breast Cancer Res. Treat. 2011, 128, 827–835. [Google Scholar] [CrossRef]
- Ravdin, P.M.; Siminoff, L.A.; Davis, G.J.; Mercer, M.B.; Hewlett, J.; Gerson, N.; Parker, H.L. Computer Program to Assist in Making Decisions about Adjuvant Therapy for Women with Early Breast Cancer. J. Clin. Oncol. 2001, 19, 980–991. [Google Scholar] [CrossRef]
- Haybittle, J.L.; Blamey, R.W.; Elston, C.W.; Johnson, J.; Doyle, P.J.; Campbell, F.C.; Nicholson, R.I.; Griffiths, K. A Prognostic Index in Primary Breast Cancer. Br. J. Cancer 1982, 45, 361–366. [Google Scholar] [CrossRef]
- Henton, M.; Gaglio, B.; Cynkin, L.; Feuer, E.J.; Rabin, B.A. Development, Feasibility, and Small-Scale Implementation of a Web-Based Prognostic Tool—Surveillance, Epidemiology, and End Results Cancer Survival Calculator. JMIR Cancer 2017, 3, e9. [Google Scholar] [CrossRef]
- Seow, H.; Tanuseputro, P.; Barbera, L.; Earle, C.; Guthrie, D.; Isenberg, S.; Juergens, R.; Myers, J.; Brouwers, M.; Sutradhar, R. Development and Validation of a Prognostic Survival Model With Patient-Reported Outcomes for Patients With Cancer. JAMA Netw. Open 2020, 3, e201768. [Google Scholar] [CrossRef]
- Mozumder, S.I.; Dickman, P.W.; Rutherford, M.J.; Lambert, P.C. InterPreT Cancer Survival: A Dynamic Web Interactive Prediction Cancer Survival Tool for Health-Care Professionals and Cancer Epidemiologists. Cancer Epidemiol. 2018, 56, 46–52. [Google Scholar] [CrossRef]
- Gray, E.; Marti, J.; Brewster, D.H.; Wyatt, J.C.; Hall, P.S. Independent Validation of the PREDICT Breast Cancer Prognosis Prediction Tool in 45,789 Patients Using Scottish Cancer Registry Data. Br. J. Cancer 2018, 119, 808–814. [Google Scholar] [CrossRef]
- Van Maaren, M.C.; van Steenbeek, C.D.; Pharoah, P.D.P.; Witteveen, A.; Sonke, G.S.; Strobbe, L.J.A.; Poortmans, P.M.P.; Siesling, S. Validation of the Online Prediction Tool PREDICT v. 2.0 in the Dutch Breast Cancer Population. Eur. J. Cancer 2017, 86, 364–372. [Google Scholar] [CrossRef]
- Agostinetto, E.; Ameye, L.; Martel, S.; Aftimos, P.; Pondé, N.; Maurer, C.; El-Abed, S.; Wang, Y.; Vicente, M.; Chumsri, S.; et al. PREDICT Underestimates Survival of Patients with HER2-Positive Early-Stage Breast Cancer. NPJ Breast Cancer 2022, 8, 87. [Google Scholar] [CrossRef]
- Wong, H.S.; Subramaniam, S.; Alias, Z.; Taib, N.A.; Ho, G.F.; Ng, C.H.; Yip, C.H.; Verkooijen, H.M.; Hartman, M.; Bhoo-Pathy, N. The Predictive Accuracy of PREDICT: A Personalized Decision-Making Tool for Southeast Asian Women with Breast Cancer. Medicine 2015, 94, e593. [Google Scholar] [CrossRef]
- Polchai, N.; Sa-Nguanraksa, D.; Numprasit, W.; Thumrongtaradol, T.; O-Charoenrat, E.; O-Charoenrat, P. A Comparison between the Online Prediction Models CancerMath and PREDICT as Prognostic Tools in Thai Breast Cancer Patients. Cancer Manag. Res. 2020, 12, 5549–5559. [Google Scholar] [CrossRef]
- Bhoo-Pathy, N.; Yip, C.-H.; Hartman, M.; Saxena, N.; Taib, N.A.; Ho, G.F.; Looi, L.-M.; Bulgiba, A.M.; van der Graaf, Y.; Verkooijen, H.M. Adjuvant! Online Is Overoptimistic in Predicting Survival of Asian Breast Cancer Patients. Eur. J. Cancer 2012, 48, 982–989. [Google Scholar] [CrossRef]
- Miao, H.; Hartman, M.; Verkooijen, H.M.; Taib, N.A.; Wong, H.S.; Subramaniam, S.; Yip, C.H.; Tan, E.Y.; Chan, P.; Lee, S.C.; et al. Validation of the CancerMath Prognostic Tool for Breast Cancer in Southeast Asia. BMC Cancer 2016, 16, 820. [Google Scholar] [CrossRef]
- Van Gemert-Pijnen, J.E.W.C.; Nijland, N.; van Limburg, M.; Ossebaard, H.C.; Kelders, S.M.; Eysenbach, G.; Seydel, E.R. A Holistic Framework to Improve the Uptake and Impact of EHealth Technologies. J. Med. Internet Res. 2011, 13, e111. [Google Scholar] [CrossRef] [PubMed]
- Wachtler, C.; Coe, A.; Davidson, S.; Fletcher, S.; Mendoza, A.; Sterling, L.; Gunn, J. Development of a Mobile Clinical Prediction Tool to Estimate Future Depression Severity and Guide Treatment in Primary Care: User-Centered Design. JMIR Mhealth Uhealth 2018, 6, e95. [Google Scholar] [CrossRef] [PubMed]
- Kip, H.; Keizer, J.; da Silva, M.C.; Jong, N.B.; Köhle, N.; Kelders, S.M. Methods for Human-Centered EHealth Development: Narrative Scoping Review. J. Med. Internet Res. 2022, 24, e31858. [Google Scholar] [CrossRef] [PubMed]
- Farmer, G.D.; Pearson, M.; Skylark, W.J.; Freeman, A.L.J.; Spiegelhalter, D.J. Redevelopment of the Predict: Breast Cancer Website and Recommendations for Developing Interfaces to Support Decision-Making. Cancer Med. 2021, 10, 5141–5153. [Google Scholar] [CrossRef] [PubMed]
- Nik Ab Kadir, M.N.; Yaacob, N.M.; Yusof, S.N.; Ab Hadi, I.S.; Musa, K.I.; Mohd Isa, S.A.; Bahtiar, B.; Adam, F.; Yahya, M.M.; Mohd Hairon, S. Development of Predictive Models for Survival among Women with Breast Cancer in Malaysia. Int. J. Environ. Res. Public Health 2022, 19, 15335. [Google Scholar] [CrossRef]
- Van de Water, L.F.; van den Boorn, H.G.; Hoxha, F.; Henselmans, I.; Calff, M.M.; Sprangers, M.A.G.; Abu-Hanna, A.; Smets, E.M.A.; van Laarhoven, H.W.M. Informing Patients with Esophagogastric Cancer about Treatment Outcomes by Using a Web-Based Tool and Training: Development and Evaluation Study. J. Med. Internet Res. 2021, 23, e27824. [Google Scholar] [CrossRef]
- Hakone, A.; Harrison, L.; Ottley, A.; Winters, N.; Gutheil, C.; Han, P.K.J.; Chang, R. PROACT: Iterative Design of a Patient-Centered Visualization for Effective Prostate Cancer Health Risk Communication. IEEE Trans. Vis. Comput. Graph. 2017, 23, 601–610. [Google Scholar] [CrossRef]
- Schnall, R.; Rojas, M.; Bakken, S.; Brown, W.; Carballo-Dieguez, A.; Carry, M.; Gelaude, D.; Mosley, J.P.; Travers, J. A User-Centered Model for Designing Consumer Mobile Health (MHealth) Applications (Apps). J. Biomed. Inform. 2016, 60, 243–251. [Google Scholar] [CrossRef]
- Lynn, M.R. Determination and Quantification of Content Validity. Nurs. Res. 1986, 35, 382–386. [Google Scholar]
- Polit, D.F.; Beck, C.T. The Content Validity Index: Are You Sure You Know What’s Being Reported? Critique and Recommendations. Res. Nurs. Health 2006, 29, 489–497. [Google Scholar] [CrossRef]
- Yusoff, M.S.B. ABC of Response Process Validation and Face Validity Index Calculation. Educ. Med. J. 2019, 11, 55–61. [Google Scholar] [CrossRef]
- National Cancer Institute Ministry of Health (NCI MOH) Malaysia. Malaysian Study on Cancer Survival (MySCan); NCI MOH: Putrajaya, Malaysia, 2018.
- Nordin, N.; Yaacob, N.M.; Abdullah, N.H.; Hairon, S.M. Survival Time and Prognostic Factors for Breast Cancer among Women in North-East Peninsular Malaysia. Asian Pac. J. Cancer Prev. 2018, 19, 497–502. [Google Scholar]
- Azman, N.; Hami, R.; Mohd Mujar, N.M.; Fadzillah, N.H.; Hussin, H.; Shaukat, S.I.; Mohd Shariff, N. Long-Term Survivorship of Breast Cancer Patients and Its Prognostic Factors: A Tertiary Oncological Center Experience in Penang. Malays. J. Med. Health Sci. 2019, 15, 141–147. [Google Scholar]
- Tan, K.F.; Adam, F.; Hussin, H.; Mohd Mujar, N.M. A Comparison of Breast Cancer Survival across Different Age Groups: A Multicentric Database Study in Penang, Malaysia. Epidemiol. Health 2021, 43, e2021038. [Google Scholar] [CrossRef]
- Van de Water, L.F.; van Kleef, J.J.; Dijksterhuis, W.P.M.; Henselmans, I.; van den Boorn, H.G.; Vaarzon Morel, N.M.; Schut, K.F.; Daams, J.G.; Smets, E.M.A.; van Laarhoven, H.W.M. Communicating Treatment Risks and Benefits to Cancer Patients: A Systematic Review of Communication Methods. Qual. Life Res. 2020, 29, 1747–1766. [Google Scholar] [CrossRef]
- Mohamad Marzuki, M.F.; Yaacob, N.A.; Yaacob, N.M. Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps. JMIR Hum. Factors 2018, 5, e10308. [Google Scholar] [CrossRef]
- Mahadi, N.F.; Chin, R.W.A.; Chua, Y.Y.; Chu, M.N.; Wong, M.S.; Yusoff, M.S.B.; Lee, Y.Y. Malay Language Translation and Validation of the Oldenburg Burnout Inventory Measuring Burnout. Educ. Med. J. 2018, 10, 27–40. [Google Scholar] [CrossRef]
- Andrew Chin, R.W.; Chua, Y.Y.; Chu, M.N.; Mahadi, N.F.; Wong, M.S.; Yusoff, M.S.B.; Lee, Y.Y. Investigating Validity Evidence of the Malay Translation of the Copenhagen Burnout Inventory. J. Taibah Univ. Med. Sci. 2018, 13, 1–9. [Google Scholar] [CrossRef]
- Ganggayah, M.D.; Dhillon, S.K.; Islam, T.; Kalhor, F.; Chiang, T.C.; Kalafi, E.Y.; Taib, N.A. An Artificial Intelligence-Enabled Pipeline for Medical Domain: Malaysian Breast Cancer Survivorship Cohort as a Case Study. Diagnostics 2021, 11, 1492. [Google Scholar] [CrossRef]
Page | Heading | Content |
---|---|---|
Home | myBeST header | Definition and aim of the tool |
Who could use myBeST? | Target user: healthcare provider | |
How does myBeST work | Requirement and output of the tool | |
How was the tool developed? | Description of the model development | |
Who developed the tool? | Researchers and their background | |
Disclaimer | Disclaimer of using the tool | |
Tool | Tool | Embedded R Shiny interface of the prediction tool |
About | Overview | The aim, usage, and limitation of the tool |
Development process | Cohort description and analysis used | |
Our Team | Researchers involved in the studies | |
Contact | Contact | Feedback form and location of the researchers |
Item (Predictors) | Total Score | I-CVI |
---|---|---|
Age at diagnosis | 7 | 0.88 |
Ethnicity | 7 | 0.88 |
Marital status | 7 | 0.88 |
Histology | 8 | 1.00 |
Tumour grade | 8 | 1.00 |
ER and PR status | 8 | 1.00 |
HER2 | 8 | 1.00 |
Tumour stage | 8 | 1.00 |
Nodal stage | 8 | 1.00 |
Metastasis stage | 8 | 1.00 |
Surgery | 8 | 1.00 |
Chemotherapy | 8 | 1.00 |
Radiotherapy | 8 | 1.00 |
S-CVI/Ave | 0.97 |
Page | Item (Content Heading) | Total Score | I-CVI |
---|---|---|---|
Home | myBeST definition (header) | 8 | 1.00 |
Who could use myBeST? | 8 | 1.00 | |
How does myBeST work? | 8 | 1.00 | |
How was the tool developed? | 8 | 1.00 | |
Who developed the tool? | 8 | 1.00 | |
Disclaimer | 8 | 1.00 | |
About | Overview | 8 | 1.00 |
Development process | 8 | 1.00 | |
Our Team | 8 | 1.00 | |
Contact | Contact | 8 | 1.00 |
S-CVI/Ave | 1.00 |
Items | Total Score | FVI |
---|---|---|
Prognostic tool: | ||
Clarity of the instructions given | 20 | 1.00 |
Clarity of the input predictors | 19 | 0.95 |
Understanding the survival prediction output | 20 | 1.00 |
Appropriateness of the font’s size and type | 20 | 1.00 |
Appropriateness of the interface layout | 20 | 1.00 |
Website content: | ||
Understanding the aim of the website | 20 | 1.00 |
Clarity of the target user for the website | 20 | 1.00 |
Clarity of the written website content | 20 | 1.00 |
Appropriateness of the font’s size and type | 19 | 0.95 |
Appropriateness of the overall interface layout | 19 | 0.95 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Nik Ab Kadir, M.N.; Mohd Hairon, S.; Yaacob, N.M.; Yusof, S.N.; Musa, K.I.; Yahya, M.M.; Mohd Isa, S.A.; Mamat Azlan, M.H.; Ab Hadi, I.S. myBeST—A Web-Based Survival Prognostic Tool for Women with Breast Cancer in Malaysia: Development Process and Preliminary Validation Study. Int. J. Environ. Res. Public Health 2023, 20, 2985. https://doi.org/10.3390/ijerph20042985
Nik Ab Kadir MN, Mohd Hairon S, Yaacob NM, Yusof SN, Musa KI, Yahya MM, Mohd Isa SA, Mamat Azlan MH, Ab Hadi IS. myBeST—A Web-Based Survival Prognostic Tool for Women with Breast Cancer in Malaysia: Development Process and Preliminary Validation Study. International Journal of Environmental Research and Public Health. 2023; 20(4):2985. https://doi.org/10.3390/ijerph20042985
Chicago/Turabian StyleNik Ab Kadir, Mohd Nasrullah, Suhaily Mohd Hairon, Najib Majdi Yaacob, Siti Norbayah Yusof, Kamarul Imran Musa, Maya Mazuwin Yahya, Seoparjoo Azmel Mohd Isa, Muhammad Hafizuddin Mamat Azlan, and Imi Sairi Ab Hadi. 2023. "myBeST—A Web-Based Survival Prognostic Tool for Women with Breast Cancer in Malaysia: Development Process and Preliminary Validation Study" International Journal of Environmental Research and Public Health 20, no. 4: 2985. https://doi.org/10.3390/ijerph20042985