Development and Validation of a New Questionnaire to Measure Knowledge Level of Street Food Hawkers to Support the Single-Use Plastics Reduction Program in Kelantan, Malaysia
Abstract
:1. Introduction
2. Material and Methods
2.1. Study Designs and Participant
2.2. Questionnaire Development
2.3. Validation of the Questionnaire
2.3.1. Content Validity
2.3.2. Face Validity
2.3.3. Pretesting Process of Validity
2.3.4. Item Response Theory
2.4. Statistical Analysis
3. Results
3.1. Content Validity of the Questionnaire
3.2. Face Validity of Questionnaire
3.3. Pretesting Process of Validity
3.4. Sociodemographic Characteristics of the Participants
3.5. Knowledge of Food Hawkers on Plastic Food Containers Using IRT Analysis
3.6. Final Version of Validated Knowledge Questionnaire
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- UNEP. Single-Use Plastics: A Roadmap for Sustainability (Rev. 2); UNEP: Nairobi, Kenya, 2018. [Google Scholar]
- Vimal, K.E.K.; Mathiyazhagan, K.; Agarwal, V.; Luthra, S.; Sivakumar, K. Analysis of Barriers That Impede the Elimination of Single-Use Plastic in Developing Economy Context. J. Clean. Prod. 2020, 272, 122629. [Google Scholar] [CrossRef]
- Chen, Y.; Awasthi, A.K.; Wei, F.; Tan, Q.; Li, J. Single-Use Plastics: Production, Usage, Disposal, and Adverse Impacts. Sci. Total Environ. 2021, 752, 141772. [Google Scholar] [CrossRef] [PubMed]
- Ragaert, K.; Delva, L.; Van Geem, K. Mechanical and Chemical Recycling of Solid Plastic Waste. Waste Manag. 2017, 69, 24–58. [Google Scholar] [CrossRef] [PubMed]
- Fauziah, S.H.; Rizman-Idid, M.; Cheah, W.; Loh, K.H.; Sharma, S.; Noor, N.M.; Bordt, M.; Praphotjanaporn, T.; Samah, A.A.; bin Sabaruddin, J.S.; et al. Marine Debris in Malaysia: A Review on the Pollution Intensity and Mitigating Measures. Mar. Pollut. Bull. 2021, 167, 112258. [Google Scholar] [CrossRef]
- Du, F.; Cai, H.; Zhang, Q.; Chen, Q.; Shi, H. Microplastics in Take-out Food Containers. J. Hazard. Mater. 2020, 399, 122969. [Google Scholar] [CrossRef]
- Winkler, A.; Santo, N.; Ortenzi, M.A.; Bolzoni, E.; Bacchetta, R.; Tremolada, P. Does Mechanical Stress Cause Microplastic Release from Plastic Water Bottles? Water Res. 2019, 166, 115082. [Google Scholar] [CrossRef]
- Hernandez, L.M.; Xu, E.G.; Larsson, H.C.E.; Tahara, R.; Maisuria, V.B.; Tufenkji, N. Plastic Teabags Release Billions of Microparticles and Nanoparticles into Tea. Environ. Sci. Technol. 2019, 53, 12300–12310. [Google Scholar] [CrossRef]
- Kasemsup, R.; Neesanan, N. Knowledge, Attitudes and Practices Relating to Plastic Containers for Food and Drinks. J. Med. Assoc. Thail. 2011, 94, S121–S125. [Google Scholar]
- Darbre, P.D. Chemical Components of Plastics as Endocrine Disruptors: Overview and Commentary. Birth Defects Res. 2020, 112, 1300–1307. [Google Scholar] [CrossRef]
- Eriksen, M.; Lebreton, L.; Carson, H.; Thiel, M.; Moore, C.; Borerro, J.; Galgani, F.; Ryan, P.; Reisser, J. Plastic Pollution in the World’s Oceans: More than 5 Trillion Plastic Pieces Weighing over 250,000 Tons Afloat at Sea. PLoS ONE 2014, 9, e111913. [Google Scholar] [CrossRef] [Green Version]
- WWF. WWF Releases Report Proposing Effective Solution to Mitigate Plastic Pollution in Malaysia. Available online: https://www.wwf.org.my/?28105/WWF-Releases-Report-Proposing-Effective-Solution-to-Mitigate-Plastic-Pollution-in-Malaysia (accessed on 10 May 2022).
- Laroche, M.; Bergeron, J.; Barbaro-Forleo, G. Targeting Consumers Who Are Willing to Pay More for Environmentally Friendly Products. J. Consum. Mark. 2001, 18, 503–520. [Google Scholar] [CrossRef] [Green Version]
- Liobikienė, G.; Poškus, M.S. The Importance of Environmental Knowledge for Private and Public Sphere Pro-Environmental Behavior: Modifying the Value-Belief-Norm Theory. Sustainability 2019, 11, 3324. [Google Scholar] [CrossRef] [Green Version]
- Prochaska, J.O.; Velicer, W.F. The Transtheoretical Model of Health Behavior Change. Am. J. Health Promot. 1997, 12, 38–48. [Google Scholar] [CrossRef]
- Dalila, D.; Latif, H.; Jaafar, N.; Aziz, I.; Afthanorhan, A. The Mediating Effect of Personal Values on the Relationships between Attitudes, Subjective Norms, Perceived Behavioral Control and Intention to Use. Manag. Sci. Lett. 2020, 10, 153–162. [Google Scholar] [CrossRef]
- Issa, M.Z.; Rahim, A.N. The Perceptions of Plastic Packaging Usage to Pack Hot Foods among Food Hawkers at Night Markets in Kuala Selangor, Malaysia. Int. Food Res. J. 2018, 25, S75–S78. [Google Scholar]
- Elsheikh, R. University Accommodation’s Food Handlers; Knowledge, Attitude and Practice (KAP) about Using of Selected Plastic Type Foods Contact Materials. Int. J. Environ. Sci. 2016, 5, 188–195. [Google Scholar]
- Saris, W.; Gallhofer, I. Design, Evaluation, and Analysis of Questionnaires for Survey Research; John Wiley & Sons: Hoboken, NJ, USA, 2014. [Google Scholar]
- Acharya, B. Questionnaire Design; Tribhuvan University: Kathmandu, Nepal, 2010. [Google Scholar]
- Dilkes-Hoffman, L.S.; Pratt, S.; Laycock, B.; Ashworth, P.; Lant, P.A. Public Attitudes towards Plastics. Resour. Conserv. Recycl. 2019, 147, 227–235. [Google Scholar] [CrossRef]
- DOSM. Department of Statistics Malaysia Offical Portal. Available online: https://www.dosm.gov.my/v1_/ (accessed on 12 September 2021).
- Şahin, A.; Anıl, D. The Effects of Test Length and Sample Size on Item Parameters in Item Response Theory. Kuram Uygul. Egit. Bilim. 2017, 17, 321–335. [Google Scholar] [CrossRef] [Green Version]
- Menold, N. Double Barreled Questions: An Analysis of the Similarity of Elements and Effects on Measurement Quality. J. Off. Stat. 2020, 36, 855–886. [Google Scholar] [CrossRef]
- Tourangeau, R.; Rips, L.; Rasinski, K. The Psychology of Survey Response; Cambridge University Press: Cambridge, UK, 2000. [Google Scholar]
- McKenna, H.P. The Delphi Technique: A Worthwhile Research Approach for Nursing? J. Adv. Nurs. 1994, 19, 1221–1225. [Google Scholar] [CrossRef]
- Heale, R.; Twycross, A. Validity and Reliability in Quantitative Studies. Evid. Based. Nurs. 2015, 18, 66–67. [Google Scholar] [CrossRef] [Green Version]
- Aithal, A.; Aithal, P.S. Development and Validation of Survey Questionnaire & Experimental Data—A Systematical Review-Based Statistical Approach. Int. J. Manag. Technol. Soc. Sci. 2020, 5, 233–251. [Google Scholar] [CrossRef]
- Artino, J.; Anthony, R.; Jeffrey, S.L.; Dezee, K.J.; Gehlbach, H. Developing Questionnaires for Educational Research: AMEE Guide No. 87. Med. Teach. 2014, 36, 463–474. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Farnik, M.; Aw Pierzchała, W. Instrument Development and Evaluation for Patient-Related Outcomes Assessments. Patient Relat. Outcome Meas. 2012, 3, 1–7. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Roscoe, J.T. Fundamental Research Statistics for The Behavioural Sciences, 2nd ed.; Holt Rinehart Winston: New York, NY, USA, 1975. [Google Scholar]
- Arifin, W.; Yusoff, M. Item Response Theory for Medical Educationists. Educ. Med. J. 2017, 9, 69–81. [Google Scholar] [CrossRef]
- Yusoff, M.S. ABC of Content Validation and Content Validity Index Calculation. Educ. Med. J. 2019, 11, 49–54. [Google Scholar] [CrossRef]
- Polit, D.F.; Beck, C.T. The Content Validity Index: Are You Sure You Know What’s Being Reported? Critique and Recommendations. Res. Nurs. Health 2006, 29, 489–497. [Google Scholar] [CrossRef] [Green Version]
- Yusof, M.S. ABC of Response Process Validation and Face Validity Index Calculation. Educ. Med. J. 2019, 11, 55–61. [Google Scholar] [CrossRef]
- Fadhil, M.; Yaacob, N.A.; Yaacob, N.M. Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps. JMIR Hum. Factors 2018, 5, e10308. [Google Scholar] [CrossRef]
- Little, T.D. The Oxford Handbook of Quantitative Methods in Psychology, Volume 1. Available online: https://books.google.com.my/books?hl=en&lr=&id=kOqOqVMgfzYC&oi=fnd&pg=PA144&dq=the+theory+and+practice+of+irt,+de+ayala&ots=-zP9FpUvTr&sig=-8foZz0PXu_-5nJaLBTaqGA9iKQ&redir_esc=y#v=onepage&q=the theory and practice of irt%2C de ayala&f=false (accessed on 10 September 2021).
- Edelen, M.O.; Reeve, B.B. Applying Item Response Theory (IRT) Modeling to Questionnaire Development, Evaluation, and Refinement. Qual. Life Res. 2007, 16, 5–18. [Google Scholar] [CrossRef]
- Browne, M.W.; Cudeck, R. Alternative Ways of Assessing Model Fit. In Testing Structural Equation Models; SAGE: Beverly Hills, CA, USA, 1993; pp. 132–162. [Google Scholar]
- Dimitrov, D.M. Marginal True-Score Measures and Reliability for Binary Items as a Function of Their IRT Parameters. Appl. Psychol. Meas. 2016, 27, 440–458. [Google Scholar] [CrossRef] [Green Version]
- Brown, T.A. Confirmatory Factor Analysis for Applied Research; Guilford Publications: New York, NY, USA, 2015. [Google Scholar]
- Brown, A.; Croudace, T.J. Scoring and Estimating Score Precision Using Multidimensional IRT Models. In Handbook of Item Response Theory Modeling; Routledge: New York, NY, USA, 2015; pp. 325–351. [Google Scholar] [CrossRef]
- Andersson, B.; Xin, T. Large Sample Confidence Intervals for Item Response Theory Reliability Coefficients. Educ. Psychol. Meas. 2018, 78, 32–45. [Google Scholar] [CrossRef] [Green Version]
- Afroz, R.; Rahman, A.; Masud, M.M.; Akhtar, R. The Knowledge, Awareness, Attitude and Motivational Analysis of Plastic Waste and Household Perspective in Malaysia. Environ. Sci. Pollut. Res. 2017, 24, 2304–2315. [Google Scholar] [CrossRef]
Factors of Questionnaire | No of Items | Content Validity |
---|---|---|
S-CVI/Ave | ||
Factor 1: knowledge on usage of plastic as food container | 7 | 0.92 |
Factor 2: knowledge on chemical materials in plastic food container | 14 | 0.97 |
Factor 3: knowledge on health effect of plastics usage | 16 | 0.88 |
Factor 4: knowledge on environmental effect of plastics usage | 9 | 0.99 |
Factor 5: knowledge on plastic categories | 14 | 0.79 |
Factor 6: knowledge on environment related acts and regulations | 5 | 0.99 |
Factors of Questionnaire | No of Items | Face Validity |
---|---|---|
S-FVI/Ave | ||
Factor 1: knowledge on usage of plastic as food container | 7 | 0.96 |
Factor 2: knowledge on chemical materials in plastic food container | 14 | 0.89 |
Factor 3: knowledge on health effect of plastics usage | 13 | 0.89 |
Factor 4: knowledge on environmental effect of plastics usage | 9 | 0.99 |
Factor 5: knowledge on plastic categories | 13 | 0.87 |
Factor 6: knowledge on environment related acts and regulations | 5 | 0.96 |
Comments | n (%) |
---|---|
Instructions given in this questionnaire: | |
Easily understood | 17 (56.7) |
Take some time to understand | 13 (43.3) |
Difficult to understand on certain sentences | 0 (0.0) |
Sentences used and arrangements in this questionnaire: | |
Easily understood | 26 (86.7) |
Take some time to understand | 4 (13.3) |
Difficult to understand on certain sentences | 0 (0.0) |
Answer choices given in this questionnaire: | |
asily understood | 26 (86.7) |
Take some time to understand | 4 (13.3) |
Difficult to understand on certain sentences | 0 (0.0) |
Type of writing and font size: | |
Met the formatting | 25 (83.3) |
Easy to understand | 9 (30%) |
Need to increase the font size | 1 (3.3) |
The arrangement of questions and images in this questionnaire: | |
Well arranged | 20 (66.7) |
Neat and nice | 9 (30.0) |
Need improvement | 1 (3.3) |
Variables | Mean (SD) | n (%) |
---|---|---|
Age | 36.6 (12.2) | |
Gender | ||
Female | 335 (50.8) | |
Male | 325 (49.2) | |
Educational background | ||
No formal education | 50 (7.7) | |
Secondary school or lower | 323 (48.9) | |
Diploma or equivalent | 226 (34.2) | |
Degree or equivalent | 57 (8.6) | |
Master or equivalent or higher | 4 (0.6) | |
Business experience | ||
Less than 3 years | 236 (35.8) | |
More than 3 years | 424 (64.2) | |
Information source | ||
Social media | 420 (63.5) | |
Television | 366 (55.4) | |
Newspaper | 269 (40.7) | |
Official source | 194 (29.3) | |
Advertisement | 168 (25.4) | |
Radio | 174 (26.3) |
Items | Difficulty (b) | Discrimination (a) | X2(df = 8) | p-Values |
---|---|---|---|---|
KG1 | −1.44 | 1.94 | 10.03 | 0.613 |
KG2 | −3.06 | 1.10 | 10.77 | 0.210 |
KG3 | −3.48 | 0.80 | 63.79 | <0.001 |
KC1 | −1.75 | 1.51 | 21.33 | 0.067 |
KC4 | −1.63 | 1.42 | 20.10 | 0.073 |
KC6.a | −1.50 | 2.09 | 11.90 | 0.371 |
KC6.b | −0.63 | 2.53 | 22.30 | 0.014 |
KC6.c | −0.19 | 2.23 | 16.63 | 0.055 |
KH1.a | −2.85 | 1.38 | 16.32 | 0.177 |
KH1.b | −1.55 | 1.61 | 28.33 | 0.008 |
KH1.c | −0.98 | 1.05 | 22.61 | 0.047 |
KH2.a | −1.47 | 2.01 | 10.14 | 0.604 |
KH2.b | −0.48 | 1.59 | 63.65 | <0.001 |
KH2.d | −0.14 | 1.40 | 45.59 | <0.001 |
KE1 | −2.08 | 2.14 | 22.43 | 0.008 |
KE2 | −2.24 | 1.86 | 21.07 | 0.033 |
KE4 | −1.64 | 1.68 | 67.10 | <0.001 |
KE7 | −1.88 | 2.10 | 23.01 | 0.018 |
KE8 | −1.67 | 2.36 | 16.72 | 0.116 |
KE9 | −2.52 | 1.96 | 15.40 | 0.081 |
KR1 | −0.08 | 1.23 | 45.87 | <0.001 |
KL3.a | −2.67 | 1.43 | 5.54 | 0.938 |
Item No. | Item |
---|---|
KG1 | Disposed single-use plastics will undergo chemical decomposition |
KG2 | Plastic food containers are single-use plastics |
KG3 | There is a campaign on “No Plastic Bag Day” in Malaysia |
KC1 | Polystyrene is a type of plastic |
KC4 | Using plastic containers to wrap hot food causing material from plastic to enter the food |
KC6.a | The effects of plastic chemicals on packed foods are influenced by:(a) food temperature |
KC6.b | (b) Duration of food stored in plastic containers |
KC6.c | (c) Size of plastic food containers used |
KH1.a | Plastic chemicals in food cause long-term effects to the health of consumers in these categories:(a) Baby |
KH1.b | (b) Children |
KH1.c | (c) Teenagers |
KH2.a | Plastic chemicals in food packaging can increase the risk of:(a) Cancer |
KH2.b | (b) Miscarriage |
KH2.d | (c) Foetal malformations |
KE1 | Reducing the use of plastics can help the government reduce the cost of environmental pollution control |
KE2 | Plastic food packaging chemical wastes cause land pollution |
KE4 | There are plastic food wrappers that are not decomposed by the environment |
KE7 | Plastic waste can cause marine pollution |
KE8 | Plastic waste can endanger marine life |
KE9 | Plastic waste burning will cause toxic emissions to the environment |
KR1 | Plastics are classified into 7 groups based on the materials used in its production |
KL3.a | There are laws that prohibit ready-to-eat food from being wrapped with newspaper |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Abdullah, N.B.A.; Yaacob, N.A.; Ismail, A.F. Development and Validation of a New Questionnaire to Measure Knowledge Level of Street Food Hawkers to Support the Single-Use Plastics Reduction Program in Kelantan, Malaysia. Sustainability 2022, 14, 7552. https://doi.org/10.3390/su14137552
Abdullah NBA, Yaacob NA, Ismail AF. Development and Validation of a New Questionnaire to Measure Knowledge Level of Street Food Hawkers to Support the Single-Use Plastics Reduction Program in Kelantan, Malaysia. Sustainability. 2022; 14(13):7552. https://doi.org/10.3390/su14137552
Chicago/Turabian StyleAbdullah, Nur Baizura Aini, Nor Azwany Yaacob, and Ahmad Filza Ismail. 2022. "Development and Validation of a New Questionnaire to Measure Knowledge Level of Street Food Hawkers to Support the Single-Use Plastics Reduction Program in Kelantan, Malaysia" Sustainability 14, no. 13: 7552. https://doi.org/10.3390/su14137552
APA StyleAbdullah, N. B. A., Yaacob, N. A., & Ismail, A. F. (2022). Development and Validation of a New Questionnaire to Measure Knowledge Level of Street Food Hawkers to Support the Single-Use Plastics Reduction Program in Kelantan, Malaysia. Sustainability, 14(13), 7552. https://doi.org/10.3390/su14137552