Broader Terms Curriculum Mapping: Using Natural Language Processing and Visual-Supported Communication to Create Representative Program Planning Experiences
Abstract
:1. Introduction
2. The Context: Curriculum Mapping
3. The Method: Broader Terms Curriculum Mapping
3.1. Step 1: Classification of Course Learning Objectives
3.2. Step 2: Processing of Broader Terms
3.3. Step 3: Visualization of Quantitative Data
3.4. Step 4: Discussion of the Visual Outputs
4. The Case Study: Bachelor Degree in T&IM
4.1. T&IM Bachelor Degree and the Portuguese Accreditation Agency Recommendations
- Increase program-degree mathematical content;
- Steer programming skills towards high-level languages with practical use;
- Strengthen the program plan with important applied industrial management content, namely, in operations management, supply chain management, and operational research;
- Excessive number of courses, some with little additional content;
- Poor integration of topics taught in the different courses.
4.2. T&IM Mappings
4.3. Comparing T&IM Mappings with A3ES Recommendations
4.4. Discussion
5. Conclusions
- (Section 3.1) Classification replaces the head-on discussion of subjective course LO-statements with the much more objective task of selecting broader terms from a control vocabulary.
- (Section 3.2) Natural language processing allows the quantitative analysis of the program plan, providing a way to cut across disciplinary and scientific boundaries, hierarchical and functional differences, and atomized discourses.
- (Section 3.3) Mappings render quantitative results’ interpretation universal and self-explanatory, empowering stakeholders with evidence-based details on weaknesses (and strengths) in the program plan.
- (Section 3.4) The discussion of visual outputs with non-faculty groups allows representative program planning, with these groups’ voices being heard on reclassification and review of course LO-statements.
- (Figure 1) The iterative nature of the method ensures program planning using quantitative elements and stronger links between courses’ LO-statements, allowing a holistic approach to curriculum development.
- Mappings provide evidence supporting the observations, and the broader terms CM method provides an accurate depiction of T&IM program plan weaknesses.
- Key concepts obtained from course LO-statements—and the broader terms CM method—are useful in program planning.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- ABET. ABET Homepage. 2020. Available online: https://www.abet.org/accreditation/accreditation-criteria/ (accessed on 23 July 2020).
- Crawley, E.; Malmqvist, J.; Östlund, S.; Brodeur, D. Rethinking Engineering Education: The CDIO Approach; Springer Science: Berlin/Heidelberg, Germany, 2007. [Google Scholar]
- Sutherland, K. Holistic academic development: Is it time to think more broadly about the academic development project? Int. J. Acad. Dev. 2018, 23, 261–273. [Google Scholar] [CrossRef]
- Wilson, C.; Slade, C. From consultation and collaboration to consensus: Introducing an alternative model of curriculum development. Int. J. Acad. Dev. 2020, 25, 189–194. [Google Scholar] [CrossRef]
- Ornstein, A.; Hunkins, F. Curriculum: Foundations, Principles and Issues; Pearson: London, UK, 2018; ISBN 978-1-292-16207-2. [Google Scholar]
- Burns, R. Curriculum Mapping. Association for Supervision and Curriculum Development. 2001. Available online: http://www.ascd.org/publications/curriculum-handbook/421/chapters/Overview.aspx (accessed on 17 October 2020).
- Meij, L.; Merx, S. Improving curriculum alignment and achieving learning goals by making the curriculum visible. Int. J. Acad. Dev. 2018, 23, 219–231. [Google Scholar] [CrossRef]
- Felder, R.; Brent, R. Designing and teaching courses to satisfy the ABET engineering criteria. J. Eng. Educ. 2003, 1, 7–25. [Google Scholar] [CrossRef]
- Dyjur, P.; Lock, J. Three strategies for moving curriculum mapping online. Educ. Dev. 2016, 17, 15–19. [Google Scholar]
- Harden, R. AMEE Guide No. 21: Curriculum mapping: A tool for transparent and authentic teaching and learning. Med. Teach. 2001, 23, 123–137. [Google Scholar] [CrossRef] [PubMed]
- Spady, W. Organising the results: The basis of authentic restructuring and reform. Educ. Leadersh. 1988, 46, 4–8. [Google Scholar]
- Biggs, J.; Tang, C. Teaching for Quality Learning at University; McGraw-Hill & Open University Press: Berkshire, UK, 2011; ISBN 978-0-33-524276-4. [Google Scholar]
- Willcox, K.; Huang, L. Network models for mapping educational data. Des. Sci. 2017, 3, e18. [Google Scholar] [CrossRef]
- Koedinger, K.; Corbett, A.; Perfetti, C. The knowledge-learning-instruction framework: Bridging the science-practice chasm to enhance robust student learning. Cogn. Sci. 2012, 36, 757–798. [Google Scholar] [CrossRef]
- Seering, J.; Huang, L.; Willcox, K. Mapping outcomes in an undergraduate aerospace engineering program. In Proceedings of the 2015 ASEE Annual Conference & Exposition, Seattle, WD, USA, 14–17 June 2015. [Google Scholar]
- Varagnolo, D.; Knorn, S.; Staffas, K.; Fjällström, E.; Wrigstad, T. Graph-theoretic approaches and tools for quantitatively assessing curricula coherence. Eur. J. Eng. Educ. 2020, 46, 344–363. [Google Scholar] [CrossRef]
- Krzywinski, M.; Schein, J.; Birol, I.; Connors, J.; Gascoyne, R.; Horsman, D.; Jones, S.; Marra, M. Circos: An information aesthetic for comparative genomics. Genome Res. 2009, 19, 1639–1645. [Google Scholar] [CrossRef]
- Rosen, K. Discrete Mathematics and Its Applications; McGraw-Hill: New York, NY, USA, 2009. [Google Scholar]
- Duarte, R. Supplementary Material for the Paper “Broader Terms Curriculum Mapping: Using Natural Language Processing and Visual-Supported Communication to Create Representative Program Planning Experiences”. Zenodo. 2020. Available online: https://zenodo.org/records/4313364 (accessed on 29 December 2023).
- Wikipedia Contributors. Wikipedia Indices—Wikipedia, The Free Encyclopedia. 2020. Available online: https://en.wikipedia.org/w/index.php?search=wikipedia&title=Special%3ASearch&profile=advanced&fulltext=1&advancedSearch-current=%7B%7D&ns0=1 (accessed on 30 October 2020).
- Ballantyne, N.; Hay, K.; Beddoe, L.; Maidment, J.; Walker, S. Mapping and Visualizing the Social Work Curriculum. J. Technol. Hum. Serv. 2019, 37, 184–202. [Google Scholar] [CrossRef]
- Watts, L.; Hodgson, D. Whole Curriculum Mapping of Assessment: Cartographies of Assessment and Learning. Soc. Work. Educ. 2015, 34, 682–699. [Google Scholar] [CrossRef]
- Adam, S. Using Learning Outcomes: A Consideration of the Nature, Role, Application and Implications for European Education of Emplying Learning Outcomes at the Local, National and International Levels; Technical Report; United Kingdom Bologna Seminar, Heriot-Watt University: Edinburgh, UK, 2004; Available online: http://www.aic.lv/ace/ace{_}disk/Bologna/Bol{_}semin/Edinburgh/ (accessed on 29 December 2023).
- Bloom, B. Taxonomy of Educational Objectives, Book I: The Cognitive Domain; Addison-Wesley Longman Ltd.: North York, ON, Canada, 1956; ISBN 978-0582280106. [Google Scholar]
- Hussey, T.; Smith, P. The uses of learning Outcomes. Teach. High. Educ. 2003, 8, 357–368. [Google Scholar] [CrossRef]
- Lam, B.; Tsui, K. Curriculum mapping as deliberation: Examining the alignment of subject learning outcomes and course curricula. Stud. High. Educ. 2016, 41, 1371–1388. [Google Scholar] [CrossRef]
- Lancaster, F. Indexing and Abstracting in Theory and Practice, 3rd ed.; Facet: London, UK, 2003; ISBN 1-85604-482-3. [Google Scholar]
- Library of Congress. Library of Congress Subject Headings, S/D. Available online: https://id.loc.gov/authorities/subjects.html (accessed on 23 July 2020).
- UNESCO. Unesco Thesaurus, S/D. Available online: http://vocabularies.unesco.org/browser/thesaurus/en/ (accessed on 23 July 2020).
- EUROVOC. Eurovoc Thesaurus, S/D. Available online: https://op.europa.eu/en/web/eu-vocabularies/th-top-concept-scheme/-/resource/eurovoc/100141?target=Browse (accessed on 23 July 2020).
- IEEE. IEEE Thesaurus: Version 1.0. 2019. Available online: https://www.ieee.org/publications/services/thesaurus-access-page.html (accessed on 23 July 2020).
- Bergman, M. Shaping Wikipedia into a Computable Knowledge Base. AI3, Adaptive Information Blog. 2015. Available online: https://www.mkbergman.com/1847/shaping-wikipedia-into-a-computable-knowledge-base/ (accessed on 23 July 2020).
- Joorabchi, A.; Mahdi, A. Towards linking libraries and Wikipedia: Automatic subject indexing of library records with Wikipedia concepts. J. Inf. Sci. 2013, 40, 211–221. [Google Scholar] [CrossRef]
- Golub, K. Automatic Subject Indexing of Text, S/D; Hjorland, B., Gnoli, C., Eds.; Encyclopedia of Knowledge Organization: Copenhagen, Denmark; Available online: https://www.isko.org/cyclo/automatic (accessed on 23 July 2020).
- West, J. Validating curriculum development using text mining. Curric. J. 2016, 28, 389–402. [Google Scholar] [CrossRef]
- Manning, C.; Schütze, H. Foundations of Statistical Natural Language Processing, 2nd ed.; The MIT Press: Cambridge, MA, USA, 1999. [Google Scholar]
- West, J. Teaching data science: An objective approach to curriculum validation. Comput. Sci. Educ. 2018, 28, 136–157. [Google Scholar] [CrossRef]
- R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2019; Available online: https://www.R-project.org/ (accessed on 29 December 2023).
- Fellows, I. Wordcloud: Word Clouds. R Package Version 2.6. 2018. Available online: https://CRAN.R-project.org/package=wordcloud (accessed on 29 December 2023).
- Gu, Z.; Gu, L.; Eils, R.; Schlesner, M.; Brors, B. circlize implements and enhances circular visualization in r. Bioinformatics 2014, 30, 2811–2812. [Google Scholar] [CrossRef]
- Csardi, G.; Nepusz, T. The Igraph Software Package for Complex Network Research. InterJournal, Complex Systems: 1695. 2006. Available online: http://igraph.org (accessed on 29 December 2023).
- Fruchterman, T.; Reingold, E. Graph drawing by force-directed placement. Softw.-Pract. Exp. 1991, 21, 1129–1164. [Google Scholar] [CrossRef]
- Schein, E. Kurt Lewin’s change theory in the field and in the classroom: Notes toward a model of managed learning. Reflections 1999, 1, 59–74. Available online: https://www.solonline.org/resources/ (accessed on 29 December 2023). [CrossRef]
- Arafeh, S. Curriculum mapping in higher education: A case study and proposed content scope and sequence mapping tool. J. Furth. High. Educ. 2016, 40, 585–611. [Google Scholar] [CrossRef]
- Duarte, R.; Pires, A.R.; Gonçalves, H. Identifying at-risk students in higher education. Total Qual. Manag. Bus. Excell. 2014, 25, 944–995. [Google Scholar] [CrossRef]
- Duarte, R.; Pires, A.L.O.; Nobre, A.L. Mature Learners’ Participation in Higher Education and Flexible Learning Pathways: Lessons Learned from an Exploratory Experimental Research; Springer: Berlin/Heidelberg, Germany, 2018; Chapter 2; pp. 33–53. [Google Scholar] [CrossRef]
- Lourenço, R.; Ferreira, E.; Duarte, R.; Gonçalves, H.; Duarte, H. IPS’ technology and industrial management graduate course: A curriculum follow-up analysis. In Proceedings of the 1st European Conference on Curriculum Studies, Future Directions: Uncertainty and Possibility, Braga, Portugal, 18–19 October 2013; pp. 263–269. [Google Scholar]
- A3ES. Regulations on the Assessment and Accreditation Procedures—[Portuguese] Agency for the Assessment and Accreditation of Higher Education. 2013. Available online: https://www.a3es.pt/en/accreditation-and-audit/normative-framework/regulations-assessment-and-accreditation-procedures (accessed on 27 November 2020).
- Wang, C.-L. Mapping or tracing? Rethinking curriculum mapping in higher education. Stud. High. Educ. 2015, 40, 1550–1559. [Google Scholar] [CrossRef]
- Bagui, S.; Earp, R. Database Design Using Entity-Relationship Diagrams; Auerbach Publications: Boca Raton, FL, USA, 2003; ISBN 0849315484. [Google Scholar]
- Chen, P. The Entity Relationship Model: Toward a Unified View of Data. ACM Trans. Database Syst. 1976, 1, 312–339. [Google Scholar] [CrossRef]
- Leff, A.; Rayfield, J. Web-application development using the model/view/controller design pattern. In Proceedings of the Fifth IEEE International Enterprise Distributed Object Computing Conference, EDOC’01, Seattle, WA, USA, 4–7 September 2001; National Committee of Inquiry into Higher Education: London, UK, 2001; pp. 118–127. [Google Scholar]
Course | Learning Objectives | Broader Terms |
---|---|---|
Mathematics (C1:MATH) | Recognize a real-valued function of a real variable; (…) Recall the concept of derivative of a real function and explain its geometric interpretation; (…) | Function of a real variable; Differential calculus; Integral calculus; Linear algebra; System of linear equations |
Applied Physics (C2:PHY) | List fundamental concepts in mechanics and understand their importance to engineering; Use the international units (…) | Physics; Mathematics; Calculus; Mechanics; Thermodynamics; Fluid flow |
Logistics and Oper. Manag. (C3:LOGOP) | Identify logistic activities in a generic organization; Explain the role of contemporary logistics; (…) Distinguish components of supply chain management (…) | Logistics; Supply chain management; Business; Production Economics; Operations management; Linear programming; Lean manufacturing; Process Control (…) |
Energy Manag. (C4:ENER) | Discuss the efficient use of energy in industry, buildings and transports; Recognize applicable legislation and defend energy efficiency as (…) | Energy efficiency; Organization; Buildings; Facility management; Logistics; Production planning and control; Solar water heating (…) |
Financial Manag. (C5:FIN) | List fundamental financial management concepts and functions; Recognize and explain financial statements; Contrast the economic and the financial analysis (…) | Financial management; Accounting; Economics; Finance; Organization; Business governance; Corporate law; Trade; Return on invested capital (…) |
A3ES Recommendation | Evidence from Mappings | |
---|---|---|
i. | Increase program-degree mathematical content | Small number of mathematics-related key concepts and poor integration of mathematics-related courses |
ii. | Steer programming skills towards high-level languages with practical use | Very small number of programming-related key concepts and detached location of the programming course |
iii. | Strengthen the program plan with important applied industrial management content, namely, in operations management, supply chain management and operational research | Comparison of frequencies of applied industrial management key concepts with frequencies of generic managerial key concepts sheds light on the relative weight of each group in the program plan |
iv. | Excessive number of courses, some with little additional content | Identifies and sorts courses with few (and with no) links to core program courses. |
v. | Poor integration of topics taught in the different courses | Divide between engineering and management, visible both in key program concept and in course mappings |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Duarte, R.; Lacerda Nobre, Â.; Pimentel, F.; Jacquinet, M. Broader Terms Curriculum Mapping: Using Natural Language Processing and Visual-Supported Communication to Create Representative Program Planning Experiences. Appl. Syst. Innov. 2024, 7, 7. https://doi.org/10.3390/asi7010007
Duarte R, Lacerda Nobre Â, Pimentel F, Jacquinet M. Broader Terms Curriculum Mapping: Using Natural Language Processing and Visual-Supported Communication to Create Representative Program Planning Experiences. Applied System Innovation. 2024; 7(1):7. https://doi.org/10.3390/asi7010007
Chicago/Turabian StyleDuarte, Rogério, Ângela Lacerda Nobre, Fernando Pimentel, and Marc Jacquinet. 2024. "Broader Terms Curriculum Mapping: Using Natural Language Processing and Visual-Supported Communication to Create Representative Program Planning Experiences" Applied System Innovation 7, no. 1: 7. https://doi.org/10.3390/asi7010007