Exploring the Conceptual Model and Instructional Design Principles of Intelligent Problem-Solving Learning
Abstract
1. Introduction
- What is the conceptual model of IPSL that reflects the demands of AI-integrated, future-oriented education?
- What are the instructional design principles that can guide the implementation of the IPSL model in educational practice?
- To what extent do experts evaluate the validity, coherence, and applicability of the proposed IPSL model and its instructional design principles?
2. Theoretical Background
2.1. Paradigm Shift in the Concepts of Learning and Capability
2.2. Human–AI Collaboration and Augmented Intelligence
2.3. Deriving the Conceptual Structure of IPSL from Theoretical and Empirical Foundations
3. Methods
3.1. Stage 1: Model Development Through Literature Review
- Identification: A total of 482 records were retrieved through database searches, with an additional 23 records identified from other sources, such as policy reports and grey literature.
- Screening: After removing duplicates, 430 unique records were retained. Titles and abstracts were reviewed for relevance, resulting in the exclusion of 320 records that did not pertain to instructional design, AI in education, or sustainability-related themes.
- Eligibility: 110 full-text articles were assessed for eligibility based on their theoretical robustness, empirical contribution, and instructional relevance. Of these, 55 were excluded due to insufficient conceptual grounding or lack of empirical rigor.
- Inclusion: A final set of 55 studies was included in the qualitative synthesis. These served as the theoretical and empirical foundation for the development of the IPSL model and the formulation of its design principles.
- -
- -
- -
Qualitative Synthesis Strategy
- Initial coding: Each included study was reviewed and coded for theoretical constructs (e.g., connectivism, extended mind, and capability approach), instructional considerations (e.g., AI affordances, learner agency, and task structure), and educational outcomes (e.g., future-readiness, ethical discernment, and adaptive learning).
- Formation of descriptive themes: Codes were grouped to form broader thematic categories capturing shared concerns and priorities across the studies. These descriptive themes included aspects such as “value-oriented learning,” “human–AI task distribution,” and “metacognitive strategy use.”
- Derivation of analytical domains: Through abstraction and reinterpretation, three core domains emerged as essential for intelligent problem-solving in future-ready education:
- Fostering sustainable human values: Emphasizing the cultivation of ethical reasoning, emotional intelligence, and life purpose as central to education in the AI era.
- Structuring task execution via role differentiation: Distinguishing between human-exclusive tasks, human–AI collaborative tasks, and tasks fully delegable to AI, to clarify roles and responsibilities within learning processes.
- Promoting adaptive and reflective thinking: Highlighting the importance of metacognitive and meta-emotional strategies for navigating complex and unpredictable problems.
- Model integration: These three analytical domains collectively informed the conceptual structure of the IPSL framework and served as an organizing logic for the derivation of its instructional design principles. The principles were initially drafted based on the thematic synthesis and later subjected to expert validation to refine their clarity, coherence, and applicability.
3.2. Stage 2: Expert Validation
3.2.1. Expert Panel Composition
3.2.2. Review Process and Evaluation Criteria
- Conceptual clarity: Are the core concepts clearly defined and easily understandable?
- Theoretical validity: Is the model grounded in established educational theory and conceptually coherent?
- Internal coherence: Do the components demonstrate logical consistency and alignment with one another?
- Comprehensiveness: Does the model encompass all essential elements required to support the development of human values?
- Visual communicability: Does the diagram effectively illustrate the relationships among components and convey the overarching message?
- Innovativeness: Does the model introduce novel or creative perspectives appropriate for AI-integrated educational contexts?
- Validity: Is the principle appropriate and contextually relevant to IPSL?
- Clarity: Are the statements expressed in clear, concise, and unambiguous terms?
- Usefulness: Can the principle be practically applied in instructional settings?
- Universality: Is the principle adaptable across various educational levels and contexts?
- Comprehensibility: Is the principle easily understood by both instructors and learners?
- Content Validity Index (CVI): Calculated as the proportion of experts rating an item as either 3 or 4, divided by the total number of reviewers. A CVI of 0.80 or above was considered acceptable [49].
- Inter-Rater Agreement (IRA): To assess the consistency among expert ratings, IRA was calculated as the proportion of items for which at least 75% of the experts (i.e., six out of eight) provided the same rating. An IRA value of 0.75 or higher was considered satisfactory, following the guidelines commonly used in scale development and expert validation studies [50].
4. Expert Review Results
4.1. Validation of the IPSL Conceptual Model
4.2. Expert Validation of Instructional Design Principles
5. Conceptual Model and Design Principles of IPSL
- Tasks that must be performed exclusively by humans,
- Tasks that require collaboration between humans and AI.
- Tasks that can be effectively delegated to AI systems.
5.1. Pursuit of Inherent Human Values
5.1.1. Pursuit of Personal Values
5.1.2. Pursuit of Community Values
5.2. Strategic Approaches for Value Pursuit
5.2.1. Meta-Learning
5.2.2. Solving Unpredictable and Complex Problems
5.2.3. Future-Oriented Capability
5.3. Human–AI Collaborative Structures
5.3.1. Tasks Exclusive to Humans
5.3.2. Human–AI Collaborative Tasks
5.3.3. Tasks Delegated to AI
6. Future Research and Recommendations
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Utecht, J.; Keller, D. Becoming relevant again: Applying connectivism learning theory to today’s classrooms. Crit. Quest. Educ. 2019, 10, 107–119. Available online: https://eric.ed.gov/?id=EJ1219672 (accessed on 27 May 2024).
- Siemens, G. Connectivism: Learning as network-creation. ASTD Learn. News 2005, 10, 1–28. [Google Scholar]
- Downes, S. Places to go: Connectivism & connective knowledge. Innovate J. Online Educ. 2008, 5, 6. Available online: https://nsuworks.nova.edu/innovate/vol5/iss1/6 (accessed on 27 May 2024).
- Clark, A.; Chalmers, D. The extended mind. Analysis 1998, 58, 7–19. [Google Scholar] [CrossRef]
- Paul, A.M. Extended Mind: The Power of Thinking Outside the Brain; Mariner Books: Boston, MA, USA, 2022. [Google Scholar]
- Fraser, S.W.; Greenhalgh, T. Coping with complexity: Educating for capability. BMJ 2001, 323, 799–803. [Google Scholar] [CrossRef]
- Jain, V.; Oweis, E.; Woods, C.J. Mapping the distance: From competence to capability. ATS Sch. 2023, 4, 400–404. [Google Scholar] [CrossRef] [PubMed]
- Sakata, N. Capability approach to valued pedagogical practices in Tanzania: An alternative to learner-centered pedagogy? J. Hum. Dev. Capab. 2021, 22, 663–681. [Google Scholar] [CrossRef]
- Dede, C.; Etemadi, A.; Forshaw, T. Intelligence Augmentation: Upskilling Humans to Complement AI; The Next Level Lab at the Harvard Graduate School of Education, President and Fellows of Harvard College: Cambridge, MA, USA, 2021. [Google Scholar]
- Ali Elfa, M.A.; Dawood, M.E.T. Using artificial intelligence for enhancing human creativity. J. Art Des. Music 2023, 2, 3. [Google Scholar] [CrossRef]
- Xing, Z.; Ma, G.; Wang, L.; Yang, L.; Guo, X.; Chen, S. Towards visual interaction: Hand segmentation by combining 3D graph deep learning and laser point cloud for intelligent rehabilitation. IEEE Internet Things J. 2025, 12, 21328. [Google Scholar] [CrossRef]
- Xing, Z.; Meng, Z.; Zheng, G.; Ma, G.; Yang, L.; Guo, X.; Tan, L.; Jiang, Y.; Wu, H. Intelligent rehabilitation in an aging population: Empowering human-machine interaction for hand function rehabilitation through 3D deep learning and point cloud. Front. Comput. Neurosci. 2025, 19, 1543643. [Google Scholar] [CrossRef]
- Gerlich, M. AI Tools in Society: Impacts on Cognitive Offloading and the Future of Critical Thinking. Societies 2025, 15, 6. [Google Scholar] [CrossRef]
- Kosmyna, N.; Hauptmann, E.; Yuan, Y.T.; Situ, J.; Liao, X.H.; Beresnitzky, A.V.; Braunstein, I.; Maes, P. Your Brain on ChatGPT: Accumulation of Cognitive Debt When Using an AI Assistant for Essay Writing Task. arXiv 2025, arXiv:2506.08872. [Google Scholar] [CrossRef]
- Lee, H.-P.; Sarkar, A.; Tankelevitch, L.; Drosos, I.; Rintel, S.; Banks, R.; Wilson, N. The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects from a Survey of Knowledge Workers. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, 26 April–1 May 2025; pp. 1–22. [Google Scholar]
- AlDahdouh, A.A.; Osório, A.; Caires, S. Understanding knowledge network, learning and connectivism. Int. J. Instr. Technol. Distance Learn. 2015, 12, 3–21. [Google Scholar]
- Hase, S. Learner defined curriculum: Heutagogy and action learning in vocational training. S. Inst. Technol. J. Appl. Res. 2011, 1, 1–10. [Google Scholar]
- Li, D.H.; Towne, J. How AI and human teachers can collaborate to transform education. In Proceedings of the World Economic Forum Annual Meeting, Davos-Klosters, Switzerland, 20–24 January 2025; Available online: https://www.weforum.org/stories/2025/01/how-ai-and-human-teachers-can-collaborate-to-transform-education/ (accessed on 15 January 2025).
- Dellermann, D.; Calma, A.; Lipusch, N.; Weber, T.; Weigel, S.; Ebel, P. The future of human–AI collaboration: A taxonomy of design knowledge for hybrid intelligence systems. arXiv 2021, arXiv:2105.03354. [Google Scholar]
- Gerlich, M. Perceptions and Acceptance of Artificial Intelligence: A Multi-Dimensional Study. Soc. Sci. 2023, 12, 502. [Google Scholar] [CrossRef]
- Gerlich, M. Exploring Motivators for Trust in the Dichotomy of Human–AI Trust Dynamics. Soc. Sci. 2024, 13, 251. [Google Scholar] [CrossRef]
- Rubin, C. Artificial intelligence and human nature. New Atlantis 2003, 1, 88–100. Available online: https://thenewatlantis.com/wp-content/uploads/legacy-pdfs/TNA01-Rubin.pdf (accessed on 27 May 2024).
- Alamin, F.; Sauri, S. Education in the era of artificial intelligence: Axiological study. Progres Pendidik. 2024, 5, 146–150. [Google Scholar] [CrossRef]
- Rodríguez, N.D.; Ser, J.; Coeckelbergh, M.; Prado, M.L.D.; Herrera-Viedma, E.; Herrera, F. Connecting the dots in trustworthy artificial intelligence: From AI principles, ethics, and key requirements to responsible AI systems and regulation. Inf. Fusion 2023, 99, 101896. [Google Scholar] [CrossRef]
- Garibay, O.O.; Winslow, B.D.; Andolina, S.; Antona, M.; Bodenschatz, A.; Coursaris, C.K.; Falco, G.; Fiore, S.; Garibay, I.I.; Grieman, K.; et al. Six human-centered artificial intelligence grand challenges. Int. J. Hum.-Comput. Interact. 2023, 39, 391–437. [Google Scholar] [CrossRef]
- Pekrun, R. The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educ. Psychol. Rev. 2006, 18, 315–341. [Google Scholar] [CrossRef]
- Zimmerman, B.J. Becoming a self-regulated learner: An overview. Theory Pract. 2002, 41, 64–70. [Google Scholar] [CrossRef]
- Garner, P.W. Emotional competence and its influences on teaching and learning. Educ. Psychol. Rev. 2010, 22, 297–321. [Google Scholar] [CrossRef]
- Mayer, J.D.; Salovey, P. What is emotional intelligence? In Emotional Development and Emotional Intelligence: Educational Implications; Salovey, P., Sluyter, D., Eds.; Basic Books: New York, NY, USA, 1997; pp. 3–31. [Google Scholar]
- Jonassen, D.H. Toward a design theory of problem solving. Educ. Technol. Res. Dev. 2000, 48, 63–85. [Google Scholar] [CrossRef]
- Aquino, Y.S.J.; Carter, S.; Houssami, N.; Braunack-Mayer, A.; Win, K.; Degeling, C.; Wang, L.; Rogers, W. Practical, epistemic and normative implications of algorithmic bias in healthcare artificial intelligence: A qualitative study of multidisciplinary expert perspectives. J. Med. Ethics 2023, in press. [Google Scholar] [CrossRef] [PubMed]
- Phelps, R.; Hase, S.; Ellis, A. Competency, capability, complexity and computers: Exploring a new model for conceptualising end-user computer education. Br. J. Educ. Technol. 2005, 36, 67–84. [Google Scholar] [CrossRef]
- Holdsworth, S.; Thomas, I. Competencies or capabilities in the Australian higher education landscape and its implications for the development and delivery of sustainability education. High. Educ. Res. Dev. 2020, 40, 1466–1481. [Google Scholar] [CrossRef]
- Lombardi, M.M. Authentic Learning for the 21st Century: An Overview. EDUCAUSE Learn. Initiat. 2007. Available online: https://library.educause.edu/resources/2007/1/authentic-learning-for-the-21st-century-an-overview (accessed on 27 May 2024).
- Jain, R.; Garg, N.; Khera, S.N. Effective human–AI work design for collaborative decision-making. Kybernetes 2022, 52, 5017–5040. [Google Scholar] [CrossRef]
- Zhou, L.; Paul, S.; Demirkan, H.; Yuan, L.; Spohrer, J.; Zhou, M.; Basu, J. Intelligence augmentation: Towards building human–machine symbiotic relationship. AIS Trans. Hum.-Comput. Interact. 2021, 13, 243–264. [Google Scholar] [CrossRef]
- Huo, Y. How AI ideas affect the creativity, diversity, and evolution of human ideas. arXiv 2023, arXiv:2401.01348. [Google Scholar]
- Davenport, T.H.; Ronanki, R. Artificial intelligence for the real world. Harv. Bus. Rev. 2018, 96, 108–116. Available online: https://hbr.org/2018/01/artificial-intelligence-for-the-real-world (accessed on 27 May 2024).
- Tribe AI. The Problem of Content Overload in Higher Education—And How AI Solves It. Tribe AI. 2025. Available online: https://www.tribe.ai/applied-ai/ai-and-content-overload-in-higher-education (accessed on 27 May 2024).
- Richey, R.C.; Klein, J.D. Design and Development Research: Methods, Strategies and Issues; Lawrence Erlbaum Associates: Mahwah, NJ, USA, 2007. [Google Scholar]
- Churchill, D. Conceptual model design and learning uses. Interact. Learn. Environ. 2013, 21, 54–67. [Google Scholar] [CrossRef]
- Islam, N.M.; Laughter, L.; Sadid-Zadeh, R.; Smith, C.; Dolan, T.A.; Crain, G.; Squarize, C.H. Adopting artificial intelligence in dental education: A model for academic leadership and innovation. J. Dent. Educ. 2022, 86, 1545–1551. [Google Scholar] [CrossRef]
- Luft, J.; Jeong, S.; Idsardi, R.; Gardner, G.E. Literature reviews, theoretical frameworks, and conceptual frameworks: An introduction for new biology education researchers. CBE Life Sci. Educ. 2022, 21, 3. [Google Scholar] [CrossRef]
- Selvik, J.; Abrahamsen, E.; Moen, V. Conceptualization and application of a healthcare systems thinking model for an educational system. Stud. High. Educ. 2022, 47, 1872–1889. [Google Scholar] [CrossRef]
- Sleegers, P.; Brok, P.D.D.; Verbiest, E.; Moolenaar, N.; Daly, A. Toward Conceptual Clarity: A Multidimensional, Multilevel Model of Professional Learning Communities in Dutch Elementary Schools. Elem. Sch. J. 2013, 114, 118–137. [Google Scholar] [CrossRef]
- Jung, E.; Lim, R.; Kim, D. A schema-based instructional design model for self-paced learning environments. Educ. Sci. 2022, 12, 271. [Google Scholar] [CrossRef]
- Kang, J.C. The development of instructional design principles for creativity convergence education. Korean J. Educ. Methodol. Stud. 2015, 27, 276–305. [Google Scholar] [CrossRef]
- Ryu, G.T.; Park, K.O. Developing study on instructional design principles based on the social studies blended learning for students with disabilities in inclusive environments. J. Spec. Educ. Curric. Instr. 2022, 15, 1–29. [Google Scholar] [CrossRef]
- Lynn, M.R. Determination and quantification of content validity. Nurs. Res. 1986, 35, 382–385. [Google Scholar] [CrossRef]
- Gwet, K.L. Handbook of Inter-Rater Reliability: The Definitive Guide to Measuring the Extent of Agreement Among Raters, 4th ed.; Advanced Analytics, LLC: Gaithersburg, MD, USA, 2014. [Google Scholar]
- Harvard University. Teaching Resources for Artificial Intelligence. Available online: https://www.harvard.edu/ai/teaching-resources/ (accessed on 20 April 2025).
- Fadel, C.; Black, A.; Tylor, R.; Slesinski, J.; Dunn, K. Education for the Age of AI; Center for Curriculum Redesign: Boston, MA, USA, 2024. [Google Scholar]
- Stanton, J.D.; Sebesta, A.J.; Dunlosky, J. Fostering metacognition to support student learning and performance. CBE Life Sci. Educ. 2021, 20, 2. [Google Scholar] [CrossRef] [PubMed]
- Schunk, D.H.; Greene, J.A.; Zimmerman, B. Handbook of Self-Regulation of Learning and Performance, 2nd ed.; Routledge: New York, NY, USA, 2017. [Google Scholar]
- Hyperspace. Achieve Goals with AI-Enabled Goal Setting in VR Training. 2023. Available online: https://hyperspace.mv/ai-enabled-goal-setting-skills-development-in-vr/ (accessed on 27 May 2024).
- Zakrajsek, T.D. Teaching students AI strategies to enhance metacognitive processing. Scholarly Teach. 2023. Available online: https://www.scholarlyteacher.com/post/teaching-students-ai-strategies-to-enhance-metacognitive-processing (accessed on 27 May 2024).
- Flavell, J.H. Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry. Am. Psychol. 1979, 34, 906–911. [Google Scholar] [CrossRef]
- Schraw, G.; Dennison, R.S. Assessing metacognitive awareness. Contemp. Educ. Psychol. 1994, 19, 460–475. [Google Scholar] [CrossRef]
- Garrison, D.R.; Akyol, Z. Toward the development of a metacognition construct for communities of inquiry. Internet High. Educ. 2015, 24, 66–71. [Google Scholar] [CrossRef]
- Pekrun, R.; Goetz, T.; Titz, W.; Perry, R.P. Academic emotions in students’ self-regulated learning and achievement: A program of qualitative and quantitative research. Educ. Psychol. 2002, 37, 91–105. [Google Scholar] [CrossRef]
- Kim, T.Y.; Cable, D.M.; Kim, S.P.; Wang, J. Emotional competence and work performance: The mediating effect of proactivity and the moderating effect of job autonomy. J. Organ. Behav. 2009, 30, 983–1000. [Google Scholar] [CrossRef]
- Meng, J.; Rheu, M.; Zhang, Y.; Dai, Y.; Peng, W. Mediated social support for distress reduction: AI chatbots vs. human. Proc. ACM Hum.-Comput. Interact. 2023, 7, 1–25. [Google Scholar] [CrossRef]
- ADR Times. Complex vs Complicated Understanding the Differences. 2024. Available online: https://adrtimes.com/complex-vs-complicated/ (accessed on 27 May 2024).
- Iancu, P.; Lanteigne, I. Advances in social work practice: Understanding uncertainty and unpredictability of complex non-linear situations. J. Soc. Work 2020, 22, 139–140. [Google Scholar] [CrossRef]
- Hunter, L.Y.; Albert, C.; Rutland, J.; Hennigan, C. The fourth industrial revolution, artificial intelligence, and domestic conflict. Glob. Soc. 2023, 37, 375–396. [Google Scholar] [CrossRef]
- Raisch, S.; Fomina, K. Combining human and artificial intelligence: Hybrid problem-solving in organizations. Acad. Manag. Rev. 2025, 50, 441–464. [Google Scholar] [CrossRef]
- Wang, X.; Lu, Y.; Zhao, Y.; Gong, S.; Li, B. Organisational unlearning, organisational flexibility and innovation capability: An empirical study of SMEs in China. Int. J. Technol. Manag. 2013, 61, 132–155. [Google Scholar] [CrossRef]
- Malone, T.W. Superminds: The Surprising Power of People and Computers Thinking Together; Little Brown Spark: New York, NY, USA, 2018. [Google Scholar]
- Brynjolfsson, E.; McAfee, A. Machine, Platform, Crowd: Harnessing Our Digital Future; W.W. Norton & Company: New York, NY, USA, 2017. [Google Scholar]
- Donelle, L.; Comer, L.; Hiebert, B.; Hall, J.; Shelley, J.J.; Smith, M.J.; Kothari, A.; Burkell, J.; Stranges, S.; Cooke, T.; et al. Use of digital technologies for public health surveillance during the COVID-19 pandemic: A scoping review. Digit. Health 2023, 9, 20552076231173220. [Google Scholar] [CrossRef]
- Morss, R.; Wilhelmi, O.V.; Meehl, G.; Dilling, L. Improving societal outcomes of extreme weather in a changing climate: An integrated perspective. Annu. Rev. Environ. Resour. 2011, 36, 1–25. [Google Scholar] [CrossRef]
- Fidler, D.; Williams, S. Future Skills: Update and Literature Review. Prepared for ACT Foundation and the Joyce Foundation. Institute for the Future. 2016. Available online: https://www.iftf.org/futureskills (accessed on 4 July 2025).
- Schicktanz, S.; Welsch, J.; Schweda, M.; Hein, A.; Rieger, J.; Kirste, T. AI-assisted ethics? Considerations of AI simulation for the ethical assessment and design of assistive technologies. Front. Genet. 2023, 14, 1176751. [Google Scholar] [CrossRef]
- Burton, J.W.; Stein, M.K.; Jensen, T.B. A systematic review of algorithm aversion in augmented decision making. J. Behav. Decis. Mak. 2020, 33, 220–239. [Google Scholar] [CrossRef]
- Metcalf, L.; Askay, D.A.; Rosenberg, L.B. Keeping humans in the loop: Pooling knowledge through artificial swarm intelligence to improve business decision making. Calif. Manag. Rev. 2019, 61, 84–109. [Google Scholar] [CrossRef]
- Hutagalung, D.L.I.; Nisa, L.K.; Verawati, D.M. Artificial intelligence and human creativity: Collaboration or replacement? In Proceedings of the Bengkulu International Conference on Economics, Management, Business and Accounting (BICEMBA), Bengkulu, Indonesia, 12 November 2024; Volume 2, pp. 965–972. [Google Scholar]
- D’Mello, S.K.; Biddy, Q.L.; Breideband, T.; Bush, J.B.; Chang, M.; Cortez, A.; Flanigan, J.; Foltz, P.W.; Gorman, J.C.; Hirshfield, L.M.; et al. From learning optimization to learner flourishing: Reimagining AI in education at the Institute for Student-AI Teaming (iSAT). AI Mag. 2024, 45, 61–68. [Google Scholar] [CrossRef]
- Rusandi, M.A.; Ahman; Saripah, I.; Khairun, D.Y.; Mutmainnah. No worries with ChatGPT: Building bridges between artificial intelligence and education with critical thinking soft skills. J. Public Health 2023, 45, e602–e603. [Google Scholar] [CrossRef]
- Ma, K.; Zhang, Y.; Hui, B. How does AI affect college? The impact of AI usage in college teaching on students’ innovative behavior and well-being. Behav. Sci. 2024, 14, 1223. [Google Scholar] [CrossRef]
- Wilson, H.J.; Daugherty, P.R. Collaborative intelligence: Humans and AI are joining forces. Harv. Bus. Rev. 2018, 96, 114–123. [Google Scholar]
- Jarrahi, M.H. Artificial intelligence and the future of work: Human–AI symbiosis in organizational decision making. Bus. Horiz. 2018, 61, 577–586. [Google Scholar] [CrossRef]
- Soori, M.; Arezoo, B.; Dastres, R. Artificial intelligence, machine learning and deep learning in advanced robotics: A review. Cogn. Robot. 2023, 3, 54–70. [Google Scholar] [CrossRef]
- Seo, K.; Tang, J.; Roll, I.; Fels, S.; Yoon, D. The impact of artificial intelligence on learner–instructor interaction in online learning. Int. J. Educ. Technol. High. Educ. 2021, 18, 54. [Google Scholar] [CrossRef]
- Lavin, A.; Renard, G. Technology readiness levels for AI & ML. arXiv 2020, arXiv:2006.12497. [Google Scholar] [CrossRef]
- Petzoldt, C.; Niermann, D.; Maack, E.; Sontopski, M.; Vur, B.; Freitag, M. Implementation and evaluation of dynamic task allocation for human–robot collaboration in assembly. Appl. Sci. 2022, 12, 12645. [Google Scholar] [CrossRef]
- Çela, E.; Fonkam, M.M.; Potluri, R. Risks of AI-Assisted Learning on Student Critical Thinking. Int. J. Risk Conting. Manag. 2024, 12, 1–19. [Google Scholar] [CrossRef]
- Lehner, O.M.; Ittonen, K.; Silvola, H.; Ström, E.; Wührleitner, A. Artificial Intelligence Based Decision-Making in Accounting and Auditing: Ethical Challenges and Normative Thinking. Account. Audit. Account. J. 2022, 35, 109–135. [Google Scholar] [CrossRef]
- Msambwa, M.M.; Wen, Z.; Daniel, K. The Impact of AI on the Personal and Collaborative Learning Environments in Higher Education. Eur. J. Educ. 2025, 60, e12909. [Google Scholar] [CrossRef]
- Humr, S.A.; Canan, M.; Demir, M. A Quantum Probability Approach to Improving Human–AI Decision Making. Entropy 2025, 27, 152. [Google Scholar] [CrossRef]
- Wei, J.; Qi, S.; Wang, W.; Jiang, L.; Gao, H.; Zhao, F.; Al-Bukhaiti, K.; Wan, A. Decision-Making in the Age of AI: A Review of Theoretical Frameworks, Computational Tools, and Human-Machine Collaboration. Contemp. Math. 2025, 6, 2089–2112. [Google Scholar] [CrossRef]
Major Category | Sub Category | Defined Concept | Theoretical Grounding | Empirical Studies |
---|---|---|---|---|
Pursuit of Inherent Human Values | Personal Values | Recognition of existential values, identity, and learner agency | Existential Pedagogy; Capability Approach | Rubin [22]; Alamin & Sauri [23]; Fraser & Greenhalgh [6] |
Community Values | Ethical reflection, human dignity, and public value pursuit | Moral Education; Reflective Ethics | Rodríguez et al. [24]; Garibay et al. [25] | |
Strategic Approaches | Meta-Learning | Metacognition and meta-emotion in goal setting and learning regulation | Self-Regulated; Meta-emotion Theory | Pekrun [26]; Zimmerman [27]; Garner [28]; Mayer & Salovey [29] |
Complex Problem Solving | Addressing ambiguous, real-world problems with integrated knowledge and ethics | Complex Problem-Solving Theory; Authentic Learning | Jonassen [30]; Iancu & Lanteigne [24]; Aquino et al. [31] | |
Future-Oriented Capability | Capacity to unlearn, relearn, and adapt across novel contexts | Capability-Based Learning; Extended Mind Theory | Phelps et al. [32]; Holdsworth & Thomas [33] | |
Transfer and synthesis of knowledge across boundaries | Transdisciplinary Education; Knowledge Transfer Theory | Lombardi [34]; Garibay et al. [25] | ||
Human–AI Collaborative Structure | Human–Exclusive Tasks | Ethical judgment, value-based decisions, and reflective agency | Decision-Making Theory; Moral Philosophy | Rubin [22]; Jain et al. [35] |
Human–AI Collaboration | AI-supported co-creativity and dialogic engagement | Augmented Intelligence; Extended Cognition | Zhou et al. [36]; Huo [37] | |
AI-Delegated Tasks | Strategic offloading of repetitive or data-heavy processes to AI | Automation Theory; Cognitive Load Theory | Davenport & Ronanki [38]; Tribe AI [39] |
No | Expert Code | Affiliation | Area of Expertise | Major Experience and Role | Role Category |
---|---|---|---|---|---|
1 | E1 | University A, Department of Education | Instructional Design, Educational Technology | Ph.D. in Educational Technology; 15+ years university teaching; Former secondary school teacher (10+ years); AI-based instructional design research Published on AI ethics in education | Instructional Design Expert |
2 | E2 | University B, Future Education Research Institute | Future Education, AI-based Instructional Design | National advisor on digital education policy; multiple SSCI publications | Future Education Expert |
3 | E3 | Cyber University, Dept. of AI Education | AI-based Learning Environment Design | Participated in AI tutoring system development; Lead researcher on MOE R&D project; Conducted research on AI ethics and implications for AI-based learning | AI-Based Learning Expert |
4 | E4 | National University of Education D | Pre-service Teacher Education | Led teacher training programs; Former primary school teacher (5 years); planned in-service training for school teachers | Teacher Education Expert |
5 | E5 | Educational Institute E (Policy Research) | Sustainability in Educational Policy | Conducted SDG4-based education policy research | Sustainability Policy Expert |
6 | E6 | University F, Department of Educational Psychology | Metacognition, Self-Regulated Learning | Led development of learner cognitive and affective models | Educational Psychology Expert |
7 | E7 | Private AI Education Company G | AI Content Development and UX Design | Field expert in AI-based educational content and UX prototyping | EdTech Industry Expert |
8 | E8 | National University H, Department of Education | Curriculum and Assessment Design | Participated in national project for AI-based performance assessment system | Assessment Design Expert |
Domain | Round 1 Experts (n = 8) | Round 2 Experts (n = 8) | ||||
---|---|---|---|---|---|---|
Mean | CVI | IRA | Mean | CVI | IRA | |
Conceptual Clarity | 3.13 | 0.88 | 0.63 | 3.75 | 1.00 | 0.75 |
Theoretical Validity | 4.00 | 1.00 | 1.00 | 4.00 | 1.00 | 1.00 |
Coherence Among Components | 2.88 | 0.75 | 0.63 | 3.25 | 1.00 | 0.75 |
Comprehensiveness | 3.50 | 0.88 | 0.63 | 4.00 | 1.00 | 1.00 |
Visual Communicability | 3.25 | 1.00 | 0.75 | 4.00 | 1.00 | 1.00 |
Innovativeness | 3.50 | 0.88 | 0.63 | 3.88 | 1.00 | 0.88 |
Overall Average | 3.38 | 0.90 | 0.71 | 3.81 | 1.00 | 0.90 |
Domain | Round 1 Experts (n = 8) | Round 2 Experts (n = 8) | ||||
---|---|---|---|---|---|---|
Mean | CVI | IRA | Mean | CVI | IRA | |
Validity | 2.75 | 0.63 | 0.50 | 4.00 | 1.00 | 1.00 |
Clarity | 2.38 | 0.38 | 0.38 | 3.13 | 1.00 | 0.88 |
Usefulness | 3.00 | 0.63 | 0.50 | 3.75 | 1.00 | 0.75 |
Universality | 2.63 | 0.63 | 0.63 | 3.00 | 1.00 | 1.00 |
Comprehensibility | 2.38 | 0.38 | 0.38 | 4.00 | 1.00 | 1.00 |
Overall Average | 2.63 | 0.53 | 0.38 | 3.58 | 1.00 | 0.93 |
Category | Before Revision | Expert Feedback | After Revision |
---|---|---|---|
Conceptual clarity | Principles expressed in abstract, philosophical language (e.g., “value pursuit”, “self-identity”) | Too abstract, unclear instructional implication; low clarity CVI (0.38) | Rephrased into instructional language suitable for classroom application; added practical verbs and learner-centered phrasing (e.g., Learners should explore their existential value and identity to establish life goals and vision.) |
Structural consistency | Overlapping subcategories (e.g., self-regulation vs. agency), unclear order of principles | Ambiguity in hierarchical structure and sequence among principles | Clarified subcategory boundaries and re-ordered principles to reflect learning progression. (e.g., Learners should first set meaningful goals and then develop strategies to achieve them.) |
Component inclusion | No reference to meta-emotion or emotional resilience | Missing humanistic dimensions, especially emotional components | Added new principle on meta-emotion to emphasize emotional regulation and resilience. (e.g., Learners should develop meta-emotional abilities such as emotional awareness and regulation.) |
Major Category | Subcategory | Final Instructional Design Principles |
---|---|---|
Pursuit of Inherent Human Values | Personal Values |
|
Community Values |
| |
Value Pursuit Strategies | Meta-Learning |
|
Complex Problem Solving |
| |
Future-Oriented Capability |
| |
Human–AI Collaborative Structure | Human-Exclusive Tasks |
|
Human–AI Collaborative Tasks |
| |
AI-Delegated Tasks |
| |
|
Subcategory | Instructional Design Principle | Instructional Example |
---|---|---|
Community Values | Guide learners to internalize ethical values and reflect on them. | During a civics lesson, students use AI to analyze policy debates and write ethical evaluations. Students compare AI-generated objective data with their own ethical judgments, synthesizing both into a final report to balance factual accuracy and moral reasoning. |
Meta-Learning | Support learners in setting meaningful personal learning goals. | In a middle school science class, students set their own investigation goal and use AI tools to analyze data. AI provides data summaries and trend detection, while students interpret these results in light of their original hypotheses, adjusting their strategies accordingly. |
Complex Problem Solving | Empower learners to resolve various conflicts and dilemmas during problem-solving. | In a simulation game, students make decisions in a disaster response scenario and reflect on ethical dilemmas. AI offers predictive models for different decisions, and students critically evaluate these against social and ethical implications before choosing a course of action. |
Future-Oriented Capability | Strengthen learners’ knowledge transfer by encouraging transdisciplinary thinking. | Students design an AI-powered sustainable city plan integrating science, social studies, and design thinking. AI generates feasibility analyses for proposed solutions, while students adapt and refine their designs based on local cultural, environmental, and ethical contexts. |
Human–AI Collaborative Tasks | Support learners in reconstructing meaning through co-creativity with AI. | In a language arts class, students co-write stories with a generative AI, revising tone and structure. Students prompt AI for alternative narrative developments, then select, modify, or merge these outputs to align with thematic intentions and emotional resonance. |
AI-Delegated Tasks | Allow learners to delegate repetitive or efficiency-driven tasks to AI. | In a data science project, students use AI to clean and sort large datasets before interpreting patterns. While AI automates preprocessing, students focus on drawing meaningful conclusions and identifying anomalies that require human judgment. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Lee, Y.; Lee, S.-S. Exploring the Conceptual Model and Instructional Design Principles of Intelligent Problem-Solving Learning. Sustainability 2025, 17, 7682. https://doi.org/10.3390/su17177682
Lee Y, Lee S-S. Exploring the Conceptual Model and Instructional Design Principles of Intelligent Problem-Solving Learning. Sustainability. 2025; 17(17):7682. https://doi.org/10.3390/su17177682
Chicago/Turabian StyleLee, Yuna, and Sang-Soo Lee. 2025. "Exploring the Conceptual Model and Instructional Design Principles of Intelligent Problem-Solving Learning" Sustainability 17, no. 17: 7682. https://doi.org/10.3390/su17177682
APA StyleLee, Y., & Lee, S.-S. (2025). Exploring the Conceptual Model and Instructional Design Principles of Intelligent Problem-Solving Learning. Sustainability, 17(17), 7682. https://doi.org/10.3390/su17177682