Artificial Intelligence Supporting Independent Student Learning: An Evaluative Case Study of ChatGPT and Learning to Code

Round 1

Reviewer 1 Report

Comments and Suggestions for Authors An Evaluative Case Study of ChatGPT and Learning to Code" addresses an interesting topic for education and, in general, for society. However, it needs additional hard work to be published. The introduction section highlights the increase of ChatGPT, but it is not shown who many users are from education area or research area or from civil society, in general, instead of students. It would be interested to present a classification of ChatGPT by users. It would support the increase of students (from different levels of education) that could be used ChatGPT for learning purposes. The same for teachers, as the authors state that AI applications offer new pedagogical opportunities for learning and teaching purposes. In this last matter, it is not reported other AI applications. It is recommended to include other examples of AI applications to compare the relevance or the position of ChatGPT in comparison to other AI applications in education. In addition, it is also requested to provide more evidence about the Bloom's "two-sigma" problem, other studies in the literature, and how it improves student learning success. The section "Tools for Student Learning" should be more focused on the main research purpose: to improve the understanding of how AI can support an independent learning process. Although, the authors state other specific objectives without any literature evidence, such as how could an adolescent interested in programming use ChatGPT to accomplish their goal? (see page 1, line 45-46) or How does ChatGPT provide the learning support necessary for self-regulated learning? (see page 4-line 149-150) or How does ChatGPT provide the support necessary for learning the Python programming language? (see page 4, line 151-152). After these questions, it is not clear what is the main aim of the paper, and why the authors are interested in self-regulated learning and the relevance of the Python programming language. Please, clarify these aspects. Then, Methods-section the design subsection is confusing. Please, clarify the method-design. After the methodology, the results are presented rather descriptive, which a copy and paste of some ChatGPT search results. Then, discussions are not enough clear based on the "materials", content area tool, feedback and planning. It is recommend that authors should introduce these areas of support in the design methodology.

 

Author Response

Thank you for your thoughtful review and helpful comments. We have addressed each of these concerns and feel that it has substantially improved the paper. Please find specific changes reported in the attached document. 

Author Response File: Author Response.pdf

Reviewer 2 Report

Comments and Suggestions for Authors

This manuscript was very well laid out and presented. I felt the research was very appropriate and relevant in the modern age of education. I have no further comments except a great job to the authors. 

Author Response

Thank you for reviewing our paper and for your kind words! We are glad that you found the research helpful. 

Reviewer 3 Report

Comments and Suggestions for Authors

Abstract: This abstract effectively presents a study on the role of ChatGPT in enhancing self-regulated learning, with a focus on computer programming. Utilizing an evaluative case study design, the research comprehensively investigates ChatGPT's capabilities in independent learning support. The findings reveal that ChatGPT excels in offering detailed and personalized guidance on programming concepts, adeptly integrating various information sources into cohesive explanations and examples. Additionally, its ability to assist in creating detailed learning schedules highlights its utility beyond content delivery. However, the study critically notes limitations in ChatGPT's interactivity and assessment features, adding depth and credibility to the research. Importantly, the study emphasizes that the effectiveness of ChatGPT heavily relies on the learner’s metacognitive skills to navigate and assess the tool's advice. Concluding with the potential of ChatGPT to deliver Bloom’s two sigma tutoring benefit on a large scale, the abstract effectively encapsulates the study's significant insights and contributions to understanding AI's role in educational settings, especially in fostering self-regulated learning.

Title Analysis: The title of the article is both engaging and relevant, reflecting current trends in educational technology, particularly in the context of teaching programming. It succinctly captures the essence of the study—examining the role of AI in independent student learning—with a specific focus on ChatGPT. However, to enhance clarity and impact, consider revising the title to more directly emphasize the central aspect of the study, perhaps by shortening it or making the focus on coding learning more prominent.

Introduction: The introduction is commendably well-constructed, offering a clear overview of the study's objectives and scope. It effectively sets the stage for the reader by outlining the key variables and context of the research. To further strengthen this section, it might be beneficial to include a brief overview of existing literature on AI in education and its role in learning programming, thus situating the study within the broader academic discourse.

Methodological Approach: The methodology is articulated with specificity and clarity, providing a solid understanding of how the study was conducted. This detailed description allows for replication and validation of the findings, which is a core strength of the paper. It would be advantageous to expand slightly on the rationale behind the chosen methodological approach, perhaps discussing why this method was most suitable for the research questions at hand.

Presentation of Findings: The findings are presented in a clear and organized manner, which aids in the reader’s comprehension. The use of visual aids, charts, or graphs (if not already included) could further enhance this section, providing a more immediate understanding of the results and how they relate to the study's objectives.

Referencing Consistency: The inconsistency in referencing style, particularly noted in the introduction, detracts from the overall professionalism and academic rigor of the paper. Consistency in citation is crucial for academic credibility and ease of verification by readers. It's recommended to adhere strictly to a single referencing style throughout the document, as per the journal's guidelines or a widely accepted format like APA, MLA, or Chicago.

Comments on the Quality of English Language

The English language need some editing. The author(s) can engage the services of a professional editor.

Author Response

Thank you for your thoughtful review and helpful comments. We have addressed each of these concerns and feel that it has substantially improved the paper. Please find specific changes reported in the attached document. 

Author Response File: Author Response.pdf

Round 2

Reviewer 1 Report

Comments and Suggestions for Authors

Thanks for provide additional information.