1. Introduction
Self-regulation skills encompass the ability to monitor and modify one’s own behavior, emotions, or thoughts in response to the changing demands of an environment, context, or situation [
1,
2] Researchers have shown that self-regulation skills are a critical predictor of academic achievement; however, certain students who struggle with inattention, impulsivity, and inhibition control may encounter difficulties in developing these skills [
2,
3,
4]. Particularly, students with disabilities often have difficulty self-regulating their social and academic behaviors, which has been consistently associated with diminished academic productivity, compromised social competence, and heightened teacher frustration [
3,
4,
5,
6]. Unless specific interventions are implemented, these students are unlikely to meet the social and academic expectations within a general education setting [
7,
8].
Students with disabilities who have limited self-regulating abilities may encounter difficulties in attending to tasks, engaging in appropriate social interactions, and maintaining positive behaviors in the classroom. These challenges can pose difficulties for teachers to effectively manage the classroom while maintaining instructional control [
9,
10]. Thus, when problem behavior occurs at a level that exceeds what teachers can proficiently manage in the classroom, inclusion for students with disabilities becomes increasingly difficult to sustain [
11]. As students with disabilities increasingly receive services in the general education setting, it is paramount that efficient, feasible, and contextually fit evidence-based practices (EBPs) are available for use by general education teachers [
7,
12,
13]. Unfortunately, general education teachers are less likely to accurately implement EBPs to address the problem behavior in their classrooms, and often report feeling unprepared to address the needs of students with disabilities [
9,
10,
11,
14]. To address the research-to-practice gap, researchers have emphasized the critical nature of teacher training to increase teachers’ ability to proficiently implement EBPs, especially those which ameliorate social and academic deficits concurrently [
9,
13].
1.1. Self-Monitoring
Self-monitoring (SM) is a key component of self-management strategies used to improve students’ self-regulation abilities whereby an individual observes and records their own behavior to assess whether a target behavior has occurred [
15,
16]. Theoretically, when using SM, students must discriminate the occurrence of a target behavior and then self-record some dimension of the target behavior, resulting in improvements to their self-regulation skills [
16,
17]. As an EBP, SM has been used to support a variety of students displaying problem behavior across grade levels, requiring minimal investment of teacher time and resources [
18]. Self-monitoring has been used to increase appropriate behavior (e.g., on-task behavior, task completion, academic performance, instructional engagement) and decrease problem behavior that impacts student learning [
8,
19,
20,
21,
22,
23].
Using SM in the school setting offers multiple benefits, such as producing an immediate and impactful change in behavior, being cost-effective, relatively unobtrusive, time-efficient, and easily individualized to fit the individual students’ needs, teachers’ instructional styles, logistics of recording, and availability of resources [
5,
12]. In culmination, these benefits minimize the loss of instructional time during implementation which can free up time for other classroom responsibilities and result in a reduction of teacher stress [
8,
21]. Social validity assessments have indicated that teachers found SM interventions to be feasible, appropriate, and effective within the classroom context [
24,
25]. The SM intervention is a proactive strategy that facilitates the inclusion of students with disabilities in general education settings because the intervention is implemented in the classroom where the target behavior typically occurs, thus eliminating the need to remove the students from the learning environment [
5,
21]. As such, teachers may implement practical strategies such as SM to improve student behavior and make it less likely that they will be suspended, fail courses, or even drop out [
5].
1.2. Self-Monitoring of Performance
Researchers have commonly examined the use of self-monitoring of attention (SMA) and self-monitoring of performance (SMP) to help students self-manage their behaviors [
3,
6,
16]. The focus of SMA is on increasing students’ awareness of their attentive behaviors (e.g., on-task or off-task) by instructing them to monitor and record some form of their attending behavior when cued at predetermined intervals [
12,
16]. Conversely, the focus of SMP is increasing academic performance and task-related responding by instructing students to monitor some aspect of their academic performance (e.g., completion or accuracy) during or following a task [
12,
13,
16]. Proponents of SMP emphasize that although academic productivity will affect attentional behavior, attentional behavior may not necessarily affect academic productivity [
6,
13].
The SMP intervention can be individualized to meet a variety of student and teacher needs with little investment of time or resources while offering a variety of benefits to students, including greater independence in the classroom, increased academic performance, and improved self-management skills [
13,
21,
26]. The literature reports that SMP is effective in not only increasing task completion and on-task behavior, but also improving academic performance exhibited by a variety of student populations when teachers implement it with high fidelity [
13,
27]. For example, Barry and Messer [
27] evaluated using an SMP intervention in a 6th-grade general education classroom with five students with attention deficit hyperactivity disorder (ADHD). The SMP included monitoring academic performance, on-task behavior, and disruptive behavior. The SMP resulted in increased task completion, academic performance, and on-task behavior, and decreased disruptive behavior for all students. Rafferty and Raimondi [
13] examined using both SMA and SMP with three middle school students with EBD served in an inclusive general education classroom. The findings revealed that SMP resulted in higher levels of social and academic behaviors compared to SMA. Specifically, students using SMP exhibited on-task behavior comparable to that of typical peers, demonstrated greater academic productivity and accuracy, and more significant reductions in off-task behavior. Notably, regardless of the order of implementation, each student consistently selected SMP during the choice condition, indicating a preference for the SMP over the SMA. This preference suggests that teaching students to self-monitor their academic performance may yield more desirable outcomes than teaching them to self-monitor their attentional behavior. However, due to limited existing evidence on the effectiveness of SMP, further research is needed to examine the potential benefits of using SMP in improving student behavior and enhancing academic performance.
1.3. Self-Monitoring with Differential Reinforcement
The existing body of research on school-based SM interventions has well-documented varying effects of supplementary components or materials incorporated into SM intervention on student behavior [
5,
18]. Typically, the most effective SM interventions are multi-component in nature and include reinforcement and/or feedback linked to student performance [
5]. In comparison to noncontingent reinforcement, contingent reinforcement directed at desired behaviors, such as accurate recording, meeting a goal, or completing a task, has yielded greater behavioral outcomes [
18]. For example, Bruhn and Watt [
28] evaluated an SM intervention package involving two middle school students, who self-rated their adherence to multiple classroom expectations. At the end of each session, reinforcement was provided contingent upon the students obtaining 80% of the maximum possible points during the work period. The SM intervention resulted in increased academic engagement and decreased disruptive behavior for both participants. It has been suggested that extinction is not a required component of differential reinforcement, and in situations where extinction may not be possible, manipulating the quality, duration, immediacy, and magnitude of reinforcement for an alternative or desired behavior may offer distinct advantages [
29].
In a review conducted by Briesch et al. [
30], most of the studies examined required students to self-observe and record their own behavior without receiving external feedback or reinforcement; however, nearly all studies employed frequent recording of behavior, prompting students to self-assess at least every 2 min during a task. Considering that students may find the frequent prompted monitoring during a task to be more intrusive and less motivating than monitoring after the task [
31], it remains unclear whether frequent, prompted SM leads to sustainable changes in student behavior. Furthermore, Mize et al. [
32] recommended that future researchers investigate SM applications incorporating effective instructional components, such as reinforcement and error correction delivered by a teacher. Further research is necessary to evaluate whether SMP interventions that involve reinforcement without prompts and include teacher-delivered instructional components (i.e., reinforcement and error correction as needed) will yield similar behavioral improvements for students with disabilities, and whether these behavior changes will maintain over time.
1.4. Self-Monitoring with Technology
Until recently, most SM procedures and recording devices were characterized by their simplicity and low-tech nature, relying on materials such as paper, pencil, timers, and buzzers to record student behavior [
17,
32]. However, utilizing such materials can produce social stigmatization, lead to embarrassment for students, and pose a greater investment of teacher time and materials to prepare [
33]. Studies have reported that paper and pencil strategies are less acceptable to students, and lack social validity [
34]. To address these limitations, the adoption of mobile-technology-based SM interventions has emerged as a promising alternative. The use of the technology provides greater portability and convenience, and recent research has demonstrated its effects on improving the on-task behaviors of students with disabilities [
32]. Several studies conducted in schools have shown positive outcomes when utilizing mobile technology for SM [
24,
33]. For example, Wills and Mason [
23] utilized a handheld tablet to teach two high school students with disabilities to self-monitor attention in a general education setting. The SM intervention increased on-task behavior for both students. Bedesem [
24] evaluated an SM intervention procedure with two middle school students utilizing cell phones with the CellFM app to record SM data. The intervention had positive impacts on both students’ on-task behavior, and socially valid data indicated high acceptability of the intervention by students and teachers alike. These results are in alignment with previous research suggesting that handheld technology may be more appealing and socially acceptable than typical monitoring methods, piquing the interest and improving the buy-in of students participating [
26,
32].
With rapidly developing technologies available for use by teachers in school-based settings, Mize et al. [
32] urged future researchers to examine up-to-date mobile technology (e.g., iPhone, iPod) to deliver SM interventions to improve student behaviors. The continuous progress of 21st-century technology and the growing demand for effective virtual learning strategies, necessitate further investigation into the use of technology-based SM intervention applications in schools [
15]. More specifically, given the positive effects of technology-based SM and findings that indicate screen size does not impede the effectiveness of the intervention, researchers should investigate whether technology-based SMP, utilizing a mobile app as a recording medium, yields similar or greater results than traditional methods [
32]. Moreover, in school settings, implementing extinction procedures with fidelity may not be feasible for educators. Consequently, interventions designed for use in classroom settings may focus on providing increased reinforcement contingent upon the occurrence of an alternative response, aiming to shift response allocation across two or more alternatives when problem behavior continues to contact unprogrammed reinforcement.
1.5. Maintenance Effects of Self-Monitoring
Researchers have noted that SM with reinforcement is likely to reduce the time required to improve student behavior [
21]. However, the literature provides limited information on the sustainability of behavior change when SM components are faded or guidance for practitioners on how to plan for maintenance [
30]. Bruhn and colleagues [
18] reported that only eight studies of the 41 studies they reviewed included generalization probes and only nine included maintenance programming. This is detrimental when teachers are responsible for implementation without other professionals guiding them to systematically fade intervention components. Future researchers should evaluate strategies to train teachers to systematically fade intervention components in school-based settings while formally evaluating student behavior. This can ensure that intervention effects maintain beyond implementation while capitalizing on the utility of technology to support intervention delivery and data-based decision-making [
26]. Future research on SMP should involve training teachers to make data-driven intervention decisions that promote sustained behavior change.
1.6. Current Study
The SM intervention has been effective when utilized to support students with disabilities in a variety of settings, including inclusive classrooms (e.g., [
6,
23,
24,
27]), self-contained classrooms or resource rooms (e.g., [
13,
28,
33]), and alternative schools (e.g., [
22,
29]). Given the positive effects of using up-to-date mobile technology to improve the on-task behavior of students with disabilities, more research is needed to identify practical and feasible technology-based SM applications that are palatable to both students and teachers [
32]. The current literature indicates that technology-based SMP may offer a modern way to deliver behavioral intervention to support students with disabilities in the general education setting while capitalizing on the efficiency of technology and keeping students in the classroom [
5]. Furthermore, experimental research examining the effects of technology-based SM is crucial [
15]. Specifically, few studies have attempted to examine SMP interventions that utilize technology as a recording medium, differential reinforcement, independent use of a checklist in the absence of prompts or devices, and evaluation of its maintenance effects.
To fill the gaps in the literature, the current study aimed to evaluate the use of a technology-based SMP with contingent reinforcement for task completion and accuracy of SM for students with disabilities served in the inclusive 5th-grade general education setting. The study addressed the following research questions: (a) to what extent will the implementation of a technology-based SMP with differential reinforcement increase task completion and reduce off-task behavior in students with disabilities served in inclusive general education classrooms, (b) to what extent will the effects of SMP intervention be maintained after the fading procedure is complete, and (c) to what extent will improvements in the target behaviors be maintained without intervention at 4-week follow-up?
3. Results
Figure 1 presents data on student behaviors across baseline, technology-based SMP with reinforcement, and fading for each participant. Overall, the results indicate that technology-based SMP was effective in increasing task completion above the terminal goal level while concurrently decreasing off-task behavior for each student. No overlap for either data path was observed between the baseline and intervention phases for Dominic, Selena, or Robin, indicating a positive demonstration of intervention effects. The improvements in student behavior maintained during fading in which a delay to reinforcement was implemented. Furthermore, reductions in off-task behavior and increases in task completion were maintained for each student during a 4-week follow-up.
During baseline, Dominic exhibited a moderate to high level of off-task behavior (M = 55%; range = 39–67%) and a relatively stable low level of task completion (M = 38%; range = 24–86%). Implementation of the SMP intervention resulted in an immediate increase in task completion of up to 100% and an immediate decrease in off-task behavior, below that observed in any baseline session. Dominic consistently showed improvements across both behaviors throughout the intervention phase. Task completion demonstrated sustained increases, averaging at 99% (range = 93–100%), while off-task behavior exhibited slight decreases during sessions 8–12. Notably, off-task behavior remained consistently low and stable, with an average of 14% (range = 9–20%) throughout the intervention phase. Moreover, task completion rates reached 100% and off-task behavior continued to decrease (M = 5%; range = 1–12%) in each fading session and maintained at a 4-week follow-up.
During baseline, Selena exhibited a moderate level of off-task behavior (M = 42%; range = 29–60%) and a slightly variable, moderate to low level of task completion (M = 54%; range = 40–72%). When the intervention was implemented for Dominic, a stable counter-theraputic level of task completion and off-task behavior persisted for Selena. However, upon implementation of the SMP intervention, Selena exhibited an immediate increase in task completion to 100% and a reduction in off-task behavior to 10%, below baseline levels, within the first intervention session.
Off-task behavior continued to decrease to near-zero levels throughout the intervention for Selena (range = 0–3%). During the intervention phase, Selena’s teacher anecdotally noted notable improvement in Selena’s academic progress, particularly in her reading comprehension level and descriptive writing abilities. When a delay in the reinforcement was introduced as part of the fading process, Selena consistently completed tasks without any decrease in performance, maintaining a 100% completion rate. Initially, there was a slight increase in off-task behavior, reaching 8%. However, it showed a decreasing trend in subsequent fading sessions, dropping to 4% and eventually reaching 0%. These positive changes in Selena’s behavior were maintained during the 4-week follow-up period, further demonstrating the effectiveness of the SMP intervention.
Finally, during baseline, Robin exhibited off-task behavior at a variable, high level (M = 53%; range = 39–76%) and a slightly variable, moderate to low level of task completion (M = 49%; range = 25–67%). These patterns persisted when intervention was introduced to Dominic and Selena, respectively. Similar treatment effects were observed for Robin upon implementation of the SMP intervention. Specifically, task completion increased to and remained at 100% during each intervention session while reductions in off-task behavior remained low and stable (M = 14%; range = 10–18%). Task completion remained at 100% during fading, while off-task behavior continued to decrease (M = 5%; range = 1–10%). Robin’s positive behavior changes, likewise, were maintained at a 4-week follow-up. In combination, these effects demonstrate a functional relationship between the SMP intervention and student behavior.
During follow-up observations, the teacher continued to implement the intervention despite no longer being required to do so following the study. The continued implementation of the intervention reflects the high social validity of the intervention. Furthermore, during follow-up, the level of off-task remained at 5% for Dominic, 7% for Selena, and 13% for Robin while task completion remained at 100% for all students. These results demonstrate the utility of technology-based SMP in increasing task completion and reducing off-task behavior exhibited by students with disabilities in general education settings. Furthermore, the positive behavior changes maintained for each student during fading and follow-up, suggest that these procedures may yield positive behavior change that is both efficient and durable.
3.1. Effect Sizes
PoGO effect sizes for off-task behavior ranged from 74 to 93 (74, 93, and 74 for Dominic, Selena, and Robin, respectively) indicating a moderately large to large effect. For task completion, PoGO effect sizes ranged from 98 to 100, indicating a large effect. For Selena and Robin, PoGO effect sizes were 100, demonstrating that the goal was met.
3.2. Social Validity
Social validity was evaluated after the final fading session by gathering feedback from student and teacher participants, as well as a school administrator who observed implementation on more than one occasion when the researcher was not present. Overall, students reported high levels of satisfaction with the intervention and procedures. On a 5-point Likert rating scale, ratings averaged 4.9 or 5.0 for each student. Near perfect ratings were given for each acceptability item, including the desire to use SMP in the future, enjoyment of procedures, and agreement that the SMP resulted in improvements to their academic performance and classroom behavior. Social validity assessments with the classroom teacher and school administrator were similarly promising, with near-perfect ratings for each treatment acceptability item. The average acceptability rating provided by the teacher and administrator was equally 4.8, with the lowest allocated score for any item being 4. The teacher reported high levels of satisfaction with the student outcomes and continued to use the intervention following the study. The teacher indicated that the procedures were easy to implement and produced immediate positive behavioral and academic effects for all students, piquing her interest in the possibility of utilizing the SMP as a class-wide intervention in the coming years. The administrator indicated high levels of satisfaction with student and teacher outcomes. The administrator also noted that she was pleased with the technology-based intervention application and likewise reported interest in various class-wide applications of SMP.
4. Discussion
This study evaluated the extent to which implementation of the technology-based SMP accompanied by differential reinforcement resulted in a reduction in off-task behavior and an increase in task completion among students with disabilities served in a general education classroom. This study also sought to examine where the effects of SMP intervention would maintain after the fading procedure was completed. The results of the study revealed that technology-based SMP with differential reinforcement produced marked reductions in off-task behavior and immediate increases in task completion, with all students achieving a 100% completion rate. In fact, the first intervention session for Dominic occurred during a non-typical classroom routine when two classes were combined. The tasks presented during the session remained the same, but approximately 20 additional students were present. Yet, an increase in task completion to 100% and a reduction in off-task behavior to 20% were demonstrated despite additional environmental distractions.
The consistent decrease in off-task behavior observed in all three students is noteworthy, particularly because they were not required to routinely divert their attention from the classroom tasks that they were completing to record their attentional behaviors at pre-determined intervals. Despite this absence of consistent monitoring, reliable decreases in off-task behavior and unprecedented levels of task completion persisted for all students. Increases in task completion were equally notable; during the intervention, each student completed 100% of the tasks presented to them in 96% of intervention and fading sessions. The classroom teacher anecdotally noted during the study that participating students consistently outperformed their same-age peers regardless of disability in terms of task completion achieved while using SMP. Specifically, students were only required to complete up to 90% of their work at any point in time to earn the maximum three points for task completion, yet students reliably obtained more than the minimum performance criteria by achieving 95% or more task completion during each SMP session. Moreover, compared to the variability of task completion in baseline, the repeated demonstration of task completion at 100% during intervention illustrates a clear functional relation. Increases in task completion and reductions in off-task behavior were maintained during fading, even when the criteria for reinforcement increased and a delay to the reinforcement of 45 min or more was implemented.
These results are in alignment with previous research suggesting that teaching students to self-monitor academic behavior may result in better academic and social outcomes as compared to teaching students to self-monitor attentional behavior [
13]. These results suggest that technology-based SMP is contextually fit for school settings because the teacher did not have to collect data, modify existing classroom management strategies, or alter established classroom routines to implement. The intervention was socially validated by students and teachers alike and had immediate positive effects on student behavior and performance. These findings are consistent with previous research that highlights the effectiveness of SMP in improving the academic performance of students with disabilities [
13] and that emphasizes the role of reinforcement in enhancing the effectiveness of SM intervention [
30]. Lastly, this study extends the literature suggesting that technology-based intervention applications may be highly motivating to students while still producing positive effects on behavior and academic performance [
24,
32,
33].
Several overarching implications for practice should be noted. First, the SMP intervention may be a viable classroom intervention to promote increased task completion and reductions in off-task behavior for a diverse range of students with complex academic and behavioral needs. The student participants in the current study exhibited a range of externalizing and internalizing problem behaviors that hindered their engagement in classroom instruction. It is notable that the same intervention procedures produced substantial positive changes for each student despite differences in their academic and behavioral needs. This suggests that teachers may utilize a general SMP procedure in the classroom setting to support a wide range of students with diverse behavioral needs. Additionally, teachers may implement the SMP intervention with multiple students displaying problem behavior and/or inadequate levels of task completion simultaneously in the classroom setting with relative ease. Therefore, the SMP intervention may be a feasible class-wide or targeted intervention to address off-task behavior exhibited in the classroom with little investment of teacher time or resources.
While the current study shows promising results, some limitations have been identified. The first limitation relates to the small sample size of students included in the study. With time constraints and difficulties navigating the COVID-19 pandemic, a small number of participants opted to participate in the study. Other common limitations in academic settings occurred during this study (e.g., student suspensions, state testing, and changes in classroom routines), which restricted data collection opportunities and could have potentially impacted the data set. Restricted opportunities for data collection paired with a limited sample size may limit the generalizability of the current findings. Future researchers could replicate this study with a larger, more diverse sample to evaluate the external validity of the current findings. Furthermore, evaluating the intervention effects when used with different populations of students with various complex behavioral needs would promote a more robust dissemination of effective EBPs for general education teachers.
In alignment with the first limitation, the inclusion of only one general education teacher within the study may limit the generalizability of the results. The intervention was implemented by the same teacher for all participating students during the same instructional routines. The teacher used the same classroom management strategies, and instructional techniques, and evaluated the students using identical tasks and task lists. Future research should evaluate the technology-based SMP with differential reinforcement intervention when implemented by different teachers in various settings during alternate routines to improve the external validity of the findings. Identifying alternative reinforcement procedures and adaptations to the SMP intervention may promote the generalized utility within complex settings, such as the inclusive classroom.
Finally, teacher implementation fidelity during the first three intervention sessions was 91% across students (range = 80–100%) despite the teacher having demonstrated 100% accuracy in implementing steps on multiple consecutive attempts during training. After missing the same step on the fidelity checklist for two consecutive sessions, the teacher received booster training. Following booster training, the teacher missed the step again during Session 2 when the intervention was implemented for Dominic and Selena; therefore, the researcher conducted two 5 min in vivo coaching sessions. After coaching, implementation fidelity increased to and remained at 100%. These findings suggest that in vivo coaching may be necessary to support teachers to implement classroom interventions with high fidelity following training. Even without lapses in fidelity, in vivo coaching may enhance the effectiveness of the training and promote improved fidelity beyond training circumstances.
The fading procedure implemented in this study demonstrated promising results as improvements in student target behaviors were maintained with a delay in reinforcement. However, it is worth noting that some components (e.g., SM checklist, points system, reinforcement) of the intervention remained in place during this condition. Although the continued implementation of some intervention components reflects the high social validity of the intervention, it is worth considering that they may have inadvertently influenced the data collected during fading. Furthermore, while access to backup reinforcers was delayed during fading, teacher attention was still provided without delay, which may have functioned as a reinforcer for some participants during the fading phase. Future researchers should evaluate the maintenance effects after completely removing the intervention to improve the strength of the evidence.
Additionally, with 1:1 technology policies in public schools on the rise, technology-based applications of interventions are increasingly relevant and may have valuable applications for a large number of students in school-based settings. Our study suggests that additional experimental research evaluating the effects of technology-based SM to improve student behavior is warranted [
15,
32]. Future researchers may also evaluate the technology-based SMP with reinforcement when implemented as a class-wide intervention in a general education setting as expressed by the teacher who participated in the study. Furthermore, future researchers should evaluate the differential effectiveness of specific recording mediums for SM, such as high-tech, low-tech, and no- tech (pencil and paper) methods, to determine which strategies may be more socially valid and/or preferable for use by teachers. Moreover, a comparison of recording methods may allow for recommendations of which procedures produce the greatest improvements in student behavior. Finally, it remains unclear if the current result may have differed if the additional instruction during the teacher debriefing had not been included as a component of the SMP intervention. It is possible that the high fidelity of the other components (i.e., reinforcement, teacher, and student rating accuracy) could have been adequate to obtain the same results. Consistent with previous research [
26], the current investigation suggests that future researchers should examine the moderating effects of various treatment components (i.e., reinforcement, feedback, debriefing) to determine the maximally effective treatment arrangements for students with disabilities. Future researchers may also consider evaluating the intervention with other student populations in other settings.
In conclusion, this study offers evidence that the technology-based SMP with differential reinforcement can be a feasible, practical, and effective intervention to increase task completion and reduce off-task behavior in students with disabilities served in a general education classroom. The efficiency of the intervention and immediacy of the results suggest that the technology-based SMP with differential reinforcement may be a proactive classroom intervention for use by general education teachers to support students with disabilities in their classrooms. The technology-based SMP augmented with reinforcement may also promote the development of self-regulation skills in students with disabilities, which are crucial for improving their long-term social, behavioral, and academic outcomes.