While specialized instruction has been designed to meet the needs for teaching individual students with disabilities, some of the skills necessary for independence and career readiness some students lack interest in some of these teaching strategies or require increased prompting and reminding to actually engage in the desired behavior [
2]. Students may also find some tasks being taught aversive [
3]. In studying effects of rapport on teaching students with disabilities, McLaughlin and Carr [
4] found that a staff member may establish poor rapport with a student who associates an aversive activity with him or her. These aversive activities can include chores or other tasks that the student does not want to do: learning appropriate bathroom or self-care skills, for example [
5]. To escape from the demands of these activities, the student may act out aggressively [
3,
4]. To reduce such behavior problems, teachers must incorporate elements in teaching activities that make the experience more enjoyable and valuable to the student [
2].
Several researchers have studied how technology enhanced video-based instruction can reduce students’ dependence on prompts and or reminders by thoroughly engaging and attracting students’ attention while learning skills, as well as by creating an enjoyable learning environment that may help prevent aversive responses to skills being taught [
5,
6]. Research has focused on the use of virtual environments (VE) [
7], virtual characters (VC) such as avatars [
5,
6] and the addition of animated elements to video modeling for developing techniques that can teach skills to children or adolescents with autism spectrum disorder (ASD) in more enjoyable and attractive ways [
2]. In addition to attracting students’ attention and creating a more enjoyable learning environment, using techniques such as VC and animation can be especially helpful in teaching necessary skills that are difficult to teach using other methods (i.e., showing students how to properly cover themselves during urination or teaching various safety skills) [
5,
6].
1.1. Virtual Environments
Virtual environments (VE) are used in virtual reality settings, allowing users to explore 3D computer-generated environments in which they can interact with simulated objects or characters as if experiencing them in a real-life situation [
7]. This technology has been shown to efficiently and effectively teach students target skills that generalize over time [
7].
VE has demonstrated efficacy in teaching social skills to students with disabilities. With the purpose of investigating the potential of VE for teaching social understanding to individuals with ASD, Mitchell, Parsons, and Leonard [
7] used VE to teach six students ages 14–16 with ASD social understanding. Participants viewed three sets of videos portraying busses and cafes. Between sets, they were presented with a VE program providing a scenario of a cafe and asking them where they would choose to sit. All six of the participants received the same tasks; however, they were completed in different orders. If they made an inappropriate decision, the program gave verbal feedback explaining why the response was not correct. For example, if a student chose to sit at a crowded table of people she did not know when there were single tables available, her choice would indicate that she lacked social understanding, and the program would explain why this choice would be problematic. Mitchell et al. [
7] found that after receiving the VE intervention, students demonstrated better social understanding on the remaining videos, as perceived by 10 ‘naive’ raters.
Additionally, a VE program that engaged participants with ASD in virtual reality training for a job interview improved participants’ job interview skills and their job interview confidence [
8]. The purpose of the study was to determine the feasibility and efficacy of the virtual reality program. Participants included 26 individuals with ASD. After attending five training sessions which lasted approximately two hours, participants completed an assessment to express how enjoyable and helpful the program was in order to assess feasibility. Efficacy of the program was measured through role-play job interviews. Researchers discovered that participants were engaged with the program and rated it as enjoyable and that job interview skills were significantly improved [
8]. Likewise, in a six-month follow-up of those who completed the job interview training, Smith et al. [
9] found that the observed improvement from pretest to posttest was associated with more completed job interviews (
r = 0.55,
p = 0.02). Additionally, these researchers found that compared to controls these participants had 7.82 times greater odds of accepting an offer for a competitive position [
9]. Thus, VE is effective for teaching individuals with ASD various social interactions [
7,
8,
9].
Thus, according to current research, VE is effective for teaching necessary skills to students with disabilities. However, VE itself cannot be created by a layperson and is thus not readily accessible for most teachers. For example, in Self et al.’s [
6] study, the VE had to be created by a computer programmer. Coles et al. [
10] used standard 3D game engine software and Java programming, another method average teachers would not be able to create in their free time. Ehrlich and Miller [
11] created a VE program (AViSS) that includes various virtual environments such as hallways, restrooms, and cafeterias to teach social skills to students with disabilities. While it may be very helpful for teachers to use in the future, it is currently still in the development phase. Therefore, other novel methods of teaching need to be explored. Animated videos, which can be designed in presently available apps, may be as effective for instruction as VE, but more cost effective and perhaps easier for teachers to create and modify independently.
Recent advances in technology have made the use of VE more accessible to those without specialized training [
12,
13]. There are now programs that allow educators with a moderate level of technological expertise to take advantage of instruction using VE, avatars, and animation. One program that makes it easy for practitioners to use VE and avatars to teach a variety of skills is Invirtua 3d Digital Puppeteer (Invirtua, 2016, Carson City, NV, USA). This software package allows practitioners to create VE and deliver instruction via a wide variety of avatars. Available avatars to select from include humans, fish, dinosaurs, and dragons. Students are able to select the avatar they want to learn from which is then controlled by the practitioner [
12,
13]. As technology advances, it is making interventions using AE, avatars, and animation more accessible to those practitioners with basic technology proficiency [
12,
13].
Another area of VE showing promise in the realm of education is augmented reality (AR) [
14,
15]. AR is a technology that creates hybrid virtual experience by overlaying real world situations and digital content [
12]. Details about an individual’s proximal environment is identified with cameras on mobile devices. Digital information such as videos and audio is then overlaid to enhance the users’ environment. The AR system is characterized by (a) combining the real and virtual worlds, (b) providing interaction in real time, and (c) aligning real objects or places with digital information in 3D [
12]. AR has successfully been used to teach a range of skills including academic skills such as math [
1]. In a systematic review, researchers analyzed several studies to determine the advantages and challenges associated with AR for education. Based on the review, it was found that AR can support learning and teaching [
15]. In another study by McMahon, Cihak, Wright, and Bell [
16], researchers wanted to analyze the benefits of using AR to teach science vocabulary to students with ASD and intellectual disabilities (ID). Participants included three students with ID and one student with ASD in a postsecondary program with ages ranging from 19–25. Using a multiple-probe across-behaviors/skills design, short 3D simulation videos were displayed to the participants describing different vocabulary terms. Researchers used the Aurasma app so that the video would play when certain vocabulary cards were detected. The results indicated that the AR intervention was effective in increasing the participants’ science vocabulary acquisition [
16].
Research has been done with regard to VC as well. Authors Alcorn et al. wanted to investigate how children with ASD would interact with the ECHOES environment and in which ways ac VC, Paul, would be in eliciting joint attention from the participant. Paul created two levels of the gaze including engagement and non-engagement in order to help the participant select an object on the screen. Participants included 29 males and 3 females between the ages of 5 and 14. Results indicated that the subjects were able to follow the VC’s gaze and gestures in order to respond. The authors also discovered that the children were excited and motivated to share that experience with others. However, the authors acknowledge that this cannot be verified due to the lack of baseline data concerning the participants’ social skills. The study did affirm that the VC was successful in engaging the participants [
17].
In a large-scale multi-site intervention, researchers created a VC named Andy in order to teach social communication skills to children with ASD. Participants were 29 children from special units in primary schools in the UK. All children had been previously diagnosed with ASD. Researchers found through observation that children who had never greeted their teachers spontaneously before were doing so with Andy and then later with the teachers demonstrating generalization. In addition, participants who never interacted with typical peers did so with Andy. It is recognized, however, that such technology is not always readily available in the real-world [
18].
1.2. Information and Communication Technologies
An area of research that has been discovering new ways to incorporate AR and VE is information and communication technologies (ICT). Examples of ICT have been numerous. One example is FORHHSS-TEA, a program created specifically for individuals with ASD. This project uses both VR and AR. The version with VR has the participant wear VR glasses and 3D scanners which helps them interact with a virtual environment. In AR, the subjects interact with a scenario that has been created with projection lights to help them practice independent task completion. This system uses other technologies such as facial analysis, eye tracking, IP camera, and biosignals which helps the researchers to evaluate the concentration level of the participant. The results of this study indicated that the participants were able to work more independently using the VR and AR as compared to the baseline [
19].
The universities of Spain, Birmingham, and Pompeu Fabra created an AR program called a Pictogram Room to teach individuals with ASD skills using natural interactions. The goal of this project was to increase body awareness and self-recognition through music and visual supports. This study focused on individuals with ASD and intellectual disabilities who struggled with visual recognition of themselves and who demonstrated a mental age of approximately 15–18 months. The system involved a screen with a camera which caught and projected the image of the individual in front of the screen. Using infrared marks, the computer would then superimpose other images onto the real image of the individual. This project the led to creating educational computer games which are accessible on a website. The authors of this particular study recognize that more data needs to be taken in order to determine the efficacy and efficiency of the Pictogram Room [
20].
Another ICT system is the Lands of Fog which was the outcome of the Integration of Children with Autism into Society using ICT project. The program integrates a full-body interaction system to help children with ASD learn how to play with a typically developing child. The setup includes a large floor projection in which a virtual, magical world covered by fog is presented. The rest of the world is revealed to the children as they participate in the game. As they progress, children earn creatures which then follow them throughout the rest of the game and model how to greet other creatures as a peer comes into proximation. As this greeting occurs, more creatures appear showing the children that in order to discover all the creatures they would need to collaborate. Participants in this study included 10 boys diagnosed with ASD between the ages of 10 to 14. Results indicated that the Lands of Fog was successful in fostering social interaction between the participants. Children who were involved in the study responded in a questionnaire that, after the treatment, they found it easier to create social relationships when playing the game [
21].
One example of VE is video games. Mairena et al. conducted a study to discover if a full-body video game could elicit more social initiation in children with ASD as compared to free play. The study included 15 children between the ages of 4 and 6 with an ASD diagnosis. All the subjects participated in four sessions of playing the videogame Pico’s Adventure and four sessions of free play time. Data was obtained through observation. Results indicated that the children elicited more social initiation during the videogame sessions. The study also showed that the videogame helped reduce repetitive behaviors and increasing gestures. Even though the study was successful, the authors recognize the need to conduct additional work to support their hypothesis [
22].
By harnessing the potential of VE, virtual characters, and AR practitioners have the ability to improve the outcomes of individuals with disabilities. In addition, studies have shown that individuals with ASD and other disabilities can be instrumental in helping design new technologies which can enhance the lives of others [
18,
23,
24].
1.3. Animation
Creating, editing, and animating basic videos is a useful technology for teaching individuals with disabilities [
2], and is accessible to anyone with elementary computer skills. Although some animation programs are more complex than others, some applications (apps) can create short animated clips that the user can edit and manipulate quite easily. These animated videos can be used by teachers or parents to help children with disabilities learn skills necessary for independence. Researchers have examined the potential effectiveness of virtual environments (VE), video modeling, and animated elements as teaching techniques to better engage, instruct, and increase interest of students with disabilities in skills they are being taught [
2,
5,
13,
14,
15].
A modification to VE that has become both more cost effective and more efficient to produce is animation [
2]. Animation may be particularly useful in teaching students’ difficult tasks that do not lend themselves to simple task analyses or that might be inappropriate for humans to model [
2]. For example, researchers could use animated characters to illustrate toileting behaviors that would be inappropriate for a human child to model. Additionally, teachers could use animation to teach strategies for dealing with high-risk safety situations, such as school intruders, attracting the student’s attention to the animated character rather than a human intruder who might be particularly threatening to children with ASD. Therefore, animation may be as just as effective for teaching skills as other video-based, technology-mediated intervention, but more socially valid. Creating animated videos with ready-made animation apps may also be more efficient and feasible for classroom use compared to VE and other video modeling methods.
Little research has undertaken to examine the effects of animated videos on the capacity of students with disabilities to better learn target skills or tasks—especially social skills. However, some studies have successfully used animated elements to better attract students’ attention or interest in live video modeling. For example, Ohtake et al. [
2] used animated elements in video hero modeling (VHM) to teach bathroom skills to Shinnosuke, a 12-year-old male student with ASD. VHM is similar to video modeling, except that the person correctly engaging in the target skill is a character with which the student is preoccupied. The video is then shown to the student immediately before engaging him in the target skill [
2]. Consistent with Bellini and Akullian [
17], the goal is that the student will be more attracted to and engaged in viewing the video because she is interested in the character; more engagement promotes better learning and utilization of the skill [
2]. Before participating in VHM, Shinnosuke had been unsuccessful in learning target bathroom skills using traditional verbal, gestural, and model methods, as well as physical and picture prompts. However, after being exposed to VHM five times a week for 35 days, Shinnosuke improved his skill in the four target skills [
2].
The findings with Shinnosuke are consistent with Ohtake and colleagues’ earlier [
16] work in which they found that one student could not learn the target skills until after VHM was introduced. In this particular study, researchers were investigating how effective video self-modeling (VSM) would be in eliminating public undressing during urination in two elementary-aged students diagnosed with developmental disabilities. Using a multiple-probe design, they were able to decrease the exposure of body parts using VSM. However, with one participant, the component of hero modeling or VHM was added which then eliminated the participant’s public undressing [
16]. Incorporating animated characters that preoccupy individual students into video modeling seems to be effective in teaching target behaviors such as bathroom skills to individual students [
2,
5,
13,
14,
15]. However, more research is needed to determine whether using generic animated characters is just as effective in teaching students with disabilities, in addition to generalizing whether similarly animated videos are effective for other children and for adolescents with other disabilities.
Similarly, Drysdale, Lee, Anderson, and Moore [
25] used animated elements in video self-modeling to depict in-toilet urination to two boys—a four-year-old and a five-year-old. These researchers found that after viewing the videos, the two boys acquired the target toileting skills, which were maintained after a four-week period and generalized to a different setting. However, one boy began using the toilet correctly before the video intervention, thus leaving the effectiveness of the video self-modeling with animation dependent on only one child [
26]. Although the video’s effectiveness is not clear, the animated elements were successfully incorporated in the video to more appropriately depict toileting skills.
Similarly, McLay, Carnett, van der Meer, and Lang [
5] used animated elements in video modeling to appropriately depict toileting skills, adding behavioral prompting and reinforcement to teach two boys with ASD—a seven-year-old and an eight-year-old—proper urination and defecation skills. Participants viewed the video model targeting urination first until the skill was acquired. The authors reported an increase in the percentage of independently completed steps as well as in-toilet voiding. These skills generalized to a school setting and maintained three to four months after the intervention was withdrawn. However, one child was not able to learn the proper defecation skills presented, and the child who did properly defecate had demonstrated this skill before beginning the intervention. Because behavioral strategies were used to teach toileting skills in addition to the videos, McLay and colleagues stressed the importance of future research to differentiate which effects could be attributed specifically to animation in video modeling. While both McLay and colleagues [
5] and Drysdale and colleagues [
25] did not find results clearly attributable to the animated elements in video modeling, these elements were useful in portraying situations that would otherwise be inappropriate to film. Both studies suggest that animated elements are promising features of video modeling that should be examined more fully.
While VE and animation appears to be relatively easy to implement and effective in a variety of applications, more research is needed to clarify conditions and populations for which they are most successful. The research reviewed in this paper provides multiple examples of isolated projects that have evaluated the effects of this technology on individuals with disabilities, but there are few ongoing systematic applications of VE and animation in schools or clinics. To address this need, our research team has undertaken an ongoing set of studies to examine the effects of VE, avatars, and animation, referred to as iAnimate Live.