4.1.3. Users' Satisfaction Analysis

For the score of each question, the odd-numbered questions are straightforward, with the score of each question being subtracted by the numerical value 1 to get final score; for example, if the score is 3, the calculated result will be 2. The even-numbered questions are roundabout, with the numerical value of 5 being subtracted by the score of each question to get final score; for example, if the score is 4, the calculated results will be 1. After the scores of each question are calculated, all the scores are added and multiplied by 2.5 to get the total score. The statistics obtained after the score conversion are shown in Table 3. According to the calculated results of the SUS formula, the average score of the subject for the system is 81.5. Figure 4 shows how the adjective ratings compare to both the school grading scale and the acceptability ranges [41]. The statistical results show that the users are satisfied with the usability of the system.

**Table 3.** Calculated Results of SUS Formula.


### *4.2. Eye Movement Analysis*

The 30 objects of this study were divided into an experiment group and a control group with each 15 subjects. The former conducted the experiment by using the affective tutoring system, while the latter conducted the experiment by using the traditional tutoring system. The eye tracker was applied to both groups in order to perform the eye movement analysis and tracking. The whole experiment took about 15 min.

**Number Median Maximum** 

Overall 15 81.5 82.5 95 67.5 7.245688

**Value** 

**Minimum Value** 

**Standard Deviation** 

**Figure 4.** A comparison of the adjective ratings, acceptability scores and school grading scales with the average SUS score. **Figure 4.** A comparison of the adjective ratings, acceptability scores and school grading scales with the average SUS score.

### *4.2. Eye Movement Analysis*  4.2.1. Eye Movement Fixation Analysis

**Table 3.** Calculated Results of SUS Formula.

**Sample Size** 

**Average** 

The 30 objects of this study were divided into an experiment group and a control group with each 15 subjects. The former conducted the experiment by using the affective tutoring system, while the latter conducted the experiment by using the traditional tutoring system. The eye tracker was applied to both groups in order to perform the eye movement analysis and tracking. The whole experiment took about 15 min. 4.2.1. Eye Movement Fixation Analysis The teaching contents of the system were divided into four sessions. The control group was compared with the experiment group in each session to understand the fixation duration of the subjects using the affective tutoring system. After finishing the experiment, the aggregate and average data of both the control group and the experiment group, as shown in Table 4, were calculated to obtain the total average fixation duration: 80,889.27 for the control group and 120,477.2 for the experiment group. The total average The teaching contents of the system were divided into four sessions. The control group was compared with the experiment group in each session to understand the fixation duration of the subjects using the affective tutoring system. After finishing the experiment, the aggregate and average data of both the control group and the experiment group, as shown in Table 4, were calculated to obtain the total average fixation duration: 80,889.27 for the control group and 120,477.2 for the experiment group. The total average fixation duration at the course contents was 80,687.73 for the control group and 86,751.6 for the experiment group. The total average fixation count on the course contents was 796,133 for the control group and 803,533 for the experiment group. The single average fixation duration was 101,349 for the control group and 107,962 for the experiment group. In the analysis of eye movement statistics, the results of the experiment group were better than those of the control group, which indicates that using the affective tutoring system increased the course learning fixation duration.


**Control Group Experiment Group** 

fixation duration at the course contents was 80,687.73 for the control group and 86,751.6 **Table 4.** Sessions one to four—Overall Average Table.

### Total Average Fixation Duration 80,889.27 120,477.2 4.2.2. Learning Duration Analysis of Eye Movement Course

Course Contents Total Average Fixation Duration 80,687.73 86,751.6 Course Contents Total Average Fixation Counts 796,133 803,533 Course Contents Single Average Fixation Duration 101,349 107,962 The teaching contents of the system were divided into four sessions. The control group was compared with the experiment group in each session to understand if the affective tutoring system can effectively increase the learners' course learning duration. According to Table 5, the average number of the experiment group and the control group was 1,084,836.47 and 851,582.27 respectively. The former was higher than the latter, which indicates that the affective tutoring system lengthened the learning duration compared with the traditional tutoring system. According to the significance judgment and analysis results of the data in Table 6, the significance was 0.000 < 0.05. We can say that the total course learning duration of the experiment group using the affective tutoring system is significantly different from that of the control group using the traditional tutoring system.

According to Table 7 below, the average number of the experiment group and control group is 86,751.60 and 80,687.73 respectively. Based on the significance judgment and analysis results of the data in Table 8, the significance is 0.242 > 0.05. According to Tables 7 and 8, the Test (T) table shows that there is no significant difference in the total fixation duration of the control group, but the average duration is increased.


**Table 5.** T Verification—Group Statistical Analysis (Total Course Learning Duration).

**Table 6.** T Verification—Independent Sample Verification (Total Course Learning Duration).


**Table 7.** Test (T)—Group Statistics (Fixation duration at the course contents).


**Table 8.** Test (T)—Independent sample test (course content gaze time).


According to Table 9 below, the average number of the experiment group and the control group is 1,084,836.47 and 851,582.27, respectively. Based on the significance judgment and analysis results of data in Table 10, the significance is 0.003 < 0.05. According to Tables 9 and 10, it can be found that there is a significant difference in the total fixation duration of the experiment group using the affective tutoring system compared with the control group using the general tutoring system. It shows that the fixation duration of the users with the affective tutoring system is longer than that of the users with the general tutoring system.

**Table 9.** Test (T)—Group Statistics (Total fixation duration).


**Table 10.** Test (T)—Independent Sample Test (Total fixation duration).


4.2.3. Eye Movement ROI Block Analysis

The teaching contents of the system were divided into four sessions. The control group was compared with the experiment group in respect of the time before the first visit of ROI block and the counts of fixation before the first visit.

Time before the first visit of the ROI block, the time before the first visit of the ROI block from sessions one to four of both the control group and the experiment group is zero. In this study, the course contents were in the middle position of the page layout, and after the nine-point correction, all subjects looked straight ahead and waited for the experiment to start, so they had already looked into the ROI block of the course contents at the very beginning of the first time, and thus the statistics show zero.

Fixation counts before the first visit, the fixation counts before the first visit from sessions one to four of both the control group and the experiment group are zero. In this study, the course contents were in the middle position of the page layout, and after the nine-point correction, all subjects looked straight ahead and waited for the experiment to start, and the standard fixation duration is 80 ms and the count statistics show zero.
