3.1. First Level (190 Students) Results
As indicated, at this level, the objectives were to examine the effects of the podcast activity on the total set of 190 students through the analysis of a) the academic contribution of the activity in terms of learning and passing subjects (H1 to H4); b) the contribution to classroom enhancement in terms of the student satisfaction with their participation in this activity, and possible improvement of the classroom environment in terms of the relationship between peers and with the teacher (H5 to H12).
To enhance the presentation and interpretation of the data, several tables have been devised.
Table 3 provides a comprehensive overview of the frequencies and descriptive statistics (median and mode) of all the items that have been analyzed in this study.
Table 4 shows the results of the test of the null hypothesis that specifies that the median value is greater than or equal to a given amount.
The results obtained for each of the hypotheses presented in
Table 1 will now be discussed in light of the data in
Table 3,
Table 4 and
Table 5, depending on the case. Specifically,
Table 4 is referenced when the hypothesis pertains to a single item, while
Table 5 is used when the hypothesis examines the independence between items.
- (a)
Hypotheses H1 to H4: review the possible academic contributions of using a podcast created by students.
Hypothesis 1 (H1). Podcasts help to understand the subject (P2).
This first hypothesis asks whether the podcasting activity has helped students to understand the subject better. The frequency distribution of P2 indicates that creating podcasts has helped students understand the subject matter, given that 80% of the evaluations are concentrated in scores 4 to 7. Although P2 has a median value and mode value equal to 5, 54.8% of the students gave a score equal to or greater than 5 to P2. The findings of the investigation conducted on the median of P2 do not permit the rejection of the hypothesis that the median is greater than or equal to 5 at a 95% confidence level. However, the null hypothesis that the median is greater than or equal to 6 is rejected. Nevertheless, these results lend support to the proposition that the podcast assists students in comprehending the subject matter about which they created the podcast.
Hypothesis 2 (H2). Podcasts help to pass subjects (P6).
The second hypothesis posits the question of whether engagement in the creation of podcasts, a student-centered activity, contributes to successful academic performance in studies. It has been observed that the students place a high value on this component, with 86.2% of evaluations falling within the 4 to 7 range on a scale of 1 to 7. The median value of P6 is 5, and its mode value is equal to 5. The results of the test of the median of P6 do not allow us to reject that the median is greater than or equal to 6 at a 95% confidence level, a hypothesis that is supported by the observation that 49.4% of students rate this item with a score of 6 or 7.
Hypothesis 3 (H3). Podcasts increase interest in other topics related to the subject (P5).
This activity could encourage students to be interested in other topics not considered in the podcast but related to the subject, which can result in better learning and, ultimately, passing the subject. Thus, 53.2% gave P5 a score of 5 or higher, causing its median and mode to coincide at 5 points, and it is rejected at the 95% confidence level that its median is greater than 6 (with a test statistic value equal to 52) but it cannot be rejected that its median value is equal to or greater than 5.
Once it is established that this activity supports strict academic objectives, such as facilitating subject matter comprehension and contributing to academic success, it becomes relevant to examine whether the podcast’s impact on passing the subject operates independently of its contribution to understanding the subject content. However, before presenting the results related to this proposition (H4), methodological clarification is warranted. As noted by
Agresti (
2012), among others, when testing the hypothesis of independence between two variables or items, the expected frequency in all cells of the contingency table must be a minimum of 5.
Given that this assumption was not met in several of the analyzed items, they were recoded. They are presented in their final form in
Appendix B.
Table 5 reports the Pearson chi-square statistic values for the independence tests conducted in this study, where the null hypothesis posits that the relative frequency distribution of one variable remains unchanged regardless of the value of the other.
Hypothesis 4 (H4). The contribution of the podcasts to passing the subject (P6) is independent of the contribution of the podcasts to understanding the subject matter (P2).
The null hypothesis of independence between P2 and P6 is rejected at the 99% confidence level. Although not explicitly included for the sake of clarity, the cross-tabulation of the recoded items reveals that the conditioned relative frequency distribution of one item varies depending on the score of the other. Specifically, higher scores in one item correspond to a greater proportion of students assigning higher scores to the other item. These distributional differences substantiate the rejection of the independence hypothesis at the 99% confidence level. Moreover, the Spearman correlation coefficient (0.220) between understanding and passing the subject suggests a low but statistically significant positive association in the context of the podcasting activity.
- (b)
Hypotheses H5 to H12: review of the possible contribution of the activity to the improvement of the classroom environment.
Hypothesis 5 (H5). Podcasts help students get to know their classmates better (P3).
The frequency distribution of P3 shows that the podcasts help the students to get to know their classmates better, which has an impact on the general atmosphere of the class; 81.1% of responses scored 5 or higher. In fact, its median value was 6, and its modal value was 7. Thus, when testing at the 95% confidence level, if the median is greater than or equal to 6, H5 could not be rejected.
Hypothesis 6 (H6). Podcasts help students improve their relationship with classmates (P4).
Creating a podcast about a degree subject seems to have benefited the students by improving their relationships with their classmates. In fact, its modal value was 7, although the median was 6. There were 116 of the 190 students that gave this item a score of 6 or 7, so it is not surprising that the null hypothesis that its median is equal to or greater than 6 could not be rejected at the 95% confidence level.
Hypothesis 7 (H7). Students like the activity of making a podcast (P1).
This hypothesis evaluates the students’ degree of satisfaction with creating a podcast. The activity is based on the teachers’ conviction that it would be well received by the students, but it was unknown whether this really was the case for the participating students. The median and mode values were equal to 6, and the results of the tests on the median of P1 do not allow us to reject that the median is greater than or equal to 6, which is supported by the fact that 143 students rated this item with a value greater than 6. For all these reasons, it can be concluded that the acceptance of the activity by participating students is high.
Hypothesis 8 (H8). Liking the activity is independent of the perception that it enhances understanding of the subject (P1 and P2).
The cross-tabulation between these two recoded items reveals differences in the distribution of conditioned relative frequencies, and such differences explain why the hypothesis of independence is rejected at the 99% confidence level.
Hypothesis 9 (H9). Liking the activity is independent of the perception that it helps to pass the subject (P1 and P6).
The cross-tabulation between P1 and P6, when recoded, reveals that the conditioned relative frequency of one item varies as the score of the other changes, which explains the rejection of the independence hypothesis at the 99% confidence level.
Hypothesis 10 (H10). Liking the activity is independent of recommending its use (P1 and P7).
The cross-tabulation between these items, when they are recoded, shows that the conditioned relative frequency of one of the items changes when the other’s score changes, which accounts for the rejection of the independence hypothesis at the 99% confidence level. It is clear, however, that they recommend its use.
Hypothesis 11 (H11). Participation in the podcast activity negatively influences students’ perception of the teacher who proposed it (P8).
A critical question that we, as university teachers, must consider is whether proposing an activity that encroaches on students’ free time could negatively influence their perceptions of the instructors who introduce it. Notably, Item P8 was the only statement framed in a negative manner. This intentional modification aimed to prompt students to reflect more carefully on their response regarding their perception of the instructor, ensuring that this response was distinct from the rest of the questionnaire. Consequently, the measurement scale for this item must be interpreted inversely compared to the other items: a score of 1 indicates that engaging in the activity does not negatively affect the student’s perceptions of the teacher, whereas a score of 7 signifies a substantial deterioration in that perception. The null hypothesis stating that “the median value of P8 is equal to or greater than 2” is rejected at the 95% confidence level. In fact, 86.4% of responses fall within the range of 1 to 2, suggesting that participation in this activity does not negatively impact students’ perceptions of their teacher.
Hypothesis 12 (H12). Podcasts should be used in other subjects and degrees as a teaching system (P7).
This final hypothesis examines whether, after completing the activity and reflecting on its perceived value, students believe it should be implemented in other degrees. Recommending an activity for use in additional subjects is arguably one of the most direct indicators that a newly introduced classroom tool has achieved its intended impact. The frequency distribution of P7 suggests that students would endorse incorporating this activity into other subjects. Specifically, 84.7% of responses fall within the 5 to 7 range, with a median of 6 and a mode of 7. Given these results, it is unsurprising that the statistical tests for the median of P7 do not provide sufficient evidence to reject the hypothesis that the median is greater than or equal to 6 (test statistic = 129).
3.2. Second Level (Students by Degree) Results
The second level of analysis seeks to evaluate the 12 previously stated hypotheses, now examining potential differences in results based on the degree of the students participating in the podcasting activity. The distinct student profiles of these degree programs suggest that the acceptance of a teaching tool may vary considerably depending on the professional orientation of the field. Specifically, in a program such as pedagogy, where knowledge transmission is a fundamental component of professional training, the adoption of such an activity might differ significantly from that in tourism, where students’ future careers are largely unrelated to education.
Again, three tables show the results at this level.
Table 6 contains the frequencies, mode, and median for each item by degree, although it should be noted that the results of the independence tests that provide answers to the hypotheses raised have been carried out on the recoded items and are shown in
Appendix B.
These results of independence testing are shown in
Table 7 (independence tests between items P1 to P8 and the degree) and
Table 8 (independence tests between P1 with P2, P6, P7, and P2 with P6 for one degree and the other).
As observed, median values of items P1 to P8 for the two degrees were very similar. In fact, the corresponding independence tests suggest that the distribution of relative frequencies for items P2 to P8 does not change when the degree changes. However, such a hypothesis is rejected in the case of P1 (
Table 7).
Hypothesis (H1S). The contribution of this activity to understanding the subject matter is independent of the degree (P2 and degree).
Observing that the median and mode of P2 in pedagogy is 5 and in tourism is 4, it could be said that pedagogy students agree more with the statement than tourism students. However, when this item is recoded, the observed differences in the relative frequencies of this item according to degree do not seem sufficient to conclude that the podcast contributes to understanding the subject matter in one degree more than in the other.
Hypothesis (H2S). The contribution of this activity to passing the subject is independent of the degree (P6 and degree).
Considering the conditioned relative frequencies of P6, which has been recorded, by degree, it follows that there is not sufficient evidence to conclude that the podcast contributes more significantly to passing the subject in one degree than in the other.
Hypothesis (H3S). The contribution of this activity to increase interest in other topics related to the subject is independent of the degree (P5 and degree).
Regarding P5, this contribution was higher in Tourism than in Pedagogy. However, when P5 is recoded, differences in the relative frequencies of this item according to the degree do not seem sufficient to conclude that the podcasts contribute to increasing interest in other subjects related to one degree more than in the other. So, the independence hypothesis between this type of contribution and the degree is not rejected.
Hypothesis (H4S). The contribution of the podcast to passing a subject (P6) is independent of the contribution of the podcast to understanding the subject matter (P2) by degree.
In this case, the observed differences in the frequencies of these two items, once recoded, support the conclusion that passing the subject and understanding the subject matter yield different results by degree. Specifically, the null hypothesis is not rejected for tourism students, whereas it is rejected for pedagogy students. This indicates that, for pedagogy students, the relationship between the podcast’s contribution to passing the subject and its role in fostering subject-matter comprehension is more clearly established than for tourism students.
Hypothesis (H5S). The contribution of this activity to getting to know classmates better is independent of the degree (P3 and degree).
The median value is 7, and the mode value is 7 in both degrees, but the percentage of students who gave this item a value equal to or greater than 5 was 77.5% in tourism and 84.2% in pedagogy. When P3 is recoded, the frequencies in relative frequencies observed in the recoded values of this item according to the degree do not seem sufficient to conclude that the podcast contributes to getting to know classmates better in one degree than in the other.
Hypothesis (H6S). The contribution of this activity to improving the relationship between classmates is independent of the degree (P4 and degree).
Reviewing the frequencies given to P4, we can see that 33.7% of tourism students and 37.6% of pedagogy students awarded it a 7. The percentage of students who are quite/very/totally in agreement with the statement (values 5, 6, and 7) represents 82.1% of the responses in the tourism degree, and in pedagogy, it reaches 75.2%. However, the distribution of relative frequencies of P4, once recoded, does not seem to change according to the degree. So, the test statistic for the independence between the contribution of this activity to improving the relationship between classmates and the degree does not allow for the rejection of the null hypothesis of independence.
Hypothesis (H7S). Liking the activity of creating a podcast is independent of the degree (P1 and degree).
In both degrees, the mode and median of P1 were equal to 6, but when P1 is recoded, the hypothesis of independence with a 99% confidence level is rejected; that is, the distribution of relative frequencies of P1 changes with the degree.
Hypothesis (H8S). Liking the activity is independent of feeling that it helps to understand the subject matter (P1 and P2).
In this case, the differences in the relative frequencies of these items, according to degree, seem sufficient to conclude that there is a relationship between liking the activity and feeling that it helps to understand the subject matter in both degrees.
Hypothesis (H9S). Liking the activity is independent of the perception that it helps to pass the subject (P1 and P6).
For both university degrees, the results suggest that the differences in the relative frequencies of these items are sufficient to conclude the existence of a relationship between liking the activity and perceiving it as helpful for passing subjects.
Hypothesis (H10S). Liking the activity is independent of recommending its use (P1 and P7).
The differences in the relative frequencies of these items seem sufficient to conclude that there is a relationship between liking the activity and recommending its use in both degrees.
Hypothesis (H11S). Participation in the podcast activity negatively influences students’ perception of the teacher who proposed it (P8) is independent of the degree (P8 and degree).
When P8 is recoded, the null hypothesis that this item and the degree are independent is not rejected. This is especially interesting because the different subjects in both degrees had the same teacher.
Hypothesis (H12S). Recommending this activity in other subjects is independent of the degree (P7 and degree).
In both degrees, the observed differences in the relative frequencies of this item according to the degree do not seem sufficient to conclude that the recommendation of using this activity in other subjects is higher in one degree than in the other, so the null hypothesis that this item and the degree are independent is not rejected.