Next Article in Journal
Does Animal Personality Affect Movement in Habitat Corridors? Experiments with Common Voles (Microtus arvalis) Using Different Corridor Widths
Next Article in Special Issue
A Review of the Appropriate Nutrition Welfare Criteria of Dairy Donkeys: Nutritional Requirements, Farm Management Requirements and Animal-Based Indicators
Previous Article in Journal
Rearing of Hermetia Illucens on Different Organic By-Products: Influence on Growth, Waste Reduction, and Environmental Impact
Previous Article in Special Issue
Equine Welfare in Practice: A Collaborative Outreach and Education Program with Michigan State University, Universidad Nacional Autónoma de México, and Universidad Veracruzana
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Equine Activities Influence Horses’ Responses to Different Stimuli: Could This Have an Impact on Equine Welfare?

1
Behavioral and Physiological Mechanisms of Adaptation Department, Research Institute in Semiochemistry and Applied Ethology (IRSEA), 84400 Apt, France
2
Animal Experimentation Department, IRSEA, 84400 Apt, France
3
Statistical Analysis Department, IRSEA, 84400 Apt, France
4
Semiochemicals’ Identification and Analogs’ Design Department, IRSEA, 84400 Apt, France
*
Author to whom correspondence should be addressed.
Animals 2019, 9(6), 290; https://doi.org/10.3390/ani9060290
Submission received: 19 February 2019 / Revised: 4 May 2019 / Accepted: 24 May 2019 / Published: 29 May 2019

Abstract

:

Simple Summary

Horses are required to perform a wide variety of activities. Training a horse for these activities may influence the horse’s perception of and reactions to different stimuli. This study investigated the reactivity and emotional responses of horses involved by humans in different equine activities (dressage, jumping, eventing and equine-assisted activity/therapy) by studying their physiological and behavioral responses to different stimuli. A test setting with five phases was created to test equine responses to five different stimuli and compare these responses among horses from the different disciplines. It was demonstrated that the horses involved in the different activities had different responses, both physiologically and behaviorally, to the studied stimuli. These findings suggest that training a horse for a specific activity modifies the perception of stimuli and the strategies that the horse uses to balance its emotional state. Thus, horses involved in different activities probably behave differently according to their training. Such information is of great importance in improving training methods, with the aim of increasing equine welfare.

Abstract

The learning and cognitive challenges that horses may face differ according to the activities in which they are involved. The aim of this investigation was to study the influence of equine activities on the behavioral responses and autonomic nervous system (ANS) activity of adult horses. Forty-one horses were divided into four groups: dressage (9), jumping (10), eventing (13) and equine-assisted activity/therapy (9). A test was created to compare the horses’ behavioral and physiological responses to different stimuli. The goal was always to obtain a treat. To study the ANS activity, heart rate variability was assessed using the standard deviation of the R-R intervals (SDNN), square root of the mean of the sum of the squares of differences between successive interbeat-intervals (RMSSD) and low frequency/high frequency (LF/HF). To assess behavioral responses, video analysis was performed considering the following behaviors: exploration, interactions with another horse, and latency to approach. Significant differences in SDNN (DF = 3; F = 3.36; p = 0.0202), RMSSD (DF = 3; F = 4.09; p = 0.0078), LF/HF (DF = 3; F = 4.79; p = 0.0031), exploration (DF = 3; F = 5.79; p = 0.0013) and latency to approach (DF = 3; F = 8.97; p < 0.0001) were found among horses from different equine activities. The activity that adult horses practice appears to influence behavioral and physiological responses to different stimuli, thus impacting equine welfare.

1. Introduction

The concept of animal welfare includes both physical and mental elements, suggesting that emotions are an important component of welfare [1,2]. Animal emotions have been widely studied and many studies have investigated the influence of emotions on animal welfare [3,4,5]. Stress has often been associated with negative emotions [6], and the latter has been associated with poor animal welfare [1].
Some authors have suggested that horses from different activities might express their emotions through different behaviors [7,8]. For example, fear reactions differ between horses from different activities [9]. Jumping horses appear to be less reactive to frightening stimuli than dressage horses [9]. The cited study suggested that jumping horses may have a genetic component involved in the development of such behavior, while no correlation was found between genetics and the development of behavior in dressage horses. Learning not to respond to frightening stimuli may be associated with a habituation or desensitization to these stimuli through training, but horses might not generalize this reduced fear response to all potentially fear-inducing situations related to competition and training [10].
Learning capacities are influenced by emotions [3], which means that horses trained to perform different equine activities may use different behavioral and physiological strategies to adapt to the training conditions in which they are involved. These differences could have consequences in the development of the animals’ behavioral traits and emotional management [11].
The learning and cognitive challenges that horses may face differ with the sports discipline they practice [12]. Dressage horses must discriminate between similar cues provided by riders, while jumping horses must learn to jump obstacles, while ignoring the obstacle color or structure [12]. Eventing horses must combine the needs of dressage and jumping horses [12]. Equine-assisted activity/therapy (EAA/T) involves activities that include both recreational and therapeutic interventions for people with mental and/or physical conditions [13,14,15]. Horses involved in these activities may experience stress induced by the inconsistency of the patients’ contact or cues, as these people are usually experiencing physical, mental or combined medical conditions [16,17].
As a social species, horses devote a significant amount of their time to intra- and interspecific interactions, and even to reconciliation after conflict [18,19]. The husbandry conditions and management of these animals should encourage socialization because equine behavioral and emotional responses might be influenced by the animals’ sociability [20]. Housing conditions that allow horses to interact with conspecifics have been associated with an improvement in learning abilities and training performance [21]. Additionally, housing conditions that involve social isolation have been associated to increases in psychological stress expressed by behavioral and physiological changes [22,23]. These findings suggest that improving the welfare (e.g., improving housing conditions) of horses may improve training performance as well. Nevertheless, training performance could also be influenced by other factors [8].
Stress-related responses have been associated with an increase in the activity of the hypothalamic-pituitary-adrenocortical (HPA) axis, adrenomedullary system and autonomic nervous system (ANS) in horses [24]. Some studies have investigated the HPA axis through the assessment of serum or salivary cortisol [15,25,26]. Other studies have investigated the ANS through the assessment of heart rate variability (HRV), which is a noninvasive technique for studying the ANS responses of horses [27]. Additionally, HRV analysis in horses has often been used to study emotional responses to cognitive [3] and temperament tests [11], and as an indicator for equine welfare assessments [27].
Sympathetic activity may be modified by psychological states without any perceived alteration in heart rate (HR) or in respiratory rate [28]. However, modifications in sympathetic activity should be reflected in HRV [27]. HRV might be useful to study sympathetic and parasympathetic activities during psychological or physical challenges via parameters such as the low frequency/high frequency (LF/HF) ratio [27].
HRV outputs include time domain analysis and frequency domain analysis. Time domain analysis has different parameters [27,29]. The most commonly used parameters to study HRV in horses are the HR, the standard deviation of all the R-R wave intervals (SDNN) and the square root of the mean of the sum of the squares of differences between successive interbeat-intervals (RMSSD) [29,30]. Frequency domain analysis includes parameters that are influenced by the respiratory rate, which varies according to species; therefore, the frequency band widths should be adapted in this type of analysis [31,32]. These band widths concern the following parameters: LF and HF. However, there is no established agreement concerning these frequency band widths. Some authors suggest that, for LH and HF, the band width thresholds should be 0.01–0.07 Hz and 0.07–0.6 Hz, respectively [33,34], while other authors suggest thresholds of 0.005–0.07 Hz for LH and 0.07–0.5 Hz for HF [32,35].
Each of the described parameters reflects different aspects of HRV [29]. The HR represents the net interactions between vagal and sympathetic regulation [27]. The SDNN reflects the long-term variability of cardiac activity and could be influenced by both the sympathetic and parasympathetic systems of the ANS [27,29]. The RMSSD represents high-frequency beat-to-beat variations reflecting the vagal activity [27,29]. Notably, no agreement has been established regarding the meaning of LF. Some authors have suggested that this parameter may represent sympathetic activity [27,36], while others have suggested that LF may represent both sympathetic and parasympathetic activities [32,35]. Additionally, some have suggested that the sympathetic tone should not be directly derived from HRV parameters [27,33]. In contrast, HF is commonly considered a marker of the cardiac vagal tone and, consequently, the parasympathetic system [27,29,33]. Finally, the most widely accepted aspect of frequency domain analysis is that the LF/HF ratio parameter reflects the sympatho-vagal balance or the sympathetic-parasympathetic balance [27,29,37].
The noninvasive character of and the information provided by HRV make this assessment an interesting tool for studying ANS activity in horses during physical or psychological challenges [14].
Therefore, the aim of the present investigation was to study the influence of the activity in which animals were involved on the behavioral responses and ANS activity of adult horses. We hypothesized that the behavioral responses and the ANS activity of horses were influenced by the activity in which horses were involved.

2. Materials and Methods

This investigation included two experiments. The first experiment investigated equine behavior and physiological responses under different types of stimuli. The second experiment investigated the influence of several equine activities on horses’ behavior and physiological responses.
This project was approved by IRSEA’s (Research Institute in Semiochemistry and Applied Ethology) Ethics Committee (C2EA125) and the French Ministry of Research (APAFIS Process number 11949).

2.1. Population

The horse populations differed between the two experiments. Common inclusion criteria were as follows: horses should be more than 4 years old, be performing any equestrian or therapeutic activity at the time of the experiment, and according to a physical consultation performed by a veterinary practitioner, should be healthy. All horses included in the experiments had access to paddocks during the daytime and to a single box during the night. On rainy days, the horses were kept indoors.
In the first experiment, the population of horses comprised forty-one horses (1 stallion, 23 geldings and 17 females) with a mean age of 10.41 ± 4.28 years old. These horses were involved in one of the following activities in their usual daily lives: jumping, eventing, dressage, endurance, reining or leisure. Leisure horses comprised horses that were involved in various riding activities (dressage, jumping, reining, equestrian rides) with no specific purpose, as a hobby of the rider.
For the second experiment, as part of the inclusion criteria, horses had to be involved in one of the following equine activities as part of their usual routine: jumping, eventing, dressage or EAA/T. These horses had been involved in one of these activities since the age of 3–4 years. To reduce the number of animals used for research proposals and to respect legislation concerning ethics and equine welfare, particularly the 3R’s rule, data obtained in the first experiment concerning horses involved in jumping, eventing and dressage were used for the second experiment. Nine new horses involved in EAA/T were also included. Ultimately, a population of forty-one horses (25 geldings and 16 females) with a mean age of 10.76 ± 3.99 years old was considered for this experiment. The population was divided into the following groups: dressage (9), jumping (10), eventing (13) and equine assisted activity/therapy (9).

2.2. Study Design and Data Collection

Each experiment was divided into different phases (described below). The first experiment investigated the phase effects to understand the behavioral and physiological responses of the tested horses in the different phases. The second experiment studied two factors: activity and phase. The phase factor was studied to ensure that any possible observed significant difference in activity was not influenced by a cross effect between phase and activity.
The setting and testing conditions were the same for both experiments.
A testing area was created (Figure 1) to investigate equine physiological and behavioral responses to varying stimuli. The testing area was made of a 10 m2 paddock with an open field structure. A smaller paddock attached to the testing area hosted a familiar horse during the trials, respecting the horse’s need for interaction with other horses [21]. The familiar horses did not participate in the experiments and were provided with hay and water. A chair and a bucket containing treats (carrots, commonly used as treats in this equine population) were positioned at the side of the testing area opposite to the testing area’s entrance. The horse approaching and obtaining the treats from the bucket was always the goal.
A habituation period was used to let the horses spontaneously explore and get used to the setting and to create the motivation to approach the bucket and acquire the treats. This period lasted no more than 5 min. A horse was considered as habituated to the setting when it explored the setting, walked to the bucket and fed.
Each experiment included five independent phases (Table 1): baseline; unknown person; umbrella opening; ground obstacle; social isolation. These phases lasted no more than 5 min each, except for the baseline phase. Horses were led and removed from the testing area between each phase by an operator. During each testing phase, the horses were free in the testing area.
HRV data were collected using the Polar V800 Equine® system (Kempele, Finland). The data collected with the Polar system were transformed with Kubios® software (Kuopio, Finland) and only normal R-R intervals were considered for the HRV analysis. The final data included time domain and frequency domain analysis results (Table 2). Frequency band thresholds were established within each frequency interval using the following parameters: LF power = 0.005–0.07 Hz; HF power = 0.07–0.5 Hz; and LF/HF ratio [32].
During the last four phases, behavioral data were collected via video recording using a Sony Handycam HDR-CX450® camera (Weybridge, UK). Behaviors were assessed through video analysis, and with the help of an Excel® matrix (Redmond, WA, USA), behavior durations were determined by one operator according to an ethogram (Table 3). This ethogram was developed based on the importance of these behaviors for equines [18,19,38,39,40]. For experiment 1, raw data were used for statistical analysis, and the test was considered to last 5 min for each phase for each horse. However, most of the horses did not need 5 min to achieve the goal, so in the second experiment, each phase was considered as finished once the horse achieved the goal. As the time to achieve the goal could vary between individuals, the proportion of the duration of each specific behavior over the latency to obtain the treat was estimated.

2.3. Statistical Analysis

Statistical analysis was carried out using SAS 9.4 software (SAS Institute Inc., Cary, NC, USA). The significance threshold was classically fixed at 5%.
The behavioral parameter “interaction with another horse” was not considered in phase 5 because the untested horse was removed from the testing area.

2.3.1. Experiment 1

For HR, SDNN, RMSSD, LF/HF ratio and Latency 1, the assumption of normality of the data was tested using the residual diagnostics plots and the UNIVARIATE procedure. Comparisons between phases were performed with the general linear mixed model using the MIXED procedure. If significant differences were found, multiple comparisons were analyzed with the Tukey test using the LSMEANS statement.
For Exploration and Interaction, the assumption of normality of the data was tested with the same procedure, although it was not verified. Then, comparisons between phases were performed using the nonparametric Friedman test using the FREQ procedure. If significant differences were found, multiple comparisons were analyzed with the signed-rank test for each pair of times with the UNIVARIATE procedure, and then Bonferroni correction was applied with the MULTTEST procedure to control the error risk due to the multiplicity of the tests.

2.3.2. Experiment 2

For SDNN, RMSSD, LF/HF ratio and Latency 1, the assumption of normality of the data was tested using residual diagnostics plots and the UNIVARIATE procedure. Homoscedasticity was tested with Levene’s test using the GLM procedure. Comparisons between phases and activity were performed with the general linear mixed model using the MIXED procedure. When significant differences were found, multiple comparisons were analyzed with the Tukey test using the LSMEANS statement.
For HR and Exploration, the assumption of normality was verified, but the homogeneity of the variances was not. The GROUP = option was added in the REPEATED statement of the MIXED procedure. Then, comparisons between phases and activity were performed with the general linear mixed model using the MIXED procedure. If significant differences were found, multiple comparisons were analyzed with the Tukey test using the LSMEANS statement.
For Latency 2 (after the opening of the umbrella), the assumption of normality was not verified. Consequently, the nonparametric Kruskal-Wallis test was performed using the NPAR1WAY procedure. If significant differences were found, multiple comparisons were analyzed with the Wilcoxon test using the NPAR1WAY procedure, and then Bonferroni correction was applied with the MULTTEST procedure to control the error risk due to the multiplicity of the tests.
For Interaction, data were transformed into binary variables because the animals did not perform this behavior very often. In this case, the following code was considered: 1—there was an interaction with the untested horse; 0—there was no interaction with the untested horse. Comparisons between phases and activity were performed with the generalized linear mixed model using the GLIMMIX procedure. If significant differences were found, multiple comparisons were analyzed with the Tukey test using the LSMEANS statement.

3. Results

3.1. Experiment 1

Due to technical issues concerning the HR monitor, the data of 3 horses were not recorded. Additionally, artifacts concerning SDNN, RMSSD and the LF/HF ratio parameter of 2 horses were found. Aberrant data were excluded from the statistical analysis.
Additionally, for technical reasons, the video camera did not record some time frames, and some data were absent for 1 horse and could not be considered in the statistical analysis.
Some horses in the original population (one horse in phase 2; one horse in phase 3; three horses in phase 4; and two horses in phase 5) did not achieve the goal within 5 min, so their data were removed from the statistical analysis considering Latency 1.
All the included horses succeeded in the habituation phase.

3.1.1. Physiological Data (Table 4)

Significant differences in HR were observed between phases (DF = 4; F = 20.55; p < 0.0001). More specifically, HR was significantly lower in phase 1 than in all the other phases, and HR was significantly higher in phase 3 than in phases 2 and 4 (Table 4).
There was no significant difference in SDNN between phases (DF = 4; F = 1.74; p = 0.1446) (Table 4).
Significant differences in RMSSD were observed between phases (DF = 4; F = 2.74; p = 0.0309). However, after performing the Tukey adjustment for multiple comparisons, significant differences between individual phases could not be identified (Table 4).
There was no significant difference in the LF/HF ratio between phases (DF = 4; F = 0.45; p = 0.7723) (Table 4).
Table 4. Physiological data results of experiment 1.
Table 4. Physiological data results of experiment 1.
ParameterPhaseNMeanStd. Dev.MedianMinimumMaximum
Heart RateBaseline4142 a7433055
Unknown person3952 b12493580
Umbrella opening4158 bc13563488
Ground obstacle4052 c10503478
Social isolation4054175231129
SDNNBaseline41218167163701026
Unknown person39244184216701192
Umbrella opening4120710017659408
Ground obstacle3917711114544482
Social isolation38227191167291024
RMSSDBaseline4119115012748568
Unknown person3917210318329441
Umbrella opening411339211628404
Ground obstacle39124869027409
Social isolation3815611613623453
LF/HF RatioBaseline41333013
Unknown person397113059
Umbrella opening418135078
Ground obstacle40573035
Social isolation408153067
a Significant difference between the marked phase and all the other phases (Tukey test). b,c Significant difference between the marked phases (Tukey test).

3.1.2. Behavioral Data (Table 5)

For Exploration, significant differences were observed between phases (DF = 3; Chi-square = 27.35; p < 0.0001). More specifically, Exploration was significantly lower in phase 5 than all the other phases (Table 5).
There was no significant difference in interactions with another horse between phases (DF = 2; Chi-square = 2.71; p = 0.2576) (Table 5).
Significant differences were observed between phases considering Latency 1 (DF = 3; F = 14.53; p < 0.0001). More precisely, Latency 1 was significantly higher in phase 2 than in phase 3. Additionally, Latency 1 was significantly lower in phase 5 than all the other phases (Table 5).
Table 5. Behavioral data results of experiment 1.
Table 5. Behavioral data results of experiment 1.
ParameterPhaseNMeanStd. Dev.MedianMinimumMaximum
Exploration time (s)Unknown person414248220199
Umbrella opening414140310183
Ground obstacle403553140233
Social isolation4012167 b086
Interaction time (s)Unknown person417190098
Umbrella opening415120055
Ground obstacle40380040
Latency 1 time (s)Unknown person4071 c763810300
Umbrella opening4037 c27299123
Ground obstacle3848622410300
Social isolation3921 a1814589
a Significant difference between the marked phase and all the other phases (Tukey test). b Significant difference between the marked phase and all the other phases (Signed-rank test). c Significant difference between the marked phases (Tukey test).

3.2. Experiment 2

Due to technical issues concerning the HR monitor, the data of 5 horses were not recorded. Additionally, artifacts concerning HR, SDNN, RMSSD, and the LF/HF ratio of a few horses were found. Aberrant data were excluded from the statistical analysis.
Furthermore, because of technical reasons, the video camera did not record some time frames of 1 horse, so these data were absent and could not be considered in the statistical analysis.
Some horses in the original population did not achieve the goal within the 5 min, so their data were removed from the statistical analysis for Latency 1 (one horse in phase 2, one horse in phase 3, three horses in phase 4, and two horses in phase 5) and Latency 2 (three horses only in phase 3).
All the included horses succeeded in the habituation phase.

3.2.1. Physiological Data (Table 6)

There was no significant difference in HR between activities (DF = 3; F = 1.02; p = 0.3886) (Table 6).
Significant differences in SDNN were observed between activities (DF = 3; F = 3.36; p = 0.0202). More specifically, SDNN was significantly higher in the dressage group than in the EAA/T group. A trend was also observed between the jumping and the EAA/T groups, with a higher SDNN value in the jumping group than in the EAA/T group. No significant difference was observed in the phase effect or in the interaction between the activity and phase factors (Table 6).
Significant differences in RMSSD were observed between activities (DF = 3; F = 4.09; p = 0.0078). More specifically, RMSSD was significantly higher in the dressage group than in the EAA/T group. A trend was also observed between the jumping and the EAA/T groups, with a higher RMSSD value in the jumping group than in the EAA/T group. No significant difference was observed in the phase effect or in the interaction between the activity and phase factors (Table 6).
Significant differences in LF/HF were observed between activities (DF = 3; F = 4.79; p = 0.0031). More specifically, LF/HF was significantly higher in the EAA/T and eventing groups than in the dressage group. No significant difference was observed in the phase effect or in the interaction between the activity and phase factors (Table 6).
Table 6. Physiological data results of experiment 2.
Table 6. Physiological data results of experiment 2.
ParameterActivityNMeanStd. Dev.MedianMinimumMaximum
Heart RateJumping495010493281
Eventing655113493082
Dressage375015493085
EAA/T43478463576
SDNNJumping481899317067443
Eventing6418811215329515
Dressage38216 a11418857500
EAA/T43152 a9411032406
RMSSDJumping481388411745351
Eventing6513610510625441
Dressage36171 a10615423436
EAA/T43108 a898132466
LF/HF RatioJumping49563038
Eventing646 a84054
Dressage382 ab22012
EAA/T437 b94057
a,b significant differences between the marked phases (Tukey test).

3.2.2. Behavioral Data (Table 7)

Significant differences in Exploration were observed between activities (DF = 3; F = 5.79; p = 0.0013). More specifically, Exploration was significantly higher in the jumping and EAA/T groups than in the eventing and dressage groups. No significant difference was observed in the phase effect or in the interaction between the activity and phase factors (Table 7).
There was no significant difference in Interaction between activities (DF = 3; F = 1.11; p = 0.3486). Interaction was only performed by 47% of the horses in the jumping group, 24% in the eventing group, 15% in the dressage group and 7% in the EAA/T group (Descriptive statistics: 0 = absence of interaction; 1 = presence of interaction; jumping: 0 = 16, 1 = 14; eventing: 0 = 29, 1 = 9; dressage: 0 = 23, 1 = 4; EAA/T: 0 = 25, 1 = 2) (Table 7).
Significant differences in Latency 1 were observed between activities (DF = 3; F = 8.97; p < 0.0001). More specifically, Latency 1 was significantly higher in the jumping and EAA/T groups than in the eventing group. Additionally, Latency 1 was significantly higher in the EAA/T group than in the dressage group. A significant difference was also observed in the phase effect (DF = 3; F = 5.87; p < 0.001). More precisely, Latency 1 was significantly higher in phase 2 than in phase 5. No significant difference was observed in interaction between activity and phase factors (Table 7).
There was no significant difference in Latency 2 between activities (DF = 3; Chi-Square = 4.58; p = 0.2052) (Table 7).
Table 7. Behavioral data results of experiment 2.
Table 7. Behavioral data results of experiment 2.
ParameterActivityNMeanStd. Dev.MedianMinimumMaximum
ExplorationJumping4068 ab20721397
Eventing5151 ac25550100
Dressage3557 bd2160886
EAA/T3669 cd296814100
Latency 1Jumping3866 a694010300
Eventing4929 ab31198179
Dressage3644 c61255300
EAA/T3582 bc77627294
Latency 2Jumping10413238280
Eventing12368290295
Dressage9448062247
EAA/T7776018
a,b,c,d significant differences between the marked phases (Tukey test).

4. Discussion

In general, the results obtained in this study have shown that equine behavioral and physiological responses can be influenced by the activities in which horses are involved.
The first experiment confirmed that the stimuli in the different phases were neither too frightening nor challenging for the animals. Significant differences in RMSSD meant that the parasympathetic nervous system response differed in the different phases, but an overall balance of the ANS was maintained, as demonstrated by the absence of significant differences in SDNN and the LF/HF ratio.
In terms of the HR, an increase between the baseline HR and the HR of all the other phases was expected because the baseline represents an inactive phase from both physical and psychological perspectives. In the other phases, horses were exposed to new environmental conditions that they had to explore and were thus active. Significant differences concerning HR in phase 3 were most likely associated with the physical reaction of moving away from the sudden stimulus (the umbrella opening) rather than with emotional unbalance, as no other modifications in physiological parameters were found.
The decrease in the time spent exploring the testing area, as well as the decrease in Latency 1 between phases 2 and 3, could be explained by the learning capacities of the horses. The decrease in Exploration and Latency 1 in phase 5 might be interpreted as a strategy to cope with social isolation. This coping strategy was successful in balancing the emotional state of the horses, as demonstrated in the HR, SDNN and LF/HF ratio results.
The general lack of interactions between horses was an interesting finding, especially since horses are a social species. Nevertheless, even though interactions between horses were not observed as often as expected, the removal of the familiar horse modified the behavior of the tested horse. This behavioral modification was expressed by a reduction in exploratory behavior and Latency 1. These findings mean that even if the horses did not interact, the presence of a familiar horse appeared to have an emotional value for the tested horse.
To investigate the influence of equines’ activities on the emotional responses of horses, the selected stimuli should not create excessive fear. This condition was important because stimuli that are too frightening may induce maladaptive responses [41,42], which was not the subject of the present investigation. The first experiment demonstrated that the stimuli were suitable for the investigation of the influence of equines’ activities on horses’ emotional responses.
The results of the second experiment showed that the activities in which horses are involved influence horses’ physiological and behavioral responses to different stimuli.
Jumping horses balanced the activity of the ANS during the test, as demonstrated by the SDNN and LF/HF ratio results. This group required more time than the dressage and eventing groups to explore the testing area before approaching the person and obtaining the reward, as expressed by the Exploration and Latency 1 results. Nevertheless, the time spent exploring did not induce any modification of ANS activity.
Dressage horses had a higher value of SDNN than EAA/T horses, meaning that the former experienced a higher overall variability of the ANS than the latter during the test. However, the differences in the RMSSD and LF/HF ratio results demonstrated a higher influence of the parasympathetic nervous system in the overall variability of horses in the dressage group than in the EAA/T group. The EAA/T group had a lower overall variability and higher sympathetic nervous system activity than the dressage group during the test, as described by the RMSSD and LF/HF ratio results. This means that horses in the dressage group were more successful than horses in the EAA/T group in balancing the ANS during the test. Dressage horses took less time than EAA/T horses to explore the testing area and approach the person and the bucket to obtain the treat. Considering the physiological data, EAA/T horses showed an unbalance in the ANS and needed more time than dressage horses to approach the unknown person, which suggests that some social apprehension in horses may be induced by equine-assisted activities/therapy.
Eventing horses also had a high LF/HF ratio. Even if no other differences were found considering the physiological data, these results mean that an unbalance in the ANS was induced by the test, and this unbalance was most likely related to the sympathetic nervous system, as no differences were found in RMSSD. Eventing horses approached the person and achieved the goal more quickly than jumping horses, but eventing horses experienced an emotional unbalance, while jumping horses did not.
All horses needed a similar length of time to approach the person after the opening of the umbrella. This is an interesting finding because it means that, independent of the activity they have been trained to practice, horses will demonstrate the same response to a sudden stimulus: running away and then returning and exploring the area.
The influence of the equine’s activity on equine behavioral and physiological responses has been studied by different authors [8,9,10,17,43].
Some authors have suggested that jumping horses react significantly less than other horses to novelty [9]. Indeed, in our test, the jumping horses had a lower reactivity than the other horses. This low reactivity is usually desired in jumping horses by riders to reduce the risk of accidents [9]. However, some undesirable side effects can be expected, such as undesirable behaviors related to low fearfulness [9].
Another study [8] described differences in the reactional state of horses from different activities, suggesting that dressage horses could be more emotionally reactive than other horses. In agreement with the cited studies, the dressage horses reacted quickly to the different stimuli in our study. However, they rapidly recovered emotional homeostasis and were more successful in coping with the different stimuli than eventing and EAA/T horses. These findings suggest that dressage horses react to different stimuli faster than the other horses, but they also recover faster than other horses from an emotional challenge. A factor that could have a role in the observed difference between the reactivity of dressage horses in different studies is the housing conditions of the animals and their temperament [43,44,45]. Horses living in single boxes are deprived of many stimuli and may become more reactive to novelty, while horses with access to paddocks, likes the ones involved in this study, may be less reactive [22,23]. Additionally, equitation science has encouraged the application of training techniques that improve equine welfare in recent years [46], which may result in horses that are less inhibited and learn to manage their emotions in different situations [47].
A difference in the endocrinal responses (salivary cortisol) between eventing and dressage horses was previously described [10]. In the present study, eventing horses showed a higher increase in sympathetic system activity than jumping and dressage horses. These differences suggest that either the endocrinal or autonomic responses of eventing horses differ from those of other horses.
Studies on EAA/T horses have suggested that therapeutic riding may be as stressful as recreational riding [15,17]. In our study, even free horses demonstrated some emotional responses (HRV and behavior results) and probably some apprehension in approaching the person. These findings suggest that EAA/T horses may cope well with therapeutic activities but have some apprehension towards human contact; thus, producing poorer interspecific socialization.
The training exercises and conditions for performing different activities are very variable as horses need to acquire different competences to succeed in each of the activities, as described previously in [12,16,17]. The different learning situations associated to specific training for the different activities may influence the behavioral and physiological responses of horses in adulthood.
Equine welfare can be influenced by handling, training and housing conditions [44,48,49,50]. This investigation highlighted the variability of equine behavioral and physiological responses to different stimuli, and the influence of some equine activities on the reactional state and emotional management of adult horses. This means that the specific training for different activities may influence equine welfare in different ways. Understandings of equine perception of different stimuli and the corresponding emotional responses are of great importance to the equestrian community and for improving equine welfare.

5. Conclusions

The activity in which adult horses are involved appears to have an influence on their behavioral and physiological responses to different stimuli, and thus affects the welfare of horses. Understanding this influence is of great interest for improving equine welfare, with the aim of habituating and/or desensitizing horses to disturbing stimuli.
It might be interesting to study the same responses in foals before starting the training process for any of the described activities. This investigation would allow us to better understand how the genetic component, and the learning process through training and environmental stimulation are related in the development of behavioral and physiological responses of horses.
Further studies should be performed to acquire more knowledge about equine behavior and physiological responses related to emotions. Equine housing and general management conditions have been improved thanks to increased knowledge based on scientific evidence. Therefore, strategies to balance the emotional state of equines will probably change in the future.

Author Contributions

Conceptualization, T.M., C.B.-F., and P.P.; Data curation, T.M. and S.A.; Formal analysis, S.A.; Investigation, T.M., I.K., and J.L.; Methodology, T.M., C.B.-F., and P.P.; Project administration, T.M.; Resources, P.P.; Software, T.M. and S.A.; Supervision, C.B.-F. and P.P.; Validation, T.M., C.B.-F., and P.P.; Visualization, T.M.; Writing—original draft, T.M.; Writing—review & editing, C.B.-F., S.A., and P.P.

Funding

This research received no external funding.

Acknowledgments

The authors would like to thank Dr Pietro Asproni for his review of the manuscript, to the American Journal Experts (AJE) for the English editing of this manuscript, to Céline Lafont-Lecuelle for her review of the statistical analysis and to Fanny Menuge and Nicolas Sanchez for his help in field trials.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Marcet-Rius, M.; Kalonji, G.; Cozzi, A.; Bienboire-Frosini, C.; Monneret, P.; Kowalczyk, I.; Teruel, E.; Codecasa, E.; Pageat, P. Effects of straw provision, as environmental enrichment, on behavioural indicators of welfare and emotions in pigs reared in an experimental system. Livest. Sci. 2019, 221, 89–94. [Google Scholar] [CrossRef]
  2. Broom, D. Animal Welfare: Concepts and Measurement. J. Anim. Sci. 1991, 69, 4167–4175. [Google Scholar] [CrossRef] [PubMed]
  3. Mengoli, M.; Pageat, P.; Lafont-Lecuelle, C.; Monneret, P.; Giacalone, A.; Sighieri, C.; Cozzi, A. Influence of emotional balance during a learning and recall test in horses (Equus caballus). Behav. Process. 2014, 106, 141–150. [Google Scholar] [CrossRef]
  4. Boissy, A.; Manteuffel, G.; Jensen, M.; Moe, R.; Spruijt, B.; Keeling, L.; Winckler, C.; Forkman, B.; Dimitrov, I.; Langbein, J.; et al. Assessment of positive emotions in animals to improve their welfare. Physiol. Behav. 2007, 92, 375–397. [Google Scholar] [CrossRef] [PubMed]
  5. Stewart, M.; Stratton, R.B.; Beausoleil, N.J.; Stafford, K.J.; Worth, G.M.; Waran, N.K. Assessment of positive emotions in horses: Implications for welfare and performance. J. Vet. Behav. Clin. Appl. Res. 2011, 6, 296. [Google Scholar] [CrossRef]
  6. Paul, E.; Harding, E.; Mendl, M. Measuring emotional processes in animals: The utility of a cognitive approach. Neurosci. Biobehav. Rev. 2005, 29, 469–491. [Google Scholar] [CrossRef] [PubMed]
  7. Kiley-Worthingthon, M. The tail movement of ungulates, canids and felids with particular reference to their causation and function as displays. Behaviour 2011, 56, 69–114. [Google Scholar] [CrossRef]
  8. Hausberger, M.; Muller, C.; Lunel, C. Does work affect personality? A study in horses. PLoS ONE 2011, 6. [Google Scholar] [CrossRef]
  9. Von Borstel, U.U.K.; Duncan, I.J.H.; Lundin, M.C.; Keeling, L.J. Fear reactions in trained and untrained horses from dressage and show-jumping breeding lines. Appl. Anim. Behav. Sci. 2010, 125, 124–131. [Google Scholar] [CrossRef]
  10. Bartolomé, E.; Cockram, M.S. Potential effects of stress on the performance of sport horses. J. Equine Vet. Sci. 2016, 40, 84–93. [Google Scholar] [CrossRef]
  11. König von Borstel, U.; Euent, S.; Graf, P.; König, S.; Gauly, M. Equine behaviour and heart rate in temperament tests with or without rider or handler. Physiol. Behav. 2011, 104, 454–463. [Google Scholar] [CrossRef]
  12. McGreevy, P.; McLean, A. Horses in Sport and Work. In Equitation Science; Wiley-Blackwell: Oxford, UK, 2010; pp. 162–178. ISBN 9781405189057. [Google Scholar]
  13. Borgi, M.; Loliva, D.; Cerino, S.; Chiarotti, F.; Vinti, C.; De Santis, C.; Bisacco, F.; Fagerlie, M. Effectiveness of a Standardized Equine-Assisted Therapy Program for Children with Autism Spectrum Disorder. J. Autism Dev. Disord. 2016, 46, 1–9. [Google Scholar] [CrossRef]
  14. Malinowski, K.; Yee, C.; Tevlin, J.; Birks, E.; Durando, M.; Pournajafi-Nazarloo, H.; Cavaiola, A.; Mckeever, K. The effects of equine assisted therapy on plasma cortisol and oxytocin concentrations and heart rate variability in horses and measures of symptoms of post-traumatic stress disorder in veterans. J. Equine Vet. Sci. 2018, 64, 17–26. [Google Scholar] [CrossRef]
  15. McKinney, C.; Mueller, M.K.; Frank, N. Effects of therapeutic riding on measures of stress in horses. J. Equine Vet. Sci. 2015, 35, 922–928. [Google Scholar] [CrossRef]
  16. Johnson, R.; Johnson, P.; Megarani, D.; Patel, S.; Yaglom, H.; Osterlind, S.; Grindler, K.; Vogelweid, C.; Parker, T.; Pascua, C.; et al. Horses working in therapeutic riding programs: Cortisol, ACTH, glucose, and behavior stress indicators. J. Equine Vet. Sci. 2017, 57, 77–85. [Google Scholar] [CrossRef]
  17. Kaiser, L.; Heleski, C.R.; Siegford, J.; Smith, K.A. Stress-related behaviors among horses used in a therapeutic riding program. J. Am. Vet. Med. Assoc. 2006, 228, 39–45. [Google Scholar] [CrossRef]
  18. Cozzi, A.; Sighieri, C.; Gazzano, A.; Nicol, C.J.; Baragli, P. Post-conflict friendly reunion in a permanent group of horses (Equus caballus). Behav. Process. 2010, 85, 185–190. [Google Scholar] [CrossRef]
  19. Heitor, F.; do Mar Oom, M.; Vicente, L. Social relationships in a herd of Sorraia horses. Part II. Factors affecting affiliative relationships and sexual behaviours. Behav. Process. 2006, 73, 231–239. [Google Scholar] [CrossRef]
  20. Lansade, L.; Bouissou, M.F.; Erhard, H.W. Reactivity to isolation and association with conspecifics: A temperament trait stable across time and situations. Appl. Anim. Behav. Sci. 2008, 109, 355–373. [Google Scholar] [CrossRef]
  21. Rivera, E.; Benjamin, S.; Nielsen, B.; Shelle, J.; Zanella, A.J. Behavioral and physiological responses of horses to initial training: The comparison between pastured versus stalled horses. Appl. Anim. Behav. Sci. 2002, 78, 235–252. [Google Scholar] [CrossRef]
  22. Le Scolan, N.; Hausberger, M.; Wolff, A. Stability over situations in temperamental traits of horses as revealed by experimental and scoring approaches. Behav. Process. 1997, 41, 257–266. [Google Scholar] [CrossRef]
  23. Hothersall, B.; Casey, R. Undesired behaviour in horses: A review of their development, prevention, management and association with welfare. Equine Vet. Educ. 2012, 24, 479–485. [Google Scholar] [CrossRef]
  24. Von Lewinski, M.; Biau, S.; Erber, R.; Ille, N.; Aurich, J.; Faure, J.M.; Möstl, E.; Aurich, C. Cortisol release, heart rate and heart rate variability in the horse and its rider: Different responses to training and performance. Vet. J. 2013, 197, 229–232. [Google Scholar] [CrossRef]
  25. Peeters, M.; Closson, C.; Beckers, J.; Vandenheede, M. Rider and horse salivary cortisol levels during competition and impact on performance. J. Equine Vet. Sci. 2013, 33, 155–160. [Google Scholar] [CrossRef]
  26. Peeters, M.; Sulon, J.; Beckers, J.F.; Ledoux, D.; Vandenheede, M. Comparison between blood serum and salivary cortisol concentrations in horses using an adrenocorticotropic hormone challenge. Equine Vet. J. 2011, 43, 487–493. [Google Scholar] [CrossRef]
  27. Von Borell, E.; Langbein, J.; Després, G.; Hansen, S.; Leterrier, C.; Marchant-Forde, J.; Marchant-Forde, R.; Minero, M.; Mohr, E.; Prunier, A.; et al. Heart rate variability as a measure of autonomic regulation of cardiac activity for assessing stress and welfare in farm animals. Physiol. Behav. 2007, 92, 293–316. [Google Scholar] [CrossRef]
  28. Tiller, W.; McCraty, R.; Atkinson, M. Cardiac Coherence: A new, noninvasive measure of autonomic nervous system order. Altern. Ther. Health Med. 1996, 2, 52–65. [Google Scholar]
  29. Stucke, D.; Große Ruse, M.; Lebelt, D. Measuring heart rate variability in horses to investigate the autonomic nervous system activity—Pros and cons of different methods. Appl. Anim. Behav. Sci. 2015, 166, 1–10. [Google Scholar] [CrossRef]
  30. Visser, E.K.; Van Reenen, C.G.; Van der Werf, J.T.N.; Schilder, M.B.H.; Knaap, J.H.; Barneveld, A.; Blokhuis, H.J. Heart rate and heart rate variability during a novel object test and a handling test in young horses. Physiol. Behav. 2002, 76, 289–296. [Google Scholar] [CrossRef]
  31. Després, G.; Veissier, I.; Boissy, A. Effect of autonomic blockers on heart period variability in calves: Evaluation of the sympatho-vagal balance. Physiol. Res. 2002, 51, 347–353. [Google Scholar]
  32. Bowen, M. Ambulatory electrocardiography and heart rate variability. In Cardiology of the Horse; Marr, C., Bowen, M., Eds.; Saunders Elsevier: Amsterdam, The Netherlands, 2010; pp. 127–138. ISBN 9780702028175. [Google Scholar]
  33. Kuwahara, M.; Hashimoto, S.I.; Ishii, K.; Yagi, Y.; Hada, T.; Hiraga, A.; Kai, M.; Kubo, K.; Oki, H.; Tsubone, H.; et al. Assessment of autonomic nervous function by power spectral analysis of heart rate variability in the horse. J. Auton. Nerv. Syst. 1996, 60, 43–48. [Google Scholar] [CrossRef]
  34. Zebisch, A.; May, A.; Reese, S.; Gehlen, H. Effect of different head-neck positions on physical and psychological stress parameters in the ridden horse. J. Anim. Physiol. Anim. Nutr. (Berl.) 2014, 98, 901–907. [Google Scholar] [CrossRef]
  35. Bowen, M.; Marr, C. The effects of glycopyrolate and propanolol on frequency domain analysis of heart rate variability in the horse.pdf. J. Vet. Intern. Med. 1998, 12, 255. [Google Scholar]
  36. Rietmann, T.R.; Stuart, A.E.A.; Bernasconi, P.; Stauffacher, M.; Auer, J.A.; Weishaupt, M.A. Assessment of mental stress in warmblood horses: Heart rate variability in comparison to heart rate and selected behavioural parameters. Appl. Anim. Behav. Sci. 2004, 88, 121–136. [Google Scholar] [CrossRef]
  37. Kuwahara, M.; Hiraga, A. Influence of training on autonomic nervous function in horses: Evaluation by power spectral analysis of heart rate variability. Equine Vet. J. 1999, 30, 178–180. [Google Scholar] [CrossRef]
  38. Hall, C.; Randle, H.; Pearson, G.; Preshaw, L.; Waran, N. Assessing Equine Emotional State; Elsevier B.V.: Amsterdam, The Netherlands, 2018; Volume 205, ISBN 1158485212. [Google Scholar]
  39. Nicol, C.J. Learning abilities in the horse. In The Domestic Horse: The Evolution, Development and Management of Its Behaviour; Mills, D., McDonnell, S., Eds.; Cambridge University Press: Cambridge, UK, 2005; pp. 169–183. [Google Scholar]
  40. Lansade, L.; Simon, F. Horses’ learning performances are under the influence of several temperamental dimensions. Appl. Anim. Behav. Sci. 2010, 125, 30–37. [Google Scholar] [CrossRef]
  41. Mcgreevy, P. Miscellaneous unwelcome behaviors, their causes and resolution. In Equine Behavior: A Guide for Veterinarians and Equine Scientists; Saunders Elsevier: Amsterdam, The Netherlands, 2004; pp. 331–345. ISBN 0702026344. [Google Scholar]
  42. Mcgreevy, P.; McLean, A. Fight and Flight Responses and Manifestations. In Equitation Science; Wiley-Blackwell: Hoboken, NJ, USA, 2010; pp. 225–257. ISBN 9781405189057. [Google Scholar]
  43. Graf, P.; Von Borstel, U.K.; Gauly, M. Practical considerations regarding the implementation of a temperament test into horse performance tests: Results of a large-scale test run. J. Vet. Behav. Clin. Appl. Res. 2014, 9, 329–340. [Google Scholar] [CrossRef]
  44. Yarnell, K.; Hall, C.; Royle, C.; Walker, S. Domesticated horses differ in their behavioural and physiological responses to isolated and group housing. Physiol. Behav. 2015, 143, 51–57. [Google Scholar] [CrossRef] [Green Version]
  45. Graf, P.; König von Borstel, U.; Gauly, M. Importance of personality traits in horses to breeders and riders. J. Vet. Behav. Clin. Appl. Res. 2013, 8, 316–325. [Google Scholar] [CrossRef]
  46. ISES Position Statement on Aversive Stimuli in Horse Training. Available online: https://equitationscience.com/equitation/position-statement-on-aversive-stimuli-in-horse-training (accessed on 1 March 2018).
  47. Pereira-figueiredo, I.; Costa, H.; Carro, J.; Stilwell, G.; Rosa, I. Behavioural changes induced by handling at different timeframes in Lusitano yearling horses. Appl. Anim. Behav. Sci. 2017, 36–34. [Google Scholar] [CrossRef]
  48. Nagy, K.; Bodó, G.; Bárdos, G.; Harnos, A.; Kabai, P. The effect of a feeding stress-test on the behaviour and heart rate variability of control and crib-biting horses (with or without inhibition). Appl. Anim. Behav. Sci. 2009, 121, 140–147. [Google Scholar] [CrossRef]
  49. Munsters, C.C.B.M.; Visser, K.E.K.; van den Broek, J.; Sloet van Oldruitenborgh-Oosterbaan, M.M. The influence of challenging objects and horse-rider matching on heart rate, heart rate variability and behavioural score in riding horses. Vet. J. 2012, 192, 75–80. [Google Scholar] [CrossRef] [PubMed]
  50. Cooper, J.J.; Albentosa, M.J. Behavioural adaptation in the domestic horse: Potential role of apparently abnormal responses including stereotypic behaviour. Livest. Prod. Sci. 2005, 92, 177–182. [Google Scholar] [CrossRef]
Figure 1. Scheme of the testing area. This setting was designed to test horse reactivity to different stimuli, while avoiding social isolation.
Figure 1. Scheme of the testing area. This setting was designed to test horse reactivity to different stimuli, while avoiding social isolation.
Animals 09 00290 g001
Table 1. Description of the aims of each phase of the experiment.
Table 1. Description of the aims of each phase of the experiment.
PhaseAimDescription
Baseline (1)Collection of HRV data at restHRV data was collected over a period of twenty minutes under normal life conditions of the horse (paddock or box) without any human influence.
Unknown person (2)To test interspecific socializationAn unknown person sat on a chair close to the bucket (1 m of distance), so the horse needed to approach the person to access the treat.
Umbrella opening (3)To test responses to a sudden stimulusThis stimulus has been used in many studies to investigate equine responses to sudden stimuli [37,38]. In this phase, the person sitting on the chair opened an umbrella when the horse starts eating from the bucket.
Ground obstacle (4)To test recovery capacities and strategiesObstacle bars were placed in the middle of the testing area, dividing the setting into two parts. To approach the treat and the person on the chair, the horse had to cross the bars.
Social Isolation (5)To test equine responses to social isolationThe familiar horse and the person were removed from the testing area and from the horse’s visual field.
Table 2. Adapted description of HRV variables from Stucke et al., (2015) [29].
Table 2. Adapted description of HRV variables from Stucke et al., (2015) [29].
VariableDefinitionInterpretation
HR (bpm)Heart rate meanOverall variability of cardiac activity
SDNN (ms)Standard deviation of RR intervalsLong-term variability of cardiac activity influenced by the autonomous nervous system
RMSSD (ms)Square root of the mean of the sum of the squares of differences between successive interbeat-intervals (IBI)High frequency of IBI variations correlated to parasympathetic activity
LF/HF ratioLow frequency/high frequency ratioRepresentation of the balance between sympathetic and parasympathetic nervous systems
Table 3. Ethogram used for video analysis.
Table 3. Ethogram used for video analysis.
BehaviorDefinition
ExplorationThe animal searches for information by walking around the testing area or by sniffing or touching the person or object.
Interactions with another horse (Interaction)Interactions with the untested horse through physical or visual contact.
Latency to obtain the treat (Latency 1)Time the horse takes to approach the bucket and obtain the treat in all the phases.
Latency to obtain the treat after the umbrella opens (Latency 2; only in the 2nd experiment)Time the horse takes to approach the bucket again after the umbrella opens in phase 3.

Share and Cite

MDPI and ACS Style

Mendonça, T.; Bienboire-Frosini, C.; Kowalczyk, I.; Leclercq, J.; Arroub, S.; Pageat, P. Equine Activities Influence Horses’ Responses to Different Stimuli: Could This Have an Impact on Equine Welfare? Animals 2019, 9, 290. https://doi.org/10.3390/ani9060290

AMA Style

Mendonça T, Bienboire-Frosini C, Kowalczyk I, Leclercq J, Arroub S, Pageat P. Equine Activities Influence Horses’ Responses to Different Stimuli: Could This Have an Impact on Equine Welfare? Animals. 2019; 9(6):290. https://doi.org/10.3390/ani9060290

Chicago/Turabian Style

Mendonça, Tiago, Cécile Bienboire-Frosini, Izabela Kowalczyk, Julien Leclercq, Sana Arroub, and Patrick Pageat. 2019. "Equine Activities Influence Horses’ Responses to Different Stimuli: Could This Have an Impact on Equine Welfare?" Animals 9, no. 6: 290. https://doi.org/10.3390/ani9060290

APA Style

Mendonça, T., Bienboire-Frosini, C., Kowalczyk, I., Leclercq, J., Arroub, S., & Pageat, P. (2019). Equine Activities Influence Horses’ Responses to Different Stimuli: Could This Have an Impact on Equine Welfare? Animals, 9(6), 290. https://doi.org/10.3390/ani9060290

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop