1. Introduction
Acoustic events are generally described in terms of sound pressure level (SPL) with a unit of dB. However, the human ear not only focuses on the level but also on the frequency content of the sound waves. In fact, the variety in the spectrum results in completely different perceptions even under the same levels of sound pressure [
1,
2].
Studies on the perception of sound waves were gathered under the discipline of psycho-acoustics, and the spectral events were matched with sound quality metrics. These metrics are obtained by an extensive study on the perception of a huge number of people. Loudness, sharpness, roughness, fluctuation strength, and pitch constitute the fundamentals of sound quality [
1].
Evaluating the sound quality (SQ) of vehicles, especially regarding road noise, necessitates a comprehensive assessment beyond just sound level. A multitude of metrics paint a vivid picture of the aural experience. Loudness, measured in A-weighted decibels (dBA), in sones, or in phons, reflects the perceived intensity. Sharpness, quantified by metrics like Loudness Spectrum Term (LST), gauges the high-frequency content influencing satisfaction. Roughness, assessed by the Roughness Perception Index (RPI), captures the unpleasantness caused by rapid sound pressure fluctuations [
1,
2,
3,
4,
5,
6].
The Articulation Index (AI) indicates how clearly speech can be understood over the noise, crucial for in-cabin environments. Fluctuation Strength (FS) reflects the variation in sound level over time, influencing how distracting the noise might be. Tonality Index (TI) measures the presence of prominent tonal components, often from engine noise [
7]. The tire–road noise, which can be a dominant sound source at some velocities depending on the engine type, can be better characterized using psychoacoustical parameters, such as loudness and sharpness, rather than sound pressure level [
8]. By analyzing these metrics, alongside others, researchers and engineers gain a deeper understanding of how road noise impacts human perception and well-being. This knowledge empowers them to tailor noise reduction strategies that address the specific aspects deemed most unpleasant by individuals, ultimately refining the vehicle’s acoustic environment.
The historical advances in automotive NVH reduced noises of internal combustion engines and the powertrain systems to very low levels. Low noise levels do not necessarily mean good noise. The demand of customers for good sound are still increasing. Therefore, studies to improve the sound quality are essential for developing a car that sounds good [
2]. Since the engine masking is reduced, the other systems are becoming more critical for their perception. In fact, the contribution of road noise on the vehicles has increased a lot in recent years, while the contribution of the engine noise is reducing [
3,
4].
Electrification is a dominant trend in the automotive industry, and it has benefits, like its silent soundscape, but it also has major NVH impacts due to lack of the masking effect of the engine. The NVH concern on electric or hybrid vehicles are concentrated in three major points: low-frequency road noise, high-frequency wind noise, and tonal components of motors and compressors. This situation results in a necessity to take countermeasures for emerging road noise perception [
9,
10].
In accordance with the demanding electrification trend, several aspects were studied for both interior and exterior noise impacts. Kim et al. investigated the sound quality of small motors, developing a sound quality metric related to the interior noise of vehicles [
11]. Altinsoy examined the psychoacoustic properties of electrified vehicles, proposing a new sound quality metric that addresses their environmental impact during pass-by events [
8]. Additionally, Park et al. studied engine noise to create a sound quality metric that captures the sportiness of interior sound perception in vehicles [
2]. While these studies indicate that several aspects of in-cabin and emitted noise have been explored, our study focuses specifically on developing sound quality metrics for interior noise caused by rough road excitations.
The sounds arriving from the internal combustion engine and the associated power units have been a way of communication of the driver with the vehicle. With the electric vehicles, this communication becomes weakened [
12]. This statement leads to a necessity to design a proper interior soundscape, primarily for the road noise, as it is the most dominant component in EV’s.
During the target-setting stage of a new vehicle, vehicle-level targets are established with the expectation that objective measurements will align with subjective performance criteria. However, conflicts sometimes arise between subjective targets and their corresponding objective parameters. In certain cases, although the target is objectively met, customer perception remains unsatisfactory. This issue stems from the improper use or limitations of sound quality metrics. Either the objective parameters fail to adequately represent the acoustic phenomenon, or the metrics used do not correlate strongly enough with subjective evaluations of noise perception.
The inconsistency between subjective evaluations and objective measurements presents a significant challenge in identifying and addressing sound quality issues throughout vehicle development. This divergence becomes particularly evident during the development of electric vehicles, where emerging noise sources like road and tire noise dominate. Current sound quality metrics often fail to capture these phenomena effectively, necessitating the development of a new metric that better reflects subjective perception. This study aims to create such a metric by combining objective measurements, subjective evaluations, and multiple linear regression analysis to develop an indicator that reliably predicts perceived road noise comfort and satisfaction.
2. Materials and Methods
To achieve accurate measurements of road noise, particularly on rough surfaces, controlled testing procedures are crucial. Coast-down maneuvers are the preferred method, as they minimize engine noise interference. This involves reaching a designated speed of 130 km/h and then allowing the vehicle to decelerate naturally with the engine off until a speed of 30 km/h is attained. This standardized maneuver is replicated across all test vehicles on the same rough road surface to ensure consistent comparisons.
Road noise measurement is a complex phenomenon influenced by several factors, primarily engine noise and wind noise, which becomes more prominent at higher speeds. To isolate and quantify the contribution of engine noise, coast-down tests were employed with the engine off for vehicles with internal combustion engines to remove any engine noise content.
For this study, six different cars with different brands at various segments were selected to have a vast range of noise levels and to ease quantification during the subjective tests.
Data acquisition throughout the measurements were performed using a PCB 378B02 microphone (PCB Piezotronics, Inc., Depew, NY, USA) positioned at the driver’s left ear position, as seen in
Figure 1. Siemens Simcenter SCADAS Mobile Data acquisition (Siemens, Leuven, Belgium) unit and Simcenter Testlab 2019.1 software were facilitated for the collection and analysis of the test data.
The measurements were performed using PCB 378B02 ½″ free-field ICP microphones, positioned near the driver’s ear locations to capture the sound environment experienced by the occupants. These microphones are ideal for this application due to their high sensitivity and broad-frequency response, making them suitable for accurately capturing a wide range of frequencies associated with road noise.
A multi-channel array was not considered for this study because the objective was not to localize specific sound sources but to evaluate the overall sound pressure level (SPL) experienced in the cabin. Omnidirectional microphones were selected to ensure a uniform capture of sound from all directions, which aligns with the study’s focus on overall sound quality rather than the spatial origin of the noise.
Regarding near-field considerations, since the microphones were placed near the driver’s ear but not directly adjacent to any specific noise sources, near-field effects were expected to be minimal. However, the setup was designed to avoid placing microphones too close to strong individual sources like the dashboard or windows, which could amplify near-field effects and skew the results. By positioning the microphones at a sufficient distance from dominant sound sources, we mitigated near-field influences and focused on capturing the representative acoustic environment within the cabin. The data acquisition was performed in the range of 20 Hz to 25.6 kHz with 1.56 Hz resolution.
To mitigate the influence of extraneous noise sources, the testing environment is carefully controlled. However, use of a semi-anechoic chamber was deliberately avoided to have real road excitation. Additionally, wind noise contribution was minimized by conducting all the tests under controlled conditions where wind speeds were below 3 km/h. The vehicles were thoroughly examined for any leakages, and it was ensured that the vehicles would not have any abnormal sealing or door settings. During the data collection, only the driver and the test engineer were allowed on the vehicles, so that the weight conditions kept unchanged between different vehicles. In this way, it was ensured that the gathered data accurately reflected true road noise characteristics.
2.1. Test Conditions
The coast-down data, collected during vehicle deceleration from 130 km/h to 30 km/h on a smooth road, spanned between 90 and 150 s. However, for seamless comparison of consecutive data recordings, 3 s samples were determined to be the most effective length for participants’ assessment. Therefore, a simplified method with a much shorter duration was needed for subjective evaluations. High speeds were avoided in order to eliminate the contribution of wind noise; although, to have maximum road surface excitation, high speeds were preferred. In order to meet these conditions, the velocity range for coast-down maneuvers were determined from a 80 km/h to a 70 km/h range, which results in a duration of approximately 3 s.
2.2. Jury Member Selection Process
Subjective evaluations are most effective when conducted by a jury that reflects the target customer base. While experienced listeners may be adept at identifying specific sound qualities, highly specialized experts are not always necessary, especially in automotive studies where customer satisfaction is key.
Previous research on sound quality and jury evaluations suggests minimal influence from demographic factors like social class, age, and gender. Gender balance is typically maintained, and the jury size depends on the evaluation complexity and required training.
For this study, we assembled a diverse jury of 50 individuals. We carefully considered factors like age, gender, profession, automotive experience, and others, aiming to create a representative sample of our target audience.
2.3. Subjective Evaluations
For the subjective evaluations, the jury members were asked to evaluate 3 s road noise samples in a listening room using acoustic headphones in order to avoid any disturbance during their evaluations. The evaluations in the listening room were performed using two methods: Paired Comparison (PC) Test and SAE Subjective Evaluation Rating Scale (RS) [
1]. In the PC test, participants compared sets of two sound samples for their satisfaction and comfort perception. A total of 18 pairs were evaluated, with 3 pairs repeated to assess consistency.
Two key parameters ensured reliable results: repeatability and consistency. Repeatability represents how often participants gave the same answer to a repeated question. The percentage of consistent responses for repeated pairs indicated a high level of repeatability. Consistency represents whether participants’ choices followed a logical pattern. For example, if someone preferred sound A to B, and B to C, it was expected that they would also prefer A to C. Inconsistent responses were identified and noted, as juror responses need to exhibit a consistent pattern.
Consistency (
) was calculated as the ratio of inconsistent sound triplets (three-way comparisons where the preference order did not follow logic) to all possible sound triplets within a single PC test.
where
is the number of inconsistent triples, and
is the total number of sound sample triples.
Repeatability, ensuring participants gave consistent responses to repeated questions, reached a minimum score of 89%, exceeding the established threshold of 75%. This indicates that all participants successfully passed this test.
However, consistency, which measured whether participants’ choices followed a logical pattern, presented a challenge. Four jury members’ scores fell below the 60% threshold, meaning their evaluations were excluded from the analysis.
For the rating-scale evaluations, jurors rated the sound samples on a scale of 1 to 10 based on comfort and satisfaction levels. The SAE scale was utilized for the evaluations. [
13].
2.4. Sound Quality Parameters
The sound quality (SQ) parameters in
Table 1 were investigated during the studies.
2.5. Multi-Variable Regression Analyses
The regression analyses were conducted to arrive at the following model:
The regression analysis focused on how changes in independent variables () for a set of n SQ metrics would affect the predicted jury score (). Ai represents the coefficients if only the value of changes, while all other variables are kept constant to have the impact of a single variable on the predicted score.
4. Discussion
The results of the derived sound quality (SQ) metrics indicate that car5 produces the least comfortable and most annoying sound, while car1 provides the most comfortable and least annoying sound perception, as illustrated in
Figure 8. The Figure uses different colors to represent various cars, with subjective evaluations shown as full circles and SQ metric results represented by full diamonds.
The results indicate that car1 performs best in both aspects of the new road noise SQ metrics, excelling particularly in AI, OAI, and SIL. Although SPL ranks second, this suggests that SPL can still be considered a useful indicator of sound perception. However, the superior performance of the SQ metrics demonstrates their added value in more accurately reflecting human perception.
On the other hand, car5 ranks the lowest according to the new road noise SQ metrics. This distinction would not have been clear using SPL alone, as its value of 74.1 dBA is close to the average of 73.8 dBA, making it indistinguishable from other cars. The SQ metrics provide much more relevant information regarding subjective evaluations and, thus, the perception of road noise in vehicles.
This highlights a key finding: While SPL remains a standard tool for providing basic acoustic measurements, its correlation with road noise perception is relatively weak. Instead, spectral variations play a far more significant role in how noise is perceived. This study demonstrates that subjective evaluations are closely aligned with OAI, AI, and SIL, which emerge as the most influential factors in perceived road noise.
This relationship is better captured by a new sound quality (SQ) model that combines these key SQ metrics to reflect subjective experiences more accurately. This model will be pivotal in the target-setting phase of future vehicle development, offering deeper insights into customer expectations regarding road noise. By applying this model, it will be possible to design vehicles that more effectively meet these expectations, ultimately enhancing acoustic comfort and overall customer satisfaction.