Next Article in Journal
Numerical Simulation of Unreinforced Masonry Buildings with Timber Diaphragms
Next Article in Special Issue
An Abridged Review of Buckling Analysis of Compression Members in Construction
Previous Article in Journal
Design of Robot-Inclusive Vertical Green Landscape
Previous Article in Special Issue
Calibrated Numerical Approach for the Dynamic Analysis of Glass Curtain Walls under Spheroconical Bag Impact
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Facial Expression-Based Experimental Analysis of Human Reactions and Psychological Comfort on Glass Structures in Buildings

Department of Engineering and Architecture, University of Trieste, 34127 Trieste, Italy
*
Author to whom correspondence should be addressed.
Buildings 2021, 11(5), 204; https://doi.org/10.3390/buildings11050204
Submission received: 9 April 2021 / Revised: 1 May 2021 / Accepted: 10 May 2021 / Published: 14 May 2021
(This article belongs to the Collection Innovation in Structural Analysis and Dynamics for Constructions)

Abstract

:
For engineering applications, human comfort in the built environment depends on several objective aspects that can be mathematically controlled and limited to reference performance indicators. Typical examples include structural, energy and thermal issues, and others. Human reactions, however, are also sensitive to a multitude of aspects that can be associated with design concepts of the so-called “emotional architecture”, through which subjective feelings, nervous states and emotions of end-users are evoked by constructional details. The interactions of several objective and subjective parameters can make the “optimal” building design challenging, and this is especially the case for new technical concepts, constructional materials and techniques. In this paper, a remote experimental methodology is proposed to explore and quantify the prevailing human reactions and psychological comfort trends for building occupants, with a focus on end-users exposed to structural glass environments. Major advantages were taken from the use of virtual visual stimuli and facial expression automatic recognition analysis, and from the active support of 30 volunteers. As shown, while glass is often used in constructions, several intrinsic features (transparency, brittleness, etc.) are responsible for subjective feelings that can affect the overall psychological comfort of users. In this regard, the use of virtual built environments and facial expression analysis to quantify human reactions can represent an efficient system to support the building design process.

1. Introduction

In building design, the end-user’s comfort is a target for a multitude of applications. These include, for example, thermal comfort, indoor air quality, visual comfort, noise nuisance, ergonomics and vibrations. With around 90% of our lives spent in buildings, there is a strong link between comfort and the built environment [1,2]. For decades, various researchers have sought to understand how the characteristics of the built environment can impact the emotions, behaviors and physical well-being of end-users [2]. However, comfort itself depends on a great number of factors which can, if not addressed properly, lead to annoyance. Further, it is known that such analysis requires convergent teams from the humanities, arts, social sciences, technology, engineering and medicine. With a more explicit focus on engineering issues, comfort strictly relates to many topics of primary interest for building technology [3,4,5].
Structural issues and comfort can be, for example, considered in terms of vibration serviceability assessments. Usually, the evaluation of vibration issues in relation to possible annoyance risk is carried out in terms of acceleration peaks and recommended limit values. Similar methods can be used for the comfort analysis of floors under walking or standing conditions [6,7,8], and for tall buildings against wind [9,10,11]. As a matter of fact, human reactions and comfort levels strongly depend on engineering parameters, but also on the physiological perception of the frequency and amplitudes of vibrations. The operational context, including location (street, gym, office, home, etc.), time of day (morning or evening) and stimuli duration (seconds or hours) also have severe impacts on the degree of human tolerance [8].
The structural use of materials and design concepts in buildings is an additional factor that can implicitly result in possible discomfort for the occupants. The well-known psychological effect of architectural solutions can have both positive and negative effects, and can evoke subjective feelings that reduce to a minimum the mechanical efforts of structural designers [12]. This is the major challenge of architects when evoking emotions in the design of so-called “emotional buildings” [13,14,15,16,17,18]. In the context of the built environment, experimental measurements can be carried out to quantify emotions [19]. Smart sensors or virtual walks are proven to represent useful tools in support of the analysis of human reactions to visual stimuli [20,21].
Among other things, structural glass is known to represent an attractive material for construction [22,23]. Key aspects are its transparency and abilities to adapt to various configurations and replace/interact with more traditional constructional materials. Typical examples can be found in facades, roofs, walkways, bridges and balustrades, as in Figure 1a–c. Besides, glass is also recognized as one of the most vulnerable components in constructions, and thus to need special structural design efforts in order to ensure appropriate safety levels. Glass facades and windows, for example, are the first physical barrier for building occupants, both in presence of ordinary operational conditions but also during accidental events that could result in potential shards and injuries (Figure 1d,e). The high aesthetic impact of glass components and structures is thus often in contrast with a basic discomfort and lack of safe feelings for end-users.
Glass design can be highly demanding for pedestrian systems, due to the combination of dynamic mechanical parameters and complex human–structure interaction (HSI) phenomena that typically occur during a walk, but also due to subjective reactions [8].
In general terms, glass structures are often called “architectures of vertigo,” given that transparent load-bearing systems are increasingly conceived as “spaces of visceral thrills with deep socio-spatial implications” [23]. Glass floors, in particular, can be recognized as intense psycho-physiological stimuli for pedestrians, as they induce unavoidable sensory experiences that go beyond the conventional HSI design procedures of analysis.

2. Research Goals and Approach

2.1. Glazed Stimuli

In this paper, a virtual experimental approach is presented in support of building design. The goal of the developed method is to explore and quantify the prevailing reactions and psychological comfort levels for end-users exposed to different visual built environments. At the time of analysis, careful attention was paid to the selection of visual stimuli characterized by a primary role of structural glass components in buildings and constructions (i.e., Figure 2a,b). The methodology can be adapted to different topics and design fields.
While the use of glass in buildings has been increasing in the last few decades, with new challenges for structural designers [25], the impact on end-users is often severely affected by the material’s transparency and brittleness, and also by the lack of technical knowledge regarding its mechanical properties [28,29]. In this regard, it is expected that the building design process could take advantage of subjective measurements and their possible combination with mathematical models and engineering calculations. As schematized in Figure 2c, the basic approach takes benefit from the quantitative measures of emotions and subjective feelings of individuals exposed to pre-selected visual stimuli. Based on the analysis of facial micro-expressions, comfort levels and trends can be analyzed by sub-groups of subjects of stimuli.

2.2. Experimental Procedure

The overall methodology was elaborated and designed at the University of Trieste (Department of Engineering and Architecture, Italy) in Winter 2020. The experimental study followed the procedural steps in Figure 3, and was carried out remotely.
More precisely:
  • STEP 0: the participants were first recruited. The group of volunteers (30 in total) included mostly students and researchers, both females and males (58% and 42% respectively), with an age range of 20–56 (28.8 years-old was the average, ±8.4; 26 years-old the median value). Some volunteers were students or workers living in Trieste, or residing in the Friuli Venezia Giulia Region. The age demographics and geographic distribution of participants are shown in Figure 4. Their educational experience and background skills were characterized by different fields of study or activity. Most importantly, no preliminary technical knowledge on the use and features of structural glass in construction was required at the time of the experiment. Similarly, no direct experience on glass structures was needed to join the virtual investigation.
  • STEP 1: A preliminary computer assisted Web interviewing (CAWI) survey was shared online and used to assess the multitude of subjective reactions for participants under different stimuli (Section 3).
  • STEP 2: The virtual experimental analysis was carried out (Section 4) to study human behaviors in glass-involving scenarios, based on facial expression analysis. To that end, the FaceReaderTM automatic facial expression recognition software (version 8, Noldus Information Technology bv, Wageningen, Netherlands) [31] was used in support of the quantitative analysis of experimental measurements. Two different visual stimuli were designed to assess the reactions of volunteers, namely, consisting of a set of static input items (Section 4.2) and a dynamic virtual reality (VR) video clip of pre-recorded walks in glass environments (Section 4.3). In both cases, based on STEP 1, special care was taken in the selection and arrangement of stimuli, so as to capture different reactions and emotions of participants.
  • STEP 3: the post-processing analysis of experimental measurements from STEP 2 was partly based on the automatic software analysis, and further elaborated as discussed in Section 4.4 and Section 4.5. Detailed comparative results are presented in Section 5 and Section 6 for static and dynamic stimuli respectively. As shown, the analysis of experimental measures proves that the use of structural glass in buildings is still affected by scattered human reactions. Moreover, the results from the proposed methodology suggest that the design of glass structures could benefit from subjective parameters that should be taken into account in the overall design process.

2.3. Strengths and Limitations of the Study

The proposed experimental methodology took partial inspiration from past literature, which has proved that human emotions can be used as efficient guide for designers [32,33]. The study and measuring of human behaviors based on facial micro-expressions is in fact typical of many research and market fields, especially where understanding consumers feelings can help designers to establish an efficient emotional communication between consumers and products. It is in fact generally recognized that both verbal and non-verbal behaviors enable humans to communicate emotions [12,13]. Non-verbal communication includes physical behaviors that are commonly referred to as body language and gestures, including also facial expressions. Most importantly, facial expressions are essential for the quantitative measure of basic emotions, because they provide information about inner states of individuals.
For the present study, the use of a virtual experimental setup and its adaptation to the constructional field was suggested by several motivations. The first and most severe one was represented, at the time of the investigation, by severe movement limitations, remote teaching regulations and smart-working rules due to the COVID-19 pandemic emergency (i.e., obligations for “red zone”/maximum risk measures in the Italian territory). As such, the experimental analysis was carried out with the active support of volunteers, but respectfully of social distance rules and general temporary prohibitions. Furthermore, technical trends and considerations suggested the design of the experimental study. The sanitary emergency revealed in fact that the use of transparent materials for constructions is expected to increase in the next future [29,34,35], so as to facilitate the definition of new design concepts for the organization of private or public spaces in buildings. Differently, this increasing use of glass in structures can be associated with a further magnification of “architecture of vertigo” concepts [23] earlier described. Balanced technical solutions should be thus necessarily developed. Both the cited aspects were merged to support the design of the experimental strategy herein presented.
Besides, the investigation was carried out with a clear preliminary analysis of intrinsic limitations that should be taken into account for future extensions. The number of participants (30), for example, was selected on the base of individuals availability (i.e., to join remotely the study, with own devices and high-speed internet connection). A possible extension of group size, and demographic/geographic distribution, could facilitate a more generalized analysis of reactions for specific sub-groups of participants. Another limitation of the study was represented by the fully remote experimental procedure. Under COVID-19 restrictions, the volunteers were invited to take part from homes/different regions of Italy. As such, the measure of facial expressions was carried out with shared screens only, without additional smart sensors, wearable devices or VR glasses [36,37].

3. CAWI Survey

The preliminary STEP 1 took the form of a CAWI survey that was designed to include 40 questions. The survey was designed with both the simple multiple choice (SMC) approach and the open question (OQ) method. The goal was to expose the participants to well-defined built conditions characterized by the presence of structural glass at different levels (residential buildings, open spaces, public offices, etc.), and to capture their feelings as active occupants. In this context, the survey revealed some important aspects, and suggested the development of the virtual experimental investigation herein discussed. For the majority of participants, it was proved that:
  • background technical knowledge regarding mechanical features of structural glass in buildings often lacks. This evokes discomfort and negative perceptions, especially for design scenarios characterized by contact of end-users with glass (partition walls, balustrades, roofs, etc.).
  • The brittle behavior of glass represents the most influencing parameter, and is frequently associated to a common feeling of protection lack against accidental events (i.e., shards due to impact, etc.).
  • The visual detection of minor damage or material degradation in glass structural components (delamination, etc.) evokes severely negative reactions, even in presence of safe mechanical performances.
  • The use of structural glass in pedestrian systems generally evokes very positive feelings on the architectural side. When the same participants are asked to ideally walk on those systems, however, the presence of transparency and possible vibrations, spots or noise during walks results in discomfort and highly negative comments.

4. Static and Dynamic VR Experiments

4.1. Methods

The experimental investigation was based on a sequence of pre-selected input sources that were used to act as emotional visual stimuli for the involved participants. The so-called STEP 2 from the flowchart in Figure 3 was developed as schematized in Figure 5, and represented the core of remote analysis. STEP 2 as a whole consisted of three sub-steps for each participant. The process was repeated twice, first with a static stimulus (sequence of pictures described in Section 4.2) and later with a VR video clip of pre-recorded virtual walks (Section 4.3). The remote experiments were carried out with the support of personal computers for all the volunteers, a shared screen for the visual stimuli and a webcam for recording the facial expressions of participants.
Before watching the shared input source, the invited subjects were informed about the experimental procedure (STEP 2.1 in Figure 5). A special care was paid to verify the connection speed, and minimize possible delay in transmission and acquisition of shared data. Successively (STEP 2.2 in Figure 5), the visualization setup was also properly checked, so as to avoid disturbing effects for the quality level of signals, and thus for the post-processing analysis. More in detail, the attention was given to ensure an optimal and mostly uniform ambient illumination for the participants. The screen position was also assessed for each participant, in order to prevent severe facial distortions and to avoid introducing high head/eye inclinations through the experiments. Finally, the presence of participants with glasses or beard was separately noted, for a more refined post-processing analysis of measured data.
Once verified the basic operational conditions, the input source was shared separately for each volunteer (STEP 2.3 in Figure 5). No auditory stimuli were introduced. During the presentations, however, audio communication of volunteers with the project manager was allowed to provide technical feedback (when needed). During the presentations (STEP 2.3), the project manager webcam was used to record the facial expressions of participants, while looking at the shared screen. To this end, a preliminary analysis to capture the optimal webcam resolution and sampling rate was carried out. The final choice resulted in records with minimum 1280 × 720 (or 1920 × 1028) video resolution and around 4300 frames for each recorded signal (30–60 the range of frame rate; 12,432 kbits/s the average bitrate).
The analysis of recorded signals was carried out during STEP 3 of Figure 5. The interpretation of facial micro-expressions and emotions from the participants exposed to the shared input source was partly carried out with the use of the commercial software FaceReaderTM [31]. The automatic computational analysis was based on all the collected frames (≈4300 the average) for each one of the available records (30 volunteers × 2 stimuli), and required approximately 10 min of analysis/each. The overall elaboration of signals and data analysis was then carried out as in Section 4.4. For the current study, it is thus important to note that the automatic software analysis was used to provide row quantitative data only of nervous states. The detection of human reactions and comfort trends for individuals exposed to glass environments was manually derived as in Section 4.5.

4.2. Static Input Source

The invited participants were first subjected to a shared input presentation that consisted in a selection of 27 pictures for various glass structures and scenarios. These pictures were equally spaced at time intervals of 5 s, so that the total duration of the visual stimulus could not exceed a maximum of 120 s, to avoid annoyance. Figure 6 shows an example of input pictures. A special care was spent for their selection (to capture emotions in the invited participants), but also for the definition of the optimal sequence. To that end, the pictures were selected from magazines, scientific journals, webpages of construction companies or newspapers. For all the participants, the sequence and duration of the static presentation was kept fix. Regarding the sequence, the choice was to alternate items possibly associated to comfort or negative feelings.

4.3. Dynamic Input Source

The setup schematized in Figure 5 was adapted and applied to the group of participants. The source consisted in a pre-recorded VR clip with total duration of 120 s, see Figure 7. The second stage of the investigation was in fact carried out to capture any kind of possible variation in the amplitude and trend of emotions of participants, when exposed to a virtual walk in a glazing environment. Major benefit was taken from the availability of a VR context representative of a case-study building located in Paris, and characterized by a large amount of glass components in facades, roofs, floors, balustrades. The VR context was used to pre-record a set of walks that could be used as stimulus. Based on preliminary studies, the clip was designed and divided onto three walks (40 s/each):
  • At the top terrace level (W1),
  • At the ground level of the building, from the main entrance (W2),
  • At the first story level (W3).
Similarly to Section 5, no auditory stimuli were considered for the dynamic setup, and the participants were asked to watch the shared screen and join the virtual walks.

4.4. Experimental Measurements

The measurement of relevant data for comfort analysis was carried out in the post-processing stage of records for each participant, when exposed to both static and dynamic VR glazed environments.
The FaceReaderTM software, in particular, was chosen because it allows to model accurately the face of a given individual, by taking advantage of 500 key points for the description of facial movements and micro-expressions. The software is based on Artificial Intelligence tools and can be used to detect subjective emotions and human reactions from input video records or even pictures. As a whole, the software output takes the form of a series of quantitative charts and data that can be used for the interpretation of basic emotional states. In addition to the reference “neutral” condition, the standard classification carried out by the software includes basic definitions for individual states (N = 6 in total) targeted as “happy”, “sad”, “scared”, “disgusted”, “angry” or “surprised”. From a practical point of view, the software offers an instantaneous evaluation of Action Units (AUs, ranging from 0 to 1) for all these measured emotions. Additional useful feedback can be obtained by the quantitative analysis of output parameters such as valence, arousal, gaze direction, head orientation, heart rate (based on remote skin conductance analysis) and few additional personal characteristics of participants (such as gender, average age, presence of glasses, beard).
For the present study, AU records were collected for each participant/virtual stimulus/basic emotion, as a function of the time of experiment (with 0 ≤ t ≤ 120 s). AU data were exported from the software analysis with a sampling rate of 1 s. The typical example of AU records is shown in Figure 8 for one of the participants subjected to the dynamic VR setup. The chart, more in detail, gives evidence of specific AU values over time of virtual stimulus (i.e., STEP 2.3 in Figure 5), but omits the first instants of the experimental arrangement, when some preliminary discussion was carried out with the participant to provide instructions and create a comfortable condition.
In the overall procedure, moreover, it has to be noted that the “neutral” state computed by the software was excluded from manual elaboration of measured data, as it is shown in Figure 8. In presence of VR input sources and visual stimuli that do not involve active movements of participants, it is in fact generally recognized that the expected reactions and emotions cannot be quantitatively and qualitatively compared to feelings evoked by real field experiments. Accordingly, combination of “neutral” data with other basic emotional signals for the present study would have alter most of the measured subjective reactions and comfort trends.

4.5. Manual Post-Processing Strategy for AU of Basic Emotions

The quantitative and qualitative analysis of human comfort was based on the detection and measure of the herein called “positive” (POS, in the following) or “negative” (NEG) feelings from all the participants, when visually exposed to specific glazed environments.
Given that several AU records were obtained (as for 30 participants, N = 6 basic emotions, 2 virtual scenarios), the first approach of manual data elaboration consisted in the individual analysis of collected AU records. This stage was developed to explore the subjective feelings of single volunteers when exposed to a specific building scenario (i.e., glass floor, roof, balustrade, etc.). In addition, AU calculations were used to correlate the subjective response of different participants when exposed to the same VR input, and thus to find a prevailing emotional reaction/comfort trend for groups of built environment conditions. This means that for each VR scenario, basic emotions were subdivided onto two major categories representative of the herein called POS or NEG feelings and comfort trends. In doing so, the approach schematized in Figure 9 was take into account. The automatic software analysis was first carried out at STEP 3.1.
According to AU charts as in Figure 8, the preliminary requisite of analysis consisted in the normalization of AU records of basic emotions in the time of experiment, so as to facilitate the objective comparison of multiple AU signals (STEP 3.2 in Figure 9). Starting from the exported original AU charts (AUoriginal), more in detail, the average AU for each emotion at the beginning of the individual experiment/participant (AUinitial,avg) was taken as a reference for calculating the variation of subsequent AU measurements in time, that is:
AU norm t =   AU original t AU initial , avg
with 0 ≤ t ≤ 120 s and:
  • AUnorm(t) the normalized record for each participant, emotion, VR scenario, at the time instant t;
  • AUoriginal(t) the original signal record for each participant, emotion, VR scenario, at the time instant t;
  • AUinitial,avg the mean value of each emotion, participant, VR scenario (preliminary stage).
Following Equation (1), the individual records of basic emotions, AUnorm(t), were successively grouped in basic pos*(t) and neg*(t) plots (STEP 3.3 in Figure 9). In the pos*(t) set, the AU data in time for feelings marked as “happy” were considered only:
pos * t = i = 1 N 1 AU norm t = f h a p p y
Similarly, the neg*(t) set included the input data from feelings marked as “sad”, “angry”, “scared”, “disgusted”:
neg * t = i = 1 N 1 AU norm t = f s a d ,   a n g r y , s c a r e d , d i s g u s t e d
Note in STEP 3.4 of Figure 9 that the “surprised” AU data (“SUR(t)”) were omitted from the so-calculated pos*(t) and neg*(t) signals, and analyzed separately. This because (depending on the individual subject, context and stimulus) “surprised” states can be typically associated with both positive or negative feelings for the participants. The final marking of emotional data was thus based on the analysis of prevailing AUs at a given time instant t. The SUR(t) input was in fact superimposed as:
POS * t = p o s * t + S U R t             i f   p o s * t > n e g * t p o s * t                                                       i f   p o s * t < n e g * t
or
NEG * t = n e g * t + S U R t             i f   n e g * t > p o s * t n e g * t                                                     i f   n e g * t < p o s * t
An example of calculation results is shown in Figure 10, in terms of POS*(t) and NEG*(t) measured states for one selected participant.
In conclusion, the final detection of comfort trends for a given visual stimulus was carried out as in STEP 3.5 of Figure 9. To that end, the percentage variation of elaborated signals from STEP 3.4 was measured over the time of analysis. At each increment t of the experiments, the emotional variation was calculated for both POS*(t) and NEG*(t) data, and defined as:
Δ % = 100 Y t n Y t n 1 Y t n 1
with Y = POS*(t) or NEG*(t) respectively, as shown in the example of Figure 11.
The prevailing emotional state (and thus comfort trend) was established in terms of absolute maximum values of nervous feelings and max/min percentage variations in the time of analysis. Each time instant t was classified with a POS or NEG mark, uniquely detected from data elaboration. A “comfort weight” value C(t) = POS or NEG (based on the prevailing nervous state) was assigned to each participant/instant/scenario, to facilitate the comparative analysis of multiple signals and stimuli.
The global correlation of comfort trends with the VR source was in fact carried out based on the synchronized comparison of elaborated data for the 30 participants subjected to an identical stimulus (STEP 3.6). More precisely:
  • For the static experiment (Section 5), the prevailing comfort trend was calculated over time intervals of 5 s (corresponding to the duration of a single picture presentation), in terms of average comfort level;
  • For the dynamic experiment (Section 6), the attention was focused on specific frames of pre-recorded video clips, and quantified in terms of average comfort levels for selected context scenarios.

5. Discussion of Results from Static Experiment

5.1. Prevailing Reactions

Figure 12 shows the analysis of prevailing reactions in the group of participants, as obtained by the investigation of elaborated records in the time of analysis (Figure 12a), and by the comparison of group reactions for a given static stimulus (Figure 12b). POS and NEG values are reported in percentage values for the whole group of volunteers. As such, the comparative data can be used to address the prevailing emotional state (in terms of average or maximum/minimum reaction of participants), towards the imposed picture/context. Figure 12a, more in detail, shows a clear modification of human reactions for the assigned stimuli, with marked fluctuations of POS and NEG data. It can be easily perceived that the calculated POS signal prevails on the NEG one for some time intervals, while the opposite condition can be noticed for other instants. In some other cases, rather balanced POS and NEG values can be also observed.
Most importantly, the POS and NEG trends were elaborated to derive the prevailing emotion for each input item, as shown in Figure 12b. For each time interval of 5 s, the average POS and NEG reactions were first calculated and associated with the 27 input pictures. Further, the maximum and minimum reaction peaks were also analyzed, as emphasized in the chart. This operation allowed us to derive a more precise analysis of human responses and nervous states, as a function of the imposed stimulus.
From the collected data, in particular, it was possible to assert that:
  • The static virtual experience generally highlighted a strong “neutral” reaction for most of the participants. The average value of such a state was calculated in around 60% of measured AU signals. This finding can be easily justified by the static nature of a visual stimulus, and can be considered as an intrinsic limit of the overall experimental approach.
  • A more detailed analysis of POS and NEG results, as in Figure 12, gave evidence, for most of the 27 pictures, of clear emotional trends calculated from the software analysis of minor facial micro-expressions.
The analysis of average reactions in Figure 12b highlighted in fact that:
  • For most of the 27 items, the “average” measure of reactions can provide a reliable measure of experimental data and comfort trends.
  • Differently, extreme reactions (quantified as max/min values for the fluctuation of average data) still suggest a rather variable subjective response for some of involved individuals.
  • Rather few pictures can be associated with a mostly uniform reaction from the whole group of participants (i.e., with minimum max/min variations compared to the average response). This is the case for items #15 (Figure 6) and #27 (Figure 13). Furthermore, in both cases, the NEG reaction prevails on the POS.
The detailed analysis of any kind of discomfort revealed that:
  • Average NEG peaks (>60% of participants) were found to prevail for POS states for items #8, #12, #15 (Figure 6) and #18 (Figure 13).
  • In general, the minimum absolute NEG response was calculated for 46% of the group of participants. This suggests a constant presence of discomfort for the proposed stimuli, for several volunteers, and a weak prevalence of POS states.
  • For some of the input items (as for example #12 and #15 in Figure 6), the average NEG outcome was found in line with preliminary expectations (i.e., possible discomfort due to hazard or risk of falling).
  • For picture #2 in Figure 6, a marked NEG trend was also measured, even without a clear safety risk perception for end-users. This is also the case for item #3 in Figure 13. Both the outcomes could thus suggest some discomfort due to the use of structural glass in new solutions for constructions.
  • A moderate average NEG reaction (>55% of participants) was also measured for items #2, #3, #4, #5, #9, #25 and #27. NEG and POS reactions were obtained for the residual items (see also Figure 14).
The analysis of major comfortable states, finally, can be summarized as follows:
  • Absolute POS peaks were measured for item #1 (Figure 6), but also items #10 and #16 (Figure 15).
  • For items #1 and #16, more in detail, this result could be justified by the presence of private/residential spaces and comfortable context conditions that do not involve direct contact with end-users. Regarding item #16, the POS peak could be justified by the “safe” presence of individuals on the floor mockup.
  • Relevant POS reactions (>52% of participants) were also observed for items #20 (Figure 6) and #23 (Figure 15). Again, it is interesting to notice that the presence of end-users with “safe” behavior in the context of presented static stimuli can have positive effect on the emotional state of participants. This is in contrast with the structural typology and built environment (i.e., structures with risk of falling).

5.2. Analysis of Reactions by Context of Pictures

Based on the experimental outcomes as in Figure 12, a special care was paid for the analysis of POS or NEG reactions for pictures grouped by context/building configuration. Two major categories of items were considered, namely represented by:
  • Group-A: pedestrian systems or load-bearing elements characterized by risk of falling for the end-users (items #4, #8, #10, #13, #15, #17, #18, #20, #22, #23, #27).
  • Group-B: elements characterized by the presence of damage and/or under hazard (items #6, #9, #12, #25).
In case of Group-A, a NEG reaction was typically found to prevail for the majority of pictures (8 of 11 items). For three pictures only (#10, #20, #23), the POS reaction minimally prevailed on the NEG measures. Comparative results are summarized in Figure 16a. Such an outcome suggests that pedestrian glass systems evoke the highest discomfort and emotional state for the selected stimuli, compared to other glazing solutions in buildings. The effect can be justified by the fact that, compared to other building conditions, the human interaction of pedestrians with the glass structure becomes predominant.
Further, the few pictures from Group-A with a prevailing POS reaction were found associated with comfortable presence of individuals (i.e., item #10), and thus suggesting an appropriate safety level for the participants of the present experiment. Anyway, it is necessary to explore further this kind of scenario and extend the virtual experimental stage with field experiments, so as to capture the human reactions of active pedestrians and combine their emotional feelings with the structure vibrations and other mechanical parameters of primary interest for dynamic characterization.
Regarding the experimental results for Group-B of stimuli, NEG reactions were found to prevail on POS for most of the pictures (3 of 4 items), see Figure 16b. For the whole set, the presence of visual damage in glass proved to involve discomfort for the participants, thereby resulting in a rather good correlation of experimental predictions with the expectations of planned stimuli. The exception was represented by item #6 (Figure 6), characterized by a balanced POS/NEG average response.

5.3. Analysis of Reactions by Sub-Groups of Participants

The analysis of human reactions was also focused on the emotional state of sub-groups of participants, as, for example, obtained by gender or demographic sub-groups. As far as the POS comfort state is take into account, results according with Figure 17 and Figure 18 can be observed. From Figure 17, more in detail, the total average POS response was found to prevail for the group of female volunteers, for most of items. This is the case for pictures #15 and #18 of Group-A and the whole Group-B. For some other items of Figure 17a, a more balanced reaction was indeed measured.
Another aspect worth to discuss could be related to the emotional response for demographic sub-groups of volunteers, as in Figure 18. The distribution of volunteers onto age groups as in Figure 4 is not uniform and sufficiently extended to draw general conclusions. However, it is possible to notice that the trend of POS reactions modifies with age. Especially for Group-B with damage/hazard in Figure 18b, POS data decrease with age increase. Further investigations are hence needed in this direction.

6. Discussion of Results from the Dynamic Experiment

6.1. Analysis of Reactions by Context of Walks

For the dynamic setup, the post-processing stage of measured AUs was qualitatively carried out as in Section 4. However, major attention was focused on the analysis of absolute POS and NEG reaction peaks over the time of the experiment. This choice was suggested by the dynamic nature of the stimulus, with fast sequence of frames/scenarios and a different expected response compared to the static setup in Section 5.
Typical results can be seen in Figure 19, where the sequence of three different VR walks (40 s/each) is also emphasized. More precisely, the Wn labels are used to denote:
  • W1: a walk outside the building, at the level of the roof/tope terrace, characterized by risk of falling (glass balustrades), but also by the presence of glass facades;
  • W2: a walk inside the building (ground level), with a glass floor and a glass roof on the top, glazing walls and internal partitions;
  • W3: a final walk inside the building (first story level), characterized by the risk of falling (glass balustrades), but also the floor in the below ground level (W2).
Key labels for selected frames in Figure 19 are defined as:
  • s1, s3, s4 = external balustrades, characterized by risk of falling for end-users (as in Figure 7c,d);
  • s2 = external facades / walls, without contact with end-users (Figure 20a,b);
  • s5, s7 = roofs, without contact with end-users (Figure 7f);
  • s6 = floors with risk of falling (Figure 20c);
  • s8, s9 = indoor balustrades, with risk of falling (Figure 20d);
  • s10 = indoor walls, with possible contact of end-users (Figure 20e).
Worth of interest in Figure 19 is that most of the POS or NEG peaks can be associated with well-defined s1–s10 scenarios in which glazing structural components have a primary role in the building context.
More precisely, for the W1 walk:
  • NEG reactions were measured in s1, s3 and s4 frames, when the pedestrian impacts the glass balustrades.
  • The frame labelled as s2 is associated with glass facades and walls as in Figure 18a,b.
  • During the W2 walk:
  • POS reaction peaks were found, especially for s5 and s7 stimuli, to be characterized by the presence of the glass roof (Figure 7f), as well as the facade walls and the indoor partition walls for the building entrance (Figure 20c).
  • The pedestrian glass floor (s6 and Figure 20d) still evoked negative perceptions for most of the participants.
Finally, for the W3 walk, the experimental measurements were still found in line with the earlier scenarios, given that:
  • Major NEG peaks were related to the presence of glass balustrades with risk of falling for the end-users (Figure 20d).
  • The glazing roof in s10, otherwise, reflected POS reactions peaks as previously observed for the W2 frames.

6.2. Analysis of Reactions under Static or Dynamic Stimuli

In conclusion, a comparative analysis was carried out in terms of subject/context of input stimuli for the group of volunteers, so as to capture any difference in the prevailing reactions due to a static or a dynamic setup. In Figure 21, results are shown in the form of average percentage values of measured POS and NEG reactions for selected categories of built environments and scenarios.
These are defined as:
  • E1 = outdoor balustrades (with risk of falling);
  • E2 = indoor balustrades (with risk of falling);
  • E3 = outdoor facades/walls;
  • E4 = indoor facades/walls;
  • E5 = floors/walkways/pedestrian systems (with risk of falling);
  • E6 = roofs.
For groups E1 and E2, the results are presented in Figure 21 for the dynamic input only, given that no direct correlation could be found with static items. Note, as also previously discussed, the remarkable NEG reaction of participants, both for outdoor or indoor balustrades. This reaction is typically observed when the end-user approaches the glass balustrades during virtual walks, and thus perceives a possible risk of falling.
Regarding the emotional states and reactions of participants towards glass facades and walls (E3 and E4 in Figure 21), the proposed experimental setup did not capture relevant modifications or prevailing nervous states. This effect can be quantified in mostly balanced POS/NEG reactions for both static and dynamic VR stimuli. Finally, it is possible to notice in Figure 21 that the configurations labelled as E5 (i.e., pedestrian systems) were mostly associated with prevailing NEG reactions. As shown, the discomfort and NEG reactions further increase with a dynamic stimulus, compared to the static one. This is not the case for glass roofs (E6) that do not involve direct contact with end-users and are characterized in Figure 21 by a slightly prevailing POS reaction, both under static and dynamic stimuli. In conclusion, it is worth noting that no items presenting a hazard or damage in the glass were taken into account for the comparative analysis of static and dynamic emotional states, due to the lack of appropriate comparative VR stimuli. Besides, data in Figure 21 still suggest a more concise emotional reaction of participants based on dynamic rather than static stimuli. As a further extension of the present analysis, it could be thus useful to take into account accidental scenarios and built environments in which glass walls are expected to act as physical barriers for the protection of occupants.

7. Conclusions

The optimization of human comfort in the built environment is a target for several design fields, and depends on a multitude of aspects. For engineering applications, some of these aspects can be mathematically controlled and limited to performance indicators, including structural, energy and thermal issues. Differently, human reactions are also sensitive to a various aspects that relate to subjective feelings, in the same way in which the so-called “emotional architecture” aims at evoking emotional responses from building users.
In this paper, an original experimental analysis was presented in support of the definition of new design strategies and tools. The goal was to assess the potential of virtual experimental methods and the possible combination of quantitative measures of subjective feelings with engineering targets, as well as architectural concepts and technology solutions for the constructional fields. Special attention was focused on glass structures and components in buildings, due to the material features, innovative use in constructions and emotional evocation for end-users. Major advantage was taken from the use of virtual experimental techniques and facial expression analyses able to capture the micro-reactions of the group of participants (30 volunteers).
By designing a visual stimulus composed of both static and dynamic virtual items for building configurations characterized by a prevailing role of structural glass elements at different context levels (roofs, floors, balustrades, etc.), the attention was focused on the quantification of “positive” or “negative” emotions and comfort feelings for the participants. As shown, the analysis of experimental measurements proved that the use of facial micro-expression recognition tools in support of comfort analyses can represent and efficient approach for optimal design.
Moreover, the proposed experimental methodology highlighted that the design of structural glass elements for buildings can be severely affected by subjective feelings and nervous states of end-users. This is especially the case for structural components that involve direct interaction and contact from end-users (such as floor or balustrades which present a risk of falling), but also the condition of structural components with visual damage. Differently, mostly positive feelings were experimentally measured for the presence of structural glass in walls, facades and roofs. In this regard, the experimental investigation could be extended to different contexts, and to groups of volunteers characterized by different age demographics, geographic distributions or background skills.

Author Contributions

This study resulted from a joint collaboration of the authors. C.B.: conceptualization; software; data curation; writing—original draft preparation; writing – review and editing; project administration. S.M.: conceptualization; data curation; investigation; writing – original draft preparation; writing—review and editing. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data will be shared upon request.

Acknowledgments

Seretti Vetroarchitetture S.r.l. (www.seretti.it (accessed on 12 May 2021)) is acknowledged for sharing the dynamic VR video clip for the case-study building in Paris (courtesy of © Generali Real Estate French Branch, adapted from www.helloworldparis.com (accessed on 12 May 2021)). All the participants that voluntarily and actively contributed to the experimental investigation are warmly acknowledged. A special thanks is for Corine Tetteroo (Noldus Information Technology bv, NL). Finally, Alice Iurlaro is acknowledged for supporting part of the recording stage.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Levin, H. Designing for people: What do building occupants really want? In Proceedings of the Healthy Buildings 2003, Singapore, 7–11 December 2003.
  2. Colenberg, S.; Jylha, T.; Arkesteijn, M. The relationship between interior office space and employee health and well-being—A literature review. Build. Res. Inf. 2020, 49, 35–366. [Google Scholar] [CrossRef] [Green Version]
  3. Li, D.; Menassa, C.C.; Kamat, V.R. Personalized human comfort in indoor building environments under diverse conditioning modes. Build. Environ. 2017, 126, 304–317. [Google Scholar] [CrossRef]
  4. Yun, G.Y.; Kim, J.T. Creating sustainable building through exploiting human comfort. Energy Procedia 2014, 62, 590–594. [Google Scholar] [CrossRef] [Green Version]
  5. Abdel-Ghany, A.M.; Al-Helal, I.M.; Shady, M.R. Human thermal comfort and heat stress in an outdoor urban arid environment: A case study. Adv. Meteorol. 2013. [Google Scholar] [CrossRef] [Green Version]
  6. Busca, G.; Cappellini, A.; Manzoni, S.; Tarabini, M.; Vanali, M. Quantification of changes in modal parameters due to the presence of passive people on a slender structure. J. Sound Vib. 2014, 333, 5641–5652. [Google Scholar] [CrossRef]
  7. Davis, B.; Avci, O. Simplified vibration serviceability evaluation of slender monumental stairs. J. Struct. Eng. 2015, 141, 04015017. [Google Scholar] [CrossRef]
  8. Bedon, C.; Fasan, M. Reliability of field experiments, analytical methods and pedestrian’s perception scales for the vibration serviceability assessment of an in-service glass walkway. Appl. Sci. 2019, 9, 1936. [Google Scholar] [CrossRef] [Green Version]
  9. Burton, M.D.; Kwok, K.C.S.; Abdelrazaq, A. Wind-Induced motion of tall buildings: Designing for occupant comfort. Int. J. High-Rise Build. 2015, 4, 1–8. [Google Scholar]
  10. Denoon, R.O.; Roberts, R.D.; Letchford, C.W.; Kwok, K.C.S. Field Experiments to Investigate Occupant Perception and Tolerance of Wind-Induced Building Motion; Research Report No. R803; Department of Civil Engineering, University of Sydney: Sydney, NWS, Australia, 2000. [Google Scholar]
  11. Kwok, K.C.S.; Hitchcock, P.A. Occupant comfort test using a tall building motion simulator. In Proceedings of the Fourth International Conference on Advances in Wind and Structures, Jeju, Korea, 28–30 May 2008. [Google Scholar]
  12. Bower, I.; Tucker, R.; Enticott, P.G. Impact of built environment design on emotion measured via neurophysiological correlates and subjective indicators: A systematic review. J. Environ. Psychol. 2019, 66, 101344. [Google Scholar] [CrossRef]
  13. Juan-Vidal, F.; Inarra-Abad, S. Introducing emotions in the architectural design process. In Proceedings of the 1st International Conference on Higher Education Advances(HEAd’15), Universitat Politecnica de Valencia, Valencia, Spain, 24–26 June 2015. [Google Scholar] [CrossRef] [Green Version]
  14. Shearcroft, G. The Joy of Architecture: Evoking Emotions through Building. Archit. Des. 2021, 91, 108–117. [Google Scholar]
  15. Suri, C. Inside the Rise of Emotional Design. Architectural Digest. 18 May 2017. Available online: https://www.architecturaldigest.com/story/emotional-design (accessed on 12 May 2021).
  16. Shahid, M. The Different Emotions Architecture (Buildings) Can Express. Rethinking the Future. Available online: https://www.re-thinkingthefuture.com/fresh-perspectives/a2586-the-different-emotions-architecture-buildings-can-express/ (accessed on 12 May 2021).
  17. Kozlovsky, R. Architecture, emotions and the history of childhood. In Childhood, Youth and Emotions in Modern History. Palgrave Studies in the History of Emotions; Olsen, S., Ed.; Palgrave Macmillan: London, UK, 2015. [Google Scholar] [CrossRef]
  18. Ricci, N. The Psychological Impact of Architectural Design. CMC Senior Theses. 2018. Available online: https://scholarship.claremont.edu/cmc_theses/1767 (accessed on 12 May 2021).
  19. Canepa, E.; Scelsi, V.; Fassio, A.; Avanzino, L.; Lagravinese, G.; Chiorri, C. Atmospheres: Feeling Architecture by Emotions—Preliminary Neuroscientific Insights on Atmospheric Perception in Architecture. Ambiances 2019. Available online: http://journals.openedition.org/ambiances/2907 (accessed on 12 May 2021). [CrossRef] [Green Version]
  20. Shu, L.; Yu, Y.; Chen, W.; Hua, H.; Li, Q.; Jin, J.; Xu, X. Wearable emotion recognition using heart rate data from a smart bracelet. Sensors 2020, 20, 718. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  21. Geiser, M.; Walla, P. Objective measures of emotion during virtual walks through urban environments. Appl. Sci. 2011, 1, 1–11. [Google Scholar] [CrossRef]
  22. Gulnick, J. The Psychology of Perception, Threshold, and Emotion in Interior Glass Design. Glass on Web. 2 December 2019. Available online: https://www.glassonweb.com/article/psychology-perception-threshold-and-emotion-interior-glass-design (accessed on 12 May 2021).
  23. Deriu, D. Skywalking in the city: Glass platforms and the architecture of vertigo. Emot. Space Soc. 2018, 28, 94–103. [Google Scholar] [CrossRef]
  24. Bedon, C.; Amadio, C. Exploratory numerical analysis of two-way straight cable-net facades subjected to air blast loads. Eng. Struct. 2014, 79, 276–289. [Google Scholar] [CrossRef]
  25. Bedon, C.; Zhang, X.; Santos, F.; Honfi, D.; Kozłowski, M.; Arrigoni, M.; Figuli, L.; Lange, D. Performance of structural glass facades under extreme loads—Design methods, existing research, current issues and trends. Constr. Build. Mater. 2018, 163, 921–937. [Google Scholar] [CrossRef]
  26. China Daily. World’s Longest, Highest Glass Bridge Opens in Hunan. 2016. Available online: https://www.chinadaily.com.cn/travel/2016-08/21/content_26546587_7.htm (accessed on 12 May 2021).
  27. Darral, S. Don’t Look Down! The Terrifying See-Through Path Stuck to a Chinese Cliff-Face 4,000ft above a Rocky Ravine. 2011. Available online: https://www.dailymail.co.uk/news/article-2060023/Chinas-newest-tourist-attraction--glass-bottomed-walkway-cliff-face.html (accessed on 12 May 2021).
  28. Bedon, C.; Kruszka, L. An insight on the mitigation of glass soft targets and design of protective facades. In Critical Infrastructure Protection. Best Practices and Innovative Methods of Protection, NATO Science for Peace and Security Series D: Information and Communication Security; Kruszka, L., Klósak, M., Muzolf, P., Eds.; IOS Press: Amsterdam, The Netherlands, 2019; Volume 52, pp. 107–117. ISBN 978-1-61499-963-8. [Google Scholar]
  29. Bedon, C. Transparent materials and new design strategies in the COVID-19 era. In Abstract Book of ICCECIP 2020, International Conference on Central European Critical Infrastructure Protection, Budapest, Hungary, 16–17 November 2020; Nyikes, Z., Kovacs, T.A., Molnar, A., Eds.; Óbuda University: Budapest, Hungary, 2020; p. 39. ISBN 978-963-449-221-4. [Google Scholar]
  30. Nothingam, S. Simply Breathtaking: Glass Floor Ideas for the Polished Modern Home. Available online: https://www.decoist.com/glass-floor-ideas/?firefox=1 (accessed on 12 May 2021).
  31. Loijens, L.; Krips, O. FaceReader Methodology; Noldus Information Technology: Wageningen, The Netherlands, 2013. [Google Scholar]
  32. Zaman, B.; Shrimpton-Smith, T. The FaceReader: Measuring instant fun of use. In Proceedings of the 4th Nordic Conference on Human-Computer Interaction (NordiCHI ’06). Oslo, Norway, 14–18 October 2006. [Google Scholar]
  33. Yu, C.Y.; Ko, C.H. Applying FaceReader to recognize consumer emotions in graphic styles. Procedia CIRP 2017, 60, 104–109. [Google Scholar] [CrossRef]
  34. Mordor Intelligence. Europe Flat Glass Market—Growth, Trends, COVID-19 Impact, and Forecasts (2021–2026). Technical Report. 2020. Available online: https://www.mordorintelligence.com/industry-reports/europe-flat-glass-market (accessed on 12 May 2021).
  35. Creating Safe, Sustainable Spaces: How Building Materials Will Evolve Post COVID-19. 2020. Available online: https://www.gauzy.com/creating-safe-sustainable-spaces-how-building-materials-will-evolve-post-covid-19/ (accessed on 12 May 2021).
  36. Chan, Z.Y.S.; MacPhail, A.J.C.; Au, I.P.H.; Zhang, J.H.; Lam, B.M.F.; Ferber, R.; Cheung, R.T.H. Walking with head-mounted virtual and augmented reality devices: Effects on position control and gait biomechanics. PLoS ONE 2019, 14, e0225972. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Yang, Y.R.; Tsai, M.P.; Chuang, T.Y.; Sung, W.H.; Wang, R.Y. Virtual reality-based training improves community ambulation in individuals with stroke: A randomized controlled trial. Gait Posture 2008, 28, 201–206. [Google Scholar] [CrossRef] [PubMed]
  38. Airbnb. Off-Grid itHouse. Available online: https://www.airbnb.it/rooms/19606?source_impression_id=p3_1620923233_mkY0whaLq1nXgbul (accessed on 12 May 2021).
  39. AASA Architecture. Nhow-Amsterdam-RAI-Hotel-by-OMA-01. 2020. Available online: https://aasarchitecture.com/2020/02/cod-and-being-development-delivered-the-nhow-amsterdam-rai-hotel-by-oma.html/nhow-amsterdam-rai-hotel-by-oma-01/ (accessed on 12 May 2021).
  40. ABC News. China Closes “Scary” Glass Bridges Due to “Safety Problems”. 2019. Available online: https://www.abc.net.au/news/2019-11-01/china-closes-glass-bridges-due-to-safety-problems/11662372 (accessed on 12 May 2021).
  41. Sedak All-Glass Stairs: A Step towards Freedom. Available online: https://www.sedak.com/en/applications/architecture/glass-stairs (accessed on 12 May 2021).
  42. Times Colonist. Vehicle Crashes through Window, Damaging Saanich Real Estate Office. 2020. Available online: https://www.timescolonist.com/news/local/vehicle-crashes-through-window-damaging-saanich-real-estate-office-1.24094689 (accessed on 12 May 2021).
  43. Lavars, N. Seattle’s Iconic Space Needle Tower Gets a Revolving Glass Floor. 2018. Available online: https://newatlas.com/seattle-space-needle-glass-floor/55764/ (accessed on 12 May 2021).
  44. Dragun, N. New Flights Mean Chicago Is Calling. 2018. Available online: https://www.escape.com.au/destinations/north-america/usa/new-flights-mean-chicago-is-calling/news-story/36343c5cbf8aca3de0fe6bab4f68f039 (accessed on 12 May 2021).
  45. Hello World. 2020. Available online: www.helloworldparis.com (accessed on 12 May 2021).
  46. Wellershoff, F.; Sedlacek, G. Glass pavilion rheinbach—stability of glass columns. In Proceedings of the Leading International Glass Conference “Glass Processing Days 2003”, Tampere, Finland, 15–18 June 2003; pp. 316–318. [Google Scholar]
  47. Glacier Skywalk. Available online: https://www.gettyimages.fi/photos/glacier-skywalk?family=editorial&phrase=glacier%20skywalk&sort=mostpopular (accessed on 12 May 2021).
  48. Bedon, C. Issues on the vibration analysis of in-service laminated glass structures: Analytical, experimental and numerical investigations on delaminated beams. Appl. Sci. 2019, 9, 3928. [Google Scholar] [CrossRef] [Green Version]
  49. Bedon, C. Diagnostic analysis and dynamic identification of a glass suspension footbridge via on-site vibration experiments and FE numerical modelling. Compos. Struct. 2019, 216, 366–378. [Google Scholar] [CrossRef]
  50. Wright, P. World’s Longest and Highest Glass-Bottomed Bridge Opens in China’s “Avatar” Mountains. 2016. Available online: https://weather.com/travel/news/china-glass-bridge-opens (accessed on 12 May 2021).
  51. Myers, L. Hayri Atak Envisions a Boutique Hotel Suspended over a Cliff Edge in Norway. 2019. Available online: https://www.designboom.com/architecture/hayri-atak-cliff-concept-boutique-hotel-norway-07-22-2019/ (accessed on 12 May 2021).
  52. Frearson, A. MVRDV Replaces Chanel Store’s Traditional Facade with Glass Bricks that Are “Stronger than Concrete”. 2016. Available online: https://www.dezeen.com/2016/04/20/crystal-houses-amsterdam-chanel-store-mvrdv-glass-facade-technology/ (accessed on 12 May 2021).
  53. Tripadvisor. King Power Mahanakhon. Available online: https://www.tripadvisor.it/Attraction_Review-g293916-d14135436-Reviews-King_Power_Mahanakhon-Bangkok.html (accessed on 12 May 2021).
  54. Pintos, P. 30 St Mary Axe Tower/Foster + Partners. Available online: https://www.archdaily.com/928285/30-st-mary-axe-tower-foster-plus-partners (accessed on 12 May 2021).
  55. Schlaich Bergermann Partner. Glass Bridge Lisbon. 2010. Available online: https://www.sbp.de/fr/projekt/glasbruecke-lissabon/ (accessed on 12 May 2021).
  56. MVRDV Markthal. Available online: https://www.mvrdv.nl/projects/115/markthal (accessed on 12 May 2021).
  57. A’DAM LOOKOUT + 360° Lunch in Revolving Restaurant Moon. Available online: https://www.adamlookout.com/combi-tickets/#!/lunch (accessed on 12 May 2021).
  58. Toronto Star. China Opens Terrifying Tianmen Mountain Glass Walkway. 2016. Available online: https://www.thestar.com/news/world/2016/08/03/china-opens-terrifying-tianmen-mountain-glass-walkway.html (accessed on 12 May 2021).
  59. Design & Contract. Referenze: Hotel Hubertus—Valdaora, Bolzano. Available online: https://designandcontract.com/it/referenze/hotel-hubertus-valdaora-bolzano (accessed on 12 May 2021).
  60. Crook, L. Snøhetta Completes Europe’s First Underwater Restaurant in Norway. 2019. Available online: https://www.dezeen.com/2019/03/20/underwater-restaurant-under-snohetta-baly-norway/ (accessed on 12 May 2021).
  61. Vitroplena Structural Glass Solutions—A Transparent Office Floor. 2017. Available online: https://www.vitroplena.be/en/innovative-solutions (accessed on 12 May 2021).
  62. Tripster. 360 Chicago Observation Deck in Chicago. Available online: https://www.tripster.com/detail/360-chicago-observation-deck (accessed on 12 May 2021).
Figure 1. Examples of glass in buildings: (a,b) Facades and roofs for the Poly Plaza Cable-Net Wall (Beijing, CN) and the Kempinski Hotel (Munich, DE), (reprinted with permission from [24], Copyright 2021 Elsevier®, license number 5042040336444); (c) a pedestrian system (walkway in Aquileia, IT; reprinted from [8] under the terms and conditions of CC-BY license); (d,e) cracks and shards due to a hazard (reprinted with permission from [25], Copyright 2021 Elsevier®, license number 5042381253637).
Figure 1. Examples of glass in buildings: (a,b) Facades and roofs for the Poly Plaza Cable-Net Wall (Beijing, CN) and the Kempinski Hotel (Munich, DE), (reprinted with permission from [24], Copyright 2021 Elsevier®, license number 5042040336444); (c) a pedestrian system (walkway in Aquileia, IT; reprinted from [8] under the terms and conditions of CC-BY license); (d,e) cracks and shards due to a hazard (reprinted with permission from [25], Copyright 2021 Elsevier®, license number 5042381253637).
Buildings 11 00204 g001
Figure 2. Examples of human reactions on glass structures: (a) Zhangjiajie bridge, Hunan, CN (adapted from [26], © Imagechina/REX/Shutterstock); (b) Cliffside skyway, CN (adapted from [27], © Visual China Group via Getty Images); and (c) a virtual experimental procedure.
Figure 2. Examples of human reactions on glass structures: (a) Zhangjiajie bridge, Hunan, CN (adapted from [26], © Imagechina/REX/Shutterstock); (b) Cliffside skyway, CN (adapted from [27], © Visual China Group via Getty Images); and (c) a virtual experimental procedure.
Buildings 11 00204 g002
Figure 3. Flowchart of the virtual experimental analysis. A detailed example: a glazed apartment floor in Paris, FR (adapted from [30], © Jerry Jacobs Design) and facial expression analysis (© C. Bedon).
Figure 3. Flowchart of the virtual experimental analysis. A detailed example: a glazed apartment floor in Paris, FR (adapted from [30], © Jerry Jacobs Design) and facial expression analysis (© C. Bedon).
Buildings 11 00204 g003
Figure 4. (a) Age demographics and (b) geographic distribution of participants.
Figure 4. (a) Age demographics and (b) geographic distribution of participants.
Buildings 11 00204 g004
Figure 5. General procedure for the virtual experimental investigation (STEP 2).
Figure 5. General procedure for the virtual experimental investigation (STEP 2).
Buildings 11 00204 g005
Figure 6. Selection of static input sources for the first stage of the static virtual experiment (examples from the set of 27 items): (a) private room (Off-grid itHouse, Pioneertown, USA; adapted from [38], © Airbnb); (b) Amsterdam RAI Hotel, NL (adapted from [39], © Egbert de Boer); (c) Hongyagu bridge, Hebei, CN (adapted from [40], © REUTERS/Stringer); (d) windows under a blast hazard (adapted from [29], © C. Bedon); (e) stairs of the Apple Cube, New York, USA (adapted from [41], © Sedak GmbH and Co KG); (f) facade and walls (adapted from [29], © C. Bedon); (g) window under vehicle impact (adapted from [42], © Times Colonist); (h) Space Needle tower (Seattle, WA, USA; adapted from [43], © Space Needle LLC and John Lok); (i) skydeck (Willis Tower, Chicago, USA; adapted from [44], © Ranvestel Photographic).
Figure 6. Selection of static input sources for the first stage of the static virtual experiment (examples from the set of 27 items): (a) private room (Off-grid itHouse, Pioneertown, USA; adapted from [38], © Airbnb); (b) Amsterdam RAI Hotel, NL (adapted from [39], © Egbert de Boer); (c) Hongyagu bridge, Hebei, CN (adapted from [40], © REUTERS/Stringer); (d) windows under a blast hazard (adapted from [29], © C. Bedon); (e) stairs of the Apple Cube, New York, USA (adapted from [41], © Sedak GmbH and Co KG); (f) facade and walls (adapted from [29], © C. Bedon); (g) window under vehicle impact (adapted from [42], © Times Colonist); (h) Space Needle tower (Seattle, WA, USA; adapted from [43], © Space Needle LLC and John Lok); (i) skydeck (Willis Tower, Chicago, USA; adapted from [44], © Ranvestel Photographic).
Buildings 11 00204 g006
Figure 7. Selection of screenshot frames from the pre-recorded VR video clip inspired by the case-study palace in Paris, FR (adapted from [45], © Generali Real Estate French Branch): (a) general view of the building (from Rue Réaumur); (b) indoor open space; (c) top terrace; (d) glass conical envelope/facade; (e) glass floor (from the ground level); (f) glass roof (from the ground level).
Figure 7. Selection of screenshot frames from the pre-recorded VR video clip inspired by the case-study palace in Paris, FR (adapted from [45], © Generali Real Estate French Branch): (a) general view of the building (from Rue Réaumur); (b) indoor open space; (c) top terrace; (d) glass conical envelope/facade; (e) glass floor (from the ground level); (f) glass roof (from the ground level).
Buildings 11 00204 g007
Figure 8. Example of AU records of basic emotional states, as obtained for one of the invited participants exposed to the shared VR input source.
Figure 8. Example of AU records of basic emotional states, as obtained for one of the invited participants exposed to the shared VR input source.
Buildings 11 00204 g008
Figure 9. Schematic procedure for the post-processing analysis of AU of basic emotions (STEP 3) and detection of comfort trends.
Figure 9. Schematic procedure for the post-processing analysis of AU of basic emotions (STEP 3) and detection of comfort trends.
Buildings 11 00204 g009
Figure 10. Example of calculated (a) POS* and (b) NEG* measurements of AU signals, as obtained for one of the participants under the VR input source, as a function of the time of analysis.
Figure 10. Example of calculated (a) POS* and (b) NEG* measurements of AU signals, as obtained for one of the participants under the VR input source, as a function of the time of analysis.
Buildings 11 00204 g010
Figure 11. Examples of POS and NEG variation over the time of analysis, for a single participant exposed to (a) static and (b) dynamic VR stimuli.
Figure 11. Examples of POS and NEG variation over the time of analysis, for a single participant exposed to (a) static and (b) dynamic VR stimuli.
Buildings 11 00204 g011
Figure 12. Detection of prevailing reactions (in percentage terms for the group of participants), as a function of (a) time of analysis or (b) static stimulus (27 pictures).
Figure 12. Detection of prevailing reactions (in percentage terms for the group of participants), as a function of (a) time of analysis or (b) static stimulus (27 pictures).
Buildings 11 00204 g012
Figure 13. Static items with prevailing NEG reactions: (a) Glass Pavilion Rheinbach, DE (adapted from [46], © F. Wellershoff); (b) skywalk (Jasper National Park, CA; (adapted from [47], © Getty Images); (c) delamination (adapted from [48] under the terms and permissions of a CC-BY license and adapted from [49], Copyright 2021 Elsevier®, license number 5067511162164); (d) Zhangjiajie bridge, Hunan, CN (adapted from [50], © VCG via Getty Images); (e) cliff concept boutique hotel (adapted from [51], © Hayri Atak).
Figure 13. Static items with prevailing NEG reactions: (a) Glass Pavilion Rheinbach, DE (adapted from [46], © F. Wellershoff); (b) skywalk (Jasper National Park, CA; (adapted from [47], © Getty Images); (c) delamination (adapted from [48] under the terms and permissions of a CC-BY license and adapted from [49], Copyright 2021 Elsevier®, license number 5067511162164); (d) Zhangjiajie bridge, Hunan, CN (adapted from [50], © VCG via Getty Images); (e) cliff concept boutique hotel (adapted from [51], © Hayri Atak).
Buildings 11 00204 g013
Figure 14. Static items with mostly balanced POS & NEG reactions: (a) private room (Off-grid itHouse, Pioneertown, USA; adapted from [38], © Airbnb); (b) glass bricked wall (Chanel Amsterdam Store, NL; adapted from [52], © MVRDV); (c) skywalk (Mahanakhon, Bangkok, THA; adapted from [53], © Tripadvisor); (d) roof (30 St Mary Axe Tower, London, UK; adapted from [54], © Nigel Young - Foster + Partners, Richard Bryant); (e) footbridge (Lisbon, PT; adapted from [55], © Schlaich Bergermann Partner); (f) Markthal, Rotterdam, NL (adapted from [56], © MVRDV) (g) walls for the 360 revolving restaurant Moon in Amsterdam, NL (adapted from [57], © A’DAM Lookout); (h) walkway (Coiling Dragon Cliff skywalk, CN; adapted from [58], © VCG via Getty Images); (i) swimming pool (Hubertus Hotel (Valdaora, IT; adapted from [59], © Design and Contract)); (j) underwater restaurant in Norway (adapted from [60], © Dezeen).
Figure 14. Static items with mostly balanced POS & NEG reactions: (a) private room (Off-grid itHouse, Pioneertown, USA; adapted from [38], © Airbnb); (b) glass bricked wall (Chanel Amsterdam Store, NL; adapted from [52], © MVRDV); (c) skywalk (Mahanakhon, Bangkok, THA; adapted from [53], © Tripadvisor); (d) roof (30 St Mary Axe Tower, London, UK; adapted from [54], © Nigel Young - Foster + Partners, Richard Bryant); (e) footbridge (Lisbon, PT; adapted from [55], © Schlaich Bergermann Partner); (f) Markthal, Rotterdam, NL (adapted from [56], © MVRDV) (g) walls for the 360 revolving restaurant Moon in Amsterdam, NL (adapted from [57], © A’DAM Lookout); (h) walkway (Coiling Dragon Cliff skywalk, CN; adapted from [58], © VCG via Getty Images); (i) swimming pool (Hubertus Hotel (Valdaora, IT; adapted from [59], © Design and Contract)); (j) underwater restaurant in Norway (adapted from [60], © Dezeen).
Buildings 11 00204 g014
Figure 15. Static items with prevailing POS reactions: (a) mock-up of glass floor system (adapted from [61], © Vitroplena bvba, BE); (b); roof (Botanical Garden, Amsterdam, NL); (c) observation deck (360 Chicago Tilt, Chicago, USA; adapted from [62], © Tripster).
Figure 15. Static items with prevailing POS reactions: (a) mock-up of glass floor system (adapted from [61], © Vitroplena bvba, BE); (b); roof (Botanical Garden, Amsterdam, NL); (c) observation deck (360 Chicago Tilt, Chicago, USA; adapted from [62], © Tripster).
Buildings 11 00204 g015
Figure 16. Detection of prevailing reactions (in percentage terms for the group of participants), as a function of static stimulus, for (a) Group-A or (b) Group-B.
Figure 16. Detection of prevailing reactions (in percentage terms for the group of participants), as a function of static stimulus, for (a) Group-A or (b) Group-B.
Buildings 11 00204 g016
Figure 17. Detection of prevailing POS reactions (in percentage terms for participants), as a function of static stimulus, for (a) Group-A or (b) Group-B items. In evidence: the response for gender sub-groups of volunteers.
Figure 17. Detection of prevailing POS reactions (in percentage terms for participants), as a function of static stimulus, for (a) Group-A or (b) Group-B items. In evidence: the response for gender sub-groups of volunteers.
Buildings 11 00204 g017
Figure 18. Detection of prevailing POS reactions (in percentage terms for participants), as a function of static stimulus, for (a) Group-A or (b) Group-B items. In evidence: the response for demographic sub-groups of volunteers.
Figure 18. Detection of prevailing POS reactions (in percentage terms for participants), as a function of static stimulus, for (a) Group-A or (b) Group-B items. In evidence: the response for demographic sub-groups of volunteers.
Buildings 11 00204 g018
Figure 19. Detection of prevailing reactions (in percentage values for the group of participants), as a function of the time of analysis for the dynamic VR scenario.
Figure 19. Detection of prevailing reactions (in percentage values for the group of participants), as a function of the time of analysis for the dynamic VR scenario.
Buildings 11 00204 g019
Figure 20. Selection of frames from the pre-recorded VR video clip with marked POS or NEG reactions (adapted from [45], © Generali Real Estate French Branch): (a)–(b) facade panels; (c) floor; (d) indoor balustrades; (e) indoor partition walls.
Figure 20. Selection of frames from the pre-recorded VR video clip with marked POS or NEG reactions (adapted from [45], © Generali Real Estate French Branch): (a)–(b) facade panels; (c) floor; (d) indoor balustrades; (e) indoor partition walls.
Buildings 11 00204 g020
Figure 21. Analysis of prevailing POS or NEG reactions (average percentage results for the group of participants), as a function of context, as obtained from the static and dynamic VR experiments.
Figure 21. Analysis of prevailing POS or NEG reactions (average percentage results for the group of participants), as a function of context, as obtained from the static and dynamic VR experiments.
Buildings 11 00204 g021
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Bedon, C.; Mattei, S. Facial Expression-Based Experimental Analysis of Human Reactions and Psychological Comfort on Glass Structures in Buildings. Buildings 2021, 11, 204. https://doi.org/10.3390/buildings11050204

AMA Style

Bedon C, Mattei S. Facial Expression-Based Experimental Analysis of Human Reactions and Psychological Comfort on Glass Structures in Buildings. Buildings. 2021; 11(5):204. https://doi.org/10.3390/buildings11050204

Chicago/Turabian Style

Bedon, Chiara, and Silvana Mattei. 2021. "Facial Expression-Based Experimental Analysis of Human Reactions and Psychological Comfort on Glass Structures in Buildings" Buildings 11, no. 5: 204. https://doi.org/10.3390/buildings11050204

APA Style

Bedon, C., & Mattei, S. (2021). Facial Expression-Based Experimental Analysis of Human Reactions and Psychological Comfort on Glass Structures in Buildings. Buildings, 11(5), 204. https://doi.org/10.3390/buildings11050204

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop