Next Article in Journal
Classification and Recognition of Building Appearance Based on Optimized Gradient-Boosted Decision Tree Algorithm
Next Article in Special Issue
A Reliability Analysis of a MEMS Flow Sensor with an Accelerated Degradation Test
Previous Article in Journal
Monitoring of Cardiorespiratory Parameters during Sleep Using a Special Holder for the Accelerometer Sensor
Previous Article in Special Issue
A Novel High-Sensitivity MEMS Pressure Sensor for Rock Mass Stress Sensing
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Buildings’ Biaxial Tilt Assessment Using Inertial Wireless Sensors and a Parallel Training Model

by
Luis Pastor Sánchez-Fernández
1,*,
Luis Alejandro Sánchez-Pérez
2,
José Juan Carbajal-Hernández
1,
Mario Alberto Hernández-Guerrero
1 and
Lucrecia Pérez-Echazabal
3
1
Instituto Politécnico Nacional, Centro de Investigación en Computación, Juan de Dios Bátiz Ave., México City 07738, Mexico
2
Electrical and Computer Engineering Department, University of Michigan, 4901 Evergreen Rd, Dearborn, MI 48128, USA
3
Escuela de Arquitectura Arte y Diseño, Instituto Tecnológico y de Estudios Superiores de Monterrey, Monterrey 64849, Mexico
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(11), 5352; https://doi.org/10.3390/s23115352
Submission received: 12 April 2023 / Revised: 31 May 2023 / Accepted: 2 June 2023 / Published: 5 June 2023
(This article belongs to the Special Issue Application of MEMS/NEMS-Based Sensing Technology)

Abstract

:
Applications of MEMS-based sensing technology are beneficial and versatile. If these electronic sensors integrate efficient processing methods, and if supervisory control and data acquisition (SCADA) software is also required, then mass networked real-time monitoring will be limited by cost, revealing a research gap related to the specific processing of signals. Static and dynamic accelerations are very noisy, and small variations of correctly processed static accelerations can be used as measurements and patterns of the biaxial inclination of many structures. This paper presents a biaxial tilt assessment for buildings based on a parallel training model and real-time measurements using inertial sensors, Wi-Fi Xbee, and Internet connectivity. The specific structural inclinations of the four exterior walls and their severity of rectangular buildings in urban areas with differential soil settlements can be supervised simultaneously in a control center. Two algorithms, combined with a new procedure using successive numeric repetitions designed especially for this work, process the gravitational acceleration signals, improving the final result remarkably. Subsequently, the inclination patterns based on biaxial angles are generated computationally, considering differential settlements and seismic events. The two neural models recognize 18 inclination patterns and their severity using an approach in cascade with a parallel training model for the severity classification. Lastly, the algorithms are integrated into monitoring software with 0.1° resolution, and their performance is verified on a small-scale physical model for laboratory tests. The classifiers had a precision, recall, F1-score, and accuracy greater than 95%.

1. Introduction

Cities in lacustrine and seismic zones face a significant challenge; their buildings are subject to predisposing agents and triggers of various damages. Underground water extraction changes ground subsidence and its dynamic properties; these effects are relevant during an earthquake, such as those found in the Mexico City Valley [1]. Ground subsidence can cause building biaxial tilts, which can become critical with serious safety risks. Permanent monitoring and structural health monitoring (SHM) [2,3,4,5,6] allow the acquisition of time series with historical data, including their behavior before and after seismic events. Differential settlements, together with the structural characteristics of the building, can cause uneven slopes in its walls [7,8,9]. These tilt patterns can be diverse, and the value of their angles allows for establishing their severity levels. Measurements in real time show the importance of damage detection and building assessment by placing sensors and assuming weak areas. This framework is considered in evaluation and self-monitoring [10,11], including structural health monitoring for restoring heritage buildings [12,13].
Multidisciplinary efforts and new technologies have allowed the development of high-performance monitoring systems. Structural health monitoring implements a damage identification strategy for infrastructure [14,15,16], including tilts and high-rise building safety detection methods [17]. The approach consists of integrating technologies that allow obtaining information for the prevention of injuries in structures, such as vibrations detected in towers [18,19] and bridges [20]. Some studies used the dynamic acceleration produced by inertial sensors according to the application requirements [21]. However, they did not include algorithms for time-series processing, frequent inclination pattern recognition in areas with differential settlements, or a distributed architecture based on Wi-Fi technologies and client/server systems.
This work uses noisy static acceleration, unlike others where dynamic acceleration is essential, such as vibration analysis [22] and biomechanical tremor measurement [23]. In [24,25], a case study based on a wireless sensor network was analyzed; however, algorithms for the time-series treatment of static acceleration, inclination patterns, and pattern recognition were not presented. The authors of [24] presented only a short review of structural health monitoring of historic buildings. Other papers addressed the monitoring of electrical towers [25,26] with wireless systems or vibration inspection systems for offshore platform structures [27]. Some projects analyzed injuries due to telluric movements, evaluating the performance of prototypes during and after earthquakes [28,29]. Others used modeling methods and frameworks for early warning systems [30].
Other structural health monitoring strategies [31,32,33] have been presented; nevertheless, they are not based on permanent online monitoring systems for multiple buildings. Likewise, biaxial tilt patterns and their evolution due to differential soil settlement and random events, such as earthquakes, are not considered.
The number of sensors may vary depending on the work focus and type of measured variables, from monitoring a tower with more than 100 sensors to robust systems with more than five [34]. Microelectromechanical systems (MEMS) technology represents a significant advantage due to cost reduction, as presented in [5,6,17,29,35]; likewise, their reduced sizes are more widely accepted for optimizing nonintrusive monitoring in buildings. Many works have been developed on wireless sensor networks that help create embedded systems for monitoring civil infrastructures [27,34,35,36].
Several methods can be implemented to establish which machine learning algorithms (MLA) are the most efficient for the application under development. For example, in [37], Bayesian optimization was conducted to tune the hyperparameters of each MLA. The results indicated that support vector machines are the most accurate compared to the decision tree, naïve Bayes, discriminant analysis, and K-nearest neighbor for local damage detection in reinforced concrete bridges. In other cases, structural damage detection based on data-driven techniques using a deep neural network was proposed to study a large in-orbit flexible system. The model was trained using the sensor-measured time-series responses [38] and a distributed network of accelerometers [39].
Computational systems with distributed architecture in real time allow the simultaneous monitoring of several buildings in a control center. This paper presents a computational approach based on inertial sensors, as well as a parallel neural model for biaxial tilt pattern recognition and severity determination for rectangular buildings. Section 2 provides a general description of the distributed system, methods to improve the inertial measurement unit (IMU) signals, the proposed tilt patterns and parallel neural models for pattern recognition and tilt severity analysis, and their metrics. Section 3 presents a small-scale physical model for laboratory tests and a comparison with more closely related work. Lastly, the conclusions are given in Section 4.

2. Materials and Methods

2.1. Real-Time Measurements

Figure 1 shows a general diagram of the system consisting of four inertial measurement units (IMUs) with MEMS technology. Each IMU incorporates an accelerometer, gyroscope, and magnetometer. The digital-output triple-axis accelerometer has a full-scale programmable range of ±2 g, ±4 g, ±8 g, and ±16 g with integrated 16 bit ADC.
The digital-output triple-axis gyroscope has a full-scale range until ±2000°/s and integrated 16 bit ADC. The triple-axis silicon monolithic Hall-effect magnetic sensor has an output data resolution of 14 bit (0.6 μT/LSB) or 16 bit (15 μT/LSB) and a full-scale measurement range of ±4800 μT. Figure 1a shows a schematic of the four sensors installed on each of the walls of the rectangular building. Each sensor includes an IMU, a wireless communication module with the IEEE 802.15.4 protocol (WIFI-Xbee) to create a fast point-to-multipoint network and a rechargeable battery.
A local computer acquires the sensor signals through a router, as shown in Figure 1b,c. The system uses a client–server architecture (TCP/IP protocol) to monitor one or several buildings in a control room from any geographical location (Figure 1d).
The sensors’ location reference considers the front of the building. This work calculates the inclination angle, assuming no vertical and horizontal wall deformations exist. According to the expert knowledge of structure and architecture specialists, the recommendation for this project stage was to place the sensors as high as possible on each wall. Likewise, the suggestion was applied to the small-scale physical model for laboratory tests.
Although outside the scope of this work, for measurements related to vertical and horizontal wall deformations, more than one sensor should be used per wall. The sensor network and software were designed considering possible project growth.
Cities in lacustrine and seismic zones can have many buildings with diverse damage, including biaxial inclinations. They are still habitable but require frequent inspections, which must be carried out in medium periods. The situation is even more critical after a seismic event. Therefore, each vulnerable building must have a diagnosis and inventory of its main damages, which still do not put its habitability at risk but require periodic supervision. The biaxial inclination is typical in buildings on soil with differential settlements. For this case, the experts evaluate them periodically using manual high-precision inclinometers.
On the basis of IMU measurements, the calculated inclination for this work ranged from 0° to 1.5°, with a resolution of 0.1°. The proposed method allows a resolution of <0.1° depending on the used sensors.
The model uses angles based on relative variables (deviation variables) concerning an initial inclination that could exist when the measurements and monitoring begin; there may be zero or nonzero initial slope in each of the four walls. This initial tilt information must be obtained by expert inspection before the real-time monitoring system begins to operate.
Additionally, accelerometer signals contain electrical noise, and the system can detect temporary vibrations. For such reasons, the selected sampling frequency is 50 samples per second (S/s) to apply digital filters with a cutoff frequency of up to 25 Hz. Furthermore, a quaternion-based orientation filter [40] for inertial sensors effectively separates static and dynamic accelerations. The time series of the measured inclinations is treated with a proposed algorithm of successive repetitions, which eliminates other disturbances still present. Section 2.2 describes the combination of these methods, which significantly improves the final results. Building inclinations evolve over long periods (months or years). This work verified different patterns and their evolution with computationally generated values and a small-scale physical model for laboratory tests, as described in Section 3.
Figure 1. System overview. Sensor including IMU + the wireless communication module with the IEEE 802.15.4 protocol and a rechargeable battery. (a) Schematic of the four sensors installed on each of the walls of the rectangular building. (b) Local computer acquiring the sensors’ signals through a router. (c) Client–server architecture (TCP/IP protocol) of the system. (d) Monitoring of one or several buildings in a control room from any geographical location.
Figure 1. System overview. Sensor including IMU + the wireless communication module with the IEEE 802.15.4 protocol and a rechargeable battery. (a) Schematic of the four sensors installed on each of the walls of the rectangular building. (b) Local computer acquiring the sensors’ signals through a router. (c) Client–server architecture (TCP/IP protocol) of the system. (d) Monitoring of one or several buildings in a control room from any geographical location.
Sensors 23 05352 g001

2.2. Methods Combination for the Preliminary Treatment of Measurements

2.2.1. Orientation Filter for Inertial Sensors

A useful accelerometer feature is the static acceleration measurement due to the Earth’s gravity, which is used to obtain the biaxial tilt of buildings. However, extensive tests showed that the dynamic acceleration signals existing in the sensors (caused by transient vibrations, fundamentally) are among the causes of interference with the calculated lean angles. It is necessary to obtain only the static acceleration. For this purpose, the orientation filter utilizes a quaternion representation. Accelerometer and magnetometer data are employed in an optimized gradient-descent algorithm to calculate the direction of the gyroscope measurement error as a quaternion derivative [40,41].
The quaternions are an extension of the complex numbers of four dimensions and can represent space rotations. They characterize the rigid body orientations or reference frames in three-dimensional space. For example, an orientation of the reference frame B relative to the reference frame A can be realized through a rotation of the angle θ around an axis A r ^ defined in frame A [41].
This is presented graphically in Figure 2, where the mutually orthogonal unit vectors X ^ A , Y ^ A , Z ^ A and X ^ B , Y ^ B , Z ^ B define the main reference frame axes A and B, respectively [41].
The quaternions that describe an orientation must be normalized and of unit length for an orientation q ^ B A defined in Equation (1).
q ^ B A = q 1   q 2   q 3   q 4 = ( cos θ 2 )   ( r x sin θ 2 )   ( r y sin θ 2 )   ( r z sin θ 2 ) .
In this sense, the orientation filter is applied to the inertial sensor measurements. The sensor orientation is determined using Madwick’s algorithm in [41], and a representation is obtained using quaternion calculations, as shown in Equation (1).
Subsequently, the unitary vector of the Earth’s acceleration x ,   y ,   z = 0 ,   0 ,   1 is rotated to the sensor position or IMU, obtaining its static acceleration at each sampling instant.
Figure 3 illustrates the quaternion rotation method to get gravity acceleration to calculate biaxial tilt angles. This calculation using the orientation filter eliminates any component of dynamic acceleration resulting from temporary vibrations in the building, less than 25 Hz. Any disturbance still existing in the signal will be treated in the time series using the successive repetitions algorithm proposed in Section 2.2.3, as illustrated by the block diagram in Figure 4.

2.2.2. Average Filter in Real Time

This filter averages many input signal points to produce each output signal point. Equation (2) presents this definition.
Y k = 1 n   i = k n + 1 k X i ,
where n is the number of samples to average, X i is the filter input at sampling time i , and k is the current sampling time. Equation (3) shows the programmed recursive expression.
Y k = Y k 1 + 1 n X k X k n ,
where Y k represents filter output at sampling time k , Y k 1 is the filter output at sampling time k 1 , X k is the input to the filter at sampling time k , X k n represents the average filter input at sampling time k n , and n is the number of samples to average.
The filter only requires input information at the current sampling time X k and at the last n previous sampling times. The filter must be initialized, saving Y k , Y k 1 , and the previous n inputs. The filter is efficiently programmed because the last n inputs are shifted, eliminating the oldest.

2.2.3. Successive Repetitions Algorithm

Wind or heavy traffic can produce temporary building vibrations, affecting the real-time inclination angle measurements. Figure 4 presents an algorithm of successive repetitions based on a numerical value array, which processes the time series of biaxial tilt angles. This algorithm establishes that the inclination angle must maintain its value for several successive repetitions to accept that there has been a change in it; each repetition is considered at the corresponding sampling instant.
This algorithm of successive repetitions is useful for diverse applications, and the successive repetition number can be adjusted to ensure stability and convergence. In this work, on the basis of numerous experimental tests, the successive repetition number is set to 200, and the results are reliable in their accuracy. The convergence time is always 4 s since the sampling rate is 50 S/s.
RA1 indicated in (a) is calculated after the IMU inertial signal processing by the filters of Section 2.2.1 (orientation filter) and Section 2.2.2 (average filter for real time). In (b), the system checks if RA1 differs from the building tilt angle TA recorded in the system. If there are no differences, the system considers the building tilt angle (TA) unchanged, and only the current relative angle RA1 is assigned to the previous relative angle RA2 for processing in the next sampling instant. If in (b) the answer is yes, the processing is indicated in the block diagram. (c) If RA1 is equal to RA2, then SRC increases by one; otherwise, SRC = 1. (d) If SRC is equal to SRN, the number of successive repetitions of the RA1 angle value has occurred, and the system considers that the calculation of the current relative angle measured at the present sampling instant is stable, making TA = RA1.
This processing is applied for each of the eight biaxial tilt angles in each sampling instant.
Figure 4. Algorithm block diagram of successive repetitions for a sampling instant and each of the eight biaxial tilt angles. The explanation of (ad) may be read in the paragraph before Figure 4.
Figure 4. Algorithm block diagram of successive repetitions for a sampling instant and each of the eight biaxial tilt angles. The explanation of (ad) may be read in the paragraph before Figure 4.
Sensors 23 05352 g004

2.3. Tilt Patterns

Eighteen basic patterns were proposed, representing the shapes of frequent inclinations in buildings, mainly considering the differential settlements [7,8,9]. Several buildings are leaning (off-kilter), from Big Ben at just 0.26° to the Sturluson church tower in Germany at 5.19° [42]. In general, construction regulations establish the maximum limits of the average inclination of the building through formulas based on its height, specified in percentages [43]. For example, the maximum slope allowed for a building 18 m high is 0.65% or 0.37°; for 36 m height, it is 0.48% or 0.28°. However, quite a few buildings have slopes greater than 1° and are still inhabited, although they are under supervision, as shown in Figure A1 (Appendix A) for the Mexico City Press Clinic and Figure A2 for the Palace of Fine Arts.
This work uses sexagesimal degrees; the tilt resolution is 0.1°, and the severity or range is from −1.5° to 1.5°. The tilt patterns and neural models developed can be applied to smaller resolutions, i.e., hundredths of a degree. Likewise, a conversion can be made to a percentage concerning the height of the building. The base patterns can be illustrated graphically by considering the inclinations’ general shapes. The tilt resolution of this project was 0.1°.
Figure 5a presents the sensors’ initial reference system (when installed on the walls). Two axes are used to measure the building’s tilt. The Y–Z plane represents the biaxial tilt, allowing the IMUs to be easily powered regardless of their location on the building walls. A generic building illustration is presented regarding the walls’ inclination. Figure 5b illustrates pattern 0, where all four walls tilt to the right. Figure 5c shows the rotation of the axes Y and Z, regardless of their location on the building walls.
Figure 6 illustrates an example of the wall’s possible tilts from its front view. The positive Y-axis is to the right, and the positive Z-axis goes into the page (to the sensor). In Figure 6a, the wall is perpendicular to its base, and there are no tilts. In Figure 6b, the wall has tilted over time; the Y-axis is tilted clockwise and is represented by a positive sign.
Figure 7 shows a simplified scheme of the 18 base patterns proposed in this work. Considering the expert knowledge of structure and architecture specialists, the 18 base patterns can cover the building tilt forms in practice and even more. These patterns contemplate each wall as a single entity; however, each wall tilt has a close relationship throughout the structure. Furthermore, if the classifier does not recognize a predominant pattern, the biaxial inclination of each wall is recorded independently by the real-time monitoring system. Likewise, the possible future redesign of the system may include new tilt types with classifier retraining and some changes to the model or includes more sensors per wall.
Figure 6. The possible evolution of the tilt angles. (a) The wall is perpendicular to its base, and there are no tilts. (b) The wall has tilted over time; the Y-axis is tilted clockwise and is represented by a positive sign.
Figure 6. The possible evolution of the tilt angles. (a) The wall is perpendicular to its base, and there are no tilts. (b) The wall has tilted over time; the Y-axis is tilted clockwise and is represented by a positive sign.
Sensors 23 05352 g006
Figure 7. A simplified scheme of the 18 base patterns proposed in this work.
Figure 7. A simplified scheme of the 18 base patterns proposed in this work.
Sensors 23 05352 g007
The biaxial tilt measured by the sensors is determined as shown in Equation (4), e.g., when the Z-axis has not changed.
i w = g Y w ,   g Z w   |   g Z w = 0 ,
where i w represents the biaxial inclination of the wall w of the building.
The ordered pair ( g Y w ,   g Z w ) represents the relative angles in the Y- and Z-axes, respectively, for the wall w | w = 0 … 3. For example, for pattern 0, considering the resolution of 0.1°, Equation (5) is obtained for a wall 0.
i 0 = g Y 0 ,   g Z 0   i 0 = 0.1 ,   0 .
Equation (6) represents the building’s biaxial tilt patterns mathematically for its four walls.
p x = i 0 ,   i 1 ,   i 2 ,   i 3 = g Y 0 ,   g Z 0 , g Y 1 ,   g Z 1 , g Y 2 ,   g Z 2 , g Y 3 ,   g Z 3 |   x = 0 17 ,
where p x is the set of base tilt patterns, x is the base pattern,   i 0 ,   i 1 ,   i 2 ,   and   i 3 are the tilt angles of walls 0, 1, 2, and 3, respectively, and g Y w ,   g Z w represent the relative angles in the Y- and Z-axes, respectively, for the wall w | w = 0 … 3.
The 18 base patterns were created using Equations (4) and (5). Equations (7)–(10) show examples for patterns 6 and 14 from Figure 7. Pattern 6 has inclinations in walls 2 and 3, as shown in Equation (7), with the rotation directions of Figure 5c.
p 6 = g Y 0 ,   g Z 0 , g Y 1 ,   g Z 1 , g Y 2 ,   g Z 2 , g Y 3 , g Z 3 .
The values are substituted into Equation (7) considering the system resolution of 0.1°, resulting in Equation (8).
p 6 = 0 ,   0 ,   0 ,   0 ,   0 ,   0.1 ,   0 , 0.1 .
Pattern 14 presents tilt in wall 0, as shown in Equation (9). The values are substituted in Equation (10).
p 14 = g Y 0 ,   g Z 0 , g Y 1 ,   g Z 1 , g Y 2 ,   g Z 2 , g Y 3 ,   g Z 3 .
p 14 = 0.1 , 0 ,   0 ,   0 ,   0 ,   0 ,   0 ,   0 .
Table 1 shows examples of patterns 0–3 of the four walls based on Equations (4)–(6).
So far, the example patterns have been for the minimum inclination of 0.1°. For the computer model’s training, variations of the patterns were made. For example, the pattern 0 for wall 0 illustrated with Equation (5), based on increments of 0.1°, can go up to i 0 = 1.5 ,   0 ; the same applies for walls 1, 2, and 3. However, there may be differences in the inclination between the walls, which would result in a distorted pattern 0, but the computer system indicates the angles in each wall so that an expert has additional information on the base pattern recognized. Similar behavior can be presented for other patterns.

2.4. General Diagram of the Classification Model

The model uses artificial neural networks for base tilt pattern recognition and its severity classification. Figure 8 illustrates the general diagram of the classification model. Figure 8a,b shows the four sensors and the four biaxial tilts, respectively. Figure 8c is the classifier of base patterns. Figure 8d is the computer model for the pattern severity classification, which includes the neural network N N 2 and an algorithm, which is detailed in Section 2.6.1.
N N 1 of Figure 8c is a feedforward neural network that uses the vector of biaxial tilts to classify the corresponding base pattern. The output is the classified base pattern p x (among the 18 proposed). The subsequent sections evaluate the performance of the classification models in Figure 8.

2.5. Classifier of Base Biaxial Tilt Patterns ( N N 1 ) of Figure 8c

A multilayer perceptron neural network was used to classify the base tilt patterns. Parameters that are not directly learned within the neural network training were adjusted on the basis of exhaustive search-generated candidates from a grid of parameters (grid-search) [44,45]. This grid consisted of different values for each parameter, such as epochs, learning rate, and loss function. For fitting the model to the data, the possible combinations of the grid were evaluated, and the best combination was chosen according to a specific metric (in this case, accuracy).
After applying the grid-search method, the chosen hyperparameters during the training phase were the mean squared error (MSE) as the loss function, learning rate α = 0.0001 , and training for 2000 epochs. The hidden layer and the output layer used a hyperbolic tangent activation function.
A stratified cross-validation of the 18 features (base patterns) was implemented to obtain the training and a test subset (with a ratio of 70:27, respectively). The validation uses 3% of the dataset. Afterward, the neural network training was conducted using only the training subset, leaving the test subset out of the training phase.
To have more certainty that the neural network N N 1 architecture had learned adequately, the test subset was used as input for the neural network N N 1 in the test or evaluation phase of the classifier. The metric MSE was used to compare the trained neural network N N 1 performance. The coefficient of determination R 2 did not add different information. Through many tests, the topology shown in Figure 9 was selected.
N N 1 had eight input neurons, where ( g Y 0   , g z 0 , g Y 1   , g z 1 , g Y 2   , g z 2 , g Y 3   , g z 3 ) represent the four ordered pairs of inclinations in the Y- and Z-axes for the four building walls. It had two hidden layers (96 and 58 neurons, respectively) and a layer of 18 output neurons to classify the 18 base patterns. According to a set of tests and the range of inclinations to be monitored for this work (−1.5° to 1.5°), the hyperbolic tangent activation function ( γ m ) was used to process each of the outputs ( O m ) with m = 0, …, 17.
For the neural network supervised training, a target output vector was related to each input vector, as shown in Equation (11).
v x = p x , s x ,
where v x is the training dataset consisting of the base tilt pattern p x and their respective target vectors s x . For the simulation, a computational algorithm generated v x , varying the inclinations ± 0.1° up to ± 1.5°, according to the corresponding base pattern (0…17). A total of 12,900 patterns were used (approximately 715 patterns for each base pattern): 70% for training the network, 3% for validation, and 27% for testing, with which the best results were obtained using the library of Python neural networks.
Only one of the 18 output neurons is triggered when pattern recognition is excellent. In other cases, more than one is activated, but a predominant value indicates the pattern with the most remarkable similarity. This behavior, regarding the most notable similarity, is essential for future work improvements. In that sense, if a building presents a different tilt pattern than the 18 proposed in this work or one that is the combination of two or more base patterns or their distortions, then specialists can analyze the inclination angles returned by the measurement system for each wall. We propose a buildings’ biaxial tilt classification assessment with a computer expert system that can be progressively enriched with new scientific and technological contributions and the experience derived from its application in real buildings in each geographical area. For example, Mexico City has land with very particular characteristics.
Figure 10 presents the confusion matrix generated by the base pattern classification of N N 1 .
Figure 10. Confusion matrix to evaluate NN1. The Y-axis represents the accurate classification assigned to the patterns (true label), while the X-axis indicates the classification given by the network (predicted label). The diagonal values show the correctly labeled patterns; the neural network classified them as the same pattern to which they belong. Table 2 shows the performance metrics of the multiclass classifier using macro-average, with values truncated to two decimal places.
Figure 10. Confusion matrix to evaluate NN1. The Y-axis represents the accurate classification assigned to the patterns (true label), while the X-axis indicates the classification given by the network (predicted label). The diagonal values show the correctly labeled patterns; the neural network classified them as the same pattern to which they belong. Table 2 shows the performance metrics of the multiclass classifier using macro-average, with values truncated to two decimal places.
Sensors 23 05352 g010
Table 2. Performance scores of N N 1 .
Table 2. Performance scores of N N 1 .
MetricsEvaluation
Precision0.95
Recall0.94
F10.95
Accuracy0.95
The precision [46] is the ratio shown in Equation (12).
P r e c i s i o n = t p t p + f p ,
where t p is the number of true positives, and f p is the number of false positives. The precision is intuitively the ability of the classifier not to label as positive a sample that is negative. The worst value is zero, and the best is one. The recall [46] is defined in Equation (13).
R e c a l l = t p t p + f n ,
where t p is the number of true positives, and f n is the number of false negatives. Recall is intuitively the ability of the classifier to find all the positive patterns.
The F 1 score is interpreted as a weighted average of precision and recall, where an F1 score reaches its best value at one and worst score at zero. The relative contribution of precision and recall to the F 1 score is equal. The formula for the F 1 score is shown in Equation (14).
F 1 = 2 × p r e c i s i o n × r e c a l l p r e c i s i o n + r e c a l l .
In the multiclass and multilabel case, this was the average of the F 1 score of each class with weighting depending on the average parameter.
Considering that some of the 18 base biaxial tilt patterns proposed can be infrequent in buildings, the classifier of base biaxial tilt patterns ( N N 1 ) is very recommendable since the performance scores were higher than 94%. Section 3 presents examples of tilt pattern classification on a small-scale physical model for laboratory tests.

2.6. Tilt Severity Classification

Each pattern (vector of eight angles) was labeled with an algorithm assigning the tilt severity according to Equation (15).
S = R e d u c e d   r i s k   0 < g 0.4 H i g h   r i s k   0.4 < g 0.8   S e r i o u s   r i s k   0.8 < g 1.2 C r i t i c a l   r i s k   1.2 < g 1.5 ,
g = g Y w   o r   g Z w | w = 0     3     p x ,
where S is the tilt severity, g represents a relative angle in any Y- or Z-axis for a wall (see Equation (6)), and p x is the set of base biaxial tilt patterns.
The eight tilt angles can frequently have similar magnitudes because each wall has a close relationship throughout the structure; this is considered in the training patterns. In this way, when the severity labeling algorithm detects an angle within p x |   x = 0 17 exceeding some limit of the four intervals presented in Equation (15), the severity pattern is labeled with the upper level.
Experimental work began with various topologies of a multilayer perceptron neural network to evaluate its performance as a classifier of the tilt severity or to consider other options. Figure 11 shows the selected topology with eight inputs ( g Y 0   , g z 0 , g Y 1   , g z 1 , g Y 2   , g z 2 , g Y 3   , g z 3 ); two hidden layers (100 and 98 neurons, respectively) and an output layer for the severity classification. A hyperbolic tangent function was used as the activation function ( γ m ), to process the outputs ( O m ). Table 3 shows how the neurons will be activated.
The first option for training the model to classify tilt severity used a single dataset from the 18 base biaxial tilt patterns; however, the differences in the complexities between the base patterns produced significant distortions. A model named parallel was implemented.

2.6.1. Parallel Recognition Model to Classify the Tilt Severity

This model was specialized for recognizing each base pattern severity. Figure 12 presents the schema of the parallel recognition model training. It was trained with 18 datasets, each one formed by the severity patterns of a single base pattern.
The network was trained with 18 datasets, as shown in Equation (16).
Δ p x = Δ p x j , | x = 0     17 ,
where Δ p x is a set with the number j of severity variations based on the pattern x.
Depending on its complexity, the number j must be different for each base pattern; more complex base patterns (different tilt angles on each wall) will have greater variations. The parallel recognition model training of Figure 12 allows such differences in the number of variations in tilt severity between base patterns without implications on possible training data imbalances. Figure 12a illustrates that severity samples for patterns 0–17 can generally be different. Depending on the complexity of the base pattern, 569–3884 samples were used for each training set (18 sets): 70% for training, 3% for validation, and 27% for testing.
Figure 12. Parallel recognition model training.
Figure 12. Parallel recognition model training.
Sensors 23 05352 g012
Figure 13 presents the base biaxial tilt pattern classifier and parallel recognition model implementation to classify the tilt severity. Figure 13a is the input of the four biaxial tilts, illustrated initially in Figure 8b. Figure 13b is the classifier of base biaxial tilt patterns of Figure 8c, which outputs a base pattern p x | x = 0 ,   1 ,   or   17 . This output allows the selection (Figure 13c) of the set T x | x = 0 ,   1 ,   or   17 with the weights and biases of the trained NN2 indicated in Figure 12c. Lastly, Figure 13d is the classifier of the tilt severity (see Figure 11), which has an output S i | i = 0 ,   1 ,   2 ,   or   4 , corresponding to reduced risk, high risk, serious risk, or critical risk, respectively.
Figure 14 presents the most representative confusion matrix generated by the parallel recognition model to classify the tilt severity. Table 4 shows its metrics. The tests were performed with the severity samples of each of the 18 base tilt patterns. The classifier metrics were between 0.94 and 0.98, depending on the complexity of the base tilt pattern. The specialization based on the training of each neural network is illustrated in Figure 12, and the implementation is shown in Figure 13. The performance was high, eliminating possible ambiguities between different patterns. The neural network was specialized to recognize the specific severity of each base pattern.

3. Results and Discussion

Figure 15 presents a small-scale physical model for laboratory tests. It was built to verify the distributed measurement system and the tilt pattern recognition in rectangular buildings. It comprised four separate pieces that simulated each of the walls.
Figure 16a shows the installation scheme of the IMUs. The sensors were located in the center, 1 m from the base, for the tests. Each wall had a mechanism based on screws at the corners of their respective bases, as shown in Figure 16b, to generate the base patterns and their corresponding severities. The digital inclinometer shown in Figure 16c permitted verifying that the distributed measurement system based on the IMUs correctly detected the angles generated in the prototype from an initial setting (initial reference). We emphasize that the model used angles based on relative variables (deviation variables) concerning an initial inclination that could exist when the measurements and monitoring began; there could be zero or nonzero initial tilt in each of the four walls. This initial tilt information can be obtained by expert inspection before the real-time monitoring system begins to operate.
Figure 15. A small-scale physical model for laboratory tests in rectangular buildings.
Figure 15. A small-scale physical model for laboratory tests in rectangular buildings.
Sensors 23 05352 g015
Figure 16. (a) IMU installation schematics. (b) Screws for tilt simulation. (c) Digital inclinometer.
Figure 16. (a) IMU installation schematics. (b) Screws for tilt simulation. (c) Digital inclinometer.
Sensors 23 05352 g016
Numerous laboratory tests in the small-scale physical model for rectangular buildings of Figure 15 were conducted to verify the base pattern classification and severity. Table 5 shows 96 examples of the base pattern classification and their variations. Inclination patterns in the prototype were calibrated using a digital inclinometer with two decimal places. The accuracy was 100% because the real patterns in the physical model had little distortions compared with the definitions of Figure 7. If there were failures to recognize some patterns highly distorted concerning the proposed base patterns, the measurement system returned the inclination angles in each of the eight axes. The patterns were produced in the physical model, considering the building as a single entity; the tilts in each wall had a close relationship throughout the structure. Distorted patterns are marked with asterisks, indicating the distortion for each axis.
Likewise, many tests were performed to classify the inclination severity level on the basis of the relationship presented in Equation (15) and Table 3. The NN2 model activated a neuron with a higher numerical value. Table 6 shows 30 examples of the most relevant results. Table A1 of Appendix B presents additional examples. Severities were configured in the physical model (prototype) with calibrated angles using the digital inclinometer with two decimal places. Of the 30 tests performed, one was misclassified as reduced (number 12) since its severity was close to high according to Equation (15). The small-scale physical model in rectangular buildings allowed experimenting with very different tilts between the walls; that is, while one wall had a more significant inclination, another had an angle close to 0°, which can be infrequent in real buildings. In the future, this behavior could improve the definition of severities by evaluating the non-inclusion of some mathematically subtle differences.
There are more closely related studies for building monitoring. Acceleration response functions were presented in [6], which is one of the most popular options in the structural health monitoring field. However, tilt patterns and their severity were not recognized. A design and validation of a scalable and reconfigurable interesting structural health monitoring system [5] was based on triaxial accelerometers in microelectromechanical systems. It computes the frequency response functions for the subsequent modal analysis based on efficient hardware and graphical programming environment, albeit not inexpensively. Likewise, that work did not consider biaxial tilt patterns, their severity, and their evolution in real time.
Another extensive and detailed study introduced a convolutional neural network that exploits a form of measured compressed response data through transfer learning-based techniques [32]. Although damage patterns were presented, tilt patterns and their severity were not established, which is requested in urban areas with differential soil settlements. In [47,48], MEMS technology accelerometers were used to monitor inclination, the data were transmitted wirelessly, and the tilts of two axes were analyzed; however, in both works, patterns were not classified, and tilt severity was not determined.
In [25], tilts were monitored with MEMS accelerometers in real time, and a user interface was created; six sensors were installed on the structure body to monitor three axes, but tilt patterns were not recognized, and their severity was not calculated. In some projects, real-time monitoring was carried out [18,25]; however, alarms were only included in [3]. In [49], a system with accelerometers and inclinometers for structural health monitoring was presented but not based on permanent supervision.
In this work, permanent monitoring allowed information processing for tilt angle visualization in real time. A user interface is presented in Figure A3a as an example. In addition, the software allows observing the sensor status, the timestamp of the recorded phenomena, and the tilt severity levels. When the system detects an inclination pattern, the machine learning models define the activation of emerging alarms; for example, Figure A3b provides the most relevant information on the detected pattern and its severity.

4. Conclusions

A wireless real-time computational system was developed using a distributed architecture and a TCP/IP server client, with inertial sensors to measure and analyze biaxial tilt signals in rectangular buildings. This work effectively combined a set of tools for treating inertial measurements, and a new algorithm of successive numeric repetitions was developed with successful results. It can be used in various applications to improve the quality of digital signals acquired and avoid false alarms due to the presence of unwanted oscillations.
The neural models allowed recognition of the biaxial tilt patterns and their severity in four walls. The classifiers were verified with a small-scale physical model for laboratory tests in rectangular buildings; their good performances were documented in the paper. Recognition metrics were above 95%. The system could be applied successfully since the recognition errors occurred for very infrequent patterns in real buildings. A parallel tilt severity training and recognition model was developed on the basis of specialization for each base pattern, depending on its complexity.
As the building tilt progress can occur over months or years or when an earthquake happens, the method’s feasibility must be verified first on a small-scale physical model for laboratory tests. An immediate goal for this work will be its application to real vulnerable buildings and an improvement the system based on fieldwork. Furthermore, using a more significant number of sensors for each wall, fully supported by the hardware and software, would allow for classifying other forms of inclination and deformation. This is an open research and development field where multidisciplinary researchers and engineers can contribute and enrich the scientific and technological state of the art. Machine learning tools can be integrated with low-cost wireless technology and frequently used software.
For the necessary continuous improvements of building biaxial tilt assessment models, multiclass receiver operating characteristic (ROC curves) and their respective area under the curve (AUC) may be presented over a range of thresholds, differentiating the performance from random guessing, i.e., one-vs.-rest multiclass ROC. This could help to optimize the detection algorithm to achieve the highest level of accuracy in detecting damage while minimizing false positives.

Author Contributions

Conceptualization, methodology, investigation, supervision, validation, funding acquisition, project administration, and writing—review and editing, L.P.S.-F.; conceptualization, methodology, investigation, supervision, validation, and writing—review and editing, L.A.S.-P.; formal analysis, validation, and visualization, J.J.C.-H.; formal analysis, validation, software, and visualization, M.A.H.-G.; conceptualization, investigation, resources, and validation, L.P.-E. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Instituto Politécnico Nacional of Mexico (SIP 20220452) and the Mexican Council of Science and Technology (CONACYT 222424).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

The authors thank the Instituto Politécnico Nacional, Mexico and the Mexican Council of Science and Technology (CONACYT) for their financial support of this project.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Figure A1 presents an example of a building in Mexico City with a tilt greater than 1° that is under supervision; its inclination is visually appreciated compared to the adjacent building that does not have a relevant tilt. Figure A2 shows the palace of fine Arts in Mexico City, which has presented differential subsidence (settlement) with associated inclinations for years.
Figure A1. Clinic Prensa, which is a leaning building and is under supervision.
Figure A1. Clinic Prensa, which is a leaning building and is under supervision.
Sensors 23 05352 g0a1
Figure A2. The Palace of Fine Arts in Mexico City.
Figure A2. The Palace of Fine Arts in Mexico City.
Sensors 23 05352 g0a2
Figure A3a presents an example of the interface for permanent monitoring. It allows information processing to visualize the angles in real time, the time at which the event occurred, the detected tilt pattern, and its severity. When the system detects a pattern, the machine learning models define the activation of emerging alarms; for example, Figure A3b provides the most relevant information.
Figure A3. (a) The main screen of the user interface. (b) A pop-up alarm screen.
Figure A3. (a) The main screen of the user interface. (b) A pop-up alarm screen.
Sensors 23 05352 g0a3

Appendix B

Table A1 presents additional examples of tilt severity classification. Two of the 50 tests were misclassified (numbers 22 and 41). These are excellent results considering the mathematically subtle differences, which can be infrequent in real buildings.
Table A1. Additional examples of tilt severity classification tests on the physical model at laboratory scale of Figure 15. Accuracy = 96%. * misclassified.
Table A1. Additional examples of tilt severity classification tests on the physical model at laboratory scale of Figure 15. Accuracy = 96%. * misclassified.
TestDetected Angles by the Computer ModelPhysical Model’s Real SeverityClassified Severity
Y0Z0Y1Z1Y2Z2Y3Z3
1−0.70−0.90−0.80.1−0.80SeriousSerious
21−0.20.80.10.9−0.10.90SeriousSerious
30−0.7−0.2−10−0.80−0.9SeriousSerious
4−0.9−0.8−0.2−0.90.3−0.9−0.5−0.9SeriousSerious
50.10−0.20.20000ReducedReduced
60.20−0.10.20000ReducedReduced
700000−0.800.4HighHigh
80.40.500000.60.3HighHigh
90.50.600000.40.5HighHigh
10000.20.30.100.30.4ReducedReduced
11000.10.20.100.20.3ReducedReduced
120.8−0.7−0.60.7−0.40.5−0.30.5SeriousSerious
130.7−0.6−0.50.6−0.30.4−0.30.5SeriousSerious
1400−0.1−0.30000ReducedReduced
1500000−0.200ReducedReduced
16000.100−0.200ReducedReduced
170.60.100000.60.1HighHigh
180.10.500000.10.5HighHigh
190.10.500000.10.5HighHigh
200.1−0.500000.1−0.5HighHigh
21−0.50.10000−0.50.1HighHigh
22000.40.2000.20.5High *Reduced *
2300−0.80.200−0.20.6HighHigh
240.70.2000.20.600HighHigh
25−0.8−0.300−0.1−0.500HighHigh
26−0.10.70.1−0.8−0.70.60.6−0.6HighHigh
27−0.10.60.1−0.7−0.60.50.5−0.5HighHigh
28−0.20.50.2−0.6−0.50.40.4−0.4HighHigh
2900−10.20000SeriousSerious
300.90.1000000SeriousSerious
31−0.9−0.1000000SeriousSerious
32−1.50.1000000CriticalCritical
33001.5−0.10000CriticalCritical
340000−1.50.100CriticalCritical
350000000.11.5CriticalCritical
3600000.1−0.900SeriousSerious
3700.300.400.200.1ReducedReduced
380100.900.900.1SeriousSerious
39−0.700.200000HighHigh
400.20−0.700000HighHigh
410−0.10−0.10.1−0.20.1−0.9Serious *High *
4200000−0.200.8HighHigh
43001.20.11.30.100CriticalCritical
44−0.3−0.10000−1.1−0.1SeriousSerious
45−0.1−0.30.20.30.20.1−0.3−0.5HighHigh
46000.5−0.10000HighHigh
470000−0.11.400CriticalCritical
480000000−0.5HighHigh
490.10.800.50.10.6−0.10.5SeriousSerious
50−1.3−1.11.10.91.11.0−1.3−1.1CriticalCritical

References

  1. Mayoral, J.M.; Tepalcapa, S.; Roman-de la Sancha, A.; El Mohtar, C.S.; Rivas, R. Ground Subsidence and Its Implication on Building Seismic Performance. Soil Dyn. Earthq. Eng. 2019, 126, 105766. [Google Scholar] [CrossRef]
  2. Ozer, E.; Feng, M.Q. Structural Health Monitoring. In Start-Up Creation; Woodhead Publishing: Sawston, UK, 2020; pp. 345–367. [Google Scholar] [CrossRef]
  3. Turrisi, S.; Cigada, A.; Zappa, E. A Cointegration-Based Approach for Automatic Anomalies Detection in Large-Scale Structures. Mech. Syst. Signal Process. 2022, 166, 108483. [Google Scholar] [CrossRef]
  4. Helmer-Smith, H.; Vlachopoulos, N.; Dagenais, M.A.; Forbes, B. Comparison of Multiple Monitoring Techniques for the Testing of a Scale Model Timber Warren Truss. Facets 2021, 6, 1510–1533. [Google Scholar] [CrossRef]
  5. Villacorta, J.J.; Del-Val, L.; Martínez, R.D.; Balmori, J.A.; Magdaleno, Á.; López, G.; Izquierdo, A.; Lorenzana, A.; Basterra, L.A. Design and Validation of a Scalable, Reconfigurable and Low-Cost Structural Health Monitoring System. Sensors 2021, 21, 648. [Google Scholar] [CrossRef]
  6. Magdaleno, A.; Villacorta, J.J.; Del-Val, L.; Izquierdo, A.; Lorenzana, A. Measurement of Acceleration Response Functions with Scalable Low-Cost Devices. An Application to the Experimental Modal Analysis. Sensors 2021, 21, 6637. [Google Scholar] [CrossRef] [PubMed]
  7. Gómez-Martínez, F.; Millen, M.D.L.; Alves Costa, P.; Romão, X. Estimation of the Potential Relevance of Differential Settlements in Earthquake-Induced Liquefaction Damage Assessment. Eng. Struct. 2020, 211, 110232. [Google Scholar] [CrossRef]
  8. Wang, S.; Fu, J.; Zhang, C.; Yang, J. Ground Deformation and Its Effects on the Environment. In Shield Tunnel Engineering: From Theory to Practice; Elsevier: Amsterdam, The Netherlands, 2021; pp. 523–580. [Google Scholar] [CrossRef]
  9. Differential Settlements—Causes, Methods of Prevention and Remediation. Available online: https://www.geotech.hr/en/differential-settlements/ (accessed on 6 May 2022).
  10. Sivasuriyan, A.; Vijayan, D.S.; Górski, W.; Wodzyń, Ł.; Vaverková, M.D.; Koda, E. Practical Implementation of Structural Health Monitoring in Multi-Story Buildings. Building 2021, 11, 263. [Google Scholar] [CrossRef]
  11. Pallarés, F.J.; Betti, M.; Bartoli, G.; Pallarés, L. Structural Health Monitoring (SHM) and Nondestructive Testing (NDT) of Slender Masonry Structures: A Practical Review. Constr. Build. Mater. 2021, 297, 123768. [Google Scholar] [CrossRef]
  12. Gopinath, V.K.; Ramadoss, R. Review on Structural Health Monitoring for Restoration of Heritage Buildings. Mater. Today Proc. 2020, 43, 1534–1538. [Google Scholar] [CrossRef]
  13. Zini, G.; Betti, M.; Bartoli, G. A Pilot Project for the Long-Term Structural Health Monitoring of Historic City Gates. J. Civ. Struct. Health Monit. 2022, 12, 537–556. [Google Scholar] [CrossRef]
  14. Farrar, C.R.; Worden, K. An Introduction to Structural Health Monitoring. In New Trends in Vibration Based Structural Health Monitoring; Springer: Berlin/Heidelberg, Germany, 2010; Volume 520, pp. 1–17. [Google Scholar] [CrossRef]
  15. Entezami, A. An Introduction to Structural Health Monitoring. In Structural Health Monitoring by Time Series Analysis and Statistical Distance Measures; SpringerBriefs in Applied Sciences and Technology; Springer: Berlin/Heidelberg, Germany, 2021; pp. 1–15. [Google Scholar] [CrossRef]
  16. Entezami, A. Structural Health Monitoring by Time Series Analysis and Statistical Distance Measures; Springer: Berlin/Heidelberg, Germany, 2021; ISBN 9783030662585. [Google Scholar]
  17. Xu, J.; Yan, C.; Su, Y.; Liu, Y. Analysis of High-Rise Building Safety Detection Methods Based on Big Data and Artificial Intelligence. Int. J. Distrib. Sens. Netw. 2020, 16, 15501477209. [Google Scholar] [CrossRef]
  18. Naticchia, B.; Vaccarini, M.; Carbonari, A.; Scorrano, P. Auto-Regressive Compensation Technique for a Reliable Non Invasive Structural Health Monitoring System. In Proceedings of the 28th International Symposium on Automation and Robotics in Construction (ISARC 2011), Seoul, Republic of Korea, 29 June–2 July 2011. [Google Scholar]
  19. Azzara, R.M.; Girardi, M.; Iafolla, V.; Padovani, C.; Pellegrini, D. Long-Term Dynamic Monitoring of Medieval Masonry Towers. Front. Built Environ. 2020, 6, 9. [Google Scholar] [CrossRef]
  20. Faulkner, K.; Brownjohn, J.M.W.; Wang, Y.; Huseynov, F. Tracking Bridge Tilt Behaviour Using Sensor Fusion Techniques. J. Civ. Struct. Health Monit. 2020, 10, 543–555. [Google Scholar] [CrossRef]
  21. Lamonaca, F.; Aggelis, D.G.; Lawal, O.; Najafi, A.; Hoang, T.; Althaf, S.; Shajihan, V.; Mechitov, K.; Spencer, B.F. Development and Validation of a Framework for Smart Wireless Strain and Acceleration Sensing. Sensors 2022, 22, 1998. [Google Scholar] [CrossRef]
  22. Juan Carbajal-Hernández, J.; Sánchez-Fernández, L.P.; Hernández-Bautista, I.; Medel-Juárez, J.D.J.; Sánchez-Pérez, L.A. Classification of Unbalance and Misalignment in Induction Motors Using Orbital Analysis and Associative Memories. Neurocomputing 2016, 175, 838–850. [Google Scholar] [CrossRef]
  23. Legaria-Santiago, V.K.; Sánchez-Fernández, L.P.; Sánchez-Pérez, L.A.; Garza-Rodríguez, A. Computer Models Evaluating Hand Tremors in Parkinson’s Disease Patients. Comput. Biol. Med. 2022, 140, 105059. [Google Scholar] [CrossRef]
  24. Clementi, F.; Formisano, A.; Milani, G.; Ubertini, F. Structural Health Monitoring of Architectural Heritage: From the Past to the Future Advances. Int. J. Archit. Herit. 2021, 15, 1–4. [Google Scholar] [CrossRef]
  25. Dong, L.; Wang, H.; Wang, G.; Qiu, W. A Wireless Multifunctional Monitoring System of Tower Body Running State Based on MEMS Acceleration Sensor. In Proceedings of the International Symposium on Quality Electronic Design, ISQED, Santa Clara, CA, USA, 13–14 March 2018; pp. 357–363. [Google Scholar]
  26. Dias, C.F.; de Oliveira, J.R.; de Mendonça, L.D.; de Almeida, L.M.; de Lima, E.R.; Wanner, L. An IoT-Based System for Monitoring the Health of Guyed Towers in Overhead Power Lines. Sensors 2021, 21, 6173. [Google Scholar] [CrossRef]
  27. Zhou, D.; Yu, Y.; Wang, J.; Li, Z. Design and Validation of a Fast Wireless Low-Frequency Vibration Inspection System for Offshore Platform Structures. J. Low Freq. Noise Vib. Act. Control 2020, 39, 720–728. [Google Scholar] [CrossRef] [Green Version]
  28. Yin, R.C.; Wu, Y.M.; Hsu, T.Y. Application of the Low-Cost MEMS-Type Seismometer for Structural Health Monitoring: A Pre-Study. In Proceedings of the 2016 IEEE International Instrumentation and Measurement Technology Conference, Taipei, Taiwan, 23–26 May 2016; pp. 1–5. [Google Scholar] [CrossRef]
  29. Hsu, T.Y.; Yin, R.C.; Wu, Y.M. Evaluating Post-Earthquake Building Safety Using Economical MEMS Seismometers. Sensors 2018, 18, 1437. [Google Scholar] [CrossRef] [Green Version]
  30. Freddi, F.; Galasso, C.; Cremen, G.; Dall’Asta, A.; Di Sarno, L.; Giaralis, A.; Gutiérrez-Urzúa, F.; Málaga-Chuquitaype, C.; Mitoulis, S.A.; Petrone, C.; et al. Innovations in Earthquake Risk Reduction for Resilience: Recent Advances and Challenges. Int. J. Disaster Risk Reduct. 2021, 60, 102267. [Google Scholar] [CrossRef]
  31. Sarmadi, H.; Yuen, K.V. Early Damage Detection by an Innovative Unsupervised Learning Method Based on Kernel Null Space and Peak-over-Threshold. Comput. Civ. Infrastruct. Eng. 2021, 36, 1150–1167. [Google Scholar] [CrossRef]
  32. Azimi, M.; Pekcan, G. Structural Health Monitoring Using Extremely Compressed Data through Deep Learning. Comput. Civ. Infrastruct. Eng. 2020, 35, 597–614. [Google Scholar] [CrossRef]
  33. Ni, F.T.; Zhang, J.; Noori, M.N. Deep Learning for Data Anomaly Detection and Data Compression of a Long-Span Suspension Bridge. Comput. Civ. Infrastruct. Eng. 2020, 35, 685–700. [Google Scholar] [CrossRef]
  34. Hannan, M.A.; Hassan, K.; Jern, K.P. A Review on Sensors and Systems in Structural Health Monitoring: Current Issues and Challenges. Smart Struct. Syst. 2018, 22, 509–525. [Google Scholar] [CrossRef]
  35. Girolami, A.; Brunelli, D.; Benini, L. Low-Cost and Distributed Health Monitoring System for Critical Buildings. In Proceedings of the 2017 IEEE Workshop on Environmental, Energy, and Structural Monitoring Systems (EESMS), Milan, Italy, 24–25 July 2017. [Google Scholar] [CrossRef] [Green Version]
  36. Abdulkarem, M.; Samsudin, K.; Rokhani, F.Z.; Rasid, M.F.A. Wireless Sensor Network for Structural Health Monitoring: A Contemporary Review of Technologies, Challenges, and Future Direction. Struct. Health Monit. 2019, 19, 693–735. [Google Scholar] [CrossRef]
  37. Salkhordeh, M.; Mirtaheri, M.; Rabiee, N.; Govahi, E.; Soroushian, S. A Rapid Machine Learning-Based Damage Detection Technique for Detecting Local Damages in Reinforced Concrete Bridges. J. Earthq. Eng. 2023, 1, 1363–2469. [Google Scholar] [CrossRef]
  38. Iannelli, P.; Angeletti, F.; Gasbarri, P.; Panella, M.; Rosato, A. Deep Learning-Based Structural Health Monitoring for Damage Detection on a Large Space Antenna. Acta Astronaut. 2022, 193, 635–643. [Google Scholar] [CrossRef]
  39. Angeletti, F.; Iannelli, P.; Gasbarri, P.; Panella, M.; Rosato, A. A Study on Structural Health Monitoring of a Large Space Antenna via Distributed Sensors and Deep Learning. Sensors 2022, 23, 368. [Google Scholar] [CrossRef]
  40. Hamilton, W.R. XXII. On Quaternions; or on a New System of Imaginaries in Algebra. Lond. Edinb. Dublin Philos. Mag. J. Sci. 1846, 29, 113–122. [Google Scholar] [CrossRef] [Green Version]
  41. Madgwick, S. An Efficient Orientation Filter for Inertial and Inertial/Magnetic Sensor Arrays. Report x-Io and University of Bristol (UK). Available online: https://forums.parallax.com/uploads/attachments/41167/106661.pdf (accessed on 10 April 2023).
  42. Architectural Tilts: 13 Leaning Wonders of the Built World | Urbanist. Available online: https://weburbanist.com/2011/11/18/13-tilted-architectural-wonders-of-the-world/ (accessed on 6 May 2022).
  43. Arnal Simón, L.; Betancourt Suárez, M. 3. Verificación de La Seguridad de Las Cimentaciones. In Reglamento de Construcciones para el Distrito Federal; Trillas: México City, Mexico, 2019; p. 1931. ISBN 978-607-17-3580-5. [Google Scholar]
  44. Bergstra, J.; Yoshua, B. Random Search for Hyper-Parameter Optimization. J. Mach. Learn. Res. 2012, 13, 281–305. [Google Scholar] [CrossRef]
  45. Kunang, Y.N.; Nurmaini, S.; Stiawan, D.; Suprapto, B.Y. Attack Classification of an Intrusion Detection System Using Deep Learning and Hyperparameter Optimization. J. Inf. Secur. Appl. 2021, 58, 102804. [Google Scholar] [CrossRef]
  46. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-Learn: Machine Learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar] [CrossRef]
  47. Samuels, J.M.; Reyer, M.; Hurlebaus, S.; Lucy, S.H.; Woodcock, D.G.; Bracci, J.M. Wireless Sensor Network to Monitor an Historic Structure under Rehabilitation. J. Civ. Struct. Health Monit. 2011, 1, 69–78. [Google Scholar] [CrossRef]
  48. Samuels, J.M.; Reyer, M.; Hurlebaus, S.; Lucy, S.H.; Woodcock, D.G.; Ozbulut, O.E. Monitoring of the St. Paul Lutheran Church Using a Wireless Sensor Network (WSN) during Foundation Stabilization. Int. J. Archit. Herit. 2013, 7, 68–88. [Google Scholar] [CrossRef]
  49. Konovalov, S.; Mayorov, D.; Ponomarev, Y.; Soloveva, T. High-Precision Smart System on Accelerometers and Inclinometers for Structural Health Monitoring: Development and Applications. In Proceedings of the 2018 12th France-Japan and 10th Europe-Asia Congress on Mechatronics, Tsu, Japan, 10–12 September 2018; pp. 52–57. [Google Scholar] [CrossRef]
Figure 2. An orientation of frame B relative to frame A can be attained through a rotation of the angle θ around an axis A r ^ defined in frame A.
Figure 2. An orientation of frame B relative to frame A can be attained through a rotation of the angle θ around an axis A r ^ defined in frame A.
Sensors 23 05352 g002
Figure 3. Quaternion rotation method to obtain gravity acceleration.
Figure 3. Quaternion rotation method to obtain gravity acceleration.
Sensors 23 05352 g003
Figure 5. (a) Reference system for the sensors. (b) Example of pattern 0. (c) Angle rotation.
Figure 5. (a) Reference system for the sensors. (b) Example of pattern 0. (c) Angle rotation.
Sensors 23 05352 g005
Figure 8. General diagram of the classification model. (a,b) Show the four sensors and the four biaxial tilts, respectively. (c) The classifier of base patterns. (d) The computer model for the pattern severity classification.
Figure 8. General diagram of the classification model. (a,b) Show the four sensors and the four biaxial tilts, respectively. (c) The classifier of base patterns. (d) The computer model for the pattern severity classification.
Sensors 23 05352 g008
Figure 9. General schema of the classifier of base biaxial tilt patterns ( N N 1 ).
Figure 9. General schema of the classifier of base biaxial tilt patterns ( N N 1 ).
Sensors 23 05352 g009
Figure 11. Multilayer perceptron neural network (NN2) topology to classify biaxial tilt severity.
Figure 11. Multilayer perceptron neural network (NN2) topology to classify biaxial tilt severity.
Sensors 23 05352 g011
Figure 13. The classifier of the base biaxial tilt pattern and parallel recognition model implementation to classify the tilt severity. (a) The input of the four biaxial tilts, illustrated initially in Figure 8b. (b) The classifier of base biaxial tilt patterns of Figure 8c. (c) This output allows the choice of a set of weights and biases (see Figure 12c). (d) The classifier of the tilt severity (see Figure 11).
Figure 13. The classifier of the base biaxial tilt pattern and parallel recognition model implementation to classify the tilt severity. (a) The input of the four biaxial tilts, illustrated initially in Figure 8b. (b) The classifier of base biaxial tilt patterns of Figure 8c. (c) This output allows the choice of a set of weights and biases (see Figure 12c). (d) The classifier of the tilt severity (see Figure 11).
Sensors 23 05352 g013
Figure 14. Most representative confusion matrix of NN2.
Figure 14. Most representative confusion matrix of NN2.
Sensors 23 05352 g014
Table 1. Examples of tilt angles of patterns 0–3.
Table 1. Examples of tilt angles of patterns 0–3.
IMU 0 (Wall 0)IMU 1 (Wall 1)IMU 2 (Wall 1)IMU 3 (Wall 3)
Pattern 0
Delta   Y   ( g Y ) 0.10.10.10.1
Delta   Z   ( g Z ) 0000
Pattern 1
Delta   Y   ( g Y ) −0.1−0.1−0.1−0.1
Delta   Z   ( g Z ) 0000
Pattern 2
Delta   Y   ( g Y ) 0.10.10.10.1
Delta   Z   ( g Z ) 0.10.10.10.1
Pattern 2
Delta   Y   ( g Y ) 0.10.10.10.1
Delta   Z   ( g Z ) −0.1−0.1−0.1−0.1
Pattern 3
Delta   Y   ( g Y ) −0.1−0.1−0.1−0.1
Delta   Z   ( g Z ) 0.10.10.10.1
Pattern 3
Delta   Y   ( g Y ) −0.1−0.1−0.1−0.1
Delta   Z   ( g Z ) −0.1−0.1−0.10.1
Table 3. Relationship between the neural network outputs and the severity level.
Table 3. Relationship between the neural network outputs and the severity level.
Activated NeuronsSeverity
1 0 0 0Reduced risk
0 1 0 0High risk
0 0 1 0Serious risk
0 0 0 1Critical risk
Table 4. Performance scores of NN2.
Table 4. Performance scores of NN2.
MetricsEvaluation
Precision0.96
Recall0.96
F10.96
Accuracy0.96
Table 5. Examples of base tilt pattern classification on the small-scale physical model of Figure 15 (base pattern and its variations). Distorted patterns are marked with asterisks indicating the distortion for each axis. Accuracy = 100%.
Table 5. Examples of base tilt pattern classification on the small-scale physical model of Figure 15 (base pattern and its variations). Distorted patterns are marked with asterisks indicating the distortion for each axis. Accuracy = 100%.
TestDetected Angles by the Computer ModelPhysical Model’s Real PatternClassified Pattern
Y0Z0Y1Z1Y2Z2Y3Z3
1  0.200.200.200.2000
2  0.900.900.900.9000
3  100.600.400.7000
4  10.1 *0.60.1 *0.400.7000
5  1−0.1 *0.60.1 *0.400.7000
6  −0.20−0.20−0.20−0.2011
7  −0.90−0.90−0.90−0.9011
8  −10−0.60−0.40−0.7011
9  −10.1 *−0.60−0.40.1 *−0.7011
10  −1−0.1 *−0.60−0.40.1 *−0.7011
11  0.20.20.20.20.20.20.20.222
12  0.90.60.90.60.90.60.90.622
13  10.50.60.70.410.70.822
14  0.20.20.20.20.20.20.20.222
15  0.80.60.60.50.40.30.40.422
16  0.9−0.60.9−0.60.9−0.60.9−0.622
17  1−0.50.6−0.70.4−10.7−0.822
18  10.5 *0.6−0.70.4−10.7−0.822
19  −0.2−0.2−0.2−0.2−0.2−0.2−0.2−0.233
20  −0.9−0.6−0.9−0.6−0.9−0.6−0.9−0.633
21  −1−0.5−0.6−0.7−0.4−1−0.7−0.833
22  −0.20.2−0.20.2−0.20.2−0.20.233
23  −0.90.6−0.90.6−0.90.6−0.90.633
24  −10.5−0.60.7−0.41−0.70.833
25  −1−0.5 *−0.60.7−0.41−0.70.833
26  −0.8−0.1 *−0.70.7−0.610.2 *0.833
27  −0.100.10000044
28  −0.800.70000044
29  −1.5010000044
30  −1.50100.1 *00.1 *044
31  −1.50.1 *100.1 *00.1 *044
32  0.50−0.50000055
33  1.50−10000055
34  1.50.1 *−10.2 *000055
35  0.60.2 *−0.90.1 *000055
36  0.50.1 *−1.30.1 *000055
37  000000.50−0.566
38  000000.20−0.766
39  00000.1 *0.80−0.366
40  00000.2 *0.80−0.366
41  00000.1 *0.80.2 *−0.666
42  00000−0.500.577
43  00000−0.200.777
44  00000.1 *−0.900.477
45  00000.2 *−1.501.277
46  0−0.1 *00.2 *0−10177
47  000.40.40.40.40088
48  000.4000.80088
49  000.410.410088
50  000.410.40.70088
51  0.1 *0.2 *0.410.40.70088
52  −0.6−0.60000−0.6−0.699
53  −0.6−10000−0.4−199
54  −0.6−0.8−0.1 *−0.2 *00−0.4−0.799
55  −0.6−0.80.1 *−0.2 *00−0.4−0.799
56  −1.5−1.50000−1.5−1.599
57  −0.90.900−0.90.9001010
58  −0.50.600−0.40.5001010
59  −1.30.300−1.40.2001010
60  −0.80.70.1 *0−0.71.50.2 *01010
61  −0.70.90.1 *0−0.51.50.1 *0.2 *1010
62  000.7−0.7000.7−0.71111
63  001.3−0.7001.5−0.91111
64  000.4−1.2000.9−0.71111
65  0.2 *−0.1 *0.4−1.2000.9−0.71111
66  −0.1 *0.2 *0.4−1.2000.9−0.71111
67  −0.8−0.80.80.80.80.8−0.8−0.81212
68  −0.6−1.20.51.50.40.7−1.4−11212
69  −0.60.8 *0.51.50.40.7−1.4−11212
70  −0.61 *0.51.20.40.8−1.2−11212
71  −0.3−0.70.6−0.5 *−0.7 *0.30.3 *−0.61212
72  −0.90.90.9−0.9−0.90.90.9−0.91313
73  −0.80.20.4−0.6−0.30.90.4−1.31313
74  −110.7−0.7−0.10.10.9−0.91313
75  −1−0.5 *0.9−1.2−10.70.80.3 *1313
76  0.1 *−0.5 *0.9−1.2−10.70.8−0.61313
77  −0.900000001414
78  −0.9000−0.90−0.901414
79  −0.90.1 *00−0.90.1 *−0.90.1 *1414
80  −1−0.1 *00−0.8−0.2 *−0.7−0.1 *1414
81  −1.5−0.2 *00−10.3 *−1.3−0.2 *1414
82  000.9000001515
83  000.900.900.901515
84  000.900.90.1 *0.90.1 *1515
85  001−0.1 *0.8−0.2 *0.7−0.1 *1515
86  001.5−0.2 *−10.3 *−1.3−0.2 *1515
87  000000.8001616
88  00.900.800.9001616
89  0.2 *0.90.1 *0.80.1 *0.9001616
90  −0.2 *0.90.1 *0.9−0.1 *1001616
91  0.1 *10.2 *1.2−0.2 *1.4001616
92  0000000−1.31717
93  0−1.30−1.3000−1.31717
94  0.1 *−10.2 *−0.9000.1 *−0.71717
95  −0.1 *−1.5−0.2 *−1.400−0.2−1.21717
96  0.1 *−1.50.2 *−1.400−0.3 *−1.21717
Table 6. Tilt severity classification on a small-scale physical model for laboratory tests in rectangular buildings of Figure 15. Accuracy = 96%. * misclassified.
Table 6. Tilt severity classification on a small-scale physical model for laboratory tests in rectangular buildings of Figure 15. Accuracy = 96%. * misclassified.
TestDetected Angles by the Computer ModelPhysical Model’s Real SeverityClassified Severity
Y0Z0Y1Z1Y2Z2Y3Z3
1−0.80−10−0.90.1−0.80SeriousSerious
21−0.10.900.9−0.10.90SeriousSerious
30−0.8−0.1−10−10−0.9SeriousSerious
40.30−0.20.10000ReducedReduced
500000−0.800.3HighHigh
60.50.400000.30.6HighHigh
7000.30.20.100.40.3ReducedReduced
80.7−0.8−0.50.7−0.50.4−0.30.5SeriousSerious
900−0.3−0.10000ReducedReduced
1000000−0.300ReducedReduced
110.60.100000.50.1HighHigh
1200−0.50.200−0.10.4High *Reduced *
130.1−0.7−0.10.80.7−0.6−0.60.6HighHigh
1400−0.90.10000SeriousSerious
151.5−0.1000000CriticalCritical
1600000.1−0.900SeriousSerious
170.300.400.200.10ReducedReduced
180−1.10−0.90−0.90−0.1SeriousSerious
190.70−0.200000HighHigh
20−0.200.700000HighHigh
2100000−0.301SeriousSerious
22000000.20−0.8HighHigh
2300−1.2−0.1−1.3−0.100CriticalCritical
240.30.100001.10.1SeriousSerious
250.10.3−0.2−0.3−0.2−0.10.30.5HighHigh
2600−0.50.10000HighHigh
2700000.1−1.400CriticalCritical
2800000000.5HighHigh
29−0.1−0.80−0.5−0.1−0.60.1−0.5SeriousSerious
301.31.1−1.1−0.9−1.1−1.01.31.1CriticalCritical
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Sánchez-Fernández, L.P.; Sánchez-Pérez, L.A.; Carbajal-Hernández, J.J.; Hernández-Guerrero, M.A.; Pérez-Echazabal, L. Buildings’ Biaxial Tilt Assessment Using Inertial Wireless Sensors and a Parallel Training Model. Sensors 2023, 23, 5352. https://doi.org/10.3390/s23115352

AMA Style

Sánchez-Fernández LP, Sánchez-Pérez LA, Carbajal-Hernández JJ, Hernández-Guerrero MA, Pérez-Echazabal L. Buildings’ Biaxial Tilt Assessment Using Inertial Wireless Sensors and a Parallel Training Model. Sensors. 2023; 23(11):5352. https://doi.org/10.3390/s23115352

Chicago/Turabian Style

Sánchez-Fernández, Luis Pastor, Luis Alejandro Sánchez-Pérez, José Juan Carbajal-Hernández, Mario Alberto Hernández-Guerrero, and Lucrecia Pérez-Echazabal. 2023. "Buildings’ Biaxial Tilt Assessment Using Inertial Wireless Sensors and a Parallel Training Model" Sensors 23, no. 11: 5352. https://doi.org/10.3390/s23115352

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop