An Adaptive Importance Sampling Method Based on Improved MCMC Simulation for Structural Reliability Analysis
Abstract
1. Introduction
2. Theoretical Optimal Importance Sampling Density
3. Obtaining Failure Domain Distribution Samples via IMCMC
3.1. MCMC Simulation
3.2. Improved Proposal Distribution Function
- (1)
- Randomly generate a direction vector uniformly distributed on the n-dimensional unit sphere. This is achieved by first generating an n-dimensional independent standard normal sample , computing its norm , and then normalizing to obtain .
- (2)
- Given the current state in the sampling process, generate a uniformly distributed random number k within the interval: .
- (3)
- Compute the candidate state as .
3.3. Selection of Initial State Point for MCMC
- (1)
- Define the stationary distribution of the Markov chain from in Equation (2):
- (2)
- Using Latin Hypercube Sampling, identify a sample point within the failure domain to act as the initial state for MCMC.
- (3)
- From the current Markov chain state , generate a candidate state via the proposal distribution function from Equation (5). Compute the stationary distribution function values and for and , respectively, and determine their ratio r:
- (4)
- Following the Metropolis–Hastings criterion [33], as in Equation (8), accept the candidate state as the next state with probability min(1, r), and retain the current state with probability 1 − min(1, r).In Equation (8), is a uniform random number on [0, 1].
- (5)
- Iterate steps (3) to (4) M times to yield a set of M samples within the failure domain that adhere to the optimal distribution .
4. Constructing the Importance Sampling Density via KDE
- (1)
- Based on the failure domain distribution samples , calculate the bandwidth w using Equation (11).
- (2)
- Based on the failure domain distribution samples , calculate the local bandwidth factor for each sample using Equation (14).
- (3)
- Substitute the failure domain samples , bandwidth w, and local bandwidth factors into Equation (12) to establish the corresponding probability density function .
5. Numerical Example Analysis
5.1. Two-Dimensional Example
5.2. Analysis of Parameter l Value
5.3. High-Dimensional Example
6. Conclusions
- (1)
- Based on the morphological features of the theoretical optimal importance sampling density in standard normal space, an n-dimensional annular uniform distribution function is proposed as the proposal distribution in MCMC simulation, enabling efficient sampling in discontinuous failure domains.
- (2)
- Using collected complex failure domain samples, KDE with a local bandwidth factor effectively constructs an importance sampling density that approximates the theoretical optimum.
- (3)
- Comparisons with other methods confirm that the proposed approach offers good accuracy and efficiency for the reliability analysis of complex and high-dimensional performance functions.
7. Discussion
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Melchers, R.E.; Beck, A.T. Structural Reliability Analysis and Prediction; John Wiley & Sons: Hoboken, NJ, USA, 2018. [Google Scholar]
- Rubinstein, R.Y.; Kroese, D.P. Simulation and the Monte Carlo Method; John Wiley & Sons: Hoboken, NJ, USA, 2016. [Google Scholar]
- Madsen, H.O.; Krenk, S.; Lind, N.C. Methods of Structural Safety; Courier Corporation: North Chelmsford, MA, USA, 2006. [Google Scholar]
- Rackwitz, R. Reliability analysis—A review and some perspectives. Struct. Saf. 2001, 23, 365–395. [Google Scholar] [CrossRef]
- Au, S.K.; Beck, J.L. A new adaptive importance sampling scheme for reliability calculations. Struct. Saf. 1999, 21, 135–158. [Google Scholar] [CrossRef]
- Au, S.K.; Beck, J.L. Subset simulation and its application to seismic risk based on dynamic analysis. J. Eng. Mech. 2003, 129, 901–917. [Google Scholar] [CrossRef]
- Del Moral, P.; Doucet, A.; Jasra, A. Sequential monte carlo samplers. J. R. Stat. Soc. Ser. B Stat. Methodol. 2006, 68, 411–436. [Google Scholar] [CrossRef]
- Echard, B.; Gayton, N.; Lemaire, M. AK-MCS: An active learning reliability method combining Kriging and Monte Carlo simulation. Struct. Saf. 2011, 33, 145–154. [Google Scholar] [CrossRef]
- Dubourg, V.; Sudret, B.; Deheeger, F. Metamodel-based importance sampling for structural reliability analysis. Probabilistic Eng. Mech. 2013, 33, 47–57. [Google Scholar] [CrossRef]
- Hu, W.; Yan, J.; Zhao, F.; Jiang, C.; Liu, H.; Cho, H.; Lee, I. Surrogate-based time-dependent reliability analysis for a digital twin. J. Mech. Des. 2023, 145, 091708. [Google Scholar] [CrossRef]
- Andrieu, C.; De Freitas, N.; Doucet, A.; Jordan, M.I. An introduction to MCMC for machine learning. Mach. Learn. 2003, 50, 5–43. [Google Scholar] [CrossRef]
- Silverman, B.W. Density Estimation for Statistics and Data Analysis; Routledge: London, UK, 2018. [Google Scholar]
- Wu, D.; Ma, J. An effective EM algorithm for mixtures of Gaussian processes via the MCMC sampling and approximation. Neurocomputing 2019, 331, 366–374. [Google Scholar] [CrossRef]
- Kurtz, N.; Song, J. Cross-entropy-based adaptive importance sampling using Gaussian mixture. Struct. Saf. 2013, 42, 35–44. [Google Scholar] [CrossRef]
- Yang, X.; Cheng, X.; Wang, T.; Mi, C. System reliability analysis with small failure probability based on active learning Kriging model and multimodal adaptive importance sampling. Struct. Multidiscip. Optim. 2020, 62, 581–596. [Google Scholar] [CrossRef]
- Neal, R.M. MCMC using Hamiltonian dynamics. In Handbook of Markov Chain Monte Carlo; CRC Press: Boca Raton, FL, USA, 2011; Volume 2, p. 2. [Google Scholar]
- Haario, H.; Saksman, E.; Tamminen, J. An adaptive metropolis algorithm. Bernoulli 2001, 7, 223–242. [Google Scholar] [CrossRef]
- Geyer, C.J. Introduction to markov chain monte carlo. In Handbook of Markov Chain Monte Carlo; CRC Press: Boca Raton, FL, USA, 2011; Volume 20116022, p. 22. [Google Scholar]
- Robert, C.P.; Casella, G.; Casella, G. Monte Carlo Statistical Methods; Springer: Berlin/Heidelberg, Germany, 1999; Volume 2. [Google Scholar]
- Shen, L.; Zhang, Y.; Song, B.; Song, K. Reliability evaluation and importance analysis of structural systems considering dependence of multiple failure modes. Eng. Comput. 2022, 38, 1053–1070. [Google Scholar] [CrossRef]
- Zhang, Y.; Ma, J. Meta-model based sequential importance sampling method for structural reliability analysis under high dimensional small failure probability. Probabilistic Eng. Mech. 2024, 76, 103620. [Google Scholar] [CrossRef]
- Liu, P.L.; Der Kiureghian, A. Optimization algorithms for structural reliability. Struct. Saf. 1991, 9, 161–177. [Google Scholar] [CrossRef]
- Valdebenito, M.A.; Schuëller, G.I. A survey on approaches for reliability-based optimization. Struct. Multidiscip. Optim. 2010, 42, 645–663. [Google Scholar] [CrossRef]
- Kumar, A.; Sangeeta, P.; Ram, M. Complex system reliability analysis and optimization. In Advanced Mathematical Techniques in Science and Engineering; River Publishers: Gistrup, Denmark, 2022; pp. 185–199. [Google Scholar]
- Liu, X.; Li, D.Q.; Cao, Z.J.; Wang, Y. Adaptive Monte Carlo simulation method for system reliability analysis of slope stability based on limit equilibrium methods. Eng. Geol. 2020, 264, 105384. [Google Scholar] [CrossRef]
- Shayanfar, M.A.; Barkhordari, M.A.; Barkhori, M.; Barkhori, M. An adaptive directional importance sampling method for structural reliability analysis. Struct. Saf. 2018, 70, 14–20. [Google Scholar] [CrossRef]
- Liu, J.S.; Liu, J.S. Monte Carlo Strategies in Scientific Computing; Springer: Berlin/Heidelberg, Germany, 2001. [Google Scholar]
- Hurtado, J.E. Filtered importance sampling with support vector margin: A powerful method for structural reliability analysis. Struct. Saf. 2007, 29, 2–15. [Google Scholar] [CrossRef]
- Fauriat, W.; Gayton, N. AK-SYS: An adaptation of the AK-MCS method for system reliability. Reliab. Eng. Syst. Saf. 2014, 123, 137–144. [Google Scholar] [CrossRef]
- Cadini, F.; Santos, F.; Zio, E. An improved adaptive kriging-based importance technique for sampling multiple failure regions of low probability. Reliab. Eng. Syst. Saf. 2014, 131, 109–117. [Google Scholar] [CrossRef]
- Xiao, S.; Nowak, W. Reliability sensitivity analysis based on a two-stage Markov chain Monte Carlo simulation. Aerosp. Sci. Technol. 2022, 130, 107938. [Google Scholar] [CrossRef]
- Shields, M.D.; Zhang, J. The generalization of Latin hypercube sampling. Reliab. Eng. Syst. Saf. 2016, 148, 96–108. [Google Scholar] [CrossRef]
- Rosenthal, J.S. Optimal proposal distributions and adaptive MCMC. In Handbook of Markov Chain Monte Carlo; CRC Press: Boca Raton, FL, USA, 2011; Volume 4, pp. 93–111. [Google Scholar]
- Sheather, S.J. An improved data-based algorithm for choosing the window width when estimating the density at a point. Comput. Stat. Data Anal. 1986, 4, 61–65. [Google Scholar] [CrossRef]
Sample Count | |||
---|---|---|---|
IS | AIS | Proposed Method (IAIS) | |
200 | 0.00249 (0.216) | 0.00259 (0.098) | 0.00338 (0.142) |
500 | 0.00257 (0.175) | 0.00254 (0.072) | 0.00344 (0.085) |
1000 | 0.00248 (0.127) | 0.00252 (0.045) | 0.00348 (0.059) |
2000 | 0.00254 (0.100) | 0.00255 (0.032) | 0.00346 (0.036) |
5000 | 0.00252 (0.069) | 0.00254 (0.019) | 0.00348 (0.027) |
Case | M | l | |||
---|---|---|---|---|---|
1 | (0, 10) | 1000 | 1.0 | 3.51 | 0.045 |
2 | (0, 10) | 2000 | 0.79 | 3.52 | 0.044 |
3 | (0, 10) | 5000 | 0.58 | 3.46 | 0.041 |
4 | (0, 3) | 1000 | 0.3 | 3.48 | 0.044 |
5 | (0, 5) | 1000 | 0.5 | 3.47 | 0.046 |
6 | (0, 8) | 1000 | 0.8 | 3.48 | 0.046 |
n | M | l | by MCS | by IAIS | |
---|---|---|---|---|---|
3 | 3000 | 0.356 | (0.027) | ||
4 | 5000 | (1.67, 3.48, 0.53, 2.97) | 0.891 | (0.028) | |
5 | 8000 | (1.84, 2.53, 1.89, 2.60, 2.99) | 1.207 | (0.047) |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Zhang, Y.; Wang, C.; Hu, X. An Adaptive Importance Sampling Method Based on Improved MCMC Simulation for Structural Reliability Analysis. Appl. Sci. 2025, 15, 10438. https://doi.org/10.3390/app151910438
Zhang Y, Wang C, Hu X. An Adaptive Importance Sampling Method Based on Improved MCMC Simulation for Structural Reliability Analysis. Applied Sciences. 2025; 15(19):10438. https://doi.org/10.3390/app151910438
Chicago/Turabian StyleZhang, Yue, Changjiang Wang, and Xiewen Hu. 2025. "An Adaptive Importance Sampling Method Based on Improved MCMC Simulation for Structural Reliability Analysis" Applied Sciences 15, no. 19: 10438. https://doi.org/10.3390/app151910438
APA StyleZhang, Y., Wang, C., & Hu, X. (2025). An Adaptive Importance Sampling Method Based on Improved MCMC Simulation for Structural Reliability Analysis. Applied Sciences, 15(19), 10438. https://doi.org/10.3390/app151910438