Next Article in Journal
Constructing Co3O4/g-C3N4 Ultra-Thin Nanosheets with Z-Scheme Charge Transfer Pathway for Efficient Photocatalytic Water Splitting
Previous Article in Journal
Research Progress of Photo-/Electro-Driven Thermochromic Smart Windows
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Prediction and Inverse Design of Structural Colors of Nanoparticle Systems via Deep Neural Network

1
School of Energy and Power Engineering, Shandong University, Jinan 250061, China
2
Optics & Thermal Radiation Research Center, Institute of Frontier and Interdisciplinary Science, Shandong University, Qingdao 266237, China
*
Authors to whom correspondence should be addressed.
Nanomaterials 2021, 11(12), 3339; https://doi.org/10.3390/nano11123339
Submission received: 12 November 2021 / Revised: 5 December 2021 / Accepted: 6 December 2021 / Published: 8 December 2021

Abstract

:
Noniridescent and nonfading structural colors generated from metallic and dielectric nanoparticles with extraordinary optical properties hold great promise in applications such as image display, color printing, and information security. Yet, due to the strong wavelength dependence of optical constants and the radiation pattern, it is difficult and time-consuming to design nanoparticles with the desired hue, saturation, and brightness. Herein, we combined the Monte Carlo and Mie scattering simulations and a bidirectional neural network (BNN) to improve the design of gold nanoparticles’ structural colors. The optical simulations provided a dataset including color properties and geometric parameters of gold nanoparticle systems, while the BNN was proposed to accurately predict the structural colors of gold nanoparticle systems and inversely design the geometric parameters for the desired colors. Taking the human chromatic discrimination ability as a criterion, our proposed approach achieved a high accuracy of 99.83% on the predicted colors and 98.5% on the designed geometric parameters. This work provides a general method to accurately and efficiently design the structural colors of nanoparticle systems, which can be exploited in a variety of applications and contribute to the development of advanced optical materials.

1. Introduction

Color generation from the assembly of nanometer- or submicron-sized structures has been of great interest for various fields including chromatic displaying [1,2,3], color printing [4,5], and biomedical imaging [6]. By exploiting the light–matter interaction in the designed structures, the generated colors are superior to the traditional pigmentary colors in many ways, due to their large tunability, resistance to bleaching, and reduced dependence on toxic materials. Much recent research has demonstrated the use of ordered and disordered photonic structures to generate colors across the visible spectrum [7,8,9]. Periodically ordered photonic structures generate colors with the iridescent feature due to Bragg diffraction [10,11]. However, their colors are strongly dependent on the angle of view because of the periodic structure. In contrast, the structures consisting of metallic and dielectric nanoparticles can generate nonfading and noniridescent colors with high resolution, and have been most widely studied as a component to realize structural coloration [12,13,14,15,16,17].
The structural colors of nanoparticle systems depend on the material, size, shape, and volume fraction of nanoparticles, and the dielectric properties of the surrounding environment. Therefore, by adjusting the parameters as mentioned above, the corresponding spectra, either scattering, transmission, or reflection modified by nanoparticles, can be manipulated to obtain a variety of colors. However, the design of specific properties of nanoparticle systems is usually based on a trial-and-error method [18], which requires prior experiences and scientific intuitions but also a lot of time and labor costs. Many attempts have been made to improve the design efficiency via various optimization strategies such as using a particle swarm algorithm, topology optimization, and combining with GPU-acceleration [19,20,21]. However, traditional design and optimization methods are still facing challenges with the increasing complexity of system functionality and integration. Fortunately, machine learning methods based on artificial neural networks have emerged as a powerful tool in solving complex computation and inverse design problems. Machine learning is a statistics technology that trains a machine by telling it what to do, and has proven to be particularly good at solving the problems of classification and regression [22,23]. In the field of nanophotonics, machine learning has made great progress in many applications such as pattern recognition, optical imaging, and structure design [24,25,26,27]. Most recently, machine learning techniques have been utilized to inversely design the structure and material to achieve the desired optical and color properties [28,29,30,31,32,33]. Baxter et al. [28] proposed a deep learning method to predict the colors of silver surfaces doped with silver nanoparticles and to inversely design the geometric parameters for the desired colors. Gao et al. [29] trained a bidirectional deep neural network model to inversely design the structural color of silicon nanostructures. The model consists of a forward network and an inverse network, which can accurately predict the color generation of silicon nanostructures, as well as inversely design the structural parameters for the desired colors. Huang et al. [30] proposed an inverse design strategy for the structural color of dielectric ring arrays using a machine learning model that combines the supervised learning with reinforcement learning. Dai et al. [31] reported a bidirectional neural network to inversely design the geometric structures of Fabry–Perot cavity color filters, which enables a gamut coverage that is 215% of the sRGB color space.
The above studies have mainly focused on the periodic systems whose optical response is obtained using the time-consuming electromagnetic simulations; yet, disperse nanoparticle systems have received little attention. In this work, a multilayered BNN model was built to accurately predict the color generation of gold nanoparticle systems and to inversely design the geometric parameters for the desired colors. The single scattering properties of nanoparticles were calculated by using the Lorenz–Mie theory, the multiple scattering problems between nanoparticles were considered by solving the radiative transfer equation, and the spectrum-to-color conversion was obtained based on the International Commission on Illumination (CIE) color spaces. Our approach captures the complex relationships between the geometric parameters and structural colors with high reliability and accuracy, and can be used for the analysis and optimization design of structural color in nanoparticle systems.

2. Model and Methods

2.1. Model and Dataset Generation

Our data generation process and machine learning strategy for structural colors of nanoparticle systems are schematically illustrated in Figure 1. A thin layer composed of randomly distributed, monodisperse spherical gold nanoparticles embedded in water was investigated, because of its strong plasmon resonances in the visible spectrum and wide application in nanophotonics [7,34,35,36]. The external medium was set to air. The dispersed layer can be considered as a typical model of colloidal suspensions, nanoparticles composite coatings, and thin-film materials. We selected three geometric parameters: particle radius r, particle volume fraction fv, and layer thickness h, and three color property parameters: (L, a, b) in the CIE 1976-Lab color space, as key features to establish the dataset for the prediction and inverse design of structural colors. The color property parameters of nanoparticle systems were obtained from a series of simulations, which include Mie scattering calculation, Monte Carlo simulation, and spectrum-to-color conversion. Then, a multilayered BNN was developed and trained to predict the structural colors of nanoparticle systems and inversely design the geometric parameters for the desired colors.
The range of r was set to 5–100 nm in 5 nm intervals, the range of fv was set to 1 × 10−6–3 × 10−5 in 1 × 10−6 intervals, and the range of h was set to 0.5–10 mm in 0.5 mm intervals. A total of 12,000 parameter combinations were generated and the corresponding transmission spectra from 360 to 830 nm (in 1 nm intervals) were obtained by combining the Mie scattering and Monte Carlo calculation. Then, the color property parameters (L, a, b) were obtained by conducting the spectrum-to-color conversion. This dataset was divided into three groups for training (9600), validation (1200), and testing purposes (1200). All colors generated in the training and validation dataset are plotted in the CIE 1931-XYZ chromaticity diagram in Figure 2. More detailed information for the model and methods is provided in the following sections.

2.2. Optical Properties of Nanoparticle Systems

For dilute gold nanoparticles embedded in water, the total optical properties of nanoparticle systems, which include the extinction coefficients μext, scattering coefficients μsca, and scattering phase functions Φ, are calculated as [37]:
μ ext = μ ext , p + μ ext , m
μ sca = μ sca , p
Φ = Φ p
where μext,m =κ/λ is the extinction coefficient of water, κ is the imaginary part of the refractive index of water, λ is the incident light wavelength, and μext,p, μsca,p, and Φp are the extinction coefficient, scattering coefficient, and scattering phase function of gold nanoparticles, respectively. In the framework of the independent scattering approximation, the optical properties of dilute monodisperse gold nanoparticles can be calculated as [37]:
μ ext , p = 3 4 Q ext , p f v r
μ sca , p = 3 4 Q sca , p f v r
Φ p = Φ p , s
where Qext,p, Qsca,p, and Φp,s are the extinction efficiency factor, scattering efficiency factor, and scattering phase function of single gold spheres, respectively, and can be calculated using Lorenz–Mie theory [38]. The dielectric function of gold nanoparticles was taken from Johnson and Christy’s [39] dataset, and the complex refractive index of pure water [40] was used.

2.3. Calculation of Transmission Spectra

Given the optical properties of the nanoparticle systems, the radiative transfer problems (e.g., transmission and reflection spectra) can be accounted for by solving the radiative transfer equation (RTE) [37,41]:
d I λ s d s = μ ext I λ s + μ ext μ sca I b λ s + μ sca 4 π 4 π I λ s , Ω Φ Ω ,   Ω d Ω
where Iλ is the spectral radiative intensity in the direction of Ω along path s, Ibλ is the spectral blackbody intensity, and Ω is the solid angle. The RTE is solved using the Monte Carlo method [37,42,43]. An infinitely thin light beam is perpendicularly incident on the upper boundary of the layer from air, as shown in Figure 1. The reflection and refraction at the boundaries are considered using the Snell’s law and Fresnel’s relation [37]. After interacting with the layer, the reflected and transmitted photons are collected, and the spectral directional-hemispherical transmittance T(λ) of the layer can be calculated as:
T λ = 2 π N t Ω t N 0
where N0 is the total number of the photons that are incident on the layer, and Ntt) is the number of photons that are collected with the use of detectors positioned in the hemispherical space outside the lower surface in the solid angle Ωt. In this study, 106 photons were used for each wavelength to obtain accurate results without using too much computation time.

2.4. Spectrum to Color Calculation

The colors perceived by the human eye result from the interplay between the sensitivity of the eye’s three cone cells, the spectral intensity of the light source, and the spectral reflection or transmission from the object. The CIE-1931-XYZ and CIE 1976-Lab color spaces were used to assess the generated colors of nanoparticle systems [44,45,46]. As the transmitted light has a wider coverage of color space compared to the reflected light, we only focused on the transmission spectra and colors of the gold nanoparticle systems for simplicity. In accordance with the proposals of the CIE-1931-XYZ, the tristimulus values X, Y, and Z are defined by [44,45,47]:
X = 100 360 nm 830 nm I D 65 λ T λ x ¯ λ d λ 360 nm 830 nm I D 65 λ y ¯ λ d λ
Y = 100 360 nm 830 nm I D 65 λ T λ y ¯ λ d λ 360 nm 830 nm I D 65 λ y ¯ λ d λ
Z = 100 360 nm 830 nm I D 65 λ T λ z ¯ λ d λ 360 nm 830 nm I D 65 λ y ¯ λ d λ
where ID65(λ) is the spectral power distribution of the standard D65 illumination. x ¯ λ , y ¯ λ , and z ¯ λ are the spectral tristimulus values, which contain information about the used light source [44]. The chromaticity of the color is obtained by the normalized values:
x = X X + Y + Z
y = Y X + Y + Z
  z = Z X + Y + Z
The normalized values x and y are used to determine the corresponding chromaticity in CIE-1931-XYZ color space. In addition, the CIE 1976-Lab has a one-to-one correspondence to the CIE-1931-XYZ but with much better uniformity, rendering it a more suitable color space for accurate color difference identification [31,46]. The CIE 1976-Lab color space is defined in terms of the tristimulus values L, a, and b, where L represents the lightness, a represents the redness (+) and greenness (−), and b represents the yellowness (+) and blueness (−). The conversion relation between (X, Y, Z) and (L, a, b) is stated as [46]:
L = 116 f Y / Y n 16
a = 500 f X / X n f Y / Y n
b = 200 f Y / Y n f Z / Z n
with Xn, Yn, and Zn being the tristimulus values of a reference white object, and:
f s = s 1 / 3   if   s > 24 / 116 3
  f s = 841 / 108 s + 16 / 116   if   s < 24 / 116 3
For the standard illuminant D65 and a 2° standard colorimetric observer, they amount to Xn = 95.049, Yn = 100, and Zn = 108.891. In contrast to X, Y, and Z, the tristimulus values L, a, and b allow the quantitative comparison of colors. The CIE color difference function ΔE can be defined as the Euclidean distance between two vectors (L, a, b) and (L′, a′, b′) [46,48].
Δ E = L L 2 + a a 2 + b b 2
and a value of ΔE ≤ 1.0 usually represents identical colors [14,48].

2.5. Machine Learning Method

A multilayered BNN model, first proposed by Liu [49], was utilized to predict the color generation of the gold nanoparticle systems and inverse design of geometric parameters for the desired colors. The model consists of a fully connected inverse neural network (INN) that directly connects to a pre-trained forward neural network (FNN), as shown in Figure 3. The major advantage of this model is the excellent ability to solve the so-called “one-to-many” problem, which describes the fact that most inverse design problems are ambiguous, and hence several non-unique solutions exist for the same design target [21,49].
Prior to training, the geometric properties of nanoparticle systems and the corresponding color properties are normalized to improve the convergence rate and reduce the training error. In the training process, the FNN is first trained to achieve accurate prediction of the structural colors (L, a, b) based on the input geometric parameters (r, fv, h). The number of layers and neurons in the hidden layer are determined by neural network training and construction, and the training is performed by minimizing the loss function, which is defined as the mean square error (MSE) between the predicted values ( L predicted , a predicted , b predicted ) and true values (Ltrue, atrue, btrue):
MSE L a b = 1 N i = 1 N L predicted L true 2 + a predicted a true 2 + b predicted b true 2
where N is the number of the entries of color data. The training of the INN subsequently uses the fixed pre-trained FNN model as a color predictor to evaluate the inverse design output. Note that the loss function of INN compares the output color properties (L, a, b) rather than the designed geometric parameters (r, fv, h), as shown in Figure 3. In this way, different geometric parameters that lead to a similar color response no longer confuse the neural network, and all correct solutions to a given design problem yield a positive training feedback.

3. Results and Discussion

3.1. Structural Colors of Gold Nanoparticle Systems

Due to the particle scattering and absorption, the colors of the dispersed layer are determined by various factors such as the size, shape, volume fraction, and refractive index of nanoparticles, and the thickness and surface condition of the layer. In this study, we focused on the influence of particle size, volume fraction, and layer thickness on the structural colors of gold nanoparticle systems. As shown in Figure 2, a relatively wide coverage of the CIE color space is observed, and the transmission light mainly appears as purple and red colors, some of which are even out of the range of the sRGB color space. These results confirm that a wide range of structural colors can be achieved by using only one type of nanoparticle through controlling the specific geometric parameters.
The influences of different geometric parameters on the generated colors and transmission spectra of gold nanoparticle systems are presented in Figure 4. Figure 4a–c shows the generated colors for different particle radii, particle volume fractions, and layer thicknesses. Figure 4d–f shows the simulated transmittance spectra of gold nanoparticle systems. To better illustrate the change in color chromaticity, Table S1 lists the corresponding color property parameters L, a, and b of the generated colors in Figure 4d–f. For the sake of comparing and analyzing, the scattering and absorption efficiency factors of single particles for different particle radii are also illustrated in Figure 4g,h. As shown, the particle radius, particle volume fraction, and layer thickness have different degrees of influence on the generated colors and transmission spectra. Compared with the impacts of particle volume fraction and layer thickness, the particle radius shows a greater impact on the color chromaticity. With increasing particle radius, the values of a and b decrease first and then increase, resulting in the colors of the gold nanoparticle system changing from red to purple, then grey, and then light-grey, as shown in Figure 4a,b,d and Table S1. For small-size particles with particle radii smaller than 30 nm, the transmitted light mainly appears as red and pink colors. This is mainly due to the strong absorption and weak scattering of light in the blue and green region, which results in the red light passing through the layers with high transmittance, as illustrated in Figure 4d,g,h. As the particle radius increases, the shifts in the resonance peaks and enhanced scattering effect result in different distribution patterns of transmittance spectra, and further lead to obvious changes in the generated colors.
In addition, we can observe that the particle volume fraction and layer thickness mainly impact the lightness L of the nanoparticle systems, as shown in Figure 4a–c and Table S1. For nanoparticle systems with low particle volume fraction and layer thickness, due to the weak extinction of gold nanoparticles, different wavelengths of transmitted light are mixed together and exhibit the white and pink colors with high lightness. As the particle volume fraction and layer thickness increase, the multiple scattering effects between gold nanoparticles obviously increase, which not only result in the enhancement of particle extinction and the decrease in transmittance and lightness, but also impact the generated colors in different degrees.
On the whole, by adjusting the geometric parameters of nanoparticle systems and controlling the multiple scattering between nanoparticles, a wide range of structural colors can be obtained. Meanwhile, it should be noted that the effects of particle size distribution, particle shape, and particle aggregation were not considered in this study, which also have important influences on the structural colors of nanoparticle systems [14,15,43]. These influence factors will be investigated in future work.

3.2. Forward Neural Networks to Predict the Color Generation

A fully connected FNN, which consists of one input layer, several hidden layers, and one output layer, was trained to accurately predict the structural colors of nanoparticle systems. Notably, 9600 groups of geometric parameters in the training set were fed to the FNN, which predicts the color properties, calculates the loss function, and updates the parameters such as weights and biases according to the back-propagation of loss function. In addition, 1200 groups of validation data were used to adjust the hyper-parameters and check the performance of the neural network during training. By minimizing the training and validation loss, and through continuously optimizing the structure parameters, a FNN structure with 3 hidden layers and 200 nodes per layer shows excellent performance with high accuracy, as shown in Figure 5a. The loss functions of training and validation sets over epochs are plotted in Figure 5b. As shown, the loss function decreases rapidly at the beginning of the training process due to a large gradient, and then the downward trend slows gradually. After 5000 epochs, the values of training and validation loss are 4.35 × 10−6 and 6.31 × 10−3, respectively. The color difference ΔE corresponding to the validation loss 6.31 × 10−3 is 0.079, which is difficult to recognize by the human eye. The smooth downward trend and the small loss values show that the FNN performs well in the training process.
In order to test the accuracy and generalization ability of the FNN, 1200 groups of completely new test data were used and analyzed. Figure 5c–e shows the comparison results between the predicted color property parameters (L′, a′, b′) and true values (L, a, b). The results obtained by the FNN show a high consistency with those obtained by the theoretical simulations, which demonstrates that the FNN has a good prediction ability for the sample of the test set. To better evaluate the performance of the FNN, the color differences ΔE between the predicted colors and true colors and their statistical distributions are illustrated in Figure 5f,g. In general, the human eye cannot identify the color difference ΔE < 1.0 [14,48]. As shown in the figure, only two of the color difference values (0.17%) are larger than 1.0, which means that the accuracy of FNN is 99.83% according to the human chromatic discrimination ability. Meanwhile, most of the color difference values (98.33%) are below 0.5, proving that the prediction of structural colors of nanoparticle systems based on the FNN is highly accurate.
To further investigate the relationship between the geometric parameters and color properties, a heat map of the Pearson correlation coefficient matrix is illustrated in Figure 6. The Pearson correlation coefficient is a measure of the linear association between two features and has a value between −1 and 1. Positive values indicate positive correlations, while negative values indicate negative correlations. The further away the correlation coefficient is from zero, the stronger the relationship between the two features becomes. As shown in Figure 6, the correlation coefficients between the particle radius r and the color property parameters L, a, and b are 0.036, −0.75, and −0.701, respectively, which indicates that the particle radius shows strong negative correlation with the chromaticity and has weak correlation with the lightness. On the contrary, the layer thickness and particle volume fraction show strong negative correlation with the lightness and weak positive correlation with the chromaticity. These results are consistent with the theoretical analysis in Section 3.1, which are mainly caused by the single scattering and multiple scattering of gold nanoparticles, and verify that our FNN can accurately capture the complex relationships between the geometric parameters and structural colors.
Overall, the application of FNN can perform the accurate prediction of structural colors of nanoparticle systems with high reliability and efficiency. Although the acquisition of 12,000 groups of training data requires a certain computational cost, after the initial one-time computation investment, the FNN method has a great advantage in the computational efficiency and can be easily and flexibly used in the related applications.

3.3. Inverse Neural Networks to Design the Geometric Parameters

Inverse design is much more complicated because different geometric parameters of nanoparticle systems may yield the same color, and “one-to-many” results may lead to untrained models. Introducing a bidirectional neural network with a tandem strategy is an effective way to solve the “one-to-many” problem [18,49]. As shown in Figure 3, the INN is directly connected to the pre-trained FNN. After completing the training of the FNN, the weights in the FNN are fixed and then the training of the INN is carried out. In the training process of the INN, the desired colors (L, a, b) are taken as the input, and the output is the designed geometric parameters (r, fv, h) denoted as the intermediate layer. The output of the pre-trained FNN is the predicted colors (L′, a′, b′) obtained based on the designed geometric parameters (r, fv, h). The weights in the INN are optimized by minimizing the loss function defined as the mean square error between the output predicted colors (L′, a′, b′) and the input desired colors (L, a, b). After optimization design, an INN model, which has 4 hidden layers with 100 neurons each layer, is constructed, as shown in Figure 7a. The training loss and validation loss curves of the INN are plotted in Figure 7b.
As shown in Figure 7b, the loss functions decrease rapidly at the beginning of the training process and then remain stable until about the 200th epoch. After a sudden drop, the downward trend of the loss function gradually slows, and the values of training and validation loss are 8.03 × 10−5 and 0.0399, respectively, at the 5000th epoch. Note that the value of validation loss 0.0399 corresponds to the color difference ΔE = 0.1997, showing that the INN performs well in the training process. We again use 1200 groups of new data to test the accuracy and generalization ability of the INN. The desired color properties (L, a, b) are input into the INN to predict the designed geometric parameters (r, fv, h). Then, the data of (r, fv, h) are fed to the FNN to obtain the designed color properties (L′, a′, b′). Figure 7c–g illustrates the comparison results between the desired color properties (L, a, b) and inversely designed color properties (L′, a′, b′), and the corresponding results of color differences ΔE. Good consistency between the desired and inversely designed color properties is observed. Most of the color difference values (90%) are below 0.5, and only 1.5% of the values are larger than 1.0, indicating that the inverse design of structural colors of nanoparticle systems based on the INN is highly accurate (with a high accuracy of 98.5%).
Furthermore, we randomly used three groups of data in the test set to evaluate the performance of the INN. Figure 8a–c shows transmittance spectra of the desired and designed colors. Note that the geometric parameters for both desired and designed colors and the corresponding color differences are inserted in the figure. Figure 8d–f shows the corresponding CIE chromaticity coordinates of the desired and designed colors. Moreover, for convenience of contrast, the reflectance and absorptance spectra of the desired and designed colors are shown in Figure S1. As shown in Figure 8 and Figure S1, the designed colors and the corresponding transmittance, reflectance, and absorptance spectra show excellent agreement with the results of desired colors. Moreover, we observe that the designed geometric parameters obtained based on the INN are different from the input geometric parameters for all three groups of data, although the color differences ΔE between the desired and designed colors are very small, as shown in Figure 8a–c. This result not only verifies that the nanoparticle systems composed of different geometric parameters can yield the same or similar colors, but also demonstrates the ability of the INN to discover new solutions outside of the training data. Overall, after the one-time investment of sufficient simulation data and the training of the BNN model, the prediction and inverse design of colors take only a few seconds, which can greatly reduce the cost and time of the colors’ design.
To summarize, our inverse design strategy based on a BNN bypasses the complicated simulations in searching for geometric parameters of nanoparticle systems for the desired colors, and so greatly accelerates the design of structural colors with high accuracy and efficiency. Our work provides a general method to accurately and efficiently design the structural colors of nanoparticle systems. Meanwhile, our model can be further extended to more complex nanoparticle systems by using additional information such as particle type, shape, and size distribution.

4. Conclusions

In summary, we combined the Monte Carlo, Mie scattering simulations, and bidirectional neural network model to successfully improve the design of structural colors in gold nanoparticle systems. A FNN model with 3 hidden layers including 200 neurons each layer, and an INN model of 4 hidden layers containing 100 neurons each layer were constructed. The proposed neural network could accurately capture the complex relationships between the geometric parameters and structural colors. Taking the human chromatic discrimination ability as a criterion, our proposed neural network achieved a high accuracy of 99.83% on the predicted colors and 98.5% on the designed geometric parameters. Our work demonstrates the applicability of the deep learning method for the prediction and inverse design of structural colors in nanoparticle systems, and will open a new way for the further exploration of the related applications about nanoparticle-based materials.

Supplementary Materials

The following are available online at www.mdpi.com/article/10.3390/nano11123339/s1, Figure S1. Inversely designing the geometric parameters of gold nanoparticle systems for desired colors. (a–c) The reflectance spectra of the desired (lines) and designed (points) colors. (d–f) The absorptance spectra of the desired (lines) and designed (points) colors, Table S1. Color properties of gold nanoparticle systems composed of different geometric parameters.

Author Contributions

Conceptualization, L.M.; methodology, L.M. and K.H.; software, L.M. and K.H.; investigation, L.M., C.W. and J.-Y.Y.; data curation, L.M. and C.W.; writing—original draft preparation, L.M., C.W. and J.-Y.Y.; writing—review and editing, L.M., J.-Y.Y. and L.L.; supervision, J.-Y.Y. and L.L.; funding acquisition, L.M., C.W., J.-Y.Y. and L.L. All authors have read and agreed to the published version of the manuscript.

Funding

This work is supported by the National Natural Science Foundation of China (grant nos. 51806124, 52076123, and 51906127), and China Postdoctoral Science Foundation (grant nos. 2019M662353, 2021T140401, and 2020T130365).

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

Lanxin Ma and Chengchao Wang gratefully acknowledge support from the Young Scholars Program of Shandong University. Jia-Yue Yang gratefully acknowledges support from the Qilu Young Scholar Program of Shandong University (grant no. 89963031).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Fleischman, D.; Fountaine, K.T.; Bukowsky, C.R.; Tagliabue, G.; Sweatlock, L.A.; Atwater, H.A. High spectral resolution plasmonic color filters with subwavelength dimensions. ACS Photon. 2019, 6, 332–338. [Google Scholar] [CrossRef] [Green Version]
  2. Shao, L.; Zhuo, X.; Wang, J. Advanced plasmonic materials for dynamic color display. Adv. Mater. 2018, 30, 1704338. [Google Scholar] [CrossRef]
  3. Yu, J.; Lee, C.-H.; Kan, C.-W. Graphene Oxide/Reduced Graphene Oxide Enhanced Noniridescent Structural Colors Based on Silica Photonic Spray Paints with Improved Mechanical Robustness. Nanomaterials 2021, 11, 949. [Google Scholar] [CrossRef] [PubMed]
  4. Sun, S.; Zhou, Z.; Zhang, C.; Gao, Y.; Duan, Z.; Xiao, S.; Song, Q. All-dielectric full-color printing with TiO2 metasurfaces. ACS Nano 2017, 11, 4445–4452. [Google Scholar] [CrossRef] [PubMed]
  5. Cui, X.; Zhu, X.; Shao, L.; Wang, J.; Kristensen, A. Plasmonic color laser printing inside transparent gold nanodisk-embedded poly(dimethylsiloxane) matrices. Adv. Opt. Mater. 2020, 8, 1901605. [Google Scholar] [CrossRef]
  6. Park, J.; Dvoracek, C.; Lee, K.H.; Galloway, J.F.; Bhang, H.; Pomper, M.G.; Searson, P.C. CuInSe/ZnS core/shell NIR quantum dots for biomedical imaging. Small 2011, 7, 3148–3152. [Google Scholar] [CrossRef] [Green Version]
  7. Kristensen, A.; Yang, J.K.; Bozhevolnyi, S.I.; Link, S.; Nordlander, P.; Halas, N.J.; Mortensen, N.A. Plasmonic colour generation. Nat. Rev. Mater. 2016, 2, 16088. [Google Scholar] [CrossRef]
  8. Sterl, F.; Herkert, E.; Both, S.; Weiss, T.; Giessen, H. Shaping the color and angular appearance of plasmonic metasurfaces with tailored disorder. ACS Nano 2021, 15, 10318–10327. [Google Scholar] [CrossRef]
  9. Hwang, V.; Stephenson, A.B.; Barkley, S.; Brandt, S.; Xiao, M.; Aizenberg, J.; Manoharan, V.N. Designing angle-independent structural colors using Monte Carlo simulations of multiple scattering. Proc. Natl. Acad. Sci. USA 2021, 118, e2015551118. [Google Scholar] [CrossRef]
  10. Ropez, C. Materials aspects of photonic crystals. Adv. Mater. 2003, 15, 1679–1704. [Google Scholar]
  11. Freymann, G.V.; Kitaev, V.; Lotsch, B.V.; Ozin, G.A. Bottom-up assembly of photonic crystals. Chem. Soc. Rev. 2013, 42, 2528–2554. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Sugimoto, H.; Okazaki, T.; Fujii, M. Mie resonator color inks of monodispersed and perfectly spherical crystalline silicon nanoparticles. Adv. Opt. Mater. 2020, 8, 2000033. [Google Scholar] [CrossRef] [Green Version]
  13. Schertel, L.; Siedentop, L.; Meijer, J.M.; Keim, P.; Aegerter, C.M.; Aubry, G.J.; Maret, G. The structural colors of photonic glasses. Adv. Opt. Mater. 2019, 7, 1900442. [Google Scholar] [CrossRef] [Green Version]
  14. Quinten, M. The color of finely dispersed nanoparticles. Appl. Phys. B 2001, 73, 317–326. [Google Scholar] [CrossRef]
  15. Chhatre, A.; Solasa, P.; Sakle, S.; Thaokar, R.; Mehra, A. Color and surface plasmon effects in nanoparticle systems: Case of silver nanoparticles prepared by microemulsion route. Colloids Surf. A 2012, 404, 83–92. [Google Scholar] [CrossRef]
  16. Yalçın, R.A.; Blandre, E.; Joulain, K.; Dreévillon, J. Colored radiative cooling coatings with nanoparticles. ACS Photon. 2020, 7, 1312–1322. [Google Scholar] [CrossRef]
  17. Pargoletti, E.; Ortenzi, M.A.; Cappelletti, G. Stable Coloured Micrometric Films from Highly Concentrated Nano-Silver Sols: The Role of the Stabilizing Agents. Nanomaterials 2021, 11, 980. [Google Scholar] [CrossRef]
  18. Molesky, S.; Lin, Z.; Piggott, A.Y.; Jin, W.; Vucković, J.; Rodriguez, A.W. Inverse design in nanophotonics. Nat. Photon. 2018, 12, 659–670. [Google Scholar] [CrossRef] [Green Version]
  19. Andonegui, I.; Calvo, I.; Garcia-Adeva, A.J. Inverse design and topology optimization of novel photonic crystal broadband passive devices for photonic integrated circuits. Appl. Phys. A 2014, 115, 433–438. [Google Scholar] [CrossRef]
  20. Kokhanovskiy, A.; Kuprikov, E.; Bednyako, V.A.; Popkov, I.; Turitsyn, S. Inverse design of mode-locked fiber laser by particle swarm optimization algorithm. Sci. Rep. 2021, 11, 13555. [Google Scholar] [CrossRef]
  21. Wiecha, P.R.; Arbouet, A.; Girard, C.; Muskens, O.L. Deep learning in nano-photonics: Inverse design and beyond. Photon. Res. 2021, 9, B182–B200. [Google Scholar] [CrossRef]
  22. Jordan, M.I.; Mitchell, T.M. Machine learning: Trends, perspectives, and prospects. Science 2015, 349, 255–260. [Google Scholar] [CrossRef]
  23. Carleo, G.; Cirac, I.; Cranmer, K.; Daudet, L.; Schuld, M.; Tishby, N.; Vogt-Maranto, L.; Zdeborová, L. Machine learning and the physical sciences. Rev. Mod. Phys. 2019, 91, 045002. [Google Scholar] [CrossRef] [Green Version]
  24. Hussain, R.; Noyan, M.A.; Woyessa, G.; Marín, R.R.R.; Martinez, P.A.; Mahdi, F.M.; Finazzi, V.; Hazlehurst, T.A.; Hunter, T.N.; Coll, T. An ultra-compact particle size analyser using a CMOS image sensor and machine learning. Light Sci. Appl. 2020, 9, 21. [Google Scholar] [CrossRef] [Green Version]
  25. Barbastathis, G.; Ozcan, A.; Situ, G. On the use of deep learning for computational imaging. Optica 2019, 6, 921–943. [Google Scholar] [CrossRef]
  26. Khatib, O.; Ren, S.; Malof, J.; Padilla, W.J. Deep learning the electromagnetic properties of metamaterials—A comprehensive review. Adv. Funct. Mater. 2021, 31, 2101748. [Google Scholar] [CrossRef]
  27. Gao, L.; Chai, Y.; Zibar, D.; Yu, Z. Deep learning in photonics: Introduction. Photon. Res. 2021, 9, DLP1–DLP3. [Google Scholar] [CrossRef]
  28. Baxter, J.; Calà Lesina, A.; Guay, J.-M.; Weck, A.; Berini, P.; Ramunno, L. Plasmonic colours predicted by deep learning. Sci. Rep. 2019, 9, 8074. [Google Scholar] [CrossRef] [Green Version]
  29. Gao, L.; Li, X.; Liu, D.; Wang, L.; Yu, Z. A bidirectional deep neural network for accurate silicon color design. Adv. Mater. 2019, 31, 1905467. [Google Scholar] [CrossRef]
  30. Zang, J.; Huang, Z.; Liu, X. Inverse design of structural color using machine learning. Nanoscale 2019, 11, 21748–21758. [Google Scholar]
  31. Dai, P.; Wang, Y.; Hu, Y.; Groot, C.; Huang, R. Accurate inverse design of Fabry–Perot-cavity-based color filters far beyond sRGB via a bidirectional artificial neural network. Photon. Res. 2021, 9, B236–B246. [Google Scholar] [CrossRef]
  32. He, X.; Gu, Y.; Yu, B.; Liu, Z.; Zhu, K.; Wu, N.; Zhao, X.; Wei, Y.; Zhou, J.; Song, Y. Multi-mode structural-color anti-counterfeiting labels based on physically unclonable amorphous photonic structures with convenient artificial intelligence authentication. J. Mater. Chem. C 2019, 7, 14069–14074. [Google Scholar] [CrossRef]
  33. Hemmatyar, O.; Abdollahramezani, S.; Kiarashinejad, Y.; Zandehshahvar, M.; Adibi, A. Full color generation with fano-type resonant HfO2 nanopillars designed by a deep-learning approach. Nanoscale 2019, 11, 21266–21274. [Google Scholar] [CrossRef] [Green Version]
  34. Nishi, H.; Tatsuma, T. Full-color scattering based on plasmon and Mie resonances of gold nanoparticles modulated by Fabry-Pérot Interference for coloring and image projection. ACS Appl. Nano Mater. 2019, 2, 5071–5078. [Google Scholar] [CrossRef]
  35. Priyadarshini, M.; Acharyya, J.N.; Mahajan, S.; Prakash, G.V. Optical nonlinearities in chemically synthesized and femtosecond laser fabricated gold nanoparticle colloidal solutions. Opt. Laser Technol. 2021, 139, 107008. [Google Scholar] [CrossRef]
  36. Yang, C.-M.; Chen, F.-C. Position Effects of Metal Nanoparticles on the Performance of Perovskite Light-Emitting Diodes. Nanomaterials 2021, 11, 993. [Google Scholar] [CrossRef]
  37. Modest, M.F. Radiative Heat Transfer; Academic Press: San Diego, CA, USA, 2013. [Google Scholar]
  38. Bohren, C.F.; Huffman, D.R. Absorption and Scattering of Light by Small Particles; Wiley: New York, NY, USA, 1983. [Google Scholar]
  39. Johnson, P.B.; Christy, R.W. Optical Constants of the Noble Metals. Phys. Rev. B 1972, 6, 4370–4379. [Google Scholar] [CrossRef]
  40. Segelstein, D.J. The Complex Refractive Index of Water; University of Missouri-Kansas City: Kansas City, MO, USA, 1981. [Google Scholar]
  41. Chandrasekhar, S. Radiative Transfer; Oxford University: Oxford, UK, 1950. [Google Scholar]
  42. Ma, L.; Wang, F.; Wang, C.; Wang, C.; Tan, J. Monte Carlo simulation of spectral reflectance and BRDF of the bubble layer in the upper ocean. Opt. Express 2015, 23, 24274–24289. [Google Scholar] [CrossRef]
  43. Ma, L.X.; Wang, C.; Tan, J.Y. Light scattering by densely packed optically soft particle systems, with consideration of the particle agglomeration and dependent scattering. Appl. Opt. 2019, 58, 7336–7345. [Google Scholar] [CrossRef]
  44. Fairman, H.S.; Brill, M.H.; Hemmendinger, H. How the CIE 1931 color-matching functions were derived from Wright-Guild data. Color Res. Appl. 1998, 22, 11–23. [Google Scholar] [CrossRef]
  45. Wyszecki, G.; Stiles, W.S. Color Science: Concepts and Method, Auantitative Data and Formulae; John Wiley & Sons: New York, NY, USA, 1982. [Google Scholar]
  46. Schanda, J. Colorimetry: Understanding the CIE System; John Wiley & Sons: New Jersey, NJ, USA, 2007. [Google Scholar]
  47. Li, W.; Shi, Y.; Chen, Z.; Fan, S. Photonic thermal management of coloured objects. Nat. Commun. 2018, 9, 4240. [Google Scholar] [CrossRef] [PubMed]
  48. Habekost, M. Which color differencing equation should be used. Int. Circ. Graph. Educ. Res. 2013, 6, 20–33. [Google Scholar]
  49. Liu, D.; Tan, Y.; Khoram, E.; Yu, Z. Training deep neural networks for the inverse design of nanophotonic structures. ACS Photon. 2018, 5, 1365–1369. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Schematic of the model and methods for the prediction and inverse design of structural colors of nanoparticle systems.
Figure 1. Schematic of the model and methods for the prediction and inverse design of structural colors of nanoparticle systems.
Nanomaterials 11 03339 g001
Figure 2. The 12,000 colors generated by gold nanoparticle systems plotted in a CIE 1931-XYZ chromaticity diagram. The boundary of the sRGB color space is marked with blue lines.
Figure 2. The 12,000 colors generated by gold nanoparticle systems plotted in a CIE 1931-XYZ chromaticity diagram. The boundary of the sRGB color space is marked with blue lines.
Nanomaterials 11 03339 g002
Figure 3. Simplified schematic of the multilayered BNN model that consists of a fully connected INN that directly connects to a pre-trained FNN.
Figure 3. Simplified schematic of the multilayered BNN model that consists of a fully connected INN that directly connects to a pre-trained FNN.
Nanomaterials 11 03339 g003
Figure 4. The generated colors of gold nanoparticle systems for different geometric parameters with (a) h = 3.0 mm, (b) fv = 1 × 10−5, and (c) r = 30 nm. The simulated transmittance spectra of gold nanoparticle systems with (d) h = 3.0 mm, fv = 1 × 10−5, and different particle radii; (e) fv = 1 × 10−5, r = 30 nm, and different layer thicknesses; and (f) r = 30 nm, h = 3.0 mm, and different particle volume fractions. Note that the curves in (df) with different geometric parameters are successively displaced upward by 1 for better visibility and comparison. (g) The scattering and (h) absorption efficiency factors of single particles for different particle radii.
Figure 4. The generated colors of gold nanoparticle systems for different geometric parameters with (a) h = 3.0 mm, (b) fv = 1 × 10−5, and (c) r = 30 nm. The simulated transmittance spectra of gold nanoparticle systems with (d) h = 3.0 mm, fv = 1 × 10−5, and different particle radii; (e) fv = 1 × 10−5, r = 30 nm, and different layer thicknesses; and (f) r = 30 nm, h = 3.0 mm, and different particle volume fractions. Note that the curves in (df) with different geometric parameters are successively displaced upward by 1 for better visibility and comparison. (g) The scattering and (h) absorption efficiency factors of single particles for different particle radii.
Nanomaterials 11 03339 g004
Figure 5. The forward neural network for predicting the colors of gold nanoparticle systems. (a) Structure of the forward neural network. (b) The loss functions of the training and validation sets. (ce) Scatter plot of the true colors (L, a, b) and predicted colors (L′, a′, b′) for the 1200 groups of test data. (f) The color differences ΔE between the predicted colors and true colors. (g) Statistical distributions of the testing results divided by different ranges of color differences.
Figure 5. The forward neural network for predicting the colors of gold nanoparticle systems. (a) Structure of the forward neural network. (b) The loss functions of the training and validation sets. (ce) Scatter plot of the true colors (L, a, b) and predicted colors (L′, a′, b′) for the 1200 groups of test data. (f) The color differences ΔE between the predicted colors and true colors. (g) Statistical distributions of the testing results divided by different ranges of color differences.
Nanomaterials 11 03339 g005
Figure 6. The heat map of the Pearson correlation coefficient matrix within the input geometric parameters (r, fv, h) and output color properties (L, a, b).
Figure 6. The heat map of the Pearson correlation coefficient matrix within the input geometric parameters (r, fv, h) and output color properties (L, a, b).
Nanomaterials 11 03339 g006
Figure 7. The bidirectional neural network for designing the geometric parameters of gold nanoparticle systems. (a) Structure of the multilayered BNN. (b) The loss functions of the training and validation sets. (ce) Scatter plot of the desired colors (L, a, b) and predicted colors (L′, a′, b′) for the 1200 groups of test data. (f) The color differences ΔE between the designed colors and desired colors. (g) Statistical distributions of the testing results divided by different ranges of color differences.
Figure 7. The bidirectional neural network for designing the geometric parameters of gold nanoparticle systems. (a) Structure of the multilayered BNN. (b) The loss functions of the training and validation sets. (ce) Scatter plot of the desired colors (L, a, b) and predicted colors (L′, a′, b′) for the 1200 groups of test data. (f) The color differences ΔE between the designed colors and desired colors. (g) Statistical distributions of the testing results divided by different ranges of color differences.
Nanomaterials 11 03339 g007
Figure 8. Inversely designing the geometric parameters of gold nanoparticle systems for desired colors. (ac) The transmittance spectra of the desired (lines) and designed (points) colors. (df) The corresponding CIE chromaticity coordinates of the desired (circles) and designed (crosses) colors. The geometric parameters for both desired and designed colors and the corresponding color differences are inserted in (ac). The color property parameters are as follows: (a) Desired color: L = 34.09, a = 63.99, b = 58.25; designed color: L = 34.49, a = 64.04, b = 58.37. (b) Desired color: L = 73.96, a = 40.44, b = 8.03; designed color: L = 73.88, a = 40.57, b = 8.17. (c) Desired color: L = 87.82, a = 11.78, b = −4.79; designed color: L = 87.75, a = 11.81, b = −4.84.
Figure 8. Inversely designing the geometric parameters of gold nanoparticle systems for desired colors. (ac) The transmittance spectra of the desired (lines) and designed (points) colors. (df) The corresponding CIE chromaticity coordinates of the desired (circles) and designed (crosses) colors. The geometric parameters for both desired and designed colors and the corresponding color differences are inserted in (ac). The color property parameters are as follows: (a) Desired color: L = 34.09, a = 63.99, b = 58.25; designed color: L = 34.49, a = 64.04, b = 58.37. (b) Desired color: L = 73.96, a = 40.44, b = 8.03; designed color: L = 73.88, a = 40.57, b = 8.17. (c) Desired color: L = 87.82, a = 11.78, b = −4.79; designed color: L = 87.75, a = 11.81, b = −4.84.
Nanomaterials 11 03339 g008
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ma, L.; Hu, K.; Wang, C.; Yang, J.-Y.; Liu, L. Prediction and Inverse Design of Structural Colors of Nanoparticle Systems via Deep Neural Network. Nanomaterials 2021, 11, 3339. https://doi.org/10.3390/nano11123339

AMA Style

Ma L, Hu K, Wang C, Yang J-Y, Liu L. Prediction and Inverse Design of Structural Colors of Nanoparticle Systems via Deep Neural Network. Nanomaterials. 2021; 11(12):3339. https://doi.org/10.3390/nano11123339

Chicago/Turabian Style

Ma, Lanxin, Kaixiang Hu, Chengchao Wang, Jia-Yue Yang, and Linhua Liu. 2021. "Prediction and Inverse Design of Structural Colors of Nanoparticle Systems via Deep Neural Network" Nanomaterials 11, no. 12: 3339. https://doi.org/10.3390/nano11123339

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop