Next Article in Journal
Shape Memory Behavior of Natural Eucommia ulmoides Gum and Low-Density Polyethylene Blends with Two Response Temperatures
Next Article in Special Issue
Estimation of Mechanical Performance, Thermal Stability and Flame Retardancy of High-Impact Polystyrene/Surface-Modified APP/Carboxylic-Functionalized MWCNTs Nanocomposites
Previous Article in Journal
Macro- and Microphase Separated Protein-Polyelectrolyte Complexes: Design Parameters and Current Progress
Previous Article in Special Issue
Impact of Chemical Post-Processing in Fused Deposition Modelling (FDM) on Polylactic Acid (PLA) Surface Quality and Structure
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Intelligent Machine Learning: Tailor-Making Macromolecules

by
Yousef Mohammadi
1,*,
Mohammad Reza Saeb
2,
Alexander Penlidis
3,*,
Esmaiel Jabbari
4,
Florian J. Stadler
5,*,
Philippe Zinck
6 and
Krzysztof Matyjaszewski
7,*
1
Petrochemical Research and Technology Company (NPC-rt), National Petrochemical Company (NPC), P.O. Box 14358-84711, Tehran, Iran
2
Department of Resin and Additives, Institute for Color Science and Technology, P.O. Box 16765-654, Tehran, Iran
3
Department of Chemical Engineering, Institute for Polymer Research (IPR), University of Waterloo, Waterloo, ON N2L 3G1, Canada
4
Biomimetic Materials and Tissue Engineering Laboratory, Department of Chemical Engineering, University of South Carolina Columbia, Columbia, SC 29208, USA
5
College of Materials Science and Engineering, Shenzhen Key Laboratory of Polymer Science and Technology, Guangdong Research Center for Interfacial Engineering of Functional Materials, Nanshan District Key Lab for Biopolymers and Safety Evaluation, Shenzhen University, Shenzhen 518055, China
6
Unity of Catalysis and Solid State Chemistry, University of Lille, CNRS, Bât C7, Cité Scientifique, 59652 Villeneuve d’Ascq Cédex, France
7
Department of Chemistry, Carnegie Mellon University, Pittsburgh, PA 15213, USA
*
Authors to whom correspondence should be addressed.
Polymers 2019, 11(4), 579; https://doi.org/10.3390/polym11040579
Submission received: 13 February 2019 / Revised: 5 March 2019 / Accepted: 10 March 2019 / Published: 1 April 2019
(This article belongs to the Special Issue Connecting the Fields of Polymer Reaction Engineering and Processing)

Abstract

:
Nowadays, polymer reaction engineers seek robust and effective tools to synthesize complex macromolecules with well-defined and desirable microstructural and architectural characteristics. Over the past few decades, several promising approaches, such as controlled living (co)polymerization systems and chain-shuttling reactions have been proposed and widely applied to synthesize rather complex macromolecules with controlled monomer sequences. Despite the unique potential of the newly developed techniques, tailor-making the microstructure of macromolecules by suggesting the most appropriate polymerization recipe still remains a very challenging task. In the current work, two versatile and powerful tools capable of effectively addressing the aforementioned questions have been proposed and successfully put into practice. The two tools are established through the amalgamation of the Kinetic Monte Carlo simulation approach and machine learning techniques. The former, an intelligent modeling tool, is able to model and visualize the intricate inter-relationships of polymerization recipes/conditions (as input variables) and microstructural features of the produced macromolecules (as responses). The latter is capable of precisely predicting optimal copolymerization conditions to simultaneously satisfy all predefined microstructural features. The effectiveness of the proposed intelligent modeling and optimization techniques for solving this extremely important ‘inverse’ engineering problem was successfully examined by investigating the possibility of tailor-making the microstructure of Olefin Block Copolymers via chain-shuttling coordination polymerization.

Graphical Abstract

1. Introduction

The ubiquity of polymers in daily life, especially in packaging and consumer products, gives them a special importance among different types of materials [1,2,3]. However, the rapid growth of both humanity and the wealth level has led to an ever-increasing demand for resources. Since the mid-1980s, more polymers have been produced in volume than steel (the second-highest-volume material). Among polymeric materials, approximately 70% are thermoplastics, 50% of which are polyolefins; the latter part is dominated by far by polyethylene (PE), polypropylene (PP), and their copolymers. Decades of research have developed important and widely used materials from high-pressure polymerization (low-density polyethylene (LDPE) [4]), (catalyzed) low-pressure polymerization (high-density polyethylene (HDPE), linear low-density polyethylene (LLDPE), and PP [5,6,7,8,9,10,11,12]), and single-site-catalyzed polymerization (metallocene HDPE/LLDPE/PP [13,14]). The property range of polyolefins has been significantly expanded by the more recent and seminal introduction of chain-shuttling polymerization by Dow Chemical Company, where a chain-shuttling agent (CSA) can transport a chain from one catalyst to another, thus allowing for the production of block copolymers inexpensively on an industrial scale [15]. In fact, although the first catalyst is capable of engaging a large number of comonomer units, the second one incorporates small amounts of comonomer. Hence, two distinct types of polyethylene chains, i.e., soft and hard copolymers, are simultaneously formed due to the difference in comonomer consumption tendency of the catalysts. Cross-shuttling of active centers among different living and dormant chains in the reaction medium via CSA molecules results in the synthesis of multi-block polyethylene chains. This invention permits designing olefin block copolymers (OBCs) with properties that allow for using not only different grades as commodity polymers but also as specialty engineering applications [16].
The multi-block structure of OBCs yields a dual character of thermoplastic processability as well as elastomeric solid state properties. More importantly, the properties can be tuned by varying the concentration and type of the catalysts and monomers, as well as the concentration of the chain-shuttling/transfer agent, ultimately leading to different comonomer contents of the hard and soft segments as well as their average lengths [15,17]. These multifaceted properties can be tuned over a wide range, but this fine-tuning is not that trivial, as the first attempt for a usable OBC required 1600 syntheses via high throughput setups with fast molar mass distribution and thermal analyses [15]. The reason behind this is that a whole set of independently controllable factors interact with each other non-trivially and non-intuitively and, consequently, simple predictions of molecular architecture from the synthesis variables are not readily possible. Hence, in comparison to classical polyolefin synthesis, the complexities of OBC polymerization require a highly advanced understanding of polymerization. This was first attempted by Zhang et al. [18], who proposed a kinetic model for chain-shuttling polymerization that was able to correlate average molecular weight, comonomer content, and number of blocks with such synthesis factors as monomer ratio, catalyst composition, and CSA level. While this model was successful in obtaining a rough idea of the structure of the OBC, more powerful tools are required for gaining an in-depth understanding of the microstructure. This has been achieved by recent Kinetic Monte Carlo (KMC) simulations of chain-shuttling polymerizations [19,20,21,22,23,24].
Due to the multifarious types of reactions occurring simultaneously, including cross-propagation and cross-shuttling reactions, setting up these simulations is not an easy task. The KMC simulation was designed to track every monomer, CSA, and catalyst molecule as well as every single chain in the virtual reactor in order to obtain the microstructural features of the OBC. These features are represented by average number of linkage points per chain (LP), ethylene sequence length (ESL) of hard and soft blocks, average degree of polymerization (DPn) of hard and soft blocks, longest ethylene sequence length (LES) of hard and soft blocks, comonomer content (C8%) of hard and soft blocks, and hard block percent (HB%) [19,20,21,22,23,24].
While the results on the microstructure of OBCs provided by the KMC simulator are believed to be very accurate, the developed KMC algorithm cannot suggest polymerization variables that can yield a certain desired microstructure. In other words, the KMC simulator receives X (x1, x2, x3, …, xn) as an input of polymerization variables and yields microstructural arrays of Y (y1, y2, y3, …, ym), i.e., the direction is X→Y (modeling). For practical applications, however, and in order to address a much more complex and interesting problem, engineers need copolymers with certain microstructures, which cannot be simply deduced from this kind of algorithm or by other means (e.g., deterministic models) due to the complexity of the microstructure. In other words, there is no such thing as a single-valued functional relationship, i.e., a one-to-one relationship between polymerization factors and microstructural features. Hence, the inverse pathway, i.e., selecting synthesis conditions from desired microstructural properties in the direction YX (optimization), constitutes an ill-posed problem.
Classical mathematical modeling methodologies are frequently very complex, time-consuming, and ill-conditioned when confronting very complex systems. The advent of Artificial Intelligence (AI) Modeling and Optimization techniques has opened new possibilities to scientists/engineers working on nonlinear processes. The use of Artificial Intelligence approaches with evolutionary learning in different areas of Science and Engineering, and notably in Materials Science [25,26,27,28,29,30,31], is offering a viable pathway to mimicking the evolution of complex system performance. This makes AI-based methods good candidates for identifying the mechanisms and inter-relations of complex polymerization kinetics. Since polymerization reactions proceed by a series of probability-controlled steps, and at any given time, new molecules are generated, converted, activated, deactivated, and transferred from one class/situation to another, polymerization systems can be better understood and, consequently, their behavior better tracked, by using evolutionary approaches.
The aim of the current study is the establishment and development of unique and versatile modeling and optimization tools capable of handling precise predictions and intricate manipulations of microstructural features of complex macromolecules via amalgamation of KMC simulation approaches and Computational Intelligence techniques. Making this possible requires a deeper understanding of the interplay between different phenomena in the reacting system, culminating in the inter-relationships between polymerization recipes/conditions and final microstructural properties. Two powerful and effective tools, including an Intelligent Modeling Tool (IMT) and an Intelligent Optimization Tool (IOT), are successfully developed and introduced. To construct and implement these tools, the KMC simulation approach has been hybridized with appropriate Artificial-Intelligence-based modeling and optimization techniques. The modeling and optimization of Chain-Shuttling Coordination (co)polymerization (invented by Dow Chemical Company) for the production of OBCs have been selected as a sufficiently complex case study to ‘challenge’ the use and validity of the proposed tools.

2. Model Development

The KMC simulator developed previously [19,20,21,22,23,24] acted as a virtual reactor to synthesize chains and look at microstructural aspects of OBCs. The microstructural variables of OBCs can be classified into two categories: (i) those that directly correspond to topological and architectural characteristics of chains, such as LP, DPnSOFT, DPnHARD, ESLSOFT, and ESLHARD; and (ii) those that indirectly determine the ultimate properties of OBCs, such as LESSOFT, LESHARD, C8%SOFT, C8%HARD, and HB%. There is some evidence that thermal, rheological, mechanical, as well as phase separation properties of OBCs in the melt-state are governed by the second category; for instance, crystallization is controlled to a large extent by HB%, LESSOFT, and LESHARD of OBCs. Hence, 10 kinetic parameters (two homo-propagation, two cross-propagation, two shuttling to virgin CSA, two shuttling to polymeryl CSA, and two transfer to hydrogen rate constants) as well as the amounts of seven reactants (a solvent, two catalysts, two monomers, hydrogen, and CSA) lead to a set of 10 (output) responses (the abovementioned microstructural features) calculated from six distribution functions (molar mass distribution of both blocks, block number distribution of both blocks, comonomer distribution of both blocks), which are partially dependent on each other. This alone provides sufficient evidence for why simple single-valued one-to-one relationships cannot be found for a complex system such as OBC synthesis.
The hybridization of KMC with machine learning tools enables the prediction and tailoring of the microstructure and ultimate properties of OBCs. In this regard, two different intelligent tools were developed: (i) an Intelligent Modeling Tool (IMT); and (ii) an Intelligent Optimization Tool (IOT). The IMT is a hybrid of the KMC simulator with an intelligent modeler, such as an Artificial Neural Network (ANN) or a Fuzzy Logic System, while the IOT is an intelligent optimizer, combining KMC with, for example, a Genetic Algorithm (GA) or Swarm Intelligence. Figure 1 provides a view of how the functions of IOT and IMT are intertwined.
Application of the IMT and IOT makes it possible to produce new grades of OBCs, with preset characteristics, without numerous trials but only via computer simulations ‘reverse-engineering’ the correct recipe to produce the desired OBC. This kind of approach-finding way to connect 10 microstructural features with highly complex inter-relations of seven synthesis factors, or to determine the possible synthesis variables to obtain a desired set of microstructural features, was tested for the OBC synthesis in references [19,20,21,22,23,24]. The basic scheme developed here can be used in numerous additional ways, spanning from biology to chemistry to physics, provided that some understanding of a possible mechanism exists that can link the input and output variables. These (simulation) calculations can be completed within an acceptable run time (for instance, ca. 45 years in case of KMC versus a few seconds in case of the IMT [22]).
The IMT (X→Y) combines the advantages of ANN and KMC methodologies in a synergistic manner. In a nutshell, the IMT relies on calculating a number of viable scenarios. For instance, polymerization recipes and conditions (X) are systematically defined to cover the whole variable space considered. Then, the KMC simulator calculates the microstructural features (Y) of all defined scenarios separately, and these are subsequently used to train several ANNs. Obviously, the KMC simulator and intelligent modeler interact in an offline manner. This results in various black boxes, which can intelligently predict any microstructural pattern with high accuracy within the covered factor space. Considering the time-intensiveness of the KMC-algorithm, the IMT offers a fast solution to obtain the required simulation results, which ultimately allows for determining a significantly wider range of polymerization recipes with their corresponding microstructural patterns, while in parallel determining the relationships between operational conditions and microstructural properties.
In the case of the IOT (YX), the KMC simulator is continuously recalled by the GA optimizer via an online route, in obvious contrast to the IMT step (XY), for which the KMC-ANN ‘modeler’ works offline. The GA optimizer randomly generates a number of polymerization recipes and sends the recipes for error evaluation to the KMC simulator. When the KMC simulator “runs” these recipes/conditions, it resembles a virtual reactor that individually receives polymerization recipes as inputs and visualizes microstructural features as outputs. Then, it returns the resulting microstructural characteristics, i.e., LP, DPnSOFT, DPnHARD, ESLSOFT, ESLHARD, LESSOFT, LESHARD, C8%SOFT, C8%HARD, and HB%, to the GA optimizer online through a closed-loop circuit. The GA optimizer subsequently invokes genetic operators, including selection, sorting, mating, crossover, and mutation, based on the feedback it received to generate the next generation (polymerization recipes); finally, the next generations are considered accordingly by sending them to the KMC simulator and receiving the corresponding microstructural characteristics; these steps are iterative. The process continues until a generation is evolved by the IOT, which contains the recipe required for production of the target OBC having a predefined (desirable) microstructure, i.e., the global optimum. Thus, the IOT allows for ‘dialing-in’ variables and obtaining the required synthesis conditions, which is the inverse way to the above-described IMT approach. The output of the IOT is either a unique recipe or several polymerization recipes (Pareto fronts) corresponding to the preset target microstructural patterns. As a result, well-defined microstructures can be tailored depending on customer demand.
Two separate computer programs were written in the PASCAL programming language (Lazarus 1.2.4 IDE) and compiled into 64-bit executable codes using FPC 2.6.2. The first program, i.e., the intelligent modeler, was established based on Artificial Neural Networks as a powerful black-box modeling technique and appropriately set to recalling our in-house KMC simulator code in an offline mode. On the other hand, the second code, i.e., the intelligent optimizer, was written based on the Non-dominated Sorting Genetic Algorithm (NSGA-II); NSGA-II is an extremely (we would like to think, the most) powerful heuristic multi-objective search strategy to communicate with the KMC simulator via an online route [32,33,34,35]. A subroutine based on the “Mother-of-all Pseudo-Random Number Generators” algorithm was employed to produce the required random numbers during the modeling and optimization steps [36]. The random number generation subroutine satisfied the tests of uniformity and serial correlation with high resolution. The cycle length of the random number generator was 3 × 1047. All modeling and optimization steps were performed with a desktop computer with Intel Core i7-3770K (3.50 GHz), 32 GB of memory (2133 MHz), under the Windows 7 Ultimate 64-bit operating system.

3. Results and Discussion

The power of the IMT (X→Y) in modeling the microstructure of OBCs has already been recently confirmed by visualizing new grades of OBCs [22]. The “fingerprint” of chain-shuttling copolymerization is envisioned using the developed IMT in terms of architecture-related (LP, DPnSOFT, DPnHARD, ESLSOFT, and ESLHARD) and property-related (LESSOFT, LESHARD, C8%SOFT, C8%HARD, and HB%) characteristics in a phase diagram like that shown in Figure 2. Figure 2 is like an operational ‘map’ for or ‘window’ into the process. Three-dimensional plots of hard and soft segments for each microstructural feature, for instance DPnSOFT and DPnHARD, are plotted first and subsequently intersected and projected onto a two-dimensional surface. Then, the intersections are determined, at which the studied specific microstructural characteristic takes on the same values for soft and hard blocks, and separately marked by different colors, e.g., the thick blue line denotes the intersection of soft and hard blocks’ lengths (DPnSOFT = DPnHARD). Obviously, the contribution of hard and soft characteristics is inversely changing in the ‘shadowed’ and ‘unshadowed’ areas (see the legends of Figure 2). For instance, the area distinguished by blue color denotes DPnSOFT > DPnHARD, while the uncolored area denotes DPnSOFT<DPnHARD. By putting all these microstructural information pieces together, a master diagram is obtained. Such a master diagram provides a fast survey of the architecture-property topological trends. For a more detailed look at such relationships, i.e., a deeper understanding of changes in the blocky nature of architecture-related and property-related microstructural features of OBCs, and for fine-tuning such characteristics, one can “zoom in” to the three-dimensional plots or corresponding contour plots. For instance, five points, A, B, C, D, and E, in the master plot are randomly considered and their polymerization recipes are read from the master plot. Eventually, the KMC simulator gives microstructural features under the conditions proposed by the IMT, corroborating the authenticity of predictions based on the Artificial Intelligence approach.
Table 1 summarizes the randomly selected points in Figure 2 representing five OBCs and their topology- and property-related characteristics yielded by the IMT and KMC operators. It can be recognized that the IMT has appropriately learned the polymerization behavior and successfully predicted both types of molecular characteristics of randomly selected OBCs, as ‘approved’ by the KMC simulator. A closer look at the statistics in Table 1, bearing in mind the very low errors in predictions of the IMT, assures that such an intelligent machine can reliably be applied in ‘anticipating’ two categories of molecular features, leading to sophisticated architecture-property correlations. The IMT consists of 10 individual prediction mechanisms, each responsible for one molecular characteristic of the OBC, which are integrated into an intelligent toolbox towards the prediction of molecular characteristics of OBCs with ‘surgical’ precision.
The points A–E are several typical examples of OBCs “synthesized”, “characterized”, and identified by the IMT. In the master plot (Figure 2 and Table 1), different classes of OBCs are distinguished, which are yielded from a feed having a monomer molar ratio (MR) of 0.75 and different catalyst compositions (CCs) and CSA levels. These grades are different from each other considering their dissimilar blocky natures. The x-axis of Figure 2 refers to the ratio of the two different catalysts, where a low catalyst composition means having more of the catalyst-producing hard blocks. The log(CSA) level on the y-axis refers to the amount of chain-shuttling agent in the reaction and, thus, to the probability of shuttling events. As can be observed, 10 key characteristics (see Table 1) determining the blocky nature of OBCs are compared in Figure 2. All these together provide an OBC with an “identification card”, which is unique to this special recipe. Exploiting these unique capabilities of the IMT, it is possible to develop new grades of OBC suited to different applications.
Several more results stemming from the master plot (Figure 2) need to be discussed. For instance, while it is counterintuitive that soft blocks (with higher comonomer content) can have a longer ethylene sequence than hard blocks, it becomes immediately obvious that such a possibility exists only for high log(CSA) levels, which in turn leads to very short blocks (few monomer units). This in combination with the higher concentration of soft-block-producing catalyst leads to much longer soft blocks than hard blocks, which means that the average ethylene sequence in the hard block is short, as it cannot be longer than the block itself. Catalyst compositions close to zero lead to much longer hard than soft blocks and vice versa for CC close to 1, as the CSA causes shuttling of the chain to a random catalyst center, which in the case of CC being very different from 1 means that the block lengths are very different from each other. Thus, the possibilities of producing OBCs with previously unexplored structures as well as exact prediction of both their architecture- and property-related molecular features are good examples of the exceptional capabilities of the IMT.
Similar to the case of the IMT, but through a completely different route, the reliability of the IOT has also been tested. For this purpose, two tailored OBCs, OBC1 and OBC2 shown in Table 2, are defined and “animated” using the IOT. OBC1 is a multi-block copolymer in which the weight percent of hard blocks has to take the value of 30; and, at the same time, the average ESL of hard blocks is 10 times bigger than the corresponding parameter defined for the soft blocks. In contrast, OBC2 is a highly uniform OBC having a hard block percent of 45. It is worth mentioning that, in a highly uniform OBC, 1-octene units are distributed evenly in both soft and hard blocks. The objectives assigned to each case, as well as the Pareto optimal fronts representing the best solutions with optimal operational conditions, are provided in Table 2. As can be seen, virtual synthesis of OBC1 and OBC2 required concurrent control of three and seven microstructural characteristics of the copolymer chains, respectively, as can be realized by the defined objectives in each case. The IOT iteratively generates and analyzes billions of solutions to find the chain microstructure closest to the target OBC1 and OBC2. To validate the authenticity of the IOT results, the optimum polymerization recipes obtained in each case were entered into the KMC simulator to virtually synthesize OBC1 and OBC2 and determine their actual microstructural characteristics. As can be seen in Table 2, errors in predicting target microstructural features are below 3.0% for almost all quantities. The percentage of error in prediction of microstructural features (highlighted in Turquoise) is defined as the ratio of the difference between the outcomes of the IOT (highlighted in yellow) and KMC (highlighted in green) under the conditions proposed by the IOT (numerator) to the difference between minimum and maximum values of that characteristic for stochastically synthesized macromolecules (denominator) multiplied by 100.
The microstructural characteristics of OBC1 and OBC2 are shown in Figure 3 and Figure 4, respectively. As can be observed, both the evolution and end-of-batch characteristics of the intelligently synthesized OBCs are precisely and thoroughly predicted and depicted.
Based on these findings, it is now possible to precisely model and optimize the synthesis of olefinic block copolymers by using the developed intelligent tools. The IOT and IMT make it possible to determine the features required to synthesize a polymer with the desired molecular structure or to visualize the factor space for an overview of the possible combinations of molecular features as a function of polymerization variables.
The approach introduced herein is obviously bound to the specific catalyst/chain-shuttling system for producing OBCs. However, it is clear that the method works sufficiently well for OBC synthesis, which is one of the most complex syntheses from a reaction kinetics point of view. Considering this, the IMT and IOT can readily be adapted to many other polymerization schemes by modifying the reaction kinetics model in the KMC simulator. Furthermore, any scheme that links any given (input) X to any given (response) Y could be modeled by a modified version of the KMC simulator.

4. Conclusions

Two powerful tools were introduced and successfully implemented to model and optimize the microstructural aspects of complex macromolecules. The newly developed computational techniques were established based on hybridization of molecular simulation approaches and Machine Learning techniques. The strategy made it possible to construct intelligent modeling and optimization tools capable of learning and decision-making. Undoubtedly, when applying these tools, polymer reaction engineers not only can effectively discover the complex inter-relationships between polymerization conditions and final architectural characteristics, but will also have the opportunity to adjust rather precisely the polymerization inputs in an attempt to synthesize predefined microstructures in detail. Chain-shuttling coordination copolymerization, an intricate polymerization system, has been chosen as the first test case to challenge the proposed intelligent modeling and optimization tools. The results obtained clearly showed that the IMT was capable of meticulously patterning the molecular landscape of OBCs in terms of operating conditions, including monomer molar ratio, catalyst composition, and CSA level. IMT was effectively put into practice to ‘crack’ the inter-relationship between operating conditions and micro-molecular characteristics and/or final properties of interest. By superimposing all microstructural information pieces together, a master diagram is obtained that provides a fast survey of the recipe-architecture-property topological trends. In contrast, the IOT was able to accurately predict the input/operating factors in response to predefined micro-molecular/architectural characteristics of the target OBC chains. To precisely evaluate the accuracy and performance of the proposed IOT, two target OBCs were designed first. Then, the IOT was implemented and applied to concurrently optimize three and seven molecular characteristics of the predefined OBC chains, respectively. The results obtained demonstrated that the IOT was able to successfully handle multi-objective optimization problems and simultaneously control various micro-molecular/architectural characteristics, resulting in negligible errors calculated for the objective functions.
Although the unique capabilities of the proposed techniques were successfully tested and examined with a complex living shuttling coordination copolymerization case study, they can be employed by both academic and industrial experts to model and optimize all types of macromolecular reactions and other reactive systems. Both the IMT and IOT, as intelligent computational tools, have the potential to guide polymer chemists and engineers towards the realization of advanced ‘living and thinking’ materials.

Author Contributions

Conceptualization, Y.M., A.P., E.J., and F.J.S.; Methodology, Y.M., A.P., and K.M.; Software, Y.M.; Validation, Y.M., P.Z., and K.M.; Formal Analysis, Y.M., A.P., E.J., and P.Z.; Investigation, Y.M., M.R.S., E.J., F.J.S., and P.Z.; Resources, Y.M. and P.Z.; Data Curation, Y.M.; Writing—Original Draft Preparation, Y.M. and M.R.S.; Writing—Review and Editing, Y.M., M.R.S., A.P., E.J., F.J.S., and P.Z.; Visualization, Y.M.; Supervision, A.P., F.J.S., and K.M.; Project Administration, Y.M., A.P., and K.M.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Sun, H.; Kabb, C.P.; Sims, M.B.; Sumerlin, B.S. Architecture-transformable polymers: Reshaping the future of stimuli-responsive polymers. Prog. Polym. Sci. 2019, 89, 61–75. [Google Scholar] [CrossRef]
  2. Lutz, J.-F.; Lehn, J.M.; Meijer, E.W.; Matyjaszewski, K. From precision polymers to complex materials and systems. Nat. Rev. Mater. 2016, 1, 16024. [Google Scholar] [CrossRef]
  3. Lutz, J.-F.; Ouchi, M.; Liu, D.R.; Sawamoto, M. Sequence-Controlled Polymers. Science 2013, 341, 1238149. [Google Scholar] [CrossRef]
  4. Fawcett, E.W.; Gibson, R.O.; Perrin, M.W.; Paton, J.G.; Williams, E.G. Improvements in or Relating to the Polymerization of Ethylene. Great Britain Patent 471,590A, 6 September 1937. [Google Scholar]
  5. Natta, G. From the Stereospecific Polymerization to the Asymmetric Autocatalytic Synthesis of Macromolecules. In Nobel Lecture; Elsevier Publishing Company: Amsterdam, the Netherlands, 1963; pp. 27–60. [Google Scholar]
  6. Ziegler, K. Consequences and Development of an Invention. In Nobel Lecture; Elsevier Publishing Company: Amsterdam, The Netherlands, 1963; pp. 6–24. [Google Scholar]
  7. Ziegler, K. Alumino-organic Syntheses in the Field of Olefinic Hydrocarbons. Angew. Chem. 1952, 64, 323–329. [Google Scholar] [CrossRef]
  8. Ziegler, K.; Holzkamp, E.; Breil, H.; Martin, H. The Mühlheim Low-pressure Polyethylene Process. Angew. Chem. Int. Ed. 1955, 67, 541–547. [Google Scholar] [CrossRef]
  9. Natta, G. Stereospecific Catalysis of Isotactic Polymers. Angew. Chem. 1956, 68, 393–403. [Google Scholar] [CrossRef]
  10. Natta, G.; Crespi, G. Properties of Ethylene-Propylene Copolymers and of Terpolymers Containing Unsaturation. J. Polym. Sci. A Gen. Pap. 1962, 61, 83–95. [Google Scholar] [CrossRef]
  11. Natta, G.; Pino, P.; Mazzanti, G.; Giannini, U. A Crystalline Organometallic Complex Containing Titanium and Aluminum. J. Am. Chem. Soc. 1957, 79, 2975–2976. [Google Scholar] [CrossRef]
  12. Ziegler, K.; Breil, H.; Holzkamp, E.; Martin, H. A Process for Preparing High-Molecular Polyethylenes. Patent DE973626C, 17 November 1953. [Google Scholar]
  13. Lai, S.-Y.; Wilson, J.R.; Knight, G.W.; Stevens, J.C.; Chum, P.-W.S. Elastic Substantially Linear Olefin Polymers. U.S. Patent 5,272,236, 21 December 1993. [Google Scholar]
  14. Brant, P.; Canich, J.A.M.; Dias, A.J.; Bamberger, R.L.; Licciardi, G.F.; Henrichs, P.M. Long Chain Branched Polymers and a Process to Make Long Chain Branched Polymers. International Patent Application. WO 94/07930, 14 April 1994. [Google Scholar]
  15. Arriola, D.J.; Carnahan, E.M.; Hustad, P.D.; Kuhlman, R.L.; Wenzel, T.T. Catalytic Production of Olefin Block Copolymers via Chain Shuttling Polymerization. Science 2006, 312, 714–719. [Google Scholar] [CrossRef]
  16. INFUSE™ Olefin Block Copolymers-Product Selection Guide. Available online: http://www.dow.com/scripts/litorder.asp?filepath=elastomers/pdfs/noreg/788-08201.pdf (accessed on 4 March 2019).
  17. Kuhlman, R.L.; Klosin, J. Tuning Block Compositions of Polyethylene Multi-Block Copolymers by Catalyst Selection. Macromolecules 2010, 43, 7903–7904. [Google Scholar] [CrossRef]
  18. Zhang, M.; Karjala, T.W.; Jain, P. Modeling of α-Olefin Copolymerization with Chain-Shuttling Chemistry Using Dual Catalysts in Stirred-Tank Reactors: Molecular Weight Distributions and Copolymer Composition. Ind. Eng. Chem. Res. 2010, 49, 8135–8146. [Google Scholar] [CrossRef]
  19. Mohammadi, Y.; Ahmadi, M.; Saeb, M.R.; Khorasani, M.M.; Yang, P.; Stadler, F.J. A Detailed Model on Kinetics and Microstructure Evolution during Copolymerization of Ethylene and 1-octene: From Coordinative Chain Transfer to Chain Shuttling Polymerization. Macromolecules 2014, 47, 4778–4789. [Google Scholar] [CrossRef]
  20. Saeb, M.R.; Khorasani, M.M.; Ahmadi, M.; Mohammadi, Y.; Stadler, F.J. A Unified Picture of Hard-soft Segmental Development along Olefin Chain Shuttling Copolymerization. Polymer 2015, 76, 245–253. [Google Scholar] [CrossRef]
  21. Ahmadi, M.; Saeb, M.R.; Mohammadi, Y.; Khorasani, M.M.; Stadler, F.J. A Perspective on Modeling and Characterization of Transformations in the Blocky Nature of Olefin Block Copolymers. Ind. Eng. Chem. Res. 2015, 54, 8867–8873. [Google Scholar] [CrossRef]
  22. Saeb, M.R.; Mohammadi, Y.; Kermaniyan, T.S.; Zinck, P.; Stadler, F.J. Unspoken Aspects of Chain Shuttling Reactions: Patterning the Molecular Landscape of Olefin Multi-block Copolymers. Polymer 2017, 116, 55–75. [Google Scholar] [CrossRef]
  23. Mohammadi, Y.; Saeb, M.R.; Penlidis, A.; Jabbari, E.; Zinck, P.; Stadler, F.J.; Matyjaszewski, K. Intelligent Monte Carlo: A New Paradigm for Inverse Polymerization Engineering. Macromol. Theory Simul. 2018, 27, 1700088. [Google Scholar] [CrossRef]
  24. D’hooge, D.R. In Silico Tracking of Individual Species Accelerating Progress in Macromolecular Engineering and Design. Macromol. Rapid Commun. 2018, 39, 1800057. [Google Scholar] [CrossRef] [PubMed]
  25. Nosengo, N. Can Artificial Intelligence Create the Next Wonder Material? Nature 2016, 533, 22–25. [Google Scholar] [CrossRef]
  26. Raccuglia, P.; Elbert, K.C.; Adler, P.D.F.; Falk, C.; Wenny, M.B.; Mollo, A.; Zeller, M.; Friedler, S.A.; Schrier, J.; Norquist, A.J. Machine-learning-assisted Materials Discovery Using Failed Experiments. Nature 2016, 533, 73–76. [Google Scholar] [CrossRef] [PubMed]
  27. Adams, N.; Schubert, U.S. From Data to Knowledge:  Chemical Data Management, Data Mining, and Modeling in Polymer Science. J. Comb. Chem. 2004, 6, 12–23. [Google Scholar] [CrossRef] [PubMed]
  28. AbuOmar, O.; Nouranian, S.; King, R.; Bouvard, J.L.; Toghiani, H.; Lacy, T.E.; Pittman, C.U. Data mining and knowledge discovery in materials science and engineering. Adv. Eng. Inform. 2013, 27, 615–624. [Google Scholar] [CrossRef]
  29. Zhao, X.; Rosen, D.W. A data mining approach in real-time measurement for polymer additive manufacturing process with exposure controlled projection lithography. J. Manuf. Syst. 2017, 43, 271–286. [Google Scholar] [CrossRef]
  30. Mohammadi, Y.; Penlidis, A. Polymerization Data Mining: A Perspective. Adv. Theory Simul. 2018, 1800144. [Google Scholar] [CrossRef]
  31. Mohammadi, Y.; Penlidis, A. “Optimulation” in Chemical Reaction Engineering: Oxidative Coupling of Methane as a Case Study. Ind. Eng. Chem. Res. 2018, 57, 8664–8678. [Google Scholar] [CrossRef]
  32. Azari, R.; Garshasbi, S.; Amini, P.; Rashed-Ali, H.; Mohammadi, Y. Multi-objective Optimization of Building Envelope Design for Life Cycle Environmental Performance. Energy Build. 2016, 126, 524–534. [Google Scholar] [CrossRef]
  33. Garshasbi, S.; Kurnitski, J.; Mohammadi, Y. A Hybrid Genetic Algorithm and Monte Carlo Simulation Approach to Predict Hourly Energy Consumption and Generation by a Cluster of Net Zero Energy Buildings. Appl. Energy 2016, 179, 626–637. [Google Scholar] [CrossRef]
  34. Hosseinnezhad, M.; Saeb, M.R.; Garshasbi, S.; Mohammadi, Y. Realization of Manufacturing Dye-sensitized Solar Cells with Possible Maximum Power Conversion Efficiency and Durability. Sol. Energy 2017, 149, 314–322. [Google Scholar] [CrossRef]
  35. Baghaei, B.; Saeb, M.R.; Jafari, S.H.; Khonakdar, H.A.; Rezaee, B.; Goodarzi, V.; Mohammadi, Y. Modeling and Closed-loop Control of Particle Size and Initial Burst of PLGA Biodegradable Nanoparticles for Targeted Drug Delivery. J. Appl. Polym. Sci. 2017, 134, 45145. [Google Scholar] [CrossRef]
  36. Marsaglia, G. Random Number Generators. J. Mod. Appl. Stat. Methods 2003, 2, 2–13. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Illustrative description of the Intelligent Modeling Tool (IMT) and the Intelligent Optimization Tool (IOT) developed for tailoring the microstructure of olefin block copolymers (OBCs). KMC, Kinetic Monte Carlo.
Figure 1. Illustrative description of the Intelligent Modeling Tool (IMT) and the Intelligent Optimization Tool (IOT) developed for tailoring the microstructure of olefin block copolymers (OBCs). KMC, Kinetic Monte Carlo.
Polymers 11 00579 g001
Figure 2. A “fingerprint” of chain-shuttling copolymerization decoded by the IMT (which visualizes different classes of OBCs all having a monomer molar ratio of 0.75, but a different blocky nature). Values (50 to 5) appearing at the bottom of the plot close to the black curves represent copolymers having a specified hard block percent (HB%). CSA, chain-shuttling agent; DP, average degree of polymerization; ESL, ethylene sequence length; LES, longest ethylene sequence length.
Figure 2. A “fingerprint” of chain-shuttling copolymerization decoded by the IMT (which visualizes different classes of OBCs all having a monomer molar ratio of 0.75, but a different blocky nature). Values (50 to 5) appearing at the bottom of the plot close to the black curves represent copolymers having a specified hard block percent (HB%). CSA, chain-shuttling agent; DP, average degree of polymerization; ESL, ethylene sequence length; LES, longest ethylene sequence length.
Polymers 11 00579 g002
Figure 3. The identification card of intelligently synthesized OBC1 demonstrating all instantaneous and cumulative microstructural features of virtually produced chains.
Figure 3. The identification card of intelligently synthesized OBC1 demonstrating all instantaneous and cumulative microstructural features of virtually produced chains.
Polymers 11 00579 g003
Figure 4. The identification card of intelligently synthesized OBC2 demonstrating all instantaneous and cumulative microstructural features of virtually produced chains.
Figure 4. The identification card of intelligently synthesized OBC2 demonstrating all instantaneous and cumulative microstructural features of virtually produced chains.
Polymers 11 00579 g004
Table 1. Typical OBCs randomly selected in the ‘master plot’ of the IMT and synthesized by the KMC simulator under specified operating conditions together with their topology- and property-related molecular characteristics.
Table 1. Typical OBCs randomly selected in the ‘master plot’ of the IMT and synthesized by the KMC simulator under specified operating conditions together with their topology- and property-related molecular characteristics.
Topology-Microstructural CharacteristicsProperty-Microstructural Characteristics
DPnSOFTDPnHARDESLSOFTESLHARDLPC8%SOFTC8%HARDLESSOFTLESHARDHB%
Point A: {MR = 0.75 and CC = 0.539 and log(CSA) = 0.313}
KMC172.8830.6525.1028.9236.513.550.7096.4655.1913.30
ANN169.31122.0724.6731.7637.263.120.5187.4961.5114.17
Error %0.012.450.920.341.010.881.072.610.141.53
Point B: {MR = 0.75 and CC = 0.792 and log(CSA) = 1.886}
KMC122.4192.1123.6310.5264.872.179.2372.1216.455.97
ANN160.86102.5024.5813.8763.722.628.8778.0018.846.63
Error %0.100.282.040.411.550.922.021.710.051.16
Point C: {MR = 0.75 and CC = 0.859 and log(CSA) = −2.594}
KMC3301.3213068.3546.70649.530.012.940.17306.403183.622.52
ANN3555.2013176.4847.54666.290.643.100.25313.263249.554.53
Error %0.672.901.802.030.850.320.451.991.473.52
Point D: {MR = 0.75 and CC = 0.202 and log(CSA) = −2.184}
KMC1873.3218132.9420.32434.770.145.030.26111.811842.6644.80
ANN1967.3318094.8820.84456.820.335.260.19125.131927.4145.15
Error %0.251.021.122.680.260.470.393.871.890.61
Point E: {MR = 0.75 and CC = 0.229 and log(CSA) = 2.397}
KMC94.37148.9623.2612.5471.586.2413.0234.729.6135.05
ANN67.66117.6122.8416.0172.826.0012.5330.5017.8335.52
Error %0.070.840.900.421.670.492.751.230.180.82
LV5.137.122.342.190.001.890.123.295.841.35
HV38085.603736.8748.97825.4374.2850.7217.90347.304480.1558.38
LV and HV are the lowest and highest values of a given response among simulated scenarios, respectively. MR and CC stand for Monomer Molar Ration and Catalyst Composition, respectively. ANN, artificial neural network.
Table 2. The chain microstructure of the OBC1 and OBC2 macromolecules tailored using the IOT. The constraints/objectives used in the multi-objective optimization, Pareto fronts showing the best solution, and optimum input variables proposed by the IOT for the synthesis of OBC1 and OBC2 are provided. Microstructural features controlled by the IOT highlighted in yellow; KMC optimizer outputs obtained at identical optimum polymerization recipes highlighted in green; errors in the IOT predictions highlighted in Turquoise.
Table 2. The chain microstructure of the OBC1 and OBC2 macromolecules tailored using the IOT. The constraints/objectives used in the multi-objective optimization, Pareto fronts showing the best solution, and optimum input variables proposed by the IOT for the synthesis of OBC1 and OBC2 are provided. Microstructural features controlled by the IOT highlighted in yellow; KMC optimizer outputs obtained at identical optimum polymerization recipes highlighted in green; errors in the IOT predictions highlighted in Turquoise.
(A) OBC1(B) OBC2
Objective 1: M I N | H B % 30 | Objective 1: M I N | ( D P ¯ n S o f t 1 + N ¯ C 8 S o f t ) E S L S o f t |
Objective 2: M I N | ( E S L S o f t E S L H a r d ) 0.1 | Objective 2: M I N | ( D P ¯ n H a r d 1 + N ¯ C 8 H a r d ) E S L H a r d |
NC8: the average number of comonomer units per block.
Objective 3: M I N | H B % 45 |
Polymers 11 00579 i001 Polymers 11 00579 i002
Optimum Input VariablesOptimum Input Variables
MR0.213890MR0.44058
CC0.44755CC0.29194
Log(CSA Level)−0.79549Log(CSA Level)−1.41288
Optimum ResponsesOptimum Responses
IOTKMCError (%) IOTKMCError (%)
C8%SOFT46.943544.01555.99667C8%SOFT16.122119.23576.37665
C8%HARD3.662743.735340.40827C8%HARD1.287431.149770.77419
HB%30.000030.32360.56760HB%44.999444.78860.36974
ESLSOFT2.785772.531690.54488ESLSOFT5.331275.589880.5546
ESLHARD27.873529.58260.20761ESLHARD85.922489.30810.41127
DPnSOFT327.719310.2510.04587DPnSOFT678.959692.4880.03553
DPnHARD362.897475.7813.02657DPnHARD2853.942765.082.38255
NC8SOFT123.617136.6053.46589NC8SOFT126.314133.2361.84699
NC8HARD20.572317.78990.17786NC8HARD32.217331.85090.02342

Share and Cite

MDPI and ACS Style

Mohammadi, Y.; Saeb, M.R.; Penlidis, A.; Jabbari, E.; J. Stadler, F.; Zinck, P.; Matyjaszewski, K. Intelligent Machine Learning: Tailor-Making Macromolecules. Polymers 2019, 11, 579. https://doi.org/10.3390/polym11040579

AMA Style

Mohammadi Y, Saeb MR, Penlidis A, Jabbari E, J. Stadler F, Zinck P, Matyjaszewski K. Intelligent Machine Learning: Tailor-Making Macromolecules. Polymers. 2019; 11(4):579. https://doi.org/10.3390/polym11040579

Chicago/Turabian Style

Mohammadi, Yousef, Mohammad Reza Saeb, Alexander Penlidis, Esmaiel Jabbari, Florian J. Stadler, Philippe Zinck, and Krzysztof Matyjaszewski. 2019. "Intelligent Machine Learning: Tailor-Making Macromolecules" Polymers 11, no. 4: 579. https://doi.org/10.3390/polym11040579

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop