Next Article in Journal
The Causal Connection between CO2 Emissions and Agricultural Productivity in Pakistan: Empirical Evidence from an Autoregressive Distributed Lag Bounds Testing Approach
Next Article in Special Issue
Dynamic Response of Copper Plates Subjected to Underwater Impulsive Loading
Previous Article in Journal
Second Harmonic Revisited: An Analytic Quantum Approach
Previous Article in Special Issue
Application of the Non-Contact Video Gauge on the Mechanical Properties Test for Steel Cable at Elevated Temperature
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

New Four Points Initialization for Digital Image Correlation in Metal-Sheet Strain Measurements

by
Alejandro-Israel Barranco-Gutiérrez
1,*,
José-Alfredo Padilla-Medina
2,
Francisco J. Perez-Pinal
2,
Juan Prado-Olivares
2,
Saúl Martínez-Díaz
3 and
Oscar-Octavio Gutiérrez-Frías
4
1
Cátedras CONACyT—TecNM-Instituto Tecnológico de Celaya, Celaya 38010, Mexico
2
TecNM-Instituto Tecnológico de Celaya, Celaya 38010, Mexico
3
TecNM-Instituto Tecnológico de la Paz, La Paz 28080, Mexico
4
UPIITA-Instituto Politécnico Nacional, Ciudad de México 07340, Mexico
*
Author to whom correspondence should be addressed.
Appl. Sci. 2019, 9(8), 1691; https://doi.org/10.3390/app9081691
Submission received: 1 March 2019 / Revised: 8 April 2019 / Accepted: 14 April 2019 / Published: 24 April 2019
(This article belongs to the Special Issue Advances in Digital Image Correlation (DIC))

Abstract

:
Nowadays, the deformation measurement in metal sheets is important for industries such as the automotive and aerospace industries during its mechanical stamping processes. In this sense, Digital Image Correlation (DIC) has become the most relevant measurement technique in the field of experimental mechanics. This is mainly due to its versatility and low-cost compared with other techniques. However, traditionally, DIC global image registration implemented in software, such as MATLAB 2018, did not find the complete perspective transformation needed successfully and with high precision, because those algorithms use an image registration of the type “afine” or “similarity”, based on a 2D information. Therefore, in this paper, a DIC initialization method is presented to estimate the surface deformation of metal sheets used in the bodywork automotive industry. The method starts with the 3D points reconstruction from a stereoscopic digital camera system. Due to the problem complexity, it is first proposed that the user indicates four points, belonging to reference marks of a “Circle grid”. Following this, an automatic search is performed among the nearby marks, as far as one desires to reconstruct it. After this, the local DIC is used to verify that those are the correct marks. The results show reliability by reason of the high coincidence of marks in experimental cases. We also consider that the quality of mark stamping, lighting, and the initial conditions also contribute to trustworthy effects.

1. Introduction

The quality control of mechanical stamping is a need in modern industries. Engineers are always looking to improve the mechanical work optimization. Specifically, in the mechanical industry of metal-sheets manufacture, it is necessary to know their mechanical properties to use them in the most suitable way [1,2]. In this industry, the material properties such as Young’s modulus, Poisson’s ratio, anisotropic plastic ratio parameters and others are required for improving the design and manufacture processes by finite element analyses. On the other hand, the most commonly used method for finding the material properties is a tensile test with a strain-gauge type extensometer. However, the results from the extensometer are not applicable to measure the strain at a local point and the onset of diffuse necking. In contrast, the Digital Image Correlation (DIC) method is a state-of-the-art technique that can be used for an accurate strain measurement of material properties [3]. DIC has become a very popular technique in mechanics, particularly for measurement materials deformation without contact. It is an economic and versatile method which also offers a big amount of experimental data [4]. As digital cameras technology constantly improves in terms of resolution, lenses and frames per second (FPS), this technique allows covering a wide range of scale in space and time. DIC in stereo systems even reach non-planar cases, very common in the industry, meaning the three-dimensional reconstruction and access to volumetric data about the material and structure behavior through time. Nonetheless, the use of DIC data to validate models in a quantitative way or to identify with precision several constitutive parameters, remains an open problem. One of the reasons for this is the complicate compromise between the measuring resolution and the large space for the measuring to be done. A second reason is the state of the frontiers. A third reason is that the measured displacements are not directly compared with common simulations. Of course, there are several efforts presenting promising results, as well as [5], a work analyzing the damage in a super pression aerostatic balloon (SPB) used by the Japanese Aerospace Exploration Agency (JAXA) during the insufflate prove. The expansion, when it is not uniform, generates a concentration of stress and makes the balloon explode. They proved a new method called the Simplified Digital Image Correlation Method (SiDIC), in a rubber balloon, to verify if the SPB could be measured. The SiDIC identified in a correct way the non-deformed region even though the deformation was not precise.
Below, a brief historical background of DIC is given. An open code 3D-DIC Toolbox for MATLAB, the one implemented algorithm for multiple cameras, inspired by biomechanics, was reported in [6]. They were verified using the Multiple Digital Image Correlation Method (MultiDIC) and low-cost hardware. In [7], a quick method to correlate digital images (3D-DIC) was proposed to implement real-time measuring. Two improvements came up: the development of an efficient algorithm of the inverse composition of Gauss-Newton (IC-GN) with parallel computing to avoid redundant calculation, and an efficient IC-GN algorithm which was used to reach a speed of 10 frames/second with a resolution of 5000 points per frame. For validation, the displacement field of a four-point bending beam was determined by the real-time 3D-DIC. The experimental results were verified in traditional Chinese medicine. In the publication of [8], a procedure was developed to generate a sequence of intermediate synthetic images for a gradual following of the transformation of the pixel’s subset between the two external configurations. An adequate distortion function of image was defined in the whole image through adopting an algorithm based in characteristics and followed by a scheme of interpolation based in non-uniform rational B-spline (NURBS). This allowed a fast and trustworthy estimation of the initial deformation parameters for the refinement phase after the DIC analysis, and tests were made on aluminum plates. Document [9] proposed a method of deconvolution to recover the real fields of displacement and tension of their counterparts provided by local DIC. The proposed algorithm could be considered an extension of the Van Cittert deconvolution, based on the small tension assumption. The authors claimed an improvement on the fine details in displacement and tension maps, as well as in space resolution. The guidelines to evaluate the precision and resolution of the 2D analysis under the patronage of the Society of Experimental Mechanics were reported in [10].
On the other hand, algorithms to map relative displacements of the deformed material points in opposition to non-deformed material by using DIC were reported in [11,12]. The current possibilities for the DIC scale allows the study of deformation on different levels, from meters to the nanoscale [13,14], with the condition of recording it correctly, following a known pattern like a circle grid or square grid. Additionally, studies have looked at how different systems behave, like biological materials [15,16,17,18], metallic alloys [19,20,21], memory-shape alloys [22,23], porous metals [24,25,26], polymers [27] and polymeric foams [28]. A key step in the process of DIC image tracking is the definition of the initial assumption, for the non-linear optimization routine aimed at finding the parameters that describe the transformation of the subset of pixels. This initialization can be very challenging and possibly fail when it comes to pairs of highly deformed images, such as those obtained from two angled views of non-planar objects. For example, in Figure 1, it can be seen how the global DIC cannot exactly match the circle mark to measure the strain. This was performed with the MATLAB function called “imregcorr”, which was reported in [29].
As can be observed from the preceding discussion, there still is the question of whether it is possible to improve the DIC accurateness. In brief, these previous works highlight the need for developing a systematic approach for achieving this goal, which to the author’s awareness has not yet been stated. Therefore, in this paper we propose the use of a mark-search as an initial condition and of DIC as the system to verify the point-pairing. We propose the use of a mark-search as an initial condition and the use of DIC as the system to verify the point-pairing, because the number of mechanical part images are plentiful, the search for features to measure is very broad, as a result of which providing the initial conditions is necessary to fully automate the process gradually. The lack of a correct initial condition generates slowness and inaccurateness in current implementations of DIC. An appropriate initial condition is especially useful to know the material properties, specifically, its deformation curve and characterization zones such as: elastic, inelastic and rupture [30]. The proposed method in this work is applied to galvanized steel sheet, used in the outside bodywork of a pickup truck at 620 µm-thick and 96.5 µ hardness. Figure 2 shows the surface view of the material obtained from a metallographic microscope model:AX @ 200X, Company: Carl Zeiss AG, Jena, Turinga, Germany. It is necessary to mention that the experiments presented in this paper were all made for the automotive industry sector.

2. Theoretical Bases

The dimensional estimation using stereoscopic vision systems was described in detail by Tsai in [31], who quantitatively concluded that the accuracy and precision relied on the distance between the camera and the object to be measured, as well as the resolution of the cameras used. Stereoscopic vision is a technique frequently used to locate points in three dimensions (3D) based on points in two or more 2D images [6,32]. To achieve a stereoscopic point triangulation, it is necessary to calibrate both cameras. In this paper, we used the PinHole model, which is described by Equation (1) [33]:
s m ˜ = A [ R | t ] M ˜ = [ f x c u 0 0 f y v 0 0 0 1 ] [ r 11 r 12 r 13 r 21 r 22 r 23 r 31 r 32 r 33 | t x t y t z ] M ˜ = [ m 11 m 12 m 13 m 21 m 22 m 23 m 31 m 32 m 33 m 14 m 24 m 34 ] [ x y z 1 ]
since s is the number that defines the scale of the objects with respect to their real size in the image, and   [ R | t ] is the matrix of extrinsic parameters of the camera that describe the rigid transformation (rotation and translation) between the coordinate system of the camera and the coordinate system of an object outside the camera. A is the matrix of intrinsic parameters that describes the position of the center of the image in pixels ( u 0 , v 0 ) , and the ratio of the size of the pixel ( f x ,   f y ) has units expressed in p i x e l s m e t e r s in the axes x and y regarding the focal distance between the entrance hole of the light and the matrix of the light sensors of the camera. Parameter c describes the asymmetry of the two axes of a pixel where a zero expresses an angle of 90 degrees. On the other hand, the entry M = M ˜ = [ x y z 1 ] is a 3D point ( x , y , z ) in homogeneous coordinates of the scene or object expressed in meters in its own coordinate system, and m ˜ = [ u v 1 ] is the corresponding 2D point in the image expressed in pixels ( u , v ) . Finally, the correction of the lens distortion is made with a polynomial based on the idea that the distortion changes as a circumference, as in Equations (2) and (3):
u ˘ = u + ( u u 0 ) [ k 1 ( x 2 + y 2 ) + k 2 ( x 2 + y 2 ) 2 ]
v ˘ = v + ( v v 0 ) [ k 1 ( x 2 + y 2 ) + k 2 ( x 2 + y 2 ) 2 ]
Subsequently, to achieve a stereoscopic calibration, the translation vector that joins each camera reference system is calculated [34,35]. The point position in three dimensions can be estimated from the coordinates in two dimensions and the Equation (4) [33,36,37,38]:
[ u m 31 m 11 u m 32 m 12 u m 33 m 13 v m 31 m 21 v m 32 m 22 v m 33 m 23 u m 31 m 11 u m 32 m 12 u m 33 m 13 v m 31 m 21 v m 32 m 22 v m 33 m 23 ] [ x ^ y ^ z ^ ] = [ m 14 u m 34 m 24 v m 34 m 14 u m 34 m 24 v m 34 ]
where ( u , v ) and ( u , v ) are the coordinates of the paired points of the left and right cameras that correspond to the 3D point to be reconstructed. The scalars m i j are obtained by multiplying the intrinsic and extrinsic parameters of the left camera A [ R | t ] ; in an analogous way, the scalars m i j are obtained by multiplying the intrinsic and extrinsic parameters of the right chamber A [ R | t ] .

2.1. Normalized Cross Correlation (NCC)

Points matching, which consists of locating a point (photographed from different positions) in the left photograph and in the right image, is necessary to carry out the triangulation process. 2D-DIC is used to correlate a given set of points in the two stereo views of the reference configuration and match these points along the sequence of images. The correlated image points that are set are used to reconstruct and track the 3D position of the material points of the ROI (region of interest) through time [6]. In the literature, there are several works that report using 2D-DIC to accomplish this process, because this technique is so meaningful for 3D point reconstruction based on 2D images. The first advantage is that cross correlation is equally simple to calculate. Once a coincidence for a patch in a typical position inside an image is achieved, the Fourier methods can be used to calculate the correlation in a fast way. The second advantage is that cross correlation is independent from translations and invariant in the scaling dominance of the intensity. Equation (5) presents the definition of a normalized cross correlation:
N C C = ( i , j ) S [ f ( u , v ) f ¯ ] [ g ( u , v ) g ¯ ] ( i , j ) S [ f ( u , v ) f ¯ ] 2 ( i , j ) S [ g ( u , v ) g ¯ ] 2
Here, f and g are each the grayscale functions of the windows of the current image at a specific location (x, y). The functions f ¯ and g ¯ correspond to the gray scale mean of the reference image and the current subset.

2.2. Superficial Strain Estimation

To estimate the level of superficial strain, the engravings of speckle, circular or square marks on the sheet are used, which involves an electrochemical process in which an electrolyte is applied as a reagent on the surface of the sheet to engrave a thin pattern so that when the sheet is painted, the marking is imperceptible. The use of a circles pattern was chosen because it is considered a non-uniform mark deformation. In this proposed method, the facet sizes (window sizes) for the correlation function are defined by the distance between the circles’ centroids. The advantages and disadvantages of a circle pattern in contrast with a speckle pattern are show in Table 1.
After the sheet is subjected to the sausage process, the circles are distorted in the form of ellipses and the distances between their centroids are modified; the latter are used in the digital images to determine the deformation states in the testing metal sheet. Figure 3a,b shows the changes of the circular grid with the deformation of the metal sheet. A simple way to estimate the deformation in the centroid of each ellipse is by averaging the distance with its four neighboring centroids C ^ k 1 , l , C ^ k , l 1 , C ^ k + 1 , l and C ^ k , l + 1 , as expressed by Equation (6):
Δ f k , l = d ( C ^ i , j , C ^ i 1 , l ) + d ( C ^ i , j , C ^ i , j 1 ) + d ( C ^ i , j ,   C ^ i + 1 , j ) + d ( C ^ i , j , C ^ i , j + 1 ) 4
where d ( [ x 1 y 1 z 1 ] , [ x 2 y 2 z 2 ] ) = ( x 1 x 2 ) 2 + ( y 1 y 2 ) 2 + ( z 1 z 2 ) 2 .

3. Materials and Methods

3.1. Materials

To capture the images, a pair of Posilica GT 2750 (Allied vision, Exton, PA, USA) cameras with a sensitivity in the range of 400 nm to 670 nm as used. It has ethernet communication, a maximum capture rate of 33 fps, and resolution of 2750 to 2200 pixels at 230–250 lux. They were mounted on a metal structure that allows lighting control. Figure 4 shows the arrangement of the cameras, the light source and the metal test piece used to test the proposed method. LED lighting was chosen due to the contrast with the circles marked on the sheet: a blue LED of 640 nm, which coincides with the work [39]. To compare the dimensional measurements, a digital microscope (Jiusion 6-06814-24289-8) with a 100 μm scale was used.

3.2. Method

The proposed method has the purpose of measuring the surface deformation in a metal sheet specimen used for truck exteriors, and it was divided into ten stages from (a) to (j). The peculiarity of this procedure consists of the incorporation of an initial condition based on points normalization to perform the matching using 2D-DIC. The general procedure is as follows:
(a)
Stamping of known circle grid on the unformed metal sheet.
(b)
Deformation of the metal-sheet through the mechanical stamping process.
(c)
Calibration of cameras.
(d)
Illumination of the piece with LED blue light for measuring.
(e)
Capture of stereo images.
(f)
Selection of four landmarks.
(g)
Search for neighbor’s centroid.
(h)
Calculation of the NCC in the proposed neighborhood.
(i)
Triangulation of the points to obtain their position in 3D space.
(j)
Strain estimation from averaging the centroids’ differences with the four neighbors using Equation (6).
The process includes the stamping of the known circle grid on the unformed metal sheet and the deformation of the sheet through the mechanical stamping process, because it is important to delimit the application of the proposed method.
The individual camera calibration can be performed with the “calib” function, while the stereoscopic calibration can be performed with the function “stereo_gui”. Both are from the library “Camera Calibration Toolbox for Matlab” published by Jean-Yves Bouguet [40]. The illumination can be performed through a blue LED set. It is important that the image capture is done with the calibrated camera system.

3.3. Four-Points Initialization

The construction of the 3D centroid mesh C M = C i , j of the deformed circles pattern begins with the process of obtaining the binarized image, which is detailed in Appendix A. After this, two clicks given on two consecutive ellipses of the left binarized image and two on the same circles of the right binarized image (Figure 5), allows for a knowledge of the distance and slope between two centroids of pseudo-ellipses.
The clicks do not necessarily have to be done on the centroids; it is only necessary that they are done on the two consecutives pseudo-ellipses. The selected points are referred to as ( x 0 , 0 l e f t ,   y 0 , 0 l e f t ) and ( x 1 , 0 l e f t ,   y 1 , 0 l e f t ) , while in the right image the points are ( x 0 , 0 r i g h t ,   y 0 , 0 r i g h t ) and ( x 1 , 0 r i g h t ,   y 1 , 0 r i g h t ) . To work with discrete values, the values of each point, in each image, are rounded up because the computational functions give fractions of the pixels where the mouse is clicked via the computer. From the rounded coordinates provided by the user, the blob number n b i s (considering a blob as a group of pixels with a connected connection equal to four) is retrieved to provide the coordinates of the centroid, also rounded; as an index of the tagged image (7).
n b i s = L s ( x ˜ i , j s , y ˜ i , j s )
where s can be the left or right side, and L s ( x , y ) is the labeled image as explained in Appendix A.
Next, the centroid of each blob C i , j s is calculated using the statistical moments for 2D (8) with the help of Equations (9) and (10):
C i , j s = ( x c i , j s , y c i , j s ) = ( m 10 m 00 , m 01 m 00 )
m p q = x = 1 k y = 1 l x p y q B O s ( x , y )
B O s ( x , y ) = { 1    s i    L s ( x , y ) = n b i s 0          o t h e r w i s e
The distance and the slope between the two centroids in Equations (11) and (12) are calculated to initiate an iterative automatic process of estimation of the 2D position of blobs. The estimation of the next blob position from the information of the two clicks on each image y c i + 1 , j s , y c i , j s , x c i + 1 , j s and x c i , j s :
d ˜ g , h s = ( y c i + 1 , j s y c i , j s ) 2 + ( x c i + 1 , j s x c i , j s ) 2
m ˜ g , h s = ( y c i + 1 , j s y c i , j s ) ( x c i + 1 , j s x c i , j s )
where g and h are the index of the distances and slopes matrixes.
From Equations (11) and (12), the pseudo-row of marks is estimated using Equations (13) and (14):
x c ˜ i + 1 , j s = x c i , j s + d ˜ g , h s cos ( m ˜ g , h s )
y c ˜ i + 1 , j s = y c i , j s + d ˜ g , h s cos ( m ˜ g , h s )
Meanwhile, to find the next row, Equations (15) and (16) are used:
x c ˜ i , j + 1 s = x c i , j s + d ˜ g , h s cos ( m ˜ t 1 s + π / 2 )
y c ˜ i , j + 1 s = x c i , j s + d ˜ g , h s cos ( m ˜ t 1 s + π / 2 )
The normalized cross-correlation (5) is used to ensure a good pairing of centroids. This drastically decreases the number of operations performed for the matching between the interest points and at the same time takes advantage of the reliability granted by the NCC. The Matlab code can be downloaded from https://sites.google.com/itcelaya.edu.mx/dic/.

4. Results

The results of a typical initialization of the DIC are displayed in Figure 6 to show an initialization comparison. The working conditions were: one facet of 21 × 21, the search for the maximum normalized correlation, one-pixel step, and 100 marks that were pre-selected in the left image.
To observe the behavior of the normalized correlation internally, the correlation between a left image ellipse against all the possible 21 × 21 facets of the right image was plotted to qualitatively locate the maximum peak of the correlation (Figure 7).
The engraving of light reference circles on the metal sheet resulted from an equidistance of 1.55 mm between the centroids when the metal sheet had not been deformed. The measurement made with a microscope is shown in Figure 8, where the before (Figure 8a) and after (Figure 8b) deformation is appreciated.
On the other hand, the calibration parameters of the right and left cameras, as well as the translation vector between both cameras are the following:
Intrinsic parameters of the left camera:
Focal length:  fc_left = [ 4139.77293   4125.08567 ] ± [ 262.92862   287.85915 ]
Principal point:  cc_left = [ 1386.44233   1290.81589 ] ± [ 145.82339   108.75101 ]
Skew:  alpha_c_left = [ 0.00000 ] ± [ 0.00000 ] => pixel angle = 90.00000 ± 0.00000 degrees
Distortion:  kc_left = [ −0.03826   −0.81032   −0.00495   −0.00231  0.00000 ] ± [ 0.15686   2.09125   0.00925   0.01010  0.00000 ]
Intrinsic parameters of the right camera:
Focal length:  fc_right = [ 4009.97898   4233.47842 ] ± [ 271.16800   339.84438 ]
Principal point:  cc_right = [ 1149.40996   962.27029 ] ± [ 198.63016   96.89436 ]
Skew:  alpha_c_right = [ 0.00000 ] ± [ 0.00000 ] => pixel angle = 90.00000 ± 0.00000 degrees
Distortion:   kc_right = [ −0.12949   0.25429   0.00496   0.02934  0.00000 ] ± [ 0.13731   0.93124   0.00825   0.01424   0.00000 ]
Extrinsic parameters (position of the right chamber with respect to the one on the left):
Rotation (In Rodrigues format):  om = [ −0.00856   0.37660   0.00093 ] ± [ 0.03213   0.04287   0.00594 ]
Translation vector:  T = [ −85.14492   33.53035   24.13032 ] ± [ 2.97387   1.09323   11.19968 ]
The results of the image processing step are shown in Figure 9. In the top row, the pair of stereo images before the area filter is presented, while in the row below, the images after the area filter application are reported.
We selected one hundred points to show the method´s accuracy in a space of 100 × 100 marks. To verify if each point matching was right, the local DIC was calculated for the proposed points estimated in the initialization stage. The best correspondence was in the same position projected by the four-point method. Figure 10 shows a case of the correlation using a window of 31 × 31 pixels on a zone of 21 × 21 pixels. The MATLAB function used for this aim was “corr2”.
Figure 11 shows the points matching of an area of 10 × 10 deformed circular marks. Those are the same taken to perform the 3D reconstruction. On one side, the detail of the points matching is shown with a zoom.
Figure 12 shows the three-dimensional reconstruction of the marks found and verified for the point matching stage. From the 3D reconstruction the strain was calculated using Equation (6), averaging the distances between the four neighboring marks of the mesh of circles of a radius of 0.5 mm and a separation between the centers of 2.55 mm. The strain estimated by the proposed method is shown in Figure 13.
The strains estimated in points having their four neighbors from a matrix of 100 × 100 were reduced to a matrix of 8 × 8. The values in Table 2 and Table 3 were obtained with the stereoscopic vision system. From these results, it can be calculated that the average error in the experiment was, in this case, ϵ = 1.290878 % (0.019995 mm.). This takes into account a distance between the centroids of the marks of 1.55 mm, without deformation.

5. Discussion

The principal contribution of this work consists in the correct points-pairing between images (100%), in the specific case of almost-identical marks, to measure the deformation of a metal sheet with a small error. The method is semi-automatic due to the high complexity of the shown problem. This is evident when using the MATLAB function called “imregcorr” [41], and it is solved when the user indicates only two pairs of coinciding points. This works as an initial condition to begin a search of correspondent marks among the images. Basically, we noticed that the initial conditions of the search increased, in a notable way, the efficiency of the point-pairing system (with efficiency referring to the amount of paired marks, divided between the total of marks in the space of analysis). We assumed that the quality of the mark stamping, lighting, and the initial conditions, also contribute to trustworthy effects. According to the results, it can be observed that the correlation applied to the detection of deformed circular patterns (ellipses) is not ordered. This is because the objective of the construction of the pattern is to make the marks identical and that, in opposition to this, the correlation uses the differences between marks to emit a factor of similarity. The system was also compared with a manual deformation measurement using a microscope, which achieved a low sensitivity of the camera system and a displacement. This was due to the resolution of the camera system. In terms of processing time, it is well known that the correlation has a computational complexity of m2n2 for an nxn image and an mxm template. Meanwhile, the proposed method depends on the number of points on the analyzed sheet; which is many times less than the number of pixels of an image, and it also depends on the distance between the camera and the printed sheet that is to be studied.

6. Conclusions

The proposed methodology solves the corresponding points-pairing for cases where multiple marks tend to be identical. This is one of the most complex and difficult problems DIC experiences in stereoscopic vision. The philosophical basis where most of points-pairing algorithms reside is the search for differences between the objects inside images. This goes against the goal of the Circle-grid of obtaining identical circles. The proposal in this work takes advantage of the characteristics of the problem to reduce its fallibility and to reach very important results, as well as the knowledge of an equal-points grid and a superficial deformation of less than 50%; which is of interest. The results are compared to the predetermined MATLAB function to show the advantages of this work´s proposal, which may be of use with a high degree of trustworthiness, thanks to the large amount of accurate correspondences. The processing time for the search in the initial conditions is relatively low because only distances, slopes and cosine functions are calculated. This way of solving the problem could be used in systems requiring patterns or points-grids, such as squares, hexagons and others. As a future work, we suggest to automatize in a total way the points´ correspondence without losing the gained benefits.

Author Contributions

Conceptualization, A.-I.B.-G. and J.-A.P.-M.; formal analysis, J.P.-O.; methodology F.J.P.-P.; software, S.M.-D.; validation, O.-O.G.-F.

Funding

The authors wish to thank the Instituto Poliécnico Nacional for its support provided through the project SIP-20195901. In addition, the authors would like to express their gratitude to the COFAA for its financial support and to the CONACYT for Cátedra ID 1641, TecNM and PRODEP.

Acknowledgments

We would also like to thank Karla Cárcamo Pérez for her valuable editorial help.

Conflicts of Interest

The authors declare no conflict of interests. The funders had no role in the design of the study, in the collection, analyses, or interpretation of data; nor in the writing of the manuscript, or in the decision to publish the results.

Appendix A

In this section, an image process is made to binarize the ellipses engraved on the metal sheets. With this, the initial condition for 2D-DIC is found. The first step is to situate the threshold in the image by using the Otsu method; that way, absolute-white circular marks will be obtained. Immediately after this, a number must be assigned to the ellipses (blobs) so they can be indexed onto the process of labelling the connected components. By the end, these connected components are discharged from areas bigger than 80 pixels. Considering that the pair of images is represented in monochrome, with a size of N × M and a pixel resolution of b bits, the pair of images can be represented as:
I s ( x , y , z ) { 0 2 b } { 1 x M } , { 1 y N }
where s represents the right or the left camera.
We receive an image in grayscale. Following this, we make a complement of this image to enhance the importance of the circles, as indicated in Equation (A2), and to obtain fair marks:
C s ( x , y ) = 2 b I g s ( x , y )
where s refers to left or right image.
To obtain a wide image-operation range, these images are normalized, as indicated in Equation (A3):
N I s ( x , y ) = 2 b C s m i n ( C s ) m a x ( C s ) m i n ( C s )
A difficulty of the non-uniform-illumination is presented on the metal-sheet surface by the nature of the problem. To decrease it, an adaptive filter of average window (A3) is applied to the normalization process on the image, where the size of the window is three times the average of the circular mark’s ratios, in pixels. The filter is defined by Equations (A4) and (A5):
S M s ( x , y ) = k = 1 M l = 1 N N I s ( k , l ) 1 ( 3 r ) 2 J s 3 r , 3 r ( x k , y l )
S I s ( x , y ) = N I s ( x , y ) α S M s ( x , y )
Afterwards, another normalization is applied, through Equation (A3) on Equation (A5), and a thresholding with the Otsu method is applied to obtain a binarized version B s ( x , y ) of S I s ( x , y ) . In such a process, we receive as a result the marks in white and the other regions in black. The next step is to label the binarized image elements O i s ( x , y ) = l a b e l i n g ( B s ( x , y ) ) . Here, every binarized segment of the image (blob) is independent: O i s O j s j i for i , j = 1 , 2 , , L N . Nonetheless, it is common to have small non-representative stains in that set of blobs O i s ( x , y ) , and this is why an interconnected pixels selection is applied with areas less than 80 pixels (A6):
L i s ( x , y ) = { O i s ( x , y )     a r e a [ O i s ( x , y ) ] < a s }
The overall previous process is shown in Figure A1 and dot matrix position indexes Figure A2.
Figure A1. Pair of images of the stereoscopic system showing the result of each stage of the pre-processing of images. The upper row presents the left-side images, and the lower row presents those from the right-side.
Figure A1. Pair of images of the stereoscopic system showing the result of each stage of the pre-processing of images. The upper row presents the left-side images, and the lower row presents those from the right-side.
Applsci 09 01691 g0a1aApplsci 09 01691 g0a1b
Figure A2. Binarized left-side photography to obtain a candidate’s marks.
Figure A2. Binarized left-side photography to obtain a candidate’s marks.
Applsci 09 01691 g0a2

References

  1. Choi, J.; Choi, B.; Heo, S.; Oh, Y.; Shin, S. Numerical modeling of the thermal deformation during stamping process of an automotive body part. Appl. Therm. Eng. 2018, 118, 159–172. [Google Scholar] [CrossRef]
  2. Lee, H.H.; Yoon, J.I.; Kim, H.S. Single-roll angular-rolling: A new continuous severe plastic deformation process for metal sheets. Scr. Mater. 2018, 146, 204–207. [Google Scholar] [CrossRef]
  3. Nguyen, V.T.; Kwon, S.J.; Kwon, O.H.; Kim, Y.S. Mechanical Properties Identification of Sheet Metals by 2D-Digital Image Correlation Method. Procedia Eng. 2017, 184, 381–389. [Google Scholar] [CrossRef]
  4. Blaber, J.; Adair, B.; Antoniou, A. Ncorr: Open-Source 2D Digital Image Correlation Matlab Software. Exp. Mech. 2015, 55, 1105–1122. [Google Scholar] [CrossRef]
  5. Kazuki, K.; Takuma, M.; Shuichi, A. Measurement of Super-Pressure Balloon Deformation with Simplified Digital Image Correlation. Appl. Sci. 2018, 8, 9. [Google Scholar] [CrossRef]
  6. Solav, D.; Moerman, K.M.; Jaeger, A.M.; Genovese, K.; Herr, H.M. MultiDIC: An Open-Source Toolbox for Multi-View 3D Digital Image Correlation. IEEE Access 2018, 16, 30520–30535. [Google Scholar] [CrossRef]
  7. Xinxing, S.; Xiangjun, D.; Chen, Z.; He, X. Real-time 3D digital image correlation method and its application in human pulse monitoring. Appl. Opt. 2016, 55, 696–704. [Google Scholar] [CrossRef]
  8. Genovese, K.; Sorgente, D. A morphing-based scheme for large deformation analysis with stereo-DIC. Opt. Lasers Eng. 2018, 104, 159–172. [Google Scholar] [CrossRef]
  9. Reu, P.L.; Toussaint, E.; Jones, E.; Bruck, H.A.; Iadicola, M.; Balcaen, R.; Turner, D.Z.; Siebert, T.; Lava, P.; Simonsen, M. DIC Challenge: Developing Images and Guidelines for Evaluating Accuracy and Resolution of 2D Analyses. Exp. Mech. 2017, 58, 1067–1099. [Google Scholar] [CrossRef]
  10. Grédiac, M.; Blaysat, B.; Sur, F. A Robust-to-Noise Deconvolution Algorithm to Enhance Displacement and Strain Maps Obtained with Local DIC and LSA. Exp. Mech. 2018, 1, 1–25. [Google Scholar] [CrossRef]
  11. Bruck, H.A.; McNeill, S.R.; Sutton, M.A.; Peters, W.H. Digital image correlation using Newton–Raphson method of partial differential correction. Exp. Mech. 1989, 29, 261–267. [Google Scholar] [CrossRef]
  12. Cheng, P.; Sutton, M.A.; Schreier, H.W.; McNeill, S.R. Full-field speckle pattern image correlation with B-spline deformation function. Exp. Mech. 2002, 42, 344–352. [Google Scholar] [CrossRef]
  13. Kammers, A.D.; Daly, S. Small-scale patterning methods for digital image correlation under scanning electron microscopy. Meas. Sci. Technol. 2011, 22, 125501. [Google Scholar] [CrossRef]
  14. Rubino, V.; Lapusta, N.; Rosakis, A.; Leprince, S.; Avouac, J. Static laboratory earthquake measurements with the digital image correlation method. Exp. Mech. 2015, 55, 77–94. [Google Scholar] [CrossRef]
  15. Dickinson, A.S.; Taylor, A.C.; Ozturk, H.; Browne, M. Experimental validation of a finite element model of the proximal femur using digital image correlation and a composite bone model. J. Biomech. Eng. 2011, 133, 014504. [Google Scholar] [CrossRef]
  16. Zhang, D.; Eggleton, C.; Arola, D. Evaluating the mechanical behavior of arterial tissue using digital image correlation. Exp. Mech. 2002, 42, 409–416. [Google Scholar] [CrossRef] [Green Version]
  17. Franck, C.; Maskarinec, S.A.; Tirrell, D.A.; Ravichandran, G. Three-dimensional traction force microscopy: A new tool for quantifying cell-matrix interactions. PLoS ONE 2011, 6, e17833. [Google Scholar] [CrossRef]
  18. Wang, H.; Lai, W.; Antoniou, A.; Bastawros, A. Application of digital image correlation for multiscale biomechanics. In Handbook of Imaging in Biological Mechanics; CRC Press: Oxfords, UK, 2014; pp. 141–151. [Google Scholar]
  19. Carroll, J.D.; Abuzaid, W.; Lambros, J.; Sehitoglu, H. High resolution digital image correlation measurements of strain accumulation in fatigue crack growth. Int. J. Fatigue 2013, 57, 140–150. [Google Scholar] [CrossRef]
  20. Tong, W. Detection of plastic deformation patterns in a binary aluminum alloy. Exp. Mech. 1997, 37, 452–459. [Google Scholar] [CrossRef]
  21. Rehrl, C.; Kleber, S.; Antretter, T.; Pippan, R. A methodology to study crystal plasticity inside a compression test sample based on image correlation and EBSD. Mater. Charact. 2011, 62, 793–800. [Google Scholar] [CrossRef]
  22. Daly, S.; Ravichandran, G.; Bhattacharya, K. Stress-induced martensitic phase transformation in thin sheets of Nitinol. Acta Mater. 2007, 55, 3593–3600. [Google Scholar] [CrossRef]
  23. Reedlunn, B.; Daly, S.; Hector, L.; Zavattieri, P.; Shaw, J. Tips and tricks for characterizing shape memory wire part 5: Full-field strain measurement by digital image correlation. Exp. Technol. 2013, 37, 62–78. [Google Scholar] [CrossRef]
  24. Bastawros, A.; Bart-Smith, H.; Evans, A. Experimental analysis of deformation mechanisms in a closed-cell aluminum alloy foam. J. Mech. Phys. Solids 2000, 48, 301–322. [Google Scholar] [CrossRef]
  25. Bart-Smith, H.; Bastawros, A.-F.; Mumm, D.; Evans, A.; Sypeck, D.; Wadley, H. Compressive deformation and yielding mechanisms in cellular Al alloys determined using X-ray tomography and surface strain mapping. Acta Mater. 1998, 46, 3583–3592. [Google Scholar] [CrossRef]
  26. Antoniou, A.; Onck, P.; Bastawros, A.F. Experimental analysis of compressive notch strengthening in closed-cell aluminum alloy foam. Acta Mater. 2004, 52, 2377–2386. [Google Scholar] [CrossRef]
  27. Jerabek, M.; Major, Z.; Lang, R. Strain determination of polymeric materials using digital image correlation. Polym. Test. 2010, 29, 407–416. [Google Scholar] [CrossRef]
  28. Wang, Y.; Cuitiño, A.M. Full-field measurements of heterogeneous deformation patterns on polymeric foams using digital image correlation. Int. J. Solids. Struct. 2002, 39, 3777–3796. [Google Scholar] [CrossRef]
  29. Reddy, B.S.; Chatterji, B.N. An FFT-Based Technique for Translation, Rotation, and Scale-Invariant Image Registration. IEEE Trans. Image Proc. 1996, 5, 1266–1271. [Google Scholar] [CrossRef]
  30. Min, J.; Stoughton, T.B.; Carsley, J.E.; Lin, J. Comparison of DIC methods of determining forming limit strains. Procedia Manuf. 2017, 7, 668–674. [Google Scholar] [CrossRef]
  31. Tsai, T.R. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J. Robot. Autom. 1987, RA-3, 323–344. [Google Scholar] [CrossRef]
  32. Barranco-Gutiérrez, A.I.; Martínez-Díaz, S.; Gómez-Torres, J.L. Visión estereoscópica con Matlab y OpenCV, 1st ed.; Pearson Education: Mexico City, Mexico, 2018; pp. 10–53. [Google Scholar]
  33. Zhang, Z. A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Int. 2000, 22, 1330–1334. [Google Scholar] [CrossRef] [Green Version]
  34. Cofaru, C.; Philips, W.; Paepegem, W.V. A novel speckle pattern Adaptive digital image correlation approach with robust strain calculation. Opt. Laser Eng. 2012, 50, 187–198. [Google Scholar] [CrossRef]
  35. Garcia, D.; Orteu, J.J.; Penazzi, L. A combined temporal tracking and stereo-correlation technique for accurate measurement of 3D displacements: Application to sheet metal forming. J. Mater. Proc. Technol. 2002, 125–126, 736–742. [Google Scholar] [CrossRef]
  36. Shi, J.; Chen, F.; Lu, J.; Chen, G. An evolutionary image matching approach. Appl. Soft Comput. 2013, 13, 3060–3065. [Google Scholar] [CrossRef]
  37. Cyrille, B.; Philippe, D. Automatic Camera Calibration. U.S. Patents US20160350921 A1, 2 May 2017. [Google Scholar]
  38. Jia, Z.; Yang, J.; Liu, W.; Wang, F.; Liu, Y.; Wang, L.; Fan, C.; Zhao, K. Improved camera calibration method based on perpendicularity compensation for binocular stereo vision measurement system. Opt. Expres 2015, 23, 15205–15223. [Google Scholar] [CrossRef] [PubMed]
  39. García-Rodenas, L.A.; Araujo, P.; Bruyère, V.I.E.; Morando, P.J.; Regazzoni, A.E.; Blesa, M.A. A Model for the Dissolution of Metal Oxides Mediated by Heterogeneous Charge Transfer. Anales de la Asociación Química Argentina, 2004, Volume 92, n.1-3. Available online: http://www.scielo.org.ar/scielo.php?script=sci_arttext&pid=S0365-03752004000100007 (accessed on 16 April 2019).
  40. Computational Vision at Caltech. Camera Calibration Toolbox for Matlab. Available online: http://www.vision.caltech.edu/bouguetj/calib_doc/ (accessed on 24 February 2019).
  41. Matlab Company. Image Processing Toolbox™ User’s Guide; Mathworks: Sherborn, MA, USA, 2018; pp. 6-18–6-60. Available online: https://www.mathworks.com/help/images/ (accessed on 16 April 2019).
Figure 1. Global correlation with an error of image registration transform.
Figure 1. Global correlation with an error of image registration transform.
Applsci 09 01691 g001
Figure 2. The surface view of a metal sheet from a metallographic microscope AX ZEISS @ 200X.
Figure 2. The surface view of a metal sheet from a metallographic microscope AX ZEISS @ 200X.
Applsci 09 01691 g002
Figure 3. (a) Circles on metal sheet without deformation; and (b) circles on formed metal sheet.
Figure 3. (a) Circles on metal sheet without deformation; and (b) circles on formed metal sheet.
Applsci 09 01691 g003
Figure 4. Setting of stereo cameras with illumination and metal sheet.
Figure 4. Setting of stereo cameras with illumination and metal sheet.
Applsci 09 01691 g004
Figure 5. The user with blue (+) and the centroids of each blob in red (*).
Figure 5. The user with blue (+) and the centroids of each blob in red (*).
Applsci 09 01691 g005
Figure 6. Pairing of points with typical initialization of the Digital Image Correlation.
Figure 6. Pairing of points with typical initialization of the Digital Image Correlation.
Applsci 09 01691 g006
Figure 7. Correlation between a left image ellipse versus the overall possible 21 × 21 facets of the right image.
Figure 7. Correlation between a left image ellipse versus the overall possible 21 × 21 facets of the right image.
Applsci 09 01691 g007
Figure 8. (a) Image captured before the forming mechanical process of the metal sheet; and (b) image captured after the forming mechanical process of the metal sheet.
Figure 8. (a) Image captured before the forming mechanical process of the metal sheet; and (b) image captured after the forming mechanical process of the metal sheet.
Applsci 09 01691 g008
Figure 9. Image segmentation to obtain referential ellipses for the deformation measurement.
Figure 9. Image segmentation to obtain referential ellipses for the deformation measurement.
Applsci 09 01691 g009
Figure 10. Correlation on one matching projected by a four-point initialization using a window of 31 × 31 pixels on a zone of 21 × 21 pixels.
Figure 10. Correlation on one matching projected by a four-point initialization using a window of 31 × 31 pixels on a zone of 21 × 21 pixels.
Applsci 09 01691 g010
Figure 11. Points matching using the initial condition proposed and verified by Normalized Cross Correlation.
Figure 11. Points matching using the initial condition proposed and verified by Normalized Cross Correlation.
Applsci 09 01691 g011
Figure 12. Three-dimensional reconstruction of marks on the metal-sheet surface from point matching.
Figure 12. Three-dimensional reconstruction of marks on the metal-sheet surface from point matching.
Applsci 09 01691 g012
Figure 13. Estimated strain in the selected zone.
Figure 13. Estimated strain in the selected zone.
Applsci 09 01691 g013
Table 1. The advantages and disadvantages of circle pattern versus speckle pattern.
Table 1. The advantages and disadvantages of circle pattern versus speckle pattern.
CharacteristicsSpeckle PatternCircle Pattern
The normalized correlation matches well with the patterns.YESNO
Mark deformation is assumed as irregular.NOYES
A pixel can represent a mark.Some casesYES
Independence of the distance between the cameras and the specimen.Some casesYES
Table 2. Estimated strain (%) using the proposed method.
Table 2. Estimated strain (%) using the proposed method.
Position Indexesj = 1j = 2j = 3j = 4j = 5j = 6j = 7j = 8
i = 110.462310.33410.298810.194510.206610.236910.193210.1931
i = 210.281410.272110.326810.201310.141610.200110.146110.209
i = 310.273910.320210.290610.257110.166510.158410.245410.2757
i = 410.361510.288610.254210.235110.309410.286610.211310.217
i = 510.269210.28210.288510.441210.355610.227210.249410.158
i = 610.436510.351410.245110.404710.36110.259210.300710.3751
i = 710.358710.437110.388510.139810.21510.277810.187710.3029
i = 810.366410.327610.359910.299910.31410.356910.239410.172
Table 3. Estimated strain (%) using a digital microscope.
Table 3. Estimated strain (%) using a digital microscope.
Position Indexesj = 1j = 2j = 3j = 4j = 5j = 6j = 7j = 8
i = 111.29039.67749.35489.67748.8718.06458.06457.2581
i = 210.48398.8717.25818.06458.06455.64524.83875.6452
i = 36.45168.06458.54847.74196.45166.45166.45166.4516
i = 48.06459.67749.67747.25816.45166.45165.64526.4516
i = 58.064510.161310.16135.64525.64526.45165.64527.2581
i = 611.290311.29038.06457.25818.064510.48398.064510.9677
i = 713.709710.48398.8718.8718.8719.67748.87112.9032
i = 89.67746.45167.25818.064510.48397.25816.45168.871

Share and Cite

MDPI and ACS Style

Barranco-Gutiérrez, A.-I.; Padilla-Medina, J.-A.; Perez-Pinal, F.J.; Prado-Olivares, J.; Martínez-Díaz, S.; Gutiérrez-Frías, O.-O. New Four Points Initialization for Digital Image Correlation in Metal-Sheet Strain Measurements. Appl. Sci. 2019, 9, 1691. https://doi.org/10.3390/app9081691

AMA Style

Barranco-Gutiérrez A-I, Padilla-Medina J-A, Perez-Pinal FJ, Prado-Olivares J, Martínez-Díaz S, Gutiérrez-Frías O-O. New Four Points Initialization for Digital Image Correlation in Metal-Sheet Strain Measurements. Applied Sciences. 2019; 9(8):1691. https://doi.org/10.3390/app9081691

Chicago/Turabian Style

Barranco-Gutiérrez, Alejandro-Israel, José-Alfredo Padilla-Medina, Francisco J. Perez-Pinal, Juan Prado-Olivares, Saúl Martínez-Díaz, and Oscar-Octavio Gutiérrez-Frías. 2019. "New Four Points Initialization for Digital Image Correlation in Metal-Sheet Strain Measurements" Applied Sciences 9, no. 8: 1691. https://doi.org/10.3390/app9081691

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop