Next Article in Journal
SND@LHC: A New Experiment in Neutrino Physics at the LHC
Previous Article in Journal
Monomiality and a New Family of Hermite Polynomials
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Research on Visual Measurement of Aperture and Hole Group Center Distance Based on Geometric Constraint

1
College of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun 130012, China
2
School of Electronic Information Engineering, Changchun University, Changchun 130022, China
3
College of Mechanical and Vehicle Engineering, Changchun University, Changchun 130022, China
4
School of Mechanical and Aerospace Engineering, Jilin University, Changchun 130025, China
*
Author to whom correspondence should be addressed.
Symmetry 2023, 15(6), 1255; https://doi.org/10.3390/sym15061255
Submission received: 2 May 2023 / Revised: 3 June 2023 / Accepted: 7 June 2023 / Published: 13 June 2023
(This article belongs to the Section Engineering and Materials)

Abstract

:
Hole is the most common symmetrical geometric structure of mechanical parts, and aperture and hole center distance are important measured dimensions in machining. However, existing visual measurement methods often require high equipment installation accuracy and low measurement accuracy. To solve the problem of projection deformation of the measured hole: Firstly, a local coordinate system is created, and the coordinate plane of the coordinate is parallel to the end face of the measured hole. Secondly, a cone is established, the end face of the measured hole is alike to the bottom face of the cone, and the optical center of the camera is the vertex. The space equation of the cone is represented by the coordinates of the center point of the hole. Finally, a cutting plane is established near the imaging plane of the camera, and the intersection line equation between the plane and the cone is obtained, and the diameter of the measured hole and the coordinates of the center of the circle are obtained through the parameters of the intersection line equation. In order to solve the problem of errors in edge points of the hole, geometric constraints based on the center of the circle are used to improve measurement accuracy. This experiment takes the automobile insert mold as the measured part and uses the measurement model of this paper to measure the aperture and hole center distance of the mold. The measurement results show that the measurement accuracy of the aperture is 0.018 mm, the measurement accuracy of the center distance of the hole is 0.05 mm, and the maximum relative error is 2.2%.

1. Introduction

A hole and a hole group composed of multiple holes according to a certain positional relationship are some of the most basic geometric elements in mechanical structure [1,2]. Aperture and center distance are important dimensions of mechanical parts.
The existing hole diameter and hole group center distance measurement methods are mainly based on contact measurement [3,4,5]. Inner hole plug gauges or special position gauges are used to complete the measurement in mass production, and inner diameter micrometers are often used to measure holes in small batch production. For parts with high precision requirements, the three-coordinate measuring instrument is used to obtain the position size between the hole groups. Since contact measurement requires human participation and cannot achieve online detection, it is not suitable for intelligent manufacturing.
Non-contact measurement uses a variety of sensors to measure the apertures and the center distance of the hole group without contacting the holes [6,7,8,9,10,11]. The vision measurement is an important measurement method and is widely used in hole size measurement [12,13,14,15,16,17,18,19].
Gong et al. [20] introduced the methods of obtaining aperture by different measurement methods, and these methods included contact probes, inductive sensor, laser sensor, and the machine vision method. Compared with other methods, the visual method was easily affected by environment lighting. Li et al. [21] proposed a method for measuring the position and size of hole groups by using a vision system consisting of two cameras and a cross-laser. The method obtains the center line of the light stripe through the improved direction template, and the position error of the hole group can be solved by the center line of the structured light. The experimental results show that the aperture measurement accuracy of this method is 0.001 mm, and the standard deviation of measurement results is 0.001 mm. In the measurement of hole center distance, the measurement error of this method is 0.02 mm. The accuracy is high, but the equipment is relatively complex. To detect the position of the brake disc hole group, Guo et al. [22] designed a measurement scheme combining a CCD image processing system and a contact displacement sensor. A CCD image processing system is used to obtain the diameter of each mounting hole and the coordinates of its center through an edge extraction algorithm and least square fitting. The difference between the diameter of the measured hole by this method and a coordinate measuring machine is 0.012 mm. For the detection of the center hole, a contact displacement sensor is used, and the measurement error of the sensor is 0.0005 mm. This method adopts a combination of a contact displacement sensor and a CCD and has high precision, but it is a compromised method for solving the insufficient precision of non-contact measurement. Jin et al. [23] proposed a method for obtaining hole diameter by a visual system which consists of dual interferometers and cameras. The measured hole dimension could be obtained by the reconstructed three-dimensional shapes. This paper uses the thickness of standard gauge blocks and the diameters of holes as the measured objects. In the measurement of gauge block thickness, the measurement accuracy is 0.04 mm. In the measurement of hole diameter, the measurement accuracy is 0.1 mm. The vision system of this method is complex and expensive, and the method is not suitable for the processing site. There are many similarities between hole diameter measurement and shaft diameter measurement based on machine vision. Both the hole diameter and the shaft diameter are obtained by ellipse fitting. Tan et al. [24] proposed a shaft diameter measurement algorithm based on linear structured light vision, and the accuracy of the algorithm was verified in static and dynamic experiments, respectively. The experimental results show that the accuracy of this algorithm is 0.019 mm. In this method, the error points in the data points were not removed, and with all data points involved in ellipse fitting, the fitting accuracy might be affected.
There are two common problems in the existing measurement of aperture and center distance based on vision algorithms: First, the existing methods have higher requirements on the position between the camera and the surface of the measured hole in high-precision measurement. When the imaging plane of the camera is substantially parallel to the plane of the measured hole, measurement accuracy can be ensured. The installation condition reduces the applicability of the measurement method. Second, the aperture and hole center distance must be obtained by using the coordinates of the hole edge points through ellipse fitting. However, the coordinates of these points obtained by the visual system generally have errors, and high measurement accuracy cannot be obtained by simple algebraic fitting or geometric fitting.
To solve these two problems, this paper proposes a visual measurement method based on the geometric constraints of the hole center for aperture and center distance. First, a local coordinate system on the surface of the measured hole is established, and the rotation matrix of the local coordinate system and the camera coordinate system can be solved by the calibration plate. Second, the expressions of the circle and conical surface corresponding to the measured hole are established in the world coordinate system, and the optical center is a conic node. Thirdly, a projection plane parallel to the surface of the measured hole is established near the camera image plane, and points on the edge of the hole onto the image plane are projected to the projection plane. The projection is the intersection circle of the projection plane truncating the conical surface. Finally, the coordinates of the center and radius of the circle are determined by the least square fitting of the intersecting circle. The optimization objective function is established according to the geometric characteristics of the circle, and these fitting results are used as initial values for optimization. The final measurement result is obtained by a nonlinear optimization algorithm.

2. Establishment of Local Coordinate System and Solution of Coordinate Transformation Matrix

According to the camera projection law, the contour formed by the edge points of the measured hole is an ellipse on the imaging plane. To facilitate the solution of aperture and center point coordinates, a local coordinate system (OE-XEYEZE) is established in this paper. The coordinate plane (XEOEYE) of this coordinate system is parallel to the surface of the measured hole group, and the direction vector of OEZE is the direction vector of the hole group surface. The origin of the coordinate system coincides with the origin of the camera coordinate system. In the vision system, OC-XCYCZC is the camera coordinate system, the origin of the coordinate system is the optical center of the camera, and the coordinate plane (XCOCYC) is parallel to the imaging plane of the camera. The relationship between the coordinate systems in the vision model is shown in Figure 1.
OC-XCYCZC is the camera coordinate system; OE-XEYEZE is the local coordinate system.
In the camera coordinate system, the plane equation of the measured hole surface is:
A 1 X C + B 1 Y C + C 1 Z C + 1 = 0
The direction vector of OEZE in local coordinates can be obtained by the surface expression of the hole group, and the direction vector is (A1, B1, C1). As shown in Figure 1, to obtain the expression of the surface of the hole group, this paper attaches the lower surface of the checkerboard calibration plate to the surface of the measured hole to ensure that the surface of the calibration plate is parallel to the surface of the hole. According to the two-step calibration method, the camera coordinates of each corner on the calibration plate can be obtained, the coordinates of the corners are substituted into Equation (1), and the direction vector of the calibration plate can be solved by least squares fitting. Since the surface of the calibration plate is parallel to the surface of the measured hole, the direction vector of the calibration plate is the direction vector of OEZE. According to the direction vector of OEZE, the direction cosine of the local coordinate axis in the camera coordinate system can be obtained:
e 13 = A 1 A 1 2 + B 1 2 + C 1 2 , e 23 = B 1 A 1 2 + B 1 2 + C 1 2 , e 33 = C 1 A 1 2 + B 1 2 + C 1 2
As shown in Figure 1, the straight line L is the connection line between any two corner points on the calibration board, and the coordinates of the corner points are (XC1, YC1, ZC1), (XC2, YC2, ZC2). According to the geometric relationship, the straight line L is parallel to the local coordinate system of OEXE, and the direction vector of the OEXE in the camera coordinate system is (nx, ny, nz), and the vector could be Equations (3) and (4).
n x = X c 2 X c 1 L 1 2 , n y = Y c 2 Y c 1 L 1 2 , n z = Z c 2 Z c 1 L 1 2
L 1 2 = ( X c 2 X c 1 ) 2 + ( Y c 2 Y c 1 ) 2 + ( Z c 2 Z c 1 ) 2
Through the direction vector of the straight line L, the direction cosine of the OEXE axis in the camera coordinate system can be obtained:
e 11 = n x n x 2 + n y 2 + n z 2 , e 21 = n y n x 2 + n y 2 + n z 2 , e 31 = n z n x 2 + n y 2 + n z 2
According to the coordinate axis relationship of the spatial rectangular coordinate system, the direction cosine of the OEYE can be solved by the direction cosine of the OEXE and the OEZE camera coordinate system, and this is shown in Equations (6) and (7).
J = K × I = i j k e 13 e 23 e 33 e 11 e 21 e 31 = e y 1 i + e y 2 j + e y 3 k
e y 1 = ( e 23 e 31 e 33 e 21 ) , e y 2 = ( e 33 e 11 e 13 e 31 ) , e y 3 = ( e 13 e 21 e 23 e 11 )
The direction cosine of the OEYE axis is:
e 12 = e y 1 e y 1 2 + e y 2 2 + e y 3 2 , e 22 = e y 2 e y 1 2 + e y 2 2 + e y 3 2 , e 32 = e y 3 e y 1 2 + e y 2 2 + e y 3 2
The transformation relationship between the local coordinate system and the camera coordinate system is obtained from Equations (2), (5) and (8).
X C Y C Z C = e 11 e 12 e 13 e 21 e 22 e 23 e 31 e 32 e 33 X E Y E Z E + T
In Equation (9), [XC, YC, ZC] is the camera coordinates, and [XE, YE, ZE] is the coordinates in the local coordinate system. According to the method of establishing the local coordinate system, the origin of the local coordinate system coincides with the origin of the camera coordinate system, so the translation matrix T is a zero matrix.

3. A Visual Measurement Model of Hole Group Size Based on Circle Center Constraints

The spatial moment edge extraction algorithm has a simple calculation process and a high detection speed [25], so the paper uses the Zernike moment algorithm to obtain pixel coordinates of the edge of the measured hole [26]. In Figure 1, P is any edge point of the hole to be measured, P’ is the projection point of P on the camera image plane. The camera calibration of P’ can be solved by the internal parameters and distortion coefficients, and the camera calibration of the point is (xui, yui, 1). The local coordinates of P’ can be obtained by Equation (10), and the local coordinate of P’ is [xEi, yEi, zEi].
x E i y E i z E i = e 11 e 12 e 13 e 21 e 22 e 23 e 31 e 32 e 33 1 x u i y u i 1
As shown in Figure 1, the surface of the measured hole, the surface of the checkerboard calibration plate, and the coordinate plane (OEXEYE) are parallel to each other according to establishment process of the local coordinate system.
Z B = e 13 X C 1 + e 23 Y C 1 + e 33 Z C 1
In Equation (11), ZB is the Z-axis coordinate corresponding to the surface of the calibration plate. The Z-axis coordinate corresponding to the surface of the measured hole (Z0) is solved by Equation (12), and D is the thickness of the checkerboard calibration plate.
Z 0 = Z B + D
In local coordinates, the coordinates of the center point in any group of holes measured are (X0, Y0, Z0), and the radius is r. The hole edge equation is:
( X E X 0 ) 2 + ( Y E Y 0 ) 2 = r 2 Z E = Z 0
As shown in Figure 2, a cone is constructed with the measured hole as the bottom surface and the camera optical center as the cone top. In the local coordinate system, the cone surface equation can be expressed as:
( X E X 0 Z 0 Z E ) 2 + ( Y E Y 0 Z 0 Z E ) 2 = ( Z E Z 0 r ) 2
A cutting plane π is established near the image plane, which is parallel to the surface of the measured hole (i.e., the bottom surface of the cone), and the Z-axis coordinate corresponding to the cutting plane π is as Z1. According to the geometric relationship, the intersection line of the plane and the cone is also a circle, and the equation of the intersection line corresponding to any hole in the hole group can be obtained according to Equation (13).
( X E X 0 Z 0 Z 1 ) 2 + ( Y E Y 0 Z 0 Z 1 ) 2 = ( Z 1 Z 0 r ) 2
As shown in Figure 2, the edge point of the measured hole on the image plane is projected to the cutting plane π, and the coordinates of the edge points are [xEi, yEi, zEi] in the local coordinate system. The equation of the projected ray L can be obtained according to the coordinates of the projected point on the image plane and the direction vector of the OEXE axis.
( X E x E i ) A 1 = ( Y E y E i ) B 1 = ( Z E z E i ) C 1
Through Equation (16) and the equation of the cutting plane π, the coordinates of the projection point, which is the edge point of the measured hole on the image plane, could be obtained, and the coordinates of the projection point are set as (xi, yi, zi).
( X E x E i ) A 1 = ( Y E y E i ) B 1 = ( Z E z E i ) C 1 Z = Z 1
According to the camera projection principle and the geometric relationship shown in Figure 2, all projection points on the cutting plane are theoretically on the circle represented by Equation (14). Equation (14) is rewritten as a general expression for a circle and is shown in Equation (18)
x 2 + y 2 + A 2 x + B 2 y + C 2 = 0
The coefficients A2, B2, and C2 of the general equation of the circle are:
A 2 = 2 X 0 Z 1 Z 0 B 2 = 2 Y 0 Z 1 Z 0 C 2 = ( X 0 Z 1 Z 0 ) 2 + ( Y 0 Z 1 Z 0 ) 2 ( r Z 1 Z 0 ) 2
All projection points corresponding to the measured hole could be substituted into Equation (18), and the coordinates of the center and radius ri could be solved by least squares fitting. However, there must be errors in the process of using the above method to obtain the measured results. The main reasons for the errors are as follows.
First, because there are errors in both the edge detection algorithm and the camera calibration, the three-dimensional coordinates of the hole edge points are inaccurate, and the hole edge points are the fitting points. However, the error points in the data cannot be eliminated in least squares fitting, which causes measurement error.
Second, it is difficult to ensure that the surface of the hole is parallel to the imaging plane of the camera. The edges of the holes on two different surfaces are captured in the image simultaneously. It leads to only the edge points of a part of the hole participating in the calculation as fitting points, and these points can’t represent the complete measured hole information. As shown in Figure 3, the edge of a hole in the mold is detected by the edge detection algorithm. The green point is the edge point of the front surface of the tested hole, which is the data point that can be used for fitting. The red point contains the edge points of the front and rear hole surfaces, and the two types of points are difficult to distinguish through the algorithm, and the edge points on the rear surface of the measured hole cannot participate in the circle fitting calculation. Therefore, the points participating in the fitting can only express part of the geometric information of the measured hole, resulting in the fitting error.
To solve this problem, the paper proposes an optimization model of hole group measurement based on center constraint, which optimizes the center point coordinates and aperture obtained by the least squares fitting algorithm to improve the measurement accuracy. As shown in Figure 4, let LL be a chord in the circle and point F be the midpoint of the chord. According to the characteristics of the circle, OF is perpendicular to the chord LL, that is O F Q Q = 0 . According to this geometric relationship, the objective function of optimization can be established:
F ( x 0 , y 0 ) = min i = 1 N / 2 [ ( x 0 x i + x N / 2 + i 2 ) ( x i x N / 2 + i ) + ( y 0 y i + y N / 2 + i 2 ) ( y i y N / 2 + i ) ]
In the equation, N is the number of participating points. When the number of fitting points is odd, remove the last fitting point and change the number of fitting points to an even number. (xi, yi) are the coordinates of the projection point. (x0, y0) are the coordinates of circle center. The objective function is optimized by the Levenberg–Marquardt algorithm, and the initial value of the optimization is obtained by the least squares fitting method. The diameter of the measured hole can be obtained by substituting the optimized coordinates of the center into Equation (21).
d = 2 × Z 0 Z 1 × i = 1 N ( x i X 0 ) 2 + ( y i ( Y 0 ) 2 N
Among them, Z0 is the Z-axis local coordinate corresponding to the surface of the measured hole, and Z1 is the Z-axis local coordinate corresponding to the section plane. xi and yi are the local coordinates of the fitting point on the measured hole. (X0, Y0) is the optimized coordinates of circle center by Equation (20). d is the diameter of the measured hole.

4. Results of Hole Group Measurement Experiment and Result Analysis Based on Vision System

In the experiment, the insert mold with higher requirements on the center distance of the hole group was used as the measured object, and the measured object is shown in Figure 5. The paper adopts a single camera vision system, the hardware parameters of the system are shown in Table 1, the camera calibration experiment site is shown in Figure 6, and the measurement site is shown in Figure 7.
In this experiment, the camera internal parameters and distortion coefficients were obtained by the two-step calibration method [27], and the calibration results are shown in Table 2. Based on the second part of the paper, the transformation matrix of the local coordinate system, and the camera coordinate system, the normal vector of the hole surface was obtained. To ensure the measurement accuracy of the vision system, the thickness of the calibration plate was obtained with a micrometer, and the measurement results are shown in Table 3.
To verify the accuracy of the hole center distance and the hole diameter measurement model proposed in this paper, the distance between the center of each hole and the hole diameter was obtained by a three-coordinate measuring instrument. The coordinate measuring machine used in this paper is made by ZEISS company, and the model is Spectrum ll 7/10/6. The measurement accuracy of the device is 2 μm. The measurement results are shown in Table 4, and the dimensions codes in this table are shown in Figure 8.
Using the edge detection algorithm of Zernike moment calculation, the pixel coordinates of the fitting data points on the insert molds 1 and 2 were obtained, and the detection results of the edge points are shown in Figure 9. Using the method proposed in this paper, all coordinates of centers and apertures could first be solved by least squares fitting, the final measurement results were obtained by the optimization method based on the center constraint, and the measurement results are shown in Table 5.
The measurement results on the paper were compared with the measurement results obtained by the three-coordinate measuring instrument. Measurement errors for each dimension are shown in Table 6 and Table 7.
According to the measurement comparison results, the average error of the diameter measurement is 0.013 mm, the maximum error is less than 0.018 mm, and the variance of the aperture measurement error is 1.77 × 10−5. To further analyze the experimental results, the relationship between the hole diameter and the corresponding measurement error is plotted, as shown in Figure 10 and Figure 11. The aperture measurement error corresponding to smaller diameter holes is higher than the measurement error corresponding to larger diameter holes. The reason for this trend is that a smaller diameter hole contains fewer data points. The error in the data points has a greater impact on the accuracy of the aperture measurement.
In the center distance measurement experiment, the error of each hole center distance is shown in Table 7. The maximum error is 68 μm, and the average error is 50 μm. According to the experimental results, the larger the hole center distance between the two holes, the greater the measurement error of the hole center distance. Therefore, the distance between the two holes is an important factor affecting measurement accuracy. To better analyze the measurement accuracy of the algorithm proposed in the paper, the relative error is used to evaluate the accuracy of the measurement algorithm, and the relative error of the hole center distance is shown in Table 8. Based on the relative error measurement results, the maximum relative error of the hole center distance is 2.2%, and the mean value of the error is 1.4%, the variance of the measurement error distribution is 3.91 × 10−9.
According to the measurement comparison results, the average error of the diameter measurement is 0.013 mm, and the maximum error is less than 0.018 mm. In the center distance measurement experiment, the average measurement error of this paper relative to the three-coordinate measuring instrument is 0.05 mm, the maximum error was less than 0.07 mm, and the maximum relative error is 2.2%.

5. Summary

The paper proposes a method for measuring aperture and hole group center distance based on machine vision. A local coordinate system is established, and the transformation matrix between the coordinate system and the camera coordinate system can be obtained through a checkerboard calibration board. Then a cutting plane is established near the imaging plane of the camera, and the intersection line equation between the plane and the cone is obtained. The cone is composed of the end face of the measured hole and the apex of the cone. Through spatial geometric relationships, the diameter and center point of the measured hole can be obtained by the intersection arc on the cutting plane. In order to further improve measurement accuracy, this paper adopts a measurement optimization model based on center constraint. In this experiment, the automobile insert mold is used as the measurement object, the aperture measurement accuracy is 0.013 mm, and the maximum measurement error is 0.018 mm. In the hole center distance measurement, the evaluation error of the hole center distance measurement is 0.05 mm, the average relative error of the hole center distance is 1.4%, and the maximum relative measurement error is 2.2%.

Author Contributions

Data curation, S.L.; Writing—original draft, C.L.; Writing—review & editing, Z.R.; Supervision, X.X. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China (52005213), Department of Science and Technology of Jilin Province (20220201040GX).

Data Availability Statement

The original data can be obtained by contacting the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Sun, Z.; Feng, P.; Zeng, L.; Zhang, S.; Cheng, X. Adaptive machining scheme for a multi-hole part with multi-position accuracy tolerances. Int. J. Adv. Manuf. Technol. 2022, 121, 661–670. [Google Scholar] [CrossRef]
  2. Feng, C.; Chen, X.; Zhang, J.; Huang, Y.; Qu, Z. Minimizing the energy consumption of hole machining integrating the optimization of tool path and cutting parameters on CNC machines. Int. J. Adv. Manuf. Technol. 2022, 121, 215–228. [Google Scholar] [CrossRef]
  3. Katsuki, A.; Sajima, T.; Murakami, H.; Hazrat, A.M.; Ohnishi, O.; Akashi, K. Development of a laser-guiding-type deep small-sized hole-measurement system: Measurement accuracy. Precis. Eng. 2020, 63, 18–32. [Google Scholar] [CrossRef]
  4. Yao, T.; Zhou, S.D.; Wang, M.; Ye, S.; Zhang, Y.C. Optimal design of hemispherical 7-hole probe tip with perpendicular holes. IEEE Access 2021, 9, 85101–85108. [Google Scholar] [CrossRef]
  5. Guan, B.; Qin, Y.; Guo, M. Angle error control model of laser profilometer contact measurement. Open Phys. 2022, 20, 680–692. [Google Scholar] [CrossRef]
  6. Yu, Y.; Zhang, H.; Wang, Z.; Chang, Y. Deep-hole inner diameter measuring system based on non-contact capacitance sensor. Trans. Tianjin Univ. 2010, 16, 447–451. [Google Scholar] [CrossRef]
  7. Littler, I.C.M.; Atkinson, E.G.; Manson, P.J. Non-contact aperture area measurement by occlusion of a laser beam. Metrologia 2013, 50, 596. [Google Scholar] [CrossRef]
  8. Usman, Z.; Monfared, R.P.; Lohse, N.; Jackson, M.R. An investigation of highly accurate and precise robotic hole measurements using non-contact devices. Int. J. Metrol. Qual. Eng. 2016, 7, 204. [Google Scholar] [CrossRef] [Green Version]
  9. Yu, B.; Li, Y.; Chen, Z.H. Photoelectric Detection of Hole Shape and Size for Large Plate Parts. J. Phys. Conf. Ser. IOP Public 2021, 1744, 022119. [Google Scholar] [CrossRef]
  10. Zhang, Q.; Liu, J.; Zheng, S.; Yu, C. A novel accurate positioning method of reference hole for complex surface in aircraft assembly. Int. J. Adv. Manuf. Technol. 2021, 119, 571–586. [Google Scholar] [CrossRef]
  11. Sadaoui, S.E.; Mehdi-Souzani, C.; Lartigue, C. Multisensor data processing in dimensional metrology for collaborative measurement of a laser plane sensor combined to a touch probe. Measurement 2022, 188, 110395. [Google Scholar] [CrossRef]
  12. Li, X.; Dai, B.; Sun, H.; Li, W. Corn classification system based on computer vision. Symmetry 2019, 11, 591. [Google Scholar] [CrossRef] [Green Version]
  13. Shi, H.; Li, G.; Bai, X.; Huang, J. Research on nonlinear control method of underactuated gantry crane based on machine vision positioning. Symmetry 2019, 11, 987. [Google Scholar] [CrossRef] [Green Version]
  14. Meng, C.; Bao, H.; Ma, Y.; Xu, X.; Li, Y. Visual Meterstick: Preceding vehicle ranging using monocular vision based on the fitting method. Symmetry 2019, 11, 1081. [Google Scholar] [CrossRef] [Green Version]
  15. Lu, C.H.E.N.; Liwen, G.U.A.N. Subpixel drilling and riveting circular hole detection method based on an improved Zernike moment. J. Tsinghua Univ. (Sci. Technol.) 2019, 59, 438–444. [Google Scholar]
  16. Chao, B.; Xue, H.; Mengchen, L.; Jianguo, F. Study on calibration method of rotary axis based on vision measurement. Infrared Laser Eng. 2020, 49, 167–174. [Google Scholar]
  17. Miao, J.; Tan, Q.; Liu, S.; Bao, H.; Li, X. Vision measuring method for the involute profile of a gear shaft. Appl. Opt. 2020, 59, 4183–4190. [Google Scholar] [CrossRef]
  18. Bi, C.; Hao, X.; Liu, M.; Fang, J. Design and establishment of the machine vision measuring system for film cooling holes. Acta Metrol. Sin. 2020, 41, 775–780. [Google Scholar]
  19. Sun, W.; Yi, J.; Ma, G.; Li, F.; Li, X.; Feng, G.; Lu, C. A vision-based method for dimensional in situ measurement of cooling holes in aero-engines during laser beam drilling process. Int. J. Adv. Manuf. Technol. 2022, 119, 3265–3277. [Google Scholar] [CrossRef]
  20. Gong, Y.; Zhang, J.C.; Liu, H.Q. Research on Online Measurement Method of Hole Diameter and Position. Appl. Mech. Mater. 2013, 347, 197–200. [Google Scholar] [CrossRef]
  21. Li, Y.; Cheng, F.; Zhao, Z.L. Machining precision online measurement of large span pin hole using structured light. J. Zhejiang Univ. (Eng. Sci.) 2020, 54, 557–565. [Google Scholar]
  22. Guo, J.; Huang, X.; Cui, L. Combined detection of position of automobile brake disc hole group. Manuf. Technol. Mach. Tool 2020, 8, 130–133. [Google Scholar]
  23. Jin, Y.; Chang, Y.; Wang, J.; Li, M.; Ren, L.; Chen, Y. The measurement method for the size of the hole on the part surface based on grating image processing. IEEE Access 2020, 8, 29159–29168. [Google Scholar] [CrossRef]
  24. Tan, Q.; Kou, Y.; Miao, J.; Liu, S.; Chai, B. A model of diameter measurement based on the machine vision. Symmetry 2021, 13, 187. [Google Scholar] [CrossRef]
  25. Lyvers, E.P.; Mitchell, O.R.; Akey, M.L.; Reeves, A.P. Subpixel measurements using a moment-based edge operator. IEEE Trans. Pattern Anal. Mach. Intell. 1989, 11, 1293–1309. [Google Scholar] [CrossRef]
  26. Huang, C.; Jin, W.; Xu, Q.; Liu, Z.; Xu, Z. Sub-pixel edge detection algorithm based on canny–zernike moment method. J. Circuits Syst. Comput. 2020, 29, 2050238. [Google Scholar] [CrossRef]
  27. Zhang, Z. A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22, 1330–1334. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Relationship between coordinate systems in the visual measurement model.
Figure 1. Relationship between coordinate systems in the visual measurement model.
Symmetry 15 01255 g001
Figure 2. Hole group measurement model.
Figure 2. Hole group measurement model.
Symmetry 15 01255 g002
Figure 3. Collected images of the measured hole group.
Figure 3. Collected images of the measured hole group.
Symmetry 15 01255 g003
Figure 4. Relations constrained by the center of the circle.
Figure 4. Relations constrained by the center of the circle.
Symmetry 15 01255 g004
Figure 5. Measured car insert molds.
Figure 5. Measured car insert molds.
Symmetry 15 01255 g005
Figure 6. Image of camera calibration site.
Figure 6. Image of camera calibration site.
Symmetry 15 01255 g006
Figure 7. Image of measurement site.
Figure 7. Image of measurement site.
Symmetry 15 01255 g007
Figure 8. Schematic diagram of insert mold parts.
Figure 8. Schematic diagram of insert mold parts.
Symmetry 15 01255 g008
Figure 9. Edge detection results of the tested hole. (a) Mold 1; (b) Mold 2.
Figure 9. Edge detection results of the tested hole. (a) Mold 1; (b) Mold 2.
Symmetry 15 01255 g009
Figure 10. Relationship between the measured hole diameter and the measurement error (Mode 1).
Figure 10. Relationship between the measured hole diameter and the measurement error (Mode 1).
Symmetry 15 01255 g010
Figure 11. Relationship between the measured hole diameter and the measurement error (Mode 2).
Figure 11. Relationship between the measured hole diameter and the measurement error (Mode 2).
Symmetry 15 01255 g011
Table 1. Device hardware parameters.
Table 1. Device hardware parameters.
Device NameDevice ModelThe Main Parameters
CameraMER-125-30UMResolution: 1292 × 964 pixel
LensComputar M2514-MPFocal length: 25 mm
Light sourceCCS LFL-200Light-emitting area: 200 × 180 mm
Checkerboard Calibration BoardNANO 25 mm-2.0Precision: ±1.0 μm
Table 2. Camera internal parameters and distortion coefficient.
Table 2. Camera internal parameters and distortion coefficient.
αβγu0v0k1k2p1p2
6788.806790.21−2.178576.937420.6980.0980.677−0.002−0.002
Table 3. Normal vector transformation matrix and calibration plate thickness corresponding to the surface of the hole group.
Table 3. Normal vector transformation matrix and calibration plate thickness corresponding to the surface of the hole group.
Hole Surface Normal VectorCoordinate System Transformation Matrix
Insert mold 1 0.0233 , 0.0229 , 1.3347 0.3433 0.9391 0.0175 0.9390 0.3436 0.0171 0.0221 0.0105 0.9997
Insert mold 1 0.016 , 0.466 , 1.3206 0.3439 0.9389 0.0121 0.9386 0.3433 0.0353 0.0289 0.0235 0.9993
Calibration plate thickness2.003 mm
Table 4. Measured size value of the insert mold (three-coordinate measurement value)/mm.
Table 4. Measured size value of the insert mold (three-coordinate measurement value)/mm.
The Diameters of Holes
d1d2d3d4
Mold 120.0520.0587.0137.019
Mold 220.05520.0637.0197.005
Center distances of holes
D1D2D3D4D5
Mold 1100.05640.02560.04020.02620.016
Mold 2100.04840.03860.02520.02820.028
Table 5. Measured size value on the insert mold (three-coordinate measurement value)/m.
Table 5. Measured size value on the insert mold (three-coordinate measurement value)/m.
d1d2d3d4
Mold 120.03920.0486.9957.002
Mold 220.04120.0587.0056.990
D1D2D3D4D5
Mold 199.98839.98259.98419.98319.977
Mold 299.98939.9859.97419.98319.993
Table 6. Aperture measurement errors based on vision measurement model/mm.
Table 6. Aperture measurement errors based on vision measurement model/mm.
d1d2d3d4Mean
Mold 10.0110.010.0180.0170.014
Mold 20.0140.0050.0140.0150.012
Table 7. Comparison results of visual measurement model and three-coordinate measurement/mm.
Table 7. Comparison results of visual measurement model and three-coordinate measurement/mm.
D1D2D3D4D5Mean
Mold 10.0680.0430.0560.0430.0390.05
Mold 20.0590.0580.0510.0450.0350.05
Table 8. Relative errors of the hole center distance.
Table 8. Relative errors of the hole center distance.
D1D2D3D4D5Mean
Mold 10.7%1.1%0.9%2.2%2.0%1.4%
Mold 20.6%1.5%0.9%2.3%1.8%1.4%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Li, C.; Xu, X.; Ren, Z.; Liu, S. Research on Visual Measurement of Aperture and Hole Group Center Distance Based on Geometric Constraint. Symmetry 2023, 15, 1255. https://doi.org/10.3390/sym15061255

AMA Style

Li C, Xu X, Ren Z, Liu S. Research on Visual Measurement of Aperture and Hole Group Center Distance Based on Geometric Constraint. Symmetry. 2023; 15(6):1255. https://doi.org/10.3390/sym15061255

Chicago/Turabian Style

Li, Chunfeng, Xiping Xu, Zhen Ren, and Siyuan Liu. 2023. "Research on Visual Measurement of Aperture and Hole Group Center Distance Based on Geometric Constraint" Symmetry 15, no. 6: 1255. https://doi.org/10.3390/sym15061255

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop