Next Article in Journal
RES-Q-Trace: A Mobile CEAS-Based Demonstrator for Multi-Component Trace Gas Detection in the MIR
Next Article in Special Issue
Modeling and Analysis of a Novel Ultrasensitive Differential Resonant Graphene Micro-Accelerometer with Wide Measurement Range
Previous Article in Journal
Sensitivity Enhancement in Surface Plasmon Resonance Biochemical Sensor Based on Transition Metal Dichalcogenides/Graphene Heterostructure
Previous Article in Special Issue
Reliability Evaluation and Robust Design of a Sensor in an Entire Roller-Embedded Shapemeter
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Real-Time Curvature Detection of a Flexible Needle with a Bevel Tip

State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Sensors 2018, 18(7), 2057; https://doi.org/10.3390/s18072057
Submission received: 25 April 2018 / Revised: 4 June 2018 / Accepted: 25 June 2018 / Published: 27 June 2018
(This article belongs to the Special Issue Sensors for MEMS and Microsystems)

Abstract

:
As one of the major methods for the diagnosis and treatment of cancers in their early stages, the percutaneous puncture technique has bright prospect in biopsy, ablation, proximity radiotherapy, and drug delivery. Recent years, researchers found the flexible needle cannot realize feedback control during the puncture surgeries only by path planning. To solve this problem, the flexible needle is tried to achieve real-time detection in this paper. Compared with previous methods, the strain gauges glued on the needle surface rather than the medical imaging techniques is used to collect the information to reconstruct the needle curve, which is benefit to integrate the whole system and obtain a more simple and accurate closed-loop control. This paper presented the math model of curve fitting and analyzed the causes of curve fitting errors. To verify the feasibility of this method, an experiment setup was built. Results from the experiments validated the solution in this paper to be effective.

1. Introduction

The percutaneous puncture technique, a typical minimally invasive surgery, makes smaller wounds, causes less postoperative complications, and is easier for patients to recover compared with traditional surgeries. It uses a needle to penetrate into the skin to detect and treat diseases [1,2,3,4]. The percutaneous puncture technique plays a positive role in biopsy, ablation, proximity radiotherapy, and drug delivery in clinical applications. It has tremendous advantages especially in the diagnosis and treatment of cancers in their early stages [5].
The needle used in today’s operating room are rigid. Since it can only move straight, the rigid needle can be only utilized in some simple operations. For some complicated cases where human tissue might block their way, it is useless. As a result, researchers come up with the idea of a bevel-tip flexible needle, whose end has an asymmetric bevel, making it curves as it goes ahead in the skin, so it can avoid the tissue and arrive at the target place successfully [6,7,8,9,10].
Scientists have put great efforts in the modeling of a needle’s force-position relations, hoping to achieve accuracy path planning of the needle through a high precision math model. Simon P. DiMaio and S. E. Salcudean [11] first proposed the idea of “control of flexible needles” in their study of rigid needles. Daniel [12] analyzed the forces and deflection of the flexible needle in the tissues, built the virtual spring model of the needle, and studied its path planning and control strategies. Robert J. Webster [13] proposed an incomplete unicycle model and a bicycle model according to the Lie group theory and obtained the model parameters from experiments. They concluded the effects of puncture speed and bevel-tip angle on a needle’s trajectory. Based on the bicycle model, Engh [14] studied the path of the flexible needle under different motor duty ratios and tried to use various arcs to avoid obstacles. Riviere [15] proved that the bevel-tip flexible needle can be used for obstacle avoidance during puncture operations based on trajectory planning.
However, no matter how accurate the path planning is, the safety cannot be guaranteed in puncture. The path controlling based on the real-time detection is in great request. Integrating medical imaging techniques, such as Ultrasonic image, CT, and MRI, into control strategies is a main technological means for feedback of the needle positions. Ultrasound image is convenient and has good real-time response, no radiation, and no damage to the human body, but it is less satisfactory in accurate positioning and penetration [16]. CT has radiation damages to patients and is usually used in the imaging of bones [17]. MRI has a high cost and requires the puncture system to be made up of non-ferromagnetic materials, which limits its application [18]. Above all, it is hard to get a stable and accurate needle image as a result of the needle’s long and thin structure applying the medical imaging techniques [19]. Therefore, combining medical imaging equipment to recognize and track the path of the needle is not a satisfactory solution.
A better thought for the real-time needle curve feedback is to integrate the sensors into the flexible needle. Park [20] embedded optical fiber sensor inside a rigid needle to detect its shift. Although the system was complicated, their work provided a new method for the detection of a needle. The key challenge integrating the sensor and the needle is to find appropriate sensing units which can be arranged in the needle whose geometric dimension is extremely limited. It is also fundamental to optimize the layout of the sensors on the needle to meet the requirements of low cost and high precision at the same time. This paper tried to use resistance strain gauges to solve the problem mentioned above.
The rest of the paper is arranged as follows: Section 2 introduces the bevel-tip flexible needle detection system based on resistance strain gauges. Section 3 is the modeling of the detection method. The experiments and results are presented in Section 4. Finally, Section 5 gives the conclusion of this paper.

2. System Design

The bevel-tip flexible needle detection system consists of the hardware and the software. The hardware includes a bevel-tip flexible needle, an actuation device, a data acquisition card (NI PCI-6251), a 24V DC power supply, and artificial human tissue. The software includes the DAQ model from LabVIEW and MATLAB-GUI, as show in Figure 1c. In implementation, the main control computer sends control commands to the motor driver via the data acquisition card. The motor actuates the needle insertion via a lead screw. In some research cases, the insertion force information is required (not included in this paper), therefore, a force sensor and a signal amplifier are also involved in the experiment setup.

2.1. Fabrication of the Needle

The bevel-tip needle is made of nickel-titanium wire, hyper-elastic material, which is able to deflect in tissue. Figure 2 is the needles for puncture. The diameters of needles medical used vary from 0.2 mm to 4.5 mm. Considering experimental conditions, the diameter of the needle in this paper is 1.2 mm. The bending radius will increase with the angle of the bevel increase (i.e., less bended). The bevel-tip of the needle used in the experiment is 15°. Other parameters of the needle are listed in Table 1.
The size of resistance strain gauges is limited by the size of the needle. This paper uses the high precision strain gauge (ZF120-3AA-A (9)-G100) of Electrical Measurement, whose size is shown in Figure 3. The bridge circuit comprises three 120 Ω resistance. The gauge is glued at the discrete point of the needle, parallel to the axis. It is obvious that for a single curvature segment, one gauge is enough for the shape detection, where the discrete point is the center position along the axis direction of the needle. However, for a multi-curvature needle, more than one gauges is required to glue on the sensitive locations of different curvatures. For a specific insertion window and target location, the needle insertion trajectory can be planned in advance, (i.e., the situation of the curvatures can be known before implementing the needle insertion). Therefore, a customized configuration of the gauges distribution is feasible in practice. The needle with gauge is shown in Figure 4.

2.2. Artificial Tissue

Artificial tissue in experiments is used as the substitute for real human tissue, so it is important to make the artificial tissue have the same physical properties as real tissue.

2.2.1. Fabrication of Artificial Tissue

The artificial human tissue was made of agar powder. Specifically, 15 g agar powder was dissolved in 1000 mL water, heated until boiling and lasted for 5 min, and then cooled down naturally, as shown in Figure 5.

2.2.2. Measurement of Young’s Modulus of the Tissue

The Young’s modulus of the tissue was measured by a capacitive sensor, as shown in Figure 6. Specifically, the deformation of the tissues were tested applying the capacitive sensor when the weights were added linearly on the upper surface of the tissue. The Young’s modulus of the tissue could be calculated with the weight and deformation. The Young’s modulus of human mammary tissue is about 7.5–66 kPa [21]. The Young’s modulus of the tissue tested in the experiment is 30 kPa.

3. Mathematic Model of Curve Fitting

When the needle deforms, the strain gauges generate voltages which are then transformed into curvature of the discrete points. The reconstruction of a needle on computer is performed based on the curvature and gauge positions by curve fitting. According to the shape of the needle, the curves are divided into plane curves and space curves.

3.1. Plane Curves Fitting

Figure 7 is the schematic diagram of the plane curve fitting. The curvature is continuous because the needle is a smooth curve. Since the curvature of the needle doesn’t change too much in actual operation, the needle can be divided into some segments and it is assumed that each section has the same curvature. By doing so, the needle can be fitted by arcs. In Figure 7, Ci, Pi are the places where gauges are glued, and Oi is the center of each arc. The center of the first arc is put at the origin of the coordinate system. θi is the angle between x-axis and the line created by linking the end of an arc with its center. ρi is the curvature radius of each arc.
For C1, the center is at the origin, so the function can be expressed as:
{ x = ρ 1 cos ( θ 1 ) y = ρ 1 sin ( θ 1 )
where 0 ≤ θθ1. Then the coordinate of P1 is:
{ P 1 x = ρ 1 cos ( θ 1 ) P 1 y = ρ 1 sin ( θ 1 )
where θ1 = C1/ρ1. Each arc intersects one by one and is tangent to the next arc, so Oi+1 must be on line OiPi. Then P1 in C2 can be written as:
{ P 1 x = O 2 x + ρ 2 cos ( θ 1 ) P 1 y = O 2 y + ρ 2 sin ( θ 1 )
Taking (2) into (3), the coordinate of O2 can be obtained:
{ O 2 x = ρ 1 cos ( θ 1 ) ρ 2 cos ( θ 1 ) O 2 y = ρ 1 sin ( θ 1 ) ρ 2 sin ( θ 1 )
When the center of C2 is known, the function in rectangular coordinate system can be written as:
{ x = ( ρ 1 ρ 2 ) cos ( θ 1 ) + ρ 2 cos ( θ ) y = ( ρ 1 ρ 2 ) sin ( θ 1 ) + ρ 2 sin ( θ )
where θ2 = θ1 + C2/ρ2. Therefore, the function of Ci can be written as:
{ x = O ( i 1 ) x + ( ρ i 1 ρ i ) cos ( θ i ) + ρ i cos ( θ ) y = O ( i 1 ) x + ( ρ i 1 ρ i ) sin ( θ 1 ) + ρ 2 sin ( θ )
where θi = θi−1 + Ci/ρi (i ≥ 1). That is all about the fitting of arcs.
For a straight line, for example segment 3 in Figure 7, the radius ρ 3 = . If the length of the line is known, then the end of the line P3 is:
{ P 3 x = O 2 x + O 2 P 3 cos ( θ 3 ) P 3 y = O 2 y + O 2 P 3 sin ( θ 3 )
where O2P3 = ρ2/sin(arctan(C3/ρ2)). Since the coordinate of the line’s origin (P2x, P2y) is already known, the function of the line can be easily obtained.
When an anticlockwise arc is followed by a clockwise arc, as shown in Figure 8, the function of clockwise Ci can be written if its center’s coordinate and the angle are known, which can be deduced by the follow equations:
{ O i x = O ( i 1 ) x + ( ρ i 1 + ρ i ) cos ( θ i 1 ) O i y = O ( i 1 ) y + ( ρ i 1 + ρ i ) sin ( θ i 1 )
It is easy to know that θi = π − θi−1.

3.2. Spatial Curves Fitting

The fitting of space curves has a similar process with plane curves. For space curves, the arcs can be in any plane in space. Under this circumstance, two vertical planes are chosen. Project the arc onto the two planes and solve the curvature of the arcs on both planes. Then calculate the vector sum of the two curvature values, which will be the curvature of the space curve.
Put the starting point of the curve at the origin of the coordinate system and fix the direction of the curvature. The space curve function will be deduced by recurrence, as shown in Figure 9. In this case, the tangent line of the first arc is parallel with y-axis. First, measure the curvature in the yoz and xoy planes, which are represented by a and b and parallel with x-axis and y-axis respectively. P1 and P2 are the discrete points. Δ c 1 is the length of O P 1 . When lim Δ c 1 0 , O P 1 can be replaced by straight line OP1. The space curve of the needle can be worked out by getting the sum of O P 1 and P 1 P 2 .
Take the calculation process of O P 1 as an example. O M 2 is the sum of a and b , which is also the curvature at point O. According to the relations between curvature and curvature radius, the space vector O M 1 of the curvature radius at point O can be obtained by:
O M 1 = O M 2 | O M 2 | | O M 2 |
Connect M1 and P1 and extend the line until it intersects with y-axis at point D1. O D 1 is vertical to O M 1 . P1 is the discrete point which means the length of arc O P 1 is known. Therefore, α can be obtained by:
α = Δ C 1 O M 1
Since OD1 is vertical to plane xoz, it is also vertical to a and b , so vector O D 1 can be calculated and also M 1 D 1 .
O D 1 = a × b | a | | b | × | O M 1 | × t a n ( a )
M 1 D 1 = O D 1 O M 1
Then M 1 P 1 and O P 1 can be obtained:
M 1 P 1 = M 1 D 1 | M 1 D 1 | | O M 1 |
O P 1 = O M 1 + M 1 P 1
As shown in Figure 9, draw a line M 1 N 1 to make it vertical to plane OM1D1. M1N1 intersects with x-axis at point N1. Next is to figure out vector a 1 and b 1 at point P1 which are corresponding to a and b . a 1 and b 1 can be obtained by rotating a and b around M1N1 by α . The curvature vector a 2 and b 2 can be calculated according to the curvature at point P1.
It can be known from Figure 9 that Δ M 1 P 1 N 1 Δ M 1 O N 1 . First calculate O N 1 , M 1 N 1 , and N 1 P 1 , and then a 1 can be obtained:
O N 1 = a | a | × | O M 1 | sin ( tan | b | | a | )
M 1 N 1 = O N 1 O M 1
N 1 P 1 = M 1 P 1 M 1 N 1
a 1 = N 1 P 1 | N 1 P 1 | × | a |
Then b 1 can be obtained according to the relations between a 1 , b 1 and a , b . Assume the norm of the curvature vectors corresponding to a 1 and b 1 is | a 2 | and | b 2 | , then the curvature vectors a 2 and b 2 can be obtained:
M 3 P 1 = | O M 2 | × M 1 P 1 | M 1 P 1 |
b 1 = M 3 P 1 + a 1
a 2 = | a 2 | × a 1 | a 1 |
b 2 = | b 2 | × b 1 | b 1 |
The solving procedure of P 1 P 2 is the same as that of O P 1 . Accordingly, P 2 P 3 , P 3 P 4 …can also be obtained. Connecting the vectors is the fitting broken line of the curve. As long as lim Δ c 1 0 , the fitted line will be accurate.
To solve the curve function of the needle, first is to calculate the curvature radius from the voltage of the gauge at each discrete point. The length of each arc is the length between gauges, which is already known when gluing the gauges. The function of the needle curve then can be deduced according to the equations listed before.

3.3. Error Analysis of Curve Fitting

The curve fitting is achieved using multiple arcs to approximate a curve. Since the value of the curvature radius is a continuous variable, this method must have errors. In the section, the layout of the sensors (i.e., how to arrange the discrete points) to keep the error within a certain range is discussed.

3.3.1. The Position Relations between Circles of Curvature and the Curve

Assuming f(x) is the curve function with a continuous second order derivative, and f″(x0) is not zero. The curvature of the curve is:
h ( x ) = k ( x ) 2 = f ( x ) 2 ( 1 + f ( x ) 2 ) 3
From (23), it is known that h(x) and k(x) have the same poles. According to the values of h′(x0) and h″(x0), there are three conditions:
  • h′(x0) = 0 and h″(x0) > 0, then k(x) has a minimum at x0. There must exist a number ε, and f(x) is outside of the curvature circle of point x0 in the open interval (x0 − ε, x0 + ε).
  • h′(x0) = 0 and h″(x0) < 0, then k(x) has a maximum at x0. There must exist a number ε, and f(x) is inside of the curvature circle of point x0 in the open interval (x0 − ε, x0 + ε).
  • h′(x0) ≠ 0, then k(x) has no extremum at x0. There must exist a number ε, and f(x) is partially outside and partially inside of the curvature circle of point x0 in the open interval (x0 − ε, x0 + ε).
Figure 10 shows the three cases discussed above. If f(x) is zero, the curvature at this point is zero. It means it is the demarcation point of a concave-convex curve or on a straight line, which doesn’t change the three conditions.

3.3.2. Error Measurement

When fitting the actual curve f(x), the first step is to analyze the curvature and work out all the extreme points and their coordinates. Divide the curve at the extreme points and fit every small segment. This section will investigate the fitting error between two extreme points.
There are two conditions in the fitting: starting from point x0, with x increasing, the curve goes inside or outside of the curvature circle. The rest of this part will only take the outside condition as an example, as shown in Figure 11.
ab is a smooth continuous curve and part of f(x). a and b are two adjacent curvature extreme points, and the curvature from a to b is diminishing. Choose a random point p0 on ab , and draw a circle where p0 is the point of tangency. Its center is oi and its radius is ρi. Then, choose two points p1 and p2 on ab and the circle respectively, making p 0 p 1 and p 0 p 2 have the same length. According to the method proposed in Section 3.3.1, p 0 p 1 is replaced by p 0 p 2 during the fitting. To make sure the error of the curve within a certain range, the error of each segment should be kept under some value. The error of each segment is defined as follow:
e i = ( x 1 i x 2 i ) 2 + ( y 1 i y 2 i ) 2
where ( x 1 i , y 1 i ) and ( x 2 i , y 2 i ) are the coordinate of p 1 and p 2 respectively. According to the fitting method, the actual curve p 0 p 1 is replaced by the curve p 0 p 2 . To restrict the error between the actual curve and the fitting one, the error is defined as the distance between point p1 and p2. When the tolerant error value is given, point p1 can be obtained. Assuming the number of segments is n, then the total error can be defined as
E = i = 1 n e i = i = 1 n ( x 1 i x 2 i ) 2 + ( y 1 i y 2 i ) 2
The maximum error should be given according to the actual requirement to get an accurate fitting curve.

3.3.3. Curvature Interpolation

In ideal circumstances, adding more discrete points on the needle can minimize the fitting error, which means mounting more sensors. However, too many sensing units means complicated and high-cost system, so the design of the needle should keep a balance between accuracy and cost.
One possible way to reduce fitting error without increasing sensors is to interpolate between two discrete points to get all points’ curvature values. By using the calculated values in the fitting process, it is easier to get accurate curve. The error of the fitting curve has two affecting factors: the number of sensors and the accuracy of the interpolation method. The number of sensors can be calculated by (25). The rest of this part will discuss the interpolation method. The length of the arc is the independent variable and the curvature is the dependent variable. The needle is smooth and continuous, so it must be guaranteed that the fitting curve is smooth and continuous. That the curvature is continuous means that the curve’s second order derivative is continuous. Polynomial interpolation (over quadratic) can get continuous and smooth curvature value, and can also guarantee the accuracy, so this paper uses the quadratic polynomial interpolation. Using s to represent arc length and k(s) the curvature. Find three points on the curve segment (s1, k(s1)), (s2, k(s2)), (s3, k(s3)). Taking the three points to Equation (26) and a 0 , a 1 , a 2 can be calculated.
k ( s ) = a 0 + a 1 × s + a 2 × s 2

4. Experiment and Results

This section experiments on the real-time detection of a bevel flexible needle’s curve shape. First is to calibrate the strain gauges. Then calculate the curvature according to the voltage. Finally, get the curve shape by curve fitting with the curvature of discrete points. It is known that it is difficult to detect the shape of a thin metal needle. Therefore, a methodology of comparing with standard curves is proposed in the planar case study (Section 4.2). For the experiments in artificial tissue (Section 4.3), a visual system is employed to describe the trajectory of the needle, in which the extracted visual curve is compared with the fitting curve result based on the gauge sensing information. For the experiments of spatial curve, since it is extremely difficult to reconstruct, only qualitative experiments were performed to validate the feasibility of the proposed methodology.

4.1. Calibration of the Strain Gauge

The relations between voltage and curvature is U = K∙k. In the experiment, the resistance values were not exactly the same, and there was no bridge balancing section in the circuit, so the initial voltage was not zero. The corrected equation is U = U0 + K∙k. This paper made a LabVIEW program to collect and record voltages, as shown in Figure 12.
The radius is ρ = ∞, 1000 mm, 900 mm, 800 mm, 700 mm, 600 mm, 500 mm, 400 mm, 300 mm, and 200 mm. Figure 13 shows different curvatures and their voltages. After fitting the points with the least square method, K and U0 was calculated as 258.7568 v∙mm, and 0.9749 v respectively.

4.2. Single Arc Experiment

The simplest case that the needle curve was a single arc was validated first. Theoretically, since the length of the needle is given, the curve shape can be easily got with only one strain gauge. However, in this experiment, the bending of the needle was performed by human, i.e., the shape was not an ideal arc. Therefore, two gauges were glued to the needle. The needle was 200 mm in length, and the two gauges were glued at 50 mm and 150 mm points separately. Bend the needle into an arc as shown in Figure 14, whose radius was 550 mm. Figure 15 is the needle figure on computer, and the two radiuses were 548.7661 mm and 540.17 mm respectively, which are very close to the real value.

4.3. Experiment of Needles in Tissue

In this section, the detection of a needle in artificial tissue was evaluated. The artificial tissue was wet inside, which might cause negative effects to stain gauges. Therefore, the strain gauges were covered with Teflon tape to protect them from damage during the experiment. By using the experiment setup shown in Figure 1, the flexible needle was inserted into the artificial tissue via the linear motion actuated by the lead-screw. The needle was inserted into the tissue by 120 mm, which was controlled by the main control computer. Figure 16a shows the needle in the tissue, which is a semitransparent material made of agar powder. The gauge glued on the needle body sensed the deflection signal, which was the feedback to the main computer. Figure 16b shows the image worked out by computer. The results showed that the curve fitted by the computer didn’t coincide with the real curve completely. The reasons why there was an error could be: First, the artificial tissue had a nonnegligible effect on the gauges, making the collected signals instable. Second, the needle was not in a plane, but rather a space curve, which was hard to see with naked eyes. The deviation of the needle point from the plane was less than 2 mm, so it was acceptable.

4.4. Space Curve Experiment

In this section, the detection of a double-arc needle was evaluated considering the difficulty of make the curve by human hand. The space curve can be divided in to four groups as shown in Figure 17.
In all these four situations, the planes of each arc are vertical to each other. This paper only examined the first case in Figure 17a. Figure 18 is the experimental picture and Figure 19 is the computer image.

5. Conclusions

To achieve the flexible needle real-time detection without medical imaging equipment, the strain gauges is first integrated in the flexible needle puncture system to realize feedback control during the puncture surgeries. The whole system integrated the mechanism, actuation, sensing, and control into a completed system. This paper researched on the recognition of the needle by curve fitting based on the curvature values which were collected by strain gauges. The feasibility of this thought is verified by the experiment. The curve fitting technique based on curvature has errors and is limited to arc like curves. Future work can focus on advanced curve recognition method to apply for more complicated situations.

Author Contributions

Conceptualization, Z.B.; Formal analysis, M.Y.; Funding acquisition, W.D.; Methodology, F.C.; Project administration, Z.D. and W.D.; Software, L.H.; Supervision, L.S.; Writing—review & editing, L.H. and W.D.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Moreira, P.; Misra, S. Biomechanics-Based Curvature Estimation for Ultrasound-guided Flexible Needle Steering in Biological Tissues. Ann. Biomed. Eng. 2015, 43, 1716–1726. [Google Scholar] [CrossRef] [PubMed]
  2. Ko, S.Y.; Frasson, L.; Rodriguez, F. Closed-Loop Planar Motion Control of a Steerable Probe With a “Programmable Bevel” Inspired by Nature. IEEE Trans. Robot. 2011, 27, 970–983. [Google Scholar] [CrossRef] [Green Version]
  3. Reed, K.B.; Okamura, A.M.; Cowan, N.J. Controlling a Robotically Steered Needle in the Presence of Torsional Friction. In Proceedings of the IEEE International conference on Robotics and Automation, Kobe, Japan, 12–17 May 2009. [Google Scholar]
  4. Abayazid, M.; Roesthuis, R.J.; Reilink, R.; Misra, S. Integrating Deflection Models and Image Feedback for Real-Time Flexible Needle Steering. IEEE Trans. Robot. 2013, 29, 542–553. [Google Scholar] [CrossRef]
  5. Abolhassani, N.; Patel, R.; Moallem, M. Needle insertion into soft tissue: A survey. Med. Eng. Phys. 2007, 29, 413–431. [Google Scholar] [CrossRef] [PubMed]
  6. Misra, S.; Reed, K.B.; Schafer, B.W.; Ramesh, K.T.; Okamura, A.M. Mechanics of Flexible Needles Robotically Steered through Soft Tissue. Int. J. Robot. Res. 2010, 29, 1640–1660. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Reed, K.B.; Okamura, A.M.; Cowan, N.J. Modeling and Control of Needles with Torsional Friction. IEEE Trans. Biomed. Eng. 2009, 56, 2905–2916. [Google Scholar] [CrossRef] [PubMed]
  8. Wang, L.; Dong, W.; Du, Z.; Zhang, Y. Motion modeling and simulation of a flexible needle system with a piezo-actuated tip. In Proceedings of the 4th International Conference on Manipulation, Manufacturing and Measurement on the Nanoscale, Taipei, Taiwan, 27–31 October 2014; pp. 124–128. [Google Scholar]
  9. Gao, D.; Lei, Y.; Zheng, H. Needle steering for robot-assisted insertion into soft tissue: A survey. Chin. J. Mech. Eng. 2012, 25, 629–638. [Google Scholar] [CrossRef]
  10. Dong, W.; Han, H.; Du, Z. The tip interface mechanics modeling of a bevel-tip flexible needle insertion. In Proceedings of the International Conference on Mechatronics and Automation, Chengdu, China, 5–8 August 2012; pp. 581–586. [Google Scholar]
  11. Dimaio, S.P.; Salcudean, S.E. Needle steering and motion planning in soft tissues. IEEE Trans. Biomed. Eng. 2005, 52, 965–974. [Google Scholar] [CrossRef] [PubMed]
  12. Glozman, D.; Shoham, M. Flexible Needle Steering and Optimal Trajectory Planning for Percutaneous Therapies. Lecture Notes Comput. Sci. 2004, 3217, 137–144. [Google Scholar] [Green Version]
  13. Webster, R.J.; Cowan, N.J.; Chirikjian, G.; Okamura, A.M. Nonholonomic Modeling of Needle Steering; Springer: Berlin/Heidelberg, Germany, 2006. [Google Scholar]
  14. Engh, J.A.; Podnar, G.; Khoo, S.Y.; Riviere, C.N. Flexible Needle Steering System for Percutaneous Access to Deep Zones of the Brain. In Proceedings of the IEEE Northeast Bioengineering Conference, Easton, PA, USA, 1–2 April 2006; pp. 103–104. [Google Scholar]
  15. Minhas, D.S.; Engh, J.A.; Fenske, M.M.; Riviere, C.N. Modeling of Needle Steering via Duty-Cycled Spinning. In Proceedings of the International Conference on Medicine and Biology Society, Lyon, France, 22–26 August 2007; pp. 2756–2759. [Google Scholar]
  16. Neubach, Z.; Shoham, M. Ultrasound-Guided Robot for Flexible Needle Steering. IEEE Trans. Biomed. Eng. 2017, 57, 799–805. [Google Scholar] [CrossRef] [PubMed]
  17. Zuo, C.J.; Wang, M.J.; Wang, P.J.; Chen, W.; Hao, Q.; Zhang, H.J. Application of flexible puncture needle in CT-guided percutaneous ethanol injection to liver neoplasms. Acad. J. Second Mil. Med. Univ. 2002, 23, 504–506. [Google Scholar]
  18. Moreira, P.; Boskma, K.J.; Misra, S. Towards MRI-guided flexible needle steering using fiber Bragg grating-based tip tracking. In Proceedings of the IEEE International Conference on Robotics and Automation, Singapore, 29 May–3 June 2017; pp. 4849–4854. [Google Scholar]
  19. Najafi, M.; Abolmaesumi, P.; Rohling, R. Single-Camera Closed-Form Real-Time Needle Tracking forUltrasound-Guided Needle Insertion. Ultrasound Med. Biol. 2015, 41, 2663–2676. [Google Scholar] [CrossRef] [PubMed]
  20. Park, Y.L.; Elayaperumal, S.; Daniel, B.; Ryu, S.C.; Shin, M.; Savall, J.; Black, R.J.; Moslehi, B.; Cutkosky, M.R. Real-Time Estimation of 3-D Needle Shape and Deflection for MRI-Guided Interventions. IEEE ASME Trans. Mechatron. 2010, 15, 906–915. [Google Scholar] [CrossRef] [PubMed]
  21. Dilmoney, B.; Dilmoney, B. Mechanics of the Normal Woman’s Breast; IOS Press: Clifton, VA, USA, 2007. [Google Scholar]
Figure 1. The experiment setup. (a) The hardware configuration; (b) The flexible needles used; and (c) The GUI.
Figure 1. The experiment setup. (a) The hardware configuration; (b) The flexible needles used; and (c) The GUI.
Sensors 18 02057 g001
Figure 2. Flexible needles with a bevel tip.
Figure 2. Flexible needles with a bevel tip.
Sensors 18 02057 g002
Figure 3. The size of the resistance strain gauge.
Figure 3. The size of the resistance strain gauge.
Sensors 18 02057 g003
Figure 4. Needle with a strain gauge.
Figure 4. Needle with a strain gauge.
Sensors 18 02057 g004
Figure 5. Artificial tissue.
Figure 5. Artificial tissue.
Sensors 18 02057 g005
Figure 6. Measurement of Young’s modulus of the tissue.
Figure 6. Measurement of Young’s modulus of the tissue.
Sensors 18 02057 g006
Figure 7. Schematic diagram of plane curve fitting.
Figure 7. Schematic diagram of plane curve fitting.
Sensors 18 02057 g007
Figure 8. The situation when an anticlockwise arc is followed by a clockwise arc.
Figure 8. The situation when an anticlockwise arc is followed by a clockwise arc.
Sensors 18 02057 g008
Figure 9. Schematic diagram of space curve fitting.
Figure 9. Schematic diagram of space curve fitting.
Sensors 18 02057 g009
Figure 10. The position relations between a circle of curvature and the curve.
Figure 10. The position relations between a circle of curvature and the curve.
Sensors 18 02057 g010
Figure 11. Schematic diagram of error measurement.
Figure 11. Schematic diagram of error measurement.
Sensors 18 02057 g011
Figure 12. LabVIEW program.
Figure 12. LabVIEW program.
Sensors 18 02057 g012
Figure 13. Voltage-curvature relation curve.
Figure 13. Voltage-curvature relation curve.
Sensors 18 02057 g013
Figure 14. Single arc experiment.
Figure 14. Single arc experiment.
Sensors 18 02057 g014
Figure 15. Experiment results.
Figure 15. Experiment results.
Sensors 18 02057 g015
Figure 16. (a) Experiment of needle in tissue; (b) experiment of needle in the computer image.
Figure 16. (a) Experiment of needle in tissue; (b) experiment of needle in the computer image.
Sensors 18 02057 g016
Figure 17. Double arc curves.
Figure 17. Double arc curves.
Sensors 18 02057 g017
Figure 18. Double arc experiment.
Figure 18. Double arc experiment.
Sensors 18 02057 g018
Figure 19. Experiment results.
Figure 19. Experiment results.
Sensors 18 02057 g019
Table 1. Parameters of the flexible needle.
Table 1. Parameters of the flexible needle.
ParameterSymbolValue
Young’s modulusE50 Gpa
DiameterD1.2 mm
Bevelα15°
LengthL120 mm

Share and Cite

MDPI and ACS Style

Zhang, B.; Chen, F.; Yang, M.; Huang, L.; Du, Z.; Sun, L.; Dong, W. Real-Time Curvature Detection of a Flexible Needle with a Bevel Tip. Sensors 2018, 18, 2057. https://doi.org/10.3390/s18072057

AMA Style

Zhang B, Chen F, Yang M, Huang L, Du Z, Sun L, Dong W. Real-Time Curvature Detection of a Flexible Needle with a Bevel Tip. Sensors. 2018; 18(7):2057. https://doi.org/10.3390/s18072057

Chicago/Turabian Style

Zhang, Bo, Fangxin Chen, Miao Yang, Linxiang Huang, Zhijiang Du, Lining Sun, and Wei Dong. 2018. "Real-Time Curvature Detection of a Flexible Needle with a Bevel Tip" Sensors 18, no. 7: 2057. https://doi.org/10.3390/s18072057

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop