Mohamed, Otmane Ait, Daoud, Mohammad I., Alshalalfah, Abdel-Latif and Alazrai, Rami (2018) A hybrid camera- and ultrasound-based approach for needle localization and tracking using a 3D motorized curvilinear ultrasound probe. Medical Image Analysis . ISSN 13618415 (In Press)
Preview |
Text (application/pdf)
10MBAit Mohamed 2018.pdf - Accepted Version Available under License Spectrum Terms of Access. |
Official URL: http://dx.doi.org/10.1016/j.media.2018.09.006
Abstract
Three-dimensional (3D) motorized curvilinear ultrasound probes provide an effective, low-cost tool to guide needle interventions, but localizing and tracking the needle in 3D ultrasound volumes is often challenging. In this study, a new method is introduced to localize and track the needle using 3D motorized curvilinear ultrasound probes. In particular, a low-cost camera mounted on the probe is employed to estimate the needle axis. The camera-estimated axis is used to identify a volume of interest (VOI) in the ultrasound volume that enables high needle visibility. This VOI is analyzed using local phase analysis and the random sample consensus algorithm to refine the camera-estimated needle axis. The needle tip is determined by searching the localized needle axis using a probabilistic approach. Dynamic needle tracking in a sequence of 3D ultrasound volumes is enabled by iteratively applying a Kalman filter to estimate the VOI that includes the needle in the successive ultrasound volume and limiting the localization analysis to this VOI. A series of ex vivo animal experiments are conducted to evaluate the accuracy of needle localization and tracking. The results show that the proposed method can localize the needle in individual ultrasound volumes with maximum error rates of 0.7 mm for the needle axis, 1.7° for the needle angle, and 1.2 mm for the needle tip. Moreover, the proposed method can track the needle in a sequence of ultrasound volumes with maximum error rates of 1.0 mm for the needle axis, 2.0° for the needle angle, and 1.7 mm for the needle tip. These results suggest the feasibility of applying the proposed method to localize and track the needle using 3D motorized curvilinear ultrasound probes.
| Divisions: | Concordia University > Gina Cody School of Engineering and Computer Science > Electrical and Computer Engineering |
|---|---|
| Item Type: | Article |
| Refereed: | Yes |
| Authors: | Mohamed, Otmane Ait and Daoud, Mohammad I. and Alshalalfah, Abdel-Latif and Alazrai, Rami |
| Journal or Publication: | Medical Image Analysis |
| Date: | 2018 |
| Digital Object Identifier (DOI): | 10.1016/j.media.2018.09.006 |
| Keywords: | Ultrasound-guided needle interventions; 3D ultrasound imaging; Needle localization and tracking; Kalman filter; RANSAC; Camera-based needle localization |
| ID Code: | 984600 |
| Deposited By: | ALINE SOREL |
| Deposited On: | 29 Oct 2018 19:50 |
| Last Modified: | 03 Oct 2020 00:00 |
References:
T.K. Adebar, A.M. Okamura. 3D segmentation of curved needles using Doppler ultrasound and vibration, Proc. International Conference on Information Processing in Computer-Assisted Interventions (2013), pp. 61-70M. Barva, J. Kybic, J.-M. Mari. Radial radon transform dedicated to micro-object localization from radio frequency ultrasound signal, Proc. IEEE Ultrasonics Symposium (2004), pp. 1836-1839
M. Barva, M. Uhercik, J.-M. Mari, J. Kybic, J.-R. Duhamel, H. Liebgott, V. Hlavac, C. Cachard. Parallel integral projection transform for straight electrode localization in 3-D ultrasound images, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 55 (7) (2008), pp. 1559-1569
P. Beigi, R. Rohling, T. Salcudean, V.A. Lessoway, G.C. Ng. Needle trajectory and tip localization in real-time 3-D ultrasound using a moving stylus, Ultrasound in Medicine & Biology, 41 (7) (2015), pp. 2057-2070
P. Beigi, R. Rohling, T. Salcudean, V.A. Lessoway, G.C. Ng. Detection of an invisible needle in ultrasound using a probabilistic SVM and time-domain features, Ultrasonics, 78 (2017), pp. 18-22
L. Cai, X. Wang, Y. Wang, Y. Guo, J. Yu, Y. Wang. Robust phase-based texture descriptor for classification of breast ultrasound images, Biomed Eng Online, 14 (1) (2015), p. 26
C. Chan, F. Lam, R. Rohling. A needle tracking device for ultrasound guided percutaneous procedures, Ultrasound in Medicine & Biology, 31 (11) (2005), pp. 1469-1483
M. Daoud, R. Rohling, S. Salcudean, P. Abolmaesumi. Needle detection in curvilinear ultrasound images based on the reflection pattern of circular ultrasound waves; Medical Physics, 42 (11) (2015), pp. 6221-6233
M.I. Daoud, P. Abolmaesumi, W. You, S.E. Salcudean, R.N. Rohling. Signature-based algorithm for improved needle localization in ultrasound images: A feasibility study, Proc. 2011 IEEE International Ultrasonics Symposium (2011), pp. 1575-1578
M. Ding, H.N. Cardinal, A. Fenster. Automatic needle segmentation in three-dimensional ultrasound images using two orthogonal two-dimensional image projections, Medical Physics, 30 (2) (2003), pp. 222-234
M.A. Fischler, R.C. Bolles. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography, Communications of the ACM, 24 (6) (1981), pp. 381-395
M.P. Fronheiser, S.F. Idriss, P.D. Wolf, S.W. Smith. Vibrating interventional device detection using real-time 3-D color Doppler, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 55 (6) (2008), pp. 1355-1362
H. Gao, Q. Huang, X. Xu, X. Li. Wireless and sensorless 3D ultrasound imaging, Neurocomputing, 195 (2016), pp. 159-171
R.E. Gebhard, T.N. Eubanks, R. Meeks. Three-dimensional ultrasound imaging, Current Opinion in Anaesthesiology, 28 (5) (2015), pp. 583-587
I. Hacihaliloglu, R. Abugharbieh, A. Hodgson, R. Rohling. Bone surface localization in ultrasound using image phase-based features, Ultrasound Med Biol., 35 (9) (2009) 1475–87
I. Hacihaliloglu, R. Abugharbieh, A. Hodgson, R. Rohling, P. Guy. Automatic bone localization and fracture detection from volumetric ultrasound images using 3-D local phase features, Ultrasound Med Biol., 38 (1) (2012) 128–44
I. Hacihaliloglu, P. Beigi, G. Ng, R. Rohling, S. Salcudean, P. Abolmaesumi. Projection-based phase features for localization of a needle tip in 2D curvilinear ultrasound, Proc. 18th International Conference Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015 (2015), pp. 347-354
E.J. Harris, N.R. Miller, J.C. Bamber, P.M. Evans, J.R. Symonds-Tayler. Performance of ultrasound based measurement of 3D displacement using a curvilinear probe for organ motion tracking, Physics in Medicine & Biology, 52 (18) (2007), pp. 5683-5703
J. Heikkila, O. Silven. A four-step camera calibration procedure with implicit image correction, Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (1997), pp. 1106-1112
H. Holm, B. Skjoldbye. Interventional ultrasound, Ultrasound in Medicine & Biology, 22 (7) (1996), pp. 773-789
S. Khosravi, T. Rohling, P. Lawrence. One-step needle pose estimation for ultrasound guided biopsies, Proc. 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (2007), pp. 3343-3346
P. Kovesi. Image features from phase congruency, Videre: Journal of Computer Vision Research, 1 (3) (1999), pp. 1-26
P. Kovesi. Phase congruency: a low-level image invariant, Psychological Research, 64 (2) (2000), pp. 136-148
P. Kovesi. Phase congruency detects corners and edges, Proc. 18th International Conference Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015 (2003), pp. 309-318
J.M. Mari, C. Cachard. Acquire real-time RF digital ultrasound data from a commercial scanner, Electronic Journal Technical Acoustics, 3 (2007), pp. 1-16
M. Morrone, J. Ross, D. Burr, R. Owens. Mach bands are phase dependent, Nature, 324 (6049) (1986), pp. 250-253
J. Mung, F. Vignon, A. Jain. A non-disruptive technology for robust 3D tool tracking for ultrasound-guided interventions, Proc. Medical Image Computing and Computer-Assisted Intervention (2011), pp. 153-160
C. Mwikirize, J.L. Nosher, I. Hacihaliloglu. Local phase-based learning for needle detection and localization in 3D ultrasound, Computer Assisted and Robotic Endoscopy and Clinical Image-Based Procedures (2017), pp. 108-115
M. Najafi, P. Abolmaesumi, R. Rohling. Single-camera closed-form real-time needle tracking for ultrasound-guided needle insertion, Ultrasound in Medicine & Biology, 41 (10) (2015), pp. 2663-2676
M. Najafi, R. Rohling. Single camera closed-form real-time needle trajectory tracking for ultrasound, Proc. SPIE, 7964 (2011), p. 79641F
H.R. Neshat, R.V. Pateluchi. Real-time parametric curved needle segmentation in 3D ultrasound images, Proc. 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (2008), pp. 670-675
P.M. Novotny, J.W. Cannon, R.D. Howe. Tool localization in 3D ultrasound images, Proc. 6th International Conference Medical Image Computing and Computer-Assisted Intervention - MICCAI 2003 (2003), pp. 969-970
P.M. Novotny, J.A. Stoll, N.V. Vasilyev, P.J. del Nido, P.E. Dupont, T.E. Zickler, R.D. Howe. GPU based real-time instrument tracking with three-dimensional ultrasound, Medical Image Analysis, 11 (5) (2007), pp. 458-464
A. Oppenheim, J. Lim. The importance of phase in signals, Proc. IEEE, 69 (5) (1981), pp. 529-541
N. Otsu. A threshold selection method from gray-level histograms, IEEE Transactions on Systems, Man, and Cybernetics, 9 (1) (1979), pp. 62-66
E.R. Pospisil, R. Rohling, R.Z. Azar, S.E. Salcudean. 4-D x 3-D ultrasound: real-time scan conversion, filtering, and display of displacement vectors with a motorized curvilinear transducer, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 57 (2010) 2271–2271
A. Pourtaherian, H.J. Scholten, L. Kusters, S. Zinger, N. Mihajlovic, A.F. Kolen, F. Zuo, G.C. Ng, H.H.M. Korsten, P.H. de With. Medical instrument detection in 3-dimensional ultrasound data volumes, IEEE Transactions on Medical Imaging, 36 (2017), pp. 1664-1675
R. Prager, R. Rohling, A. Gee, L. Berman. Rapid calibration for 3-D freehand ultrasound, Ultrasound in Medicine & Biology, 24 (6) (1998), p. 855—-869
W. Qiu, M. Ding, M. Yuchi. Needle segmentation using 3D quick randomized hough transform, Proc. First International Conference on Intelligent Networks and Intelligent Systems (2008), pp. 449-452
G.E. Trahey, S.M. Hubbard, O.T. von Ramm. Angle independent ultrasonic blood flow detection by frame-to-frame correlation of B-mode images, Ultrasonics, 26 (5) (1988), pp. 271-276
B. Tsui, K. Doyle, K. Chu, J. Pillay, D. Dillane. Case series: ultrasound-guided supraclavicular block using a curvilinear probe in 104 day-case hand surgery patients, Canadian Journal of Anesthesia, 56 (2009), pp. 46-51
M. Uherčík. Surgical Tools Localization in 3D Ultrasound Images, Institut National des Sciences Appliquées, France (2011) Ph.D. thesis.
M. Uherčík, J. Kybic, H. Liebgott, C. Cachard. Model fitting using RANSAC for surgical tool localization in 3-D ultrasound images, IEEE Transactions on Biomedical Engineering, 57 (8) (2010), pp. 1907-1916
S.J. Wisniewski, J. Smith, D.G. Patterson, S.W. Carmichael, W. Pawlina. Ultrasound-guided versus nonguided tibiotalar joint and sinus tarsi injections: A cadaveric study, PM&R, 2 (4) (2010), pp. 277-281
Y. Zhao, C. Cachard, H. Liebgott. Automatic needle detection and tracking in 3D ultrasound using an ROI-based RANSAC and Kalman method, Ultrasonic Imaging, 35 (4) (2013), pp. 283-306
Y. Zhao, Y. Shen, A. Bernard, C. Cachard, H. Liebgott. Evaluation and comparison of current biopsy needle localization and tracking methods using 3D ultrasound, Ultrasonics, 73 (2017), pp. 206-220
H. Zhou, W. Qiu, M. Ding, S. Zhang. Automatic needle segmentation in 3D ultrasound images using 3D Hough transform, Proc. of SPIE Vol. 6789 - 5th International Symposium on Multispectral Image Processing and Pattern Recognition (2007), pp. 67890R1-7
All items in Spectrum are protected by copyright, with all rights reserved. The use of items is governed by Spectrum's terms of access.
Repository Staff Only: item control page
Download Statistics
Download Statistics