0
Research Papers

A Dual-Arm 7-Degrees-of-Freedom Haptics-Enabled Teleoperation Test Bed for Minimally Invasive Surgery

[+] Author and Article Information
Ali Talasaz

Canadian Surgical Technologies
and Advanced Robotics,
Lawson Health Research Institute,
London, ON N6A 5A5, Canada;
Department of Electrical
and Computer Engineering,
Western University,
London, ON N6A 5B9, Canada
e-mail: atalasaz@uwo.ca

Ana Luisa Trejos

Canadian Surgical Technologies
and Advanced Robotics,
Lawson Health Research Institute,
London, ON N6A 5A5, Canada;
Department of Electrical
and Computer Engineering,
Western University,
London, ON N6A 5B9, Canada
e-mail: atrejos@uwo.ca

Simon Perreault

Laval University Robotics Laboratory,
Department of Mechanical Engineering,
Laval University,
Quebec City, QC G1V 0A6, Canada
e-mail: simon.perreault.2@ulaval.ca

Harmanpreet Bassan

Canadian Surgical Technologies
and Advanced Robotics,
Lawson Health Research Institute,
London, ON N6A 5A5, Canada;
Department of Electrical
and Computer Engineering,
Western University,
London, ON N6A 5B9, Canada
e-mail: hsbassan@alumni.uwo.ca

Rajni V. Patel

Project Leader and Senior Author
Canadian Surgical Technologies
and Advanced Robotics,
Lawson Health Research Institute,
London, ON N6A 5A5, Canada;
Department of Electrical
and Computer Engineering,
Western University,
London, ON N6A 5B9, Canada;
Department of Surgery,
London, ON N6A 4V2, Canada
e-mail: rvpatel@uwo.ca

1Corresponding author.

Manuscript received August 25, 2013; final manuscript received February 17, 2014; published online xx xx, xxxx. Assoc. Editor: Venketesh Dubey.

J. Med. Devices 8(4), 041004 (Aug 19, 2014) (15 pages) Paper No: MED-13-1200; doi: 10.1115/1.4026984 History: Received August 25, 2013; Revised February 17, 2014

This paper describes a dual-arm teleoperation (master-slave) system which has been developed to explore the effect of haptics in robotics-assisted minimally invasive surgery (RAMIS). This setup is capable of measuring forces in 7 degrees of freedom (DOF) and fully reflecting them to the operator through two 7-DOF haptic interfaces. An application of the test bed is in enabling the evaluation of the effect of replacing haptic feedback by other sensory cues such as visual representation of haptic information (sensory substitution). This paper discusses the design rationale, kinematic analysis and dynamic modeling of the robot manipulators, and the control system developed for the setup. Using the accurate model developed in this paper, a highly transparent haptics-enabled system can be achieved and used in robot-assisted telesurgery. Validation results obtained through experiments are presented and demonstrate the correctness and effectiveness of the developed models. The application of the setup for two RAMIS surgical tasks, a suture manipulation task and a tumor localization task, is described with different haptics modalities available through the developed haptics-enabled system for each application.

Copyright © 2014 by ASME
Your Session has timed out. Please sign back in to continue.

References

Trejos, A. L., Patel, R. V., and Naish, M. D., 2010, “Force Sensing and Its Applications in Minimally Invasive Surgery and Therapy: A Survey,” Proc. Inst. Mech. Eng., C: J. Mech. Eng. Sci., 224(7), pp. 1435–1454. [CrossRef]
Intuitive Surgical, 2013, “The da Vinci Surgical System,” Intuitive Surgical Inc., Sunnyvale, CA, available at: http://www.intuitivesurgical.com
Tavakoli, M., Patel, R., Moallem, M., and Aziminejad, A., 2008, Haptics-Based Systems for Robot-Assisted Surgery and Telesurgery: Design, Control, and Experimentation (New Frontiers in Robotics), World Scientific Publishers, Singapore.
Tavakoli, M., Patel, R. V., and Moallem, M., 2005, “Haptic Interaction in Robot-Assisted Endoscopic Surgery: A Sensorized End-Effector,” Int. J. Med. Robotics Comput. Assist. Surg.1(2), pp. 53–63. [CrossRef]
Cavusoglu, M. C., Williams, W., Tendick, F., and Sastry, S. S., 2003, “Robotics for Telesurgery: Second Generation Berkeley/UCSF Laparoscopic Telesurgical Workstation and Looking Towards the Future Applications,” Indus. Robot, 30(1), pp. 22–29. [CrossRef]
Tadano, K., and Kawashima, K., 2007, “Development of a Master Slave System With Force Sensing Using Pneumatic Servo System for Laparoscopic Surgery,” IEEE International Conference on Robotics and Automation, Rome, April 10–14, pp. 947–952. [CrossRef]
Lum, M. J. H., Friedman, D. C. W., Sankaranarayanan, G., King, H., Fodero, K., Leuschke, R., Hannaford, B., Rosen, J., and Sinanan, M. N., 2009, “The RAVEN: Design and Validation of a Telesurgery System,” Int. J. Robotics Res., 28(9), pp. 1183–1197. [CrossRef]
Salcudean, S. E., Wong, S. N. M., and Hollis, R. L., 1992, “A Force-Reflecting Teleoperation System With Magnetically Levitated Master and Wrist,” IEEE International Conference on Robotics and Automation, Nice, France, May 12–14, pp. 1420–1426. [CrossRef]
Das, H., Zak, H., Johnson, J., Crouch, J., and Frambach, D., 1999, “Evaluation of a Telerobotic System to Assist Surgeons in Microsurgery,” Comput. Aided Surg.4(1), pp. 15–25. [CrossRef] [PubMed]
Hunter, I. W., Lafontaine, S. R., Brenan, C. J. H., and Jones, L. A., 1995, “Medical Robots and Micro Machines,” Sixth International Symposium on Micro Machine and Human Science (MHS '95), Nagoya, Japan, October 4–6, pp. 25–30. [CrossRef]
Institute of Robotics and Mechatronics, Robotics Systems, 2013, “MiroSurge—Telemanipulation in Minimally Invasive Surgery,” DLR, Oberpfaffenhofen-Wessling, Germany, available at: http://www.dlr.de/rm/en/desktopdefault.aspx/tabid-3835/6288_read-9047/
Quanser, 2014, “Quanser · Innovate · Educate,” Quanser Consulting Inc., Markham, ON, Canada, available at: http://www.quanser.com
Stocco, L. J., Salcudean, S. E., and Sassani, F., 2001, “Optimal Kinematic Design of a Haptic Pen,” IEEE/ASME Trans. Mechatron., 6(3), pp. 210–220. [CrossRef]
Talasaz, A., 2012, “Haptics-Enabled Teleoperation for Robotics-Assisted Minimally Invasive Surgery,” Ph.D. thesis, The University of Western Ontario, London, ON, Canada.
Olsson, H., Astrom, K. J., Canudas de Wit, C., Gafvert, M., and Lischinsky, P., 1998, “Friction Models and Friction Compensation,” Eur. J. Control, 4(3), pp. 176–195. [CrossRef]
Tholey, G., and Desai, J. P., 2007, “A General-Purpose 7 DOF Haptic Device: Applications Toward Robot-Assisted Surgery,” IEEE/ASME Trans. Mechatron., 12(6), pp. 662–669. [CrossRef]
ATI, “Multi-Axis Force/Torque Sensors,” ATI Industrial Automation, Apex, NC, available at: http://www.ati-ia.com/products/ft/sensors.aspx
Kennedy, C. W., and Desai, J. P., 2005. “Modeling and Control of the Mitsubishi PA-10 Robot Arm Harmonic Drive System,” IEEE/ASME Trans. Mechatron., 10(3), pp. 263–274. [CrossRef]
Bompos, N. A., Artemiadis, P. K., Oikonomopoulos, A. S., and Kyriakopoulos, K. J., 2007, “Modeling, Full Identification and Control of the Mitsubishi PA-10 Robot Arm,” IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Zurich, Switzerland, September 4–7. [CrossRef]
Patel, R. V., and Shadpey, F., 2005, Control of Redundant Robot Manipulators: Theory and Experiments (Lecture Notes in Control and Information Science), Springer, Heidelberg, Germany.
Patel, R. V., Talebi, H. A., Jayender, J., and Shadpey, F., 2009, “A Robust Position and Force Control Strategy for 7-DOF Redundant Manipulators,” IEEE/ASME Trans. Mechatron., 14(5), pp. 575–589. [CrossRef]
Stotsky, A., and Kolmanovsky, I., 2002, “Application of Input Estimation Techniques to Charge Estimation and Control in Automotive Engines,” Control Eng. Practice, 10(12), pp. 1371–1383. [CrossRef]
Bassan, H., Talasaz, A., and Patel, R. V., 2009, “Design and Characterization of a 7-DOF Haptic Interface for Minimally Invasive Surgery Test-Bed,” IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2009), St. Louis, MO, October 10–15, pp. 4098–4103. [CrossRef]
Khalil, H., 1996, “Adaptive Output Feedback Control of Nonlinear Systems Represented by Input-Output Models,” IEEE Trans. Autom. Control, 41(2), pp. 177–188. [CrossRef]
Seraji, H., 1989, “Configuration Control of Redundant Manipulators: Theory and Implementation,” IEEE Trans. Robotics Autom., 5(4), pp. 472–490. [CrossRef]
Luh, J. Y. S., Walker, M. W., and Paul, R. P., 1980, “Resolved-Acceleration Control of Mechanical Manipulators,” IEEE Trans. Autom. Control, AC–25(3), pp. 468–474. [CrossRef]
NDI, 2014, “Aurora,” Northern Digital Inc., Bakersfield, CA, available at: http://www.ndigital.com/medical/products/aurora/
Talasaz, A., Trejos, A. L., and Patel, R. V., 2012, “Effect of Force Feedback on Performance of Robotics-Assisted Suturing,” 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), Rome, June 24–27, pp. 823–828. [CrossRef]
Talasaz, A., and Patel, R. V., 2012, “Integration of Force Reflection With Tactile Sensing for Minimally Invasive Robotics-Assisted Tumor Localization,” IEEE Trans. Haptics, 6(2), pp. 217–228. [CrossRef]

Figures

Grahic Jump Location
Fig. 1

The dual-arm teleoperation setup

Grahic Jump Location
Fig. 2

5-DOF haptic wand device modified to 7-DOF

Grahic Jump Location
Fig. 3

CAD rendering of the upper handle drive

Grahic Jump Location
Fig. 4

Kinematic wire frame model of the 7-DOF haptic wand

Grahic Jump Location
Fig. 5

Dynamic wire frame model of the 7-DOF haptic wand; (1) the top triple motor assembly, (2) top left drive arm, (3) top right drive arm, (4) top left passive arm, (5) top right passive arm, (6) bottom triple motor assembly, (7) bottom left drive arm, (8) bottom right drive arm, (9) bottom left passive arm, (10) bottom right passive arm, and (11) the handle

Grahic Jump Location
Fig. 6

Friction measured along x and y axes

Grahic Jump Location
Fig. 7

Sensorized instruments showing various tips and a closeup of the strain gauges applied to the cable shafts

Grahic Jump Location
Fig. 8

Kinematic modeling of a cable-driven endoscopic tool

Grahic Jump Location
Fig. 9

The control block diagram designed for the setup: Jacobian transpose impedance control at the master side and position control with software-based RCM at the slave side

Grahic Jump Location
Fig. 10

Comparison between the model Cartesian trajectory and the one from optical tracker

Grahic Jump Location
Fig. 11

End-effector position tracking performance using model-based controller

Grahic Jump Location
Fig. 12

End-effector orientation tracking performance using model-based controller

Grahic Jump Location
Fig. 13

Grasper angular position tracking performance using model-based controller

Grahic Jump Location
Fig. 14

Tracking error for model-based controller

Grahic Jump Location
Fig. 15

Joint torques during tracking experiment for model-based controller

Grahic Jump Location
Fig. 16

The dual-arm teleoperation setup performing suturing

Grahic Jump Location
Fig. 17

Three different force feedback scenarios for suturing

Grahic Jump Location
Fig. 18

Quality of the knots

Grahic Jump Location
Fig. 19

Pulling force applied on the sutures in the three scenarios

Grahic Jump Location
Fig. 20

The single-arm teleoperation setup palpating tissue

Grahic Jump Location
Fig. 21

Haptics information given to surgeon during tumor localization

Grahic Jump Location
Fig. 22

A palpation case study using the haptics-enabled teleoperation setup: (a) the pressure map; (b) the tumor force; (c) the palpation force measured by the ATI force sensor and the high gain observer; and (d) the lateral forces measured by the ATI force sensor and the high gain observer

Tables

Errata

Discussions

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging and repositioning the boxes below.

Related Journal Articles
Related eBook Content
Topic Collections

Sorry! You do not have access to this content. For assistance or to subscribe, please contact us:

  • TELEPHONE: 1-800-843-2763 (Toll-free in the USA)
  • EMAIL: asmedigitalcollection@asme.org
Sign In