A tele-manipulation system provides teleprescence by allowing a user to remotely control a slave robot through a master device. While these systems offer great potential, connecting master/slave stations in a coherent way is not trivial. While the master station is usually controlled by a human operator the slave station often interacts with an unknown and dynamic environment. The nature of the such interaction greatly influences overall system performance.

Our group have been working on a new teleoperation scheme that utilizes local force control while exchanging only position information between the master and slave station. This scheme provides much better stability characteristics, while offering the user a realistic feeling of teleprescence, through the use of a virtual spring. This proposed architecture is especially appropriate in the case where force sensing is limited only to the slave robot and the master device is relatively light and frictionless. Specifically, the use of a Phantom device and PUMA in our setup meets this criteria.

Technical Approach

The Operational Space Formulation decouples the dynamics of a mobile manipulator into end-effector dynamics and posture dynamics.Furthermore, each end-effector DOF can be independently controlled. The control of the base can be separately synthesized since its dynamics is decoupled from that of the end-effector.

Based on this formulation, a new teleoperation scheme is applied for each end-effector DOF. The scheme connects two master/slave systems with a virtual spring which generates a desired contact force based on position errors. This desired force is sent to the haptic device (master side) and to the remote compliant motion controller. The master device uses feed-forward control of the desired contact force whereas the slave system uses feedback of the contact force measurement. As a consequence, the human operator feels the desired contact force.

To deal with uncertainties and time-varying parameters (e.g. dynamic environments), the force control on the slave robot uses Active Observers (AOBs), which modify the Kalman estimation structure to achieve model-reference adaptive control. In this case, the stiffness parameter has to be identified on-line to improve robustness and telepresence. The AOB is designed to cover a medium range of stiffness values. However, for large changes, on-line stiffness estimation is necessary.

Experimental Setup

In our setup, the slave station consists of a PUMA560 manipulator mounted on an XR 4000 mobile base. The master station is a Phantom haptic device. The end-effector is controlled by teleoperation and the operator is provided with force feedback through the PHANTOM haptic device. The XR4000 mobile base is controlled with moderately slow dynamics to maintain a specified distance and

orientation with respect to the end-effector. The communication delay associated with the wireless LAN network is about 26ms.

"Robust Haptic Teleoperation of a Mobile Manipulation Platform"
Park, J, Khatib, O.
Experimental Robotics IX, Ang, M. and Khatib, O. (Eds.), Star, Springer Tracts in Advanced Robotics, 2005,

"Teleoperation for Compliant Motion Task"
Park, J., Cortesao, R., Khatib, O.
Proc. International Conference on Advanced Robotics, Coimbra, Portugal, July 2003.

"Haptically Augmented Teleoperation"
Turro, N., Khatib, O., Coste, E.-Maniere.
Proc. IEEE International Conference on Robotics and Automation, Seoul, Korea, May 2001, pp.366-392.


"Haptically Augmented Teleoperation"
Turro, N, Khatib, O.
Preprints, 7th International Symposium on Experimental Robotics (ISER2000), Hawaii, December 2000, pp.1-10.

"Dynamic Models for Haptic Rendering Systems"
Diego Ruspini, Oussama Khatib
Advances in Robot Kinematics: ARK'98, June 1998, Strobl/Salzburg, Austria, pp523-532.


Last update: 03 - 2005 by F.Conti