Silvério, J., Rozo, L., Calinon, S. and Caldwell, D. G. (2015)
Learning bimanual end-effector poses from demonstrations using task-parameterized dynamical systems
In Proc. IEEE/RSJ Intl Conf. on Intelligent Robots and Systems (IROS), Hamburg, Germany, pp. 464-470.
Abstract
Very often, when addressing the problem of human-robot skill transfer in task space, only the Cartesian position of the end-effector is encoded by the learning algorithms, instead of the full pose. However, orientation is just as important as position, if not more, when it comes to successfully performing a manipulation task. In this paper, we present a framework that allows robots to learn the full poses of their end-effectors in a task-parameterized manner. Our approach permits the encoding of complex skills, such as those found in bimanual manipulation scenarios, where the generalized coordination patterns between end-effectors (i.e. position and orientation patterns) need to be considered. The proposed framework combines a dynamical systems formulation of the demonstrated trajectories, both in R^3 and SO(3), and task-parameterized probabilistic models that build local task representations in both spaces, based on which it is possible to extract the relevant features of the demonstrated skill. We validate our approach with an experiment in which two 7-DoF WAM robots learn to perform a bimanual sweeping task.
Bibtex reference
@inproceedings{Silverio15IROS,
author="Silv\'erio, J. and Rozo, L. and Calinon, S. and Caldwell, D. G.",
title="Learning bimanual end-effector poses from demonstrations using task-parameterized dynamical systems",
booktitle='Proc. {IEEE/RSJ} Intl Conf. on Intelligent Robots and Systems ({IROS})",
year="2015",
month="Sept.-Oct.",
address="Hamburg, Germany",
pages="464--470"
}
Video
The video shows a setup of two Barrett WAM 7-DoF robots performing a bimanual sweeping task learned from demonstrations, using a combination of quaternion-based TP-GMM and dynamical systems. During the demonstration phase a human transfers the skill to the robots using kinesthetic teaching. Later, in the reproduction phase the robots carry out the task for situations that were not demonstrated, namely to new orientations of the area to be swept by the broom. The video also shows that bimanual coordination patterns are learned and that the arms compensate for perturbations in order to keep the learned patterns.