Mobile manipulation requires the integration of methodologies from all aspects of robotics. Instead of tackling each aspect in isolation,mobilemanipulation research exploits their interdependence to solve challenging problems. As a result, novel views of long-standing problems emerge. In this chapter, we present these emerging views in the areas of grasping, control, motion generation, learning, and perception. All of these areas must address the shared challenges of high-dimensionality, uncertainty, and task variability. The section on grasping and manipulation describes a trend towards actively leveraging contact and physical and dynamic interactions between hand, object, and environment. Research in control addresses the challenges of appropriately coupling mobility and manipulation. The field of motion generation increasingly blurs the boundaries between control and planning, leading to task-consistent motion in high-dimensional configuration spaces, even in dynamic and partially unknown environments. A key challenge of learning formobilemanipulation consists of identifying the appropriate priors, and we survey recent learning approaches to perception, grasping, motion, and manipulation. Finally, a discussion of promising methods in perception shows how concepts and methods from navigation and active perception are applied.
Catching objects in flight
Author Seungsu Kim, Ashwini Shukla, Aude Billard
Video ID : 653
We target the difficult problem of catching in-flight objects with uneven shapes. This requires the solution of three complex problems: predicting accurately the trajectory of fast-moving objects, predicting the feasible catching configuration, and planning the arm motion, all within milliseconds. We follow a programming-by-demonstration approach in order to learn models of the object and the arm dynamics from throwing examples. We propose a new methodology for finding a feasible catching configuration in a probabilistic manner. We leverage the strength of dynamical systems for encoding motion from several demonstrations. This enables fast and online adaptation of the arm motion in the presence of sensor uncertainty. We validate the approach in simulation with the iCub humanoid robot and in real-world experiment with the KUKA LWR 4+ (7-DOF arm robot) for catching a hammer, a tennis racket, an empty bottle, a partially filled bottle and a cardboard box.