View Chapter

Chapter 40 — Mobility and Manipulation

Oliver Brock, Jaeheung Park and Marc Toussaint

Mobile manipulation requires the integration of methodologies from all aspects of robotics. Instead of tackling each aspect in isolation,mobilemanipulation research exploits their interdependence to solve challenging problems. As a result, novel views of long-standing problems emerge. In this chapter, we present these emerging views in the areas of grasping, control, motion generation, learning, and perception. All of these areas must address the shared challenges of high-dimensionality, uncertainty, and task variability. The section on grasping and manipulation describes a trend towards actively leveraging contact and physical and dynamic interactions between hand, object, and environment. Research in control addresses the challenges of appropriately coupling mobility and manipulation. The field of motion generation increasingly blurs the boundaries between control and planning, leading to task-consistent motion in high-dimensional configuration spaces, even in dynamic and partially unknown environments. A key challenge of learning formobilemanipulation consists of identifying the appropriate priors, and we survey recent learning approaches to perception, grasping, motion, and manipulation. Finally, a discussion of promising methods in perception shows how concepts and methods from navigation and active perception are applied.

Adaptive force/velocity control for opening unknown doors

Author  Yiannis Karayiannidis, Colin Smith, Francisco E. Vina, Petter Ogren, Danica Kragic

Video ID : 675

We propose a method that can open doors without prior knowledge of the door's kinematics. The method consists of a velocity controller that uses force measurements and estimates of the radial direction based on adaptive estimates of the position of the door hinge. The control action is decomposed into an estimated radial and tangential direction, following the concept of hybrid force/motion control.

Chapter 26 — Flying Robots

Stefan Leutenegger, Christoph Hürzeler, Amanda K. Stowers, Kostas Alexis, Markus W. Achtelik, David Lentink, Paul Y. Oh and Roland Siegwart

Unmanned aircraft systems (UASs) have drawn increasing attention recently, owing to advancements in related research, technology, and applications. While having been deployed successfully in military scenarios for decades, civil use cases have lately been tackled by the robotics research community.

This chapter overviews the core elements of this highly interdisciplinary field; the reader is guided through the design process of aerial robots for various applications starting with a qualitative characterization of different types of UAS. Design and modeling are closely related, forming a typically iterative process of drafting and analyzing the related properties. Therefore, we overview aerodynamics and dynamics, as well as their application to fixed-wing, rotary-wing, and flapping-wing UAS, including related analytical tools and practical guidelines. Respecting use-case-specific requirements and core autonomous robot demands, we finally provide guidelines to related system integration challenges.

Project Skye - Autonomous blimp

Author  Project Skye

Video ID : 690

Project Skye presents a novel concept combining the elegant and energy efficient flight of a blimp with the precise handling characteristics of a quadrocopter. Thanks to its symmetrical mechanical design, Skye can orient itself in any direction. With its integrated camera system, Skye resembles a hovering eye in the sky which enables applications in countless situations thanks to its long flight duration and high safety standards.

Chapter 34 — Visual Servoing

François Chaumette, Seth Hutchinson and Peter Corke

This chapter introduces visual servo control, using computer vision data in the servo loop to control the motion of a robot. We first describe the basic techniques that are by now well established in the field. We give a general overview of the formulation of the visual servo control problem, and describe the two archetypal visual servo control schemes: image-based and pose-based visual servo control. We then discuss performance and stability issues that pertain to these two schemes, motivating advanced techniques. Of the many advanced techniques that have been developed, we discuss 2.5-D, hybrid, partitioned, and switched approaches. Having covered a variety of control schemes, we deal with target tracking and controlling motion directly in the joint space and extensions to under-actuated ground and aerial robots. We conclude by describing applications of visual servoing in robotics.

2.5-D VS on a 6 DOF robot arm (2)

Author  Francois Chaumette, Seth Hutchinson, Peter Corke

Video ID : 65

This video shows a 2.5-D VS on a 6 DOF robot arm with (c*^t_c, x_g, theta u_z) as visual features. It corresponds to the results depicted in Figure 34.13.

Chapter 23 — Biomimetic Robots

Kyu-Jin Cho and Robert Wood

Biomimetic robot designs attempt to translate biological principles into engineered systems, replacing more classical engineering solutions in order to achieve a function observed in the natural system. This chapter will focus on mechanism design for bio-inspired robots that replicate key principles from nature with novel engineering solutions. The challenges of biomimetic design include developing a deep understanding of the relevant natural system and translating this understanding into engineering design rules. This often entails the development of novel fabrication and actuation to realize the biomimetic design.

This chapter consists of four sections. In Sect. 23.1, we will define what biomimetic design entails, and contrast biomimetic robots with bio-inspired robots. In Sect. 23.2, we will discuss the fundamental components for developing a biomimetic robot. In Sect. 23.3, we will review detailed biomimetic designs that have been developed for canonical robot locomotion behaviors including flapping-wing flight, jumping, crawling, wall climbing, and swimming. In Sect. 23.4, we will discuss the enabling technologies for these biomimetic designs including material and fabrication.

A perching mechanism for micro aerial vehicles

Author  Mirko Kovač, Jürg Germann, Christoph Hürzeler, Roland Y. Siegwart, Dario Floreano

Video ID : 416

This video shows a 4.6 g perching mechanism for micro aerial vehicles (MAVs) which enables them to perch on various vertical surfaces such as tree trunks and the external walls of concrete buildings. To achieve high impact force, needles snap forward and puncture as the trigger collides with the target's surface.

Chapter 46 — Simultaneous Localization and Mapping

Cyrill Stachniss, John J. Leonard and Sebastian Thrun

This chapter provides a comprehensive introduction in to the simultaneous localization and mapping problem, better known in its abbreviated form as SLAM. SLAM addresses the main perception problem of a robot navigating an unknown environment. While navigating the environment, the robot seeks to acquire a map thereof, and at the same time it wishes to localize itself using its map. The use of SLAM problems can be motivated in two different ways: one might be interested in detailed environment models, or one might seek to maintain an accurate sense of a mobile robot’s location. SLAM serves both of these purposes.

We review the three major paradigms from which many published methods for SLAM are derived: (1) the extended Kalman filter (EKF); (2) particle filtering; and (3) graph optimization. We also review recent work in three-dimensional (3-D) SLAM using visual and red green blue distance-sensors (RGB-D), and close with a discussion of open research problems in robotic mapping.

Treemap: An O(log n) algorithm for indoor simultaneous localization and mapping

Author  Udo Frese

Video ID : 441

This video provides an illustration of graph-based SLAM, described in Chap. 46.3.3, Springer Handbook of Robotics, 2nd edn (2016). Reference: U. Frese: Treemap: An O(log n) algorithm for indoor simultaneous localization and mapping, Auton. Robot. 21(2), 103–122 (2006).

Chapter 30 — Sonar Sensing

Lindsay Kleeman and Roman Kuc

Sonar or ultrasonic sensing uses the propagation of acoustic energy at higher frequencies than normal hearing to extract information from the environment. This chapter presents the fundamentals and physics of sonar sensing for object localization, landmark measurement and classification in robotics applications. The source of sonar artifacts is explained and how they can be dealt with. Different ultrasonic transducer technologies are outlined with their main characteristics highlighted.

Sonar systems are described that range in sophistication from low-cost threshold-based ranging modules to multitransducer multipulse configurations with associated signal processing requirements capable of accurate range and bearing measurement, interference rejection, motion compensation, and target classification. Continuous-transmission frequency-modulated (CTFM) systems are introduced and their ability to improve target sensitivity in the presence of noise is discussed. Various sonar ring designs that provide rapid surrounding environmental coverage are described in conjunction with mapping results. Finally the chapter ends with a discussion of biomimetic sonar, which draws inspiration from animals such as bats and dolphins.

Antwerp biomimetic sonar system tracking two balls

Author  Herbert Peremans

Video ID : 317

The Antwerp biomimetic bat-head sonar system consists of a single emitter and two receivers. The receivers are constructed by inserting a small omnidirectional microphone in the ear canal of a plastic replica of the outer ear of the bat Phyllostomus discolor. Using the head-related transfer (HRTF) cues, the system is able to localize multiple reflectors in three dimensions based on a single emission. This video demonstrates the tracking of two balls serving as targets.

Chapter 25 — Underwater Robots

Hyun-Taek Choi and Junku Yuh

Covering about two-thirds of the earth, the ocean is an enormous system that dominates processes on the Earth and has abundant living and nonliving resources, such as fish and subsea gas and oil. Therefore, it has a great effect on our lives on land, and the importance of the ocean for the future existence of all human beings cannot be overemphasized. However, we have not been able to explore the full depths of the ocean and do not fully understand the complex processes of the ocean. Having said that, underwater robots including remotely operated vehicles (ROVs) and autonomous underwater vehicles (AUVs) have received much attention since they can be an effective tool to explore the ocean and efficiently utilize the ocean resources. This chapter focuses on design issues of underwater robots including major subsystems such as mechanical systems, power sources, actuators and sensors, computers and communications, software architecture, and manipulators while Chap. 51 covers modeling and control of underwater robots.

Preliminary experimental result of an AUV yShark2

Author  Hyun-Taek Choi

Video ID : 799

This video shows preliminary experimental result of an underwater robot named yShark2 developed by KRISO (Korea Research Institute of Ships and Ocean Engineering). yShark is a test platform and is designed especially for testing the intelligent algorithms we are working on. For this, it has AHRS, IMU, DVL, two cameras, an LED light, a depth sensor, eight-channel ranging sonar as basic navigation sensors, and we can install an imaging sonar DIDSON for obtaining pictures as shown in Fig. 25.2. More importantly, its system software architecture is implemented using the structure explained in Fig. 25.7. The motion in this video is controlled by autonomous algorithms.

Chapter 62 — Intelligent Vehicles

Alberto Broggi, Alex Zelinsky, Ümit Özgüner and Christian Laugier

This chapter describes the emerging robotics application field of intelligent vehicles – motor vehicles that have autonomous functions and capabilities. The chapter is organized as follows. Section 62.1 provides a motivation for why the development of intelligent vehicles is important, a brief history of the field, and the potential benefits of the technology. Section 62.2 describes the technologies that enable intelligent vehicles to sense vehicle, environment, and driver state, work with digital maps and satellite navigation, and communicate with intelligent transportation infrastructure. Section 62.3 describes the challenges and solutions associated with road scene understanding – a key capability for all intelligent vehicles. Section 62.4 describes advanced driver assistance systems, which use the robotics and sensing technologies described earlier to create new safety and convenience systems for motor vehicles, such as collision avoidance, lane keeping, and parking assistance. Section 62.5 describes driver monitoring technologies that are being developed to mitigate driver fatigue, inattention, and impairment. Section 62.6 describes fully autonomous intelligent vehicles systems that have been developed and deployed. The chapter is concluded in Sect. 62.7 with a discussion of future prospects, while Sect. 62.8 provides references to further reading and additional resources.

PROUD2013 - Inside VisLab's driverless car

Author  Alberto Broggi

Video ID : 178

This video shows the internal and external view of what happened during the PROUD2013 driverlesscar test in downtown Parma, Italy, on July 12, 2013. It also displays the internal status of the vehicle plus some vehicle data (speed, steering angle, and some perception results like pedestrian detection, roundabout merging alert, freeway merging alert, traffic light sensing, etc.). More info available from www.vislab.it/proud.

Chapter 21 — Actuators for Soft Robotics

Alin Albu-Schäffer and Antonio Bicchi

Although we do not know as yet how robots of the future will look like exactly, most of us are sure that they will not resemble the heavy, bulky, rigid machines dangerously moving around in old fashioned industrial automation. There is a growing consensus, in the research community as well as in expectations from the public, that robots of the next generation will be physically compliant and adaptable machines, closely interacting with humans and moving safely, smoothly and efficiently - in other terms, robots will be soft.

This chapter discusses the design, modeling and control of actuators for the new generation of soft robots, which can replace conventional actuators in applications where rigidity is not the first and foremost concern in performance. The chapter focuses on the technology, modeling, and control of lumped parameters of soft robotics, that is, systems of discrete, interconnected, and compliant elements. Distributed parameters, snakelike and continuum soft robotics, are presented in Chap. 20, while Chap. 23 discusses in detail the biomimetic motivations that are often behind soft robotics.

Variable impedance actuators: Moving the robots of tomorrow

Author  B. Vanderborght, A. Albu-Schäffer, A. Bicchi, E. Burdet, D. Caldwell, R. Carloni, M. Catalano, Ganesh, Garabini, Grebenstein, Grioli, Haddadin, Jafari, Laffranchi, Lefeber, Petit, Stramigioli, Tsagarakis, Van Damme, Van Ham, Visser, Wolf

Video ID : 456

Most of today's robots have rigid structures and actuators requiring complex software control algorithms and sophisticated sensor systems in order to behave in a compliant and safe way adapted to contact with unknown environments and humans. By studying and constructing variable impedance actuators and their control, we contribute to the development of actuation units that can match the intrinsic safety, motion performance and energy efficiency of biological systems and, in particular, of the humans. As such, this may lead to a new generation of robots that can co-exist and co-operate with people and get closer to the human manipulation and locomotion performance than is possible with current robots.

Chapter 76 — Evolutionary Robotics

Stefano Nolfi, Josh Bongard, Phil Husbands and Dario Floreano

Evolutionary Robotics is a method for automatically generating artificial brains and morphologies of autonomous robots. This approach is useful both for investigating the design space of robotic applications and for testing scientific hypotheses of biological mechanisms and processes. In this chapter we provide an overview of methods and results of Evolutionary Robotics with robots of different shapes, dimensions, and operation features. We consider both simulated and physical robots with special consideration to the transfer between the two worlds.

Online learning to adapt to fast environmental variations

Author  Dario Floreano

Video ID : 40

A mobile robot Khepera, equipped with a vision module, can gain fitness points by staying on the gray area only when the light is on. The light is normally off, but it can be switched on if the robot passes over the black area positioned on the other side of the arena. The robot can detect ambient light and wall color, but not the color of the floor.