View Chapter

Chapter 15 — Robot Learning

Jan Peters, Daniel D. Lee, Jens Kober, Duy Nguyen-Tuong, J. Andrew Bagnell and Stefan Schaal

Machine learning offers to robotics a framework and set of tools for the design of sophisticated and hard-to-engineer behaviors; conversely, the challenges of robotic problems provide both inspiration, impact, and validation for developments in robot learning. The relationship between disciplines has sufficient promise to be likened to that between physics and mathematics. In this chapter, we attempt to strengthen the links between the two research communities by providing a survey of work in robot learning for learning control and behavior generation in robots. We highlight both key challenges in robot learning as well as notable successes. We discuss how contributions tamed the complexity of the domain and study the role of algorithms, representations, and prior knowledge in achieving these successes. As a result, a particular focus of our chapter lies on model learning for control and robot reinforcement learning. We demonstrate how machine learning approaches may be profitably applied, and we note throughout open questions and the tremendous potential for future research.

Inverse reinforcement

Author  Pieter Abbeel

Video ID : 353

This video shows a successful example of inverse reinforcement learning for acrobatic helicopter maneuvers. It illustrates apprenticeship learning algorithms, which leverage expert demonstrations to efficiently learn good controllers for tasks as demonstrated by an expert. The experimental results captured here include the first autonomous execution of a wide range of maneuvers and a complete airshow. The controllers perform as well as, and often even better than, the human expert pilot. The video illustrates a solution to the "Curse of Goal Specification" in Sect 15.3.6 Challenges in Robot Reinforcement Learning. Reference: P. Abbeel, A. Coates, A.Y. Ng: Autonomous helicopter aerobatics through apprenticeship learning, Int. J. Robot. Res. 29(13), 1608–1639 (2010)

Chapter 66 — Robotics Competitions and Challenges

Daniele Nardi, Jonathan Roberts, Manuela Veloso and Luke Fletcher

This chapter explores the use of competitions to accelerate robotics research and promote science, technology, engineering, and mathematics (STEM) education. We argue that the field of robotics is particularly well suited to innovation through competitions. Two broad categories of robot competition are used to frame the discussion: human-inspired competitions and task-based challenges. Human-inspired robot competitions, of which the majority are sports contests, quickly move through platform development to focus on problemsolving and test through game play. Taskbased challenges attempt to attract participants by presenting a high aim for a robotic system. The contest can then be tuned, as required, to maintain motivation and ensure that the progress is made. Three case studies of robot competitions are presented, namely robot soccer, the UAV challenge, and the DARPA (Defense Advanced Research Projects Agency) grand challenges. The case studies serve to explore from the point of view of organizers and participants, the benefits and limitations of competitions, and what makes a good robot competition.

This chapter ends with some concluding remarks on the natural convergence of humaninspired competitions and task-based challenges in the promotion of STEM education, research, and vocations.

Brief history of RoboCup robot soccer

Author  Manuela Veloso

Video ID : 385

In this 5 min video, we explain the history of the multiple RoboCup soccer leagues.

Chapter 53 — Multiple Mobile Robot Systems

Lynne E. Parker, Daniela Rus and Gaurav S. Sukhatme

Within the context of multiple mobile, and networked robot systems, this chapter explores the current state of the art. After a brief introduction, we first examine architectures for multirobot cooperation, exploring the alternative approaches that have been developed. Next, we explore communications issues and their impact on multirobot teams in Sect. 53.3, followed by a discussion of networked mobile robots in Sect. 53.4. Following this we discuss swarm robot systems in Sect. 53.5 and modular robot systems in Sect. 53.6. While swarm and modular systems typically assume large numbers of homogeneous robots, other types of multirobot systems include heterogeneous robots. We therefore next discuss heterogeneity in cooperative robot teams in Sect. 53.7. Once robot teams allow for individual heterogeneity, issues of task allocation become important; Sect. 53.8 therefore discusses common approaches to task allocation. Section 53.9 discusses the challenges of multirobot learning, and some representative approaches. We outline some of the typical application domains which serve as test beds for multirobot systems research in Sect. 53.10. Finally, we conclude in Sect. 53.11 with some summary remarks and suggestions for further reading.

CKBOTS reconfigurable robots

Author  Mark Yim

Video ID : 196

This video shows reconfigurable robots, which are capable of a variety of configurations and modes of locomotion, including bipeds that can stand up and walk. This system is robust in a variety of situations, as shown in the video. The system has three clusters: when clusters disconnect, they enter a search mode and approach each other to assemble. After successful self-reassembling, the robot system stands up to continue its task.

Chapter 69 — Physical Human-Robot Interaction

Sami Haddadin and Elizabeth Croft

Over the last two decades, the foundations for physical human–robot interaction (pHRI) have evolved from successful developments in mechatronics, control, and planning, leading toward safer lightweight robot designs and interaction control schemes that advance beyond the current capacities of existing high-payload and highprecision position-controlled industrial robots. Based on their ability to sense physical interaction, render compliant behavior along the robot structure, plan motions that respect human preferences, and generate interaction plans for collaboration and coaction with humans, these novel robots have opened up novel and unforeseen application domains, and have advanced the field of human safety in robotics.

This chapter gives an overview on the state of the art in pHRI as of the date of publication. First, the advances in human safety are outlined, addressing topics in human injury analysis in robotics and safety standards for pHRI. Then, the foundations of human-friendly robot design, including the development of lightweight and intrinsically flexible force/torque-controlled machines together with the required perception abilities for interaction are introduced. Subsequently, motionplanning techniques for human environments, including the domains of biomechanically safe, risk-metric-based, human-aware planning are covered. Finally, the rather recent problem of interaction planning is summarized, including the issues of collaborative action planning, the definition of the interaction planning problem, and an introduction to robot reflexes and reactive control architecture for pHRI.

Collaborative human-focused robotics for manufacturing

Author  CHARM Project Consortium

Video ID : 717

The CHARM project demonstrates methods for interacting with robotic assistants through developments in the perception, communication, control, and safe interaction technologies and techniques centered on supporting workers performing complex manufacturing tasks.

Chapter 14 — AI Reasoning Methods for Robotics

Michael Beetz, Raja Chatila, Joachim Hertzberg and Federico Pecora

Artificial intelligence (AI) reasoning technology involving, e.g., inference, planning, and learning, has a track record with a healthy number of successful applications. So can it be used as a toolbox of methods for autonomous mobile robots? Not necessarily, as reasoning on a mobile robot about its dynamic, partially known environment may differ substantially from that in knowledge-based pure software systems, where most of the named successes have been registered. Moreover, recent knowledge about the robot’s environment cannot be given a priori, but needs to be updated from sensor data, involving challenging problems of symbol grounding and knowledge base change. This chapter sketches the main roboticsrelevant topics of symbol-based AI reasoning. Basic methods of knowledge representation and inference are described in general, covering both logicand probability-based approaches. The chapter first gives a motivation by example, to what extent symbolic reasoning has the potential of helping robots perform in the first place. Then (Sect. 14.2), we sketch the landscape of representation languages available for the endeavor. After that (Sect. 14.3), we present approaches and results for several types of practical, robotics-related reasoning tasks, with an emphasis on temporal and spatial reasoning. Plan-based robot control is described in some more detail in Sect. 14.4. Section 14.5 concludes.

From knowledge grounding to dialogue processing

Author  Séverin Lemaignan, Rachid Alami

Video ID : 705

This 2012 video documents the entire process of perspective-aware knowledge acquisition, knowledge representation and storage, and dialogue understanding. It demonstrates several examples of the natural interaction of a human with a PR2 robot, including speech recognition and action execution.

Chapter 23 — Biomimetic Robots

Kyu-Jin Cho and Robert Wood

Biomimetic robot designs attempt to translate biological principles into engineered systems, replacing more classical engineering solutions in order to achieve a function observed in the natural system. This chapter will focus on mechanism design for bio-inspired robots that replicate key principles from nature with novel engineering solutions. The challenges of biomimetic design include developing a deep understanding of the relevant natural system and translating this understanding into engineering design rules. This often entails the development of novel fabrication and actuation to realize the biomimetic design.

This chapter consists of four sections. In Sect. 23.1, we will define what biomimetic design entails, and contrast biomimetic robots with bio-inspired robots. In Sect. 23.2, we will discuss the fundamental components for developing a biomimetic robot. In Sect. 23.3, we will review detailed biomimetic designs that have been developed for canonical robot locomotion behaviors including flapping-wing flight, jumping, crawling, wall climbing, and swimming. In Sect. 23.4, we will discuss the enabling technologies for these biomimetic designs including material and fabrication.

Robot dragonfly DelFly Explorer flies autonomously

Author  Christophe De Wagter, Sjoerd Tijmons, Bart D.W. Remes, Guido C.H.E. de Croon

Video ID : 402

The DelFly Explorer is the first flapping-wing micro air vehicle that is able to fly with complete autonomy in unknown environments. Weighing just 20 g, it is equipped with a 4 g onboard, stereo-vision system. The DelFly Explorer can perform an autonomous take-off, maintain its height, and avoid obstacles for as long as its battery lasts (~9 min). All sensing and processing is performed onboard, so no human or offboard computer is in the loop.

Snake robot in the water

Author  Shigeo Hirose

Video ID : 394

A snake-like robot swims in the water. Thanks to dust sealing and waterproofing, the robot can crawl on land with snake-like locomotion and sinuously swim in water. The robot is composed of compact modules with small passive wheels along the outer edges of their fins.

Chapter 51 — Modeling and Control of Underwater Robots

Gianluca Antonelli, Thor I. Fossen and Dana R. Yoerger

This chapter deals with modeling and control of underwater robots. First, a brief introduction showing the constantly expanding role of marine robotics in oceanic engineering is given; this section also contains some historical backgrounds. Most of the following sections strongly overlap with the corresponding chapters presented in this handbook; hence, to avoid useless repetitions, only those aspects peculiar to the underwater environment are discussed, assuming that the reader is already familiar with concepts such as fault detection systems when discussing the corresponding underwater implementation. Themodeling section is presented by focusing on a coefficient-based approach capturing the most relevant underwater dynamic effects. Two sections dealing with the description of the sensor and the actuating systems are then given. Autonomous underwater vehicles require the implementation of mission control system as well as guidance and control algorithms. Underwater localization is also discussed. Underwater manipulation is then briefly approached. Fault detection and fault tolerance, together with the coordination control of multiple underwater vehicles, conclude the theoretical part of the chapter. Two final sections, reporting some successful applications and discussing future perspectives, conclude the chapter. The reader is referred to Chap. 25 for the design issues.

Multi-vehicle bathymetry mission

Author  Laboratario de Sistemas e Tecnologias Subaquaticas - Porto University / The NOPTILUS project

Video ID : 323

Two LAUV vehicles perform a bathymetry mission inside Porto Harbor. This video shows the deployment, execution, and data-revision phases of the mission. NOPTILUS is funded by the European Community's Seventh Framework Programme ICT-FP.

Chapter 20 — Snake-Like and Continuum Robots

Ian D. Walker, Howie Choset and Gregory S. Chirikjian

This chapter provides an overview of the state of the art of snake-like (backbones comprised of many small links) and continuum (continuous backbone) robots. The history of each of these classes of robot is reviewed, focusing on key hardware developments. A review of the existing theory and algorithms for kinematics for both types of robot is presented, followed by a summary ofmodeling of locomotion for snake-like and continuum mechanisms.

Binary manipulator navigating an obstacle

Author  Greg Chirikjian

Video ID : 163

Simulation of Greg Chirikjian's binary manipulator navigating an obstacle.

Chapter 23 — Biomimetic Robots

Kyu-Jin Cho and Robert Wood

Biomimetic robot designs attempt to translate biological principles into engineered systems, replacing more classical engineering solutions in order to achieve a function observed in the natural system. This chapter will focus on mechanism design for bio-inspired robots that replicate key principles from nature with novel engineering solutions. The challenges of biomimetic design include developing a deep understanding of the relevant natural system and translating this understanding into engineering design rules. This often entails the development of novel fabrication and actuation to realize the biomimetic design.

This chapter consists of four sections. In Sect. 23.1, we will define what biomimetic design entails, and contrast biomimetic robots with bio-inspired robots. In Sect. 23.2, we will discuss the fundamental components for developing a biomimetic robot. In Sect. 23.3, we will review detailed biomimetic designs that have been developed for canonical robot locomotion behaviors including flapping-wing flight, jumping, crawling, wall climbing, and swimming. In Sect. 23.4, we will discuss the enabling technologies for these biomimetic designs including material and fabrication.

GoQBot: Insanely fast robot caterpillar

Author  Huai-Ti Lin, Gary Leisk, Barry Trimmer

Video ID : 291

The GoQBot is a soft-bodied silicon rubber robot which uses a ballistic rolling technique powered by actuators made out of shape-memory alloy coils to move "crazy fast"; its push-off time is under 250 ms, and it spins at 300 rpm.