View Chapter

Chapter 13 — Behavior-Based Systems

François Michaud and Monica Nicolescu

Nature is filled with examples of autonomous creatures capable of dealing with the diversity, unpredictability, and rapidly changing conditions of the real world. Such creatures must make decisions and take actions based on incomplete perception, time constraints, limited knowledge about the world, cognition, reasoning and physical capabilities, in uncontrolled conditions and with very limited cues about the intent of others. Consequently, one way of evaluating intelligence is based on the creature’s ability to make the most of what it has available to handle the complexities of the real world. The main objective of this chapter is to explain behavior-based systems and their use in autonomous control problems and applications. The chapter is organized as follows. Section 13.1 overviews robot control, introducing behavior-based systems in relation to other established approaches to robot control. Section 13.2 follows by outlining the basic principles of behavior-based systems that make them distinct from other types of robot control architectures. The concept of basis behaviors, the means of modularizing behavior-based systems, is presented in Sect. 13.3. Section 13.4 describes how behaviors are used as building blocks for creating representations for use by behavior-based systems, enabling the robot to reason about the world and about itself in that world. Section 13.5 presents several different classes of learning methods for behavior-based systems, validated on single-robot and multirobot systems. Section 13.6 provides an overview of various robotics problems and application domains that have successfully been addressed or are currently being studied with behavior-based control. Finally, Sect. 13.7 concludes the chapter.

Using ROS4iOS

Author  François Michaud

Video ID : 419

Demonstration of the integration, using HBBA (hybrid behaviour-based architecture), of navigation, remote localization, speaker identification, speech recognition and teleoperation. The scenario employs the ROS4iOS to provide remote perceptual capabilities for visual location, speech and speaker recognition. Reference: F. Ferland, R. Chauvin, D. Létourneau, F. Michaud: Hello robot, can you come here? Using ROS4iOS to provide remote perceptual capabilities for visual location, speech and speaker recognition, Proc. Int. ACM/IEEE Conf. Human-Robot Interaction (2014), p. 101

Chapter 15 — Robot Learning

Jan Peters, Daniel D. Lee, Jens Kober, Duy Nguyen-Tuong, J. Andrew Bagnell and Stefan Schaal

Machine learning offers to robotics a framework and set of tools for the design of sophisticated and hard-to-engineer behaviors; conversely, the challenges of robotic problems provide both inspiration, impact, and validation for developments in robot learning. The relationship between disciplines has sufficient promise to be likened to that between physics and mathematics. In this chapter, we attempt to strengthen the links between the two research communities by providing a survey of work in robot learning for learning control and behavior generation in robots. We highlight both key challenges in robot learning as well as notable successes. We discuss how contributions tamed the complexity of the domain and study the role of algorithms, representations, and prior knowledge in achieving these successes. As a result, a particular focus of our chapter lies on model learning for control and robot reinforcement learning. We demonstrate how machine learning approaches may be profitably applied, and we note throughout open questions and the tremendous potential for future research.

Machine learning table tennis

Author  Jan Peters, Katharina Mülling, Jens Kober, Oliver Kroemer, Zhikun Wang

Video ID : 354

The video shows recent successful demonstrations of using machine learning for robot table tennis. The first part shows learning of motor primitives for forehand strikes by training a robot with a mixture of imitation and reinforcement learning. The second part shows how the robot can anticipate an opponent's intended targets based on both forehand and backhand primitives. The video illustrates Sect. 15.3.5 Policy Search of the Springer Handbook of Robotics, 2nd edn (2016). Reference: K. Mülling, J. Kober, O. Kroemer, J. Peters: Learning to select and generalize striking movements in robot table tennis, Int. J. Robot. Res. 32(3), 263-279 (2013)

Chapter 9 — Force Control

Luigi Villani and Joris De Schutter

A fundamental requirement for the success of a manipulation task is the capability to handle the physical contact between a robot and the environment. Pure motion control turns out to be inadequate because the unavoidable modeling errors and uncertainties may cause a rise of the contact force, ultimately leading to an unstable behavior during the interaction, especially in the presence of rigid environments. Force feedback and force control becomes mandatory to achieve a robust and versatile behavior of a robotic system in poorly structured environments as well as safe and dependable operation in the presence of humans. This chapter starts from the analysis of indirect force control strategies, conceived to keep the contact forces limited by ensuring a suitable compliant behavior to the end effector, without requiring an accurate model of the environment. Then the problem of interaction tasks modeling is analyzed, considering both the case of a rigid environment and the case of a compliant environment. For the specification of an interaction task, natural constraints set by the task geometry and artificial constraints set by the control strategy are established, with respect to suitable task frames. This formulation is the essential premise to the synthesis of hybrid force/motion control schemes.

Integration of force strategies and natural-admittance control

Author  Brian B. Mathewson, Wyatt S. Newman

Video ID : 685

When mating parts are brought together, small misalignments must be accommodated by responding to contact forces. Using force feedback, a robot may sense contact forces during assembly and invoke a response to guide the parts into their correct mating positions. The proposed approach integrates force-guided strategies into Hogan's impedance control. Stability of both geometric convergence and of contact dynamics are achieved. Geometric convergence is accomplished more reliably than through the use of impedance control alone, and such a convergence is achieved more rapidly than through the use of force-guided strategies alone. This work was published in the ICRA 1995 video proceedings.

Chapter 75 — Biologically Inspired Robotics

Fumiya Iida and Auke Jan Ijspeert

Throughout the history of robotics research, nature has been providing numerous ideas and inspirations to robotics engineers. Small insect-like robots, for example, usually make use of reflexive behaviors to avoid obstacles during locomotion, whereas large bipedal robots are designed to control complex human-like leg for climbing up and down stairs. While providing an overview of bio-inspired robotics, this chapter particularly focus on research which aims to employ robotics systems and technologies for our deeper understanding of biological systems. Unlike most of the other robotics research where researchers attempt to develop robotic applications, these types of bio-inspired robots are generally developed to test unsolved hypotheses in biological sciences. Through close collaborations between biologists and roboticists, bio-inspired robotics research contributes not only to elucidating challenging questions in nature but also to developing novel technologies for robotics applications. In this chapter, we first provide a brief historical background of this research area and then an overview of ongoing research methodologies. A few representative case studies will detail the successful instances in which robotics technologies help identifying biological hypotheses. And finally we discuss challenges and perspectives in the field.

Biologically inspired robotics (or bio-inspired robotics in short) is a very broad research area because almost all robotic systems are, in one way or the other, inspired from biological systems. Therefore, there is no clear distinction between bio-inspired robots and the others, and there is no commonly agreed definition [75.1]. For example, legged robots that walk, hop, and run are usually regarded as bio-inspired robots because many biological systems rely on legged locomotion for their survival. On the other hand, many robotics researchers implement biologicalmodels ofmotion control and navigation onto wheeled platforms, which could also be regarded as bio-inspired robots [75.2].

Analog Robot

Author  Fumiya Iida, Auke Ijspeert

Video ID : 242

This video presents Analog Robot that uses a biologically- inspired, visual-homing method for navigation. This robot is equipped with a set of analog circuitry for vision-based landmark navigation based on the mechanisms identified in biological systems, the so-called "snapshot model". The image registered at the start of the experiment will be used as a reference frame, and the analog circuitry finds a direction to travel by comparing it with the current frame.

Chapter 38 — Grasping

Domenico Prattichizzo and Jeffrey C. Trinkle

This chapter introduces fundamental models of grasp analysis. The overall model is a coupling of models that define contact behavior with widely used models of rigid-body kinematics and dynamics. The contact model essentially boils down to the selection of components of contact force and moment that are transmitted through each contact. Mathematical properties of the complete model naturally give rise to five primary grasp types whose physical interpretations provide insight for grasp and manipulation planning.

After introducing the basic models and types of grasps, this chapter focuses on the most important grasp characteristic: complete restraint. A grasp with complete restraint prevents loss of contact and thus is very secure. Two primary restraint properties are form closure and force closure. A form closure grasp guarantees maintenance of contact as long as the links of the hand and the object are well-approximated as rigid and as long as the joint actuators are sufficiently strong. As will be seen, the primary difference between form closure and force closure grasps is the latter’s reliance on contact friction. This translates into requiring fewer contacts to achieve force closure than form closure.

The goal of this chapter is to give a thorough understanding of the all-important grasp properties of form and force closure. This will be done through detailed derivations of grasp models and discussions of illustrative examples. For an indepth historical perspective and a treasure-trove bibliography of papers addressing a wide range of topics in grasping, the reader is referred to [38.1].

Grasp analysis using the MATLAB toolbox SynGrasp

Author  Monica Malvezzi, Guido Gioioso, Gionata Salvietti, Domenico Prattichizzo

Video ID : 551

In this video a examples of few grasp analysis are documented and reported. The analysis is performed using SynGrasp, a MATLAB toolbox for grasp analysis. It provides a graphical user interface (GUI) which the user can adopt to easily load a hand and an object, and a series of functions that the user can assemble and modify to exploit all the toolbox features. The video shows how to use SynGrasp to model and analyze grasping, and, in particular it shows how users can select and load in the GUI a hand model, then choose an object and place it in the workspace selecting its position w.r.t. the hand. The grasp is obtained closing the hand from an initial configuration, which can be set by the users acting on hand joints. Once the grasp is defined, it can be analyzed by evaluating grasp quality measures available in the toolbox. Grasps can be described either using the provided grasp planner or directly defining contact points on the hand with the respective contact normal directions. SynGrasp can model both fully and underactuated robotic hands. An important role in grasp analysis, in particular with underactuated hands, is played by system compliance. SynGrasp can model the stiffness at contact points, at the joints or in the actuation system including transmission. A wide set of analytical functions, continuously increasing with new features and capabilities, has been developed to investigate the main grasp properties: controllable forces and object displacement, manipulability analysis, grasp stiffness and different measures of grasp quality. A set of functions for the graphical representation of the hand, the object, and the main analysis results is provided. The toolbox is freely available at http://syngrasp.dii.unisi.it.

Chapter 69 — Physical Human-Robot Interaction

Sami Haddadin and Elizabeth Croft

Over the last two decades, the foundations for physical human–robot interaction (pHRI) have evolved from successful developments in mechatronics, control, and planning, leading toward safer lightweight robot designs and interaction control schemes that advance beyond the current capacities of existing high-payload and highprecision position-controlled industrial robots. Based on their ability to sense physical interaction, render compliant behavior along the robot structure, plan motions that respect human preferences, and generate interaction plans for collaboration and coaction with humans, these novel robots have opened up novel and unforeseen application domains, and have advanced the field of human safety in robotics.

This chapter gives an overview on the state of the art in pHRI as of the date of publication. First, the advances in human safety are outlined, addressing topics in human injury analysis in robotics and safety standards for pHRI. Then, the foundations of human-friendly robot design, including the development of lightweight and intrinsically flexible force/torque-controlled machines together with the required perception abilities for interaction are introduced. Subsequently, motionplanning techniques for human environments, including the domains of biomechanically safe, risk-metric-based, human-aware planning are covered. Finally, the rather recent problem of interaction planning is summarized, including the issues of collaborative action planning, the definition of the interaction planning problem, and an introduction to robot reflexes and reactive control architecture for pHRI.

Physical human-robot interaction in imitation learning

Author  Dongheui Lee, Christian Ott, Yoshihiko Nakamura, Gerd Hirzinger

Video ID : 625

This video presents our recent research on the integration of physical human-robot interaction (pHRI) with imitation learning. First, a marker control approach for real-time human-motion imitation is shown. Second, physical coaching in addition to observational learning is applied for the incremental learning of motion primitives. Last, we extend imitation learning to learning pHRI which includes the establishment of intended physical contacts. The proposed methods were implemented and tested using the IRT humanoid robot and DLR’s humanoid upper-body robot Justin.

Chapter 56 — Robotics in Agriculture and Forestry

Marcel Bergerman, John Billingsley, John Reid and Eldert van Henten

Robotics for agriculture and forestry (A&F) represents the ultimate application of one of our society’s latest and most advanced innovations to its most ancient and important industries. Over the course of history, mechanization and automation increased crop output several orders of magnitude, enabling a geometric growth in population and an increase in quality of life across the globe. Rapid population growth and rising incomes in developing countries, however, require ever larger amounts of A&F output. This chapter addresses robotics for A&F in the form of case studies where robotics is being successfully applied to solve well-identified problems. With respect to plant crops, the focus is on the in-field or in-farm tasks necessary to guarantee a quality crop and, generally speaking, end at harvest time. In the livestock domain, the focus is on breeding and nurturing, exploiting, harvesting, and slaughtering and processing. The chapter is organized in four main sections. The first one explains the scope, in particular, what aspects of robotics for A&F are dealt with in the chapter. The second one discusses the challenges and opportunities associated with the application of robotics to A&F. The third section is the core of the chapter, presenting twenty case studies that showcase (mostly) mature applications of robotics in various agricultural and forestry domains. The case studies are not meant to be comprehensive but instead to give the reader a general overview of how robotics has been applied to A&F in the last 10 years. The fourth section concludes the chapter with a discussion on specific improvements to current technology and paths to commercialization.

An automated mobile platform for orchard scanning and for soil, yield, and flower mapping

Author  James Underwood, Calvin Hung, Suchet Bargoti, Mark Calleija, Robert Fitch, Juan Nieto, Salah Sukkarieh

Video ID : 306

This video shows an end-to-end system for acquiring high-resolution information to support precision agriculture in almond orchards. The robot drives along the orchard rows autonomously, gathering LIDAR and camera data while passing the trees. Each tree is automatically identified and photographed. Image classification is performed on the photos to estimate flower and fruit densities per tree. The information can be stored in a database, compared throughout the season and from one year to the next, and mapped and displayed visually to assist growers in managing and optimizing production.

Chapter 23 — Biomimetic Robots

Kyu-Jin Cho and Robert Wood

Biomimetic robot designs attempt to translate biological principles into engineered systems, replacing more classical engineering solutions in order to achieve a function observed in the natural system. This chapter will focus on mechanism design for bio-inspired robots that replicate key principles from nature with novel engineering solutions. The challenges of biomimetic design include developing a deep understanding of the relevant natural system and translating this understanding into engineering design rules. This often entails the development of novel fabrication and actuation to realize the biomimetic design.

This chapter consists of four sections. In Sect. 23.1, we will define what biomimetic design entails, and contrast biomimetic robots with bio-inspired robots. In Sect. 23.2, we will discuss the fundamental components for developing a biomimetic robot. In Sect. 23.3, we will review detailed biomimetic designs that have been developed for canonical robot locomotion behaviors including flapping-wing flight, jumping, crawling, wall climbing, and swimming. In Sect. 23.4, we will discuss the enabling technologies for these biomimetic designs including material and fabrication.

DASH: Resilient high-speed 16 g hexapedal robot

Author  Paul Birkmeyer, Kevin C. Peterson, Ronald S. Fearing

Video ID : 405

DASH (dynamic autonomous sprawled hexapod) is a resilient high-speed 16 g hexapedal robot. Developed by P. Birkmeyer and R.S. Fearing, Biomimetic Millisystems Laboratory, University of California, Berkeley. Video presented at IEEE/IROS, St. Louis (2009).

Chapter 67 — Humanoids

Paul Fitzpatrick, Kensuke Harada, Charles C. Kemp, Yoshio Matsumoto, Kazuhito Yokoi and Eiichi Yoshida

Humanoid robots selectively immitate aspects of human form and behavior. Humanoids come in a variety of shapes and sizes, from complete human-size legged robots to isolated robotic heads with human-like sensing and expression. This chapter highlights significant humanoid platforms and achievements, and discusses some of the underlying goals behind this area of robotics. Humanoids tend to require the integration ofmany of the methods covered in detail within other chapters of this handbook, so this chapter focuses on distinctive aspects of humanoid robotics with liberal cross-referencing.

This chapter examines what motivates researchers to pursue humanoid robotics, and provides a taste of the evolution of this field over time. It summarizes work on legged humanoid locomotion, whole-body activities, and approaches to human–robot communication. It concludes with a brief discussion of factors that may influence the future of humanoid robots.

3-D, collision-free motion combining locomotion and manipulation by humanoid robot HRP-2 (experiment)

Author  Eiichi Yoshida

Video ID : 598

In this video, the whole-body motion generation described in video 598 is experimentally validated, using the HRP-2 humanoid robot.

Chapter 40 — Mobility and Manipulation

Oliver Brock, Jaeheung Park and Marc Toussaint

Mobile manipulation requires the integration of methodologies from all aspects of robotics. Instead of tackling each aspect in isolation,mobilemanipulation research exploits their interdependence to solve challenging problems. As a result, novel views of long-standing problems emerge. In this chapter, we present these emerging views in the areas of grasping, control, motion generation, learning, and perception. All of these areas must address the shared challenges of high-dimensionality, uncertainty, and task variability. The section on grasping and manipulation describes a trend towards actively leveraging contact and physical and dynamic interactions between hand, object, and environment. Research in control addresses the challenges of appropriately coupling mobility and manipulation. The field of motion generation increasingly blurs the boundaries between control and planning, leading to task-consistent motion in high-dimensional configuration spaces, even in dynamic and partially unknown environments. A key challenge of learning formobilemanipulation consists of identifying the appropriate priors, and we survey recent learning approaches to perception, grasping, motion, and manipulation. Finally, a discussion of promising methods in perception shows how concepts and methods from navigation and active perception are applied.

Exploitation of environmental constraints in human and robotic grasping

Author  Clemens Eppner, Raphael Deimel, Jose Alvarez-Ruiz, Marianne Maertens, Oliver Brock

Video ID : 657

We investigate the premise that robust grasping performance is enabled by exploiting constraints present in the environment. Given this premise, grasping becomes a process of successive exploitation of environmental constraints, until a successful grasp has been established. We present evidence for this view by showing robust robotic grasping based on constraint-exploiting grasp strategies, and we show that it is possible to design robotic hands with inherent capabilities for the exploitation of environmental constraints.