View Chapter

Chapter 78 — Perceptual Robotics

Heinrich Bülthoff, Christian Wallraven and Martin A. Giese

Robots that share their environment with humans need to be able to recognize and manipulate objects and users, perform complex navigation tasks, and interpret and react to human emotional and communicative gestures. In all of these perceptual capabilities, the human brain, however, is still far ahead of robotic systems. Hence, taking clues from the way the human brain solves such complex perceptual tasks will help to design better robots. Similarly, once a robot interacts with humans, its behaviors and reactions will be judged by humans – movements of the robot, for example, should be fluid and graceful, and it should not evoke an eerie feeling when interacting with a user. In this chapter, we present Perceptual Robotics as the field of robotics that takes inspiration from perception research and neuroscience to, first, build better perceptual capabilities into robotic systems and, second, to validate the perceptual impact of robotic systems on the user.

Active in-hand object recognition

Author  Christian Wallraven

Video ID : 569

This video showcases the implementation of active object learning and recognition using the framework proposed in Browatzki et al. [1, 2]. The first phase shows the robot trying to learn the visual representation of several paper cups differing by a few key features. The robot executes a pre-programmed exploration program to look at the cup from all sides. The (very low-resolution) visual input is tracked and so-called key-frames are extracted which represent the (visual) exploration. After learning, the robot tries to recognize cups that have been placed into its hands using a similar exploration program based on visual information - due to the low-resolution input and the highly similar objects, the robot, however, fails to make the correct decision. The video then shows the second, advanced, exploration, which is based on actively seeking the view that is expected to provide maximum information about the object. For this, the robot embeds the learned visual information into a proprioceptive map indexed by the two joint angles of the hand. In this map, the robot now tries to predict the joint-angle combination that provides the most information about the object, given the current state of exploration. The implementation uses particle filtering to track a large number of object (view) hypotheses at the same time. Since the robot now uses a multisensory representation, the subsequent object-recognition trials are all correct, despite poor visual input and highly similar objects. References: [1] B Browatzki, V. Tikhanoff, G. Metta, H.H. Bülthoff, C. Wallraven: Active in-hand object recognition on a humanoid robot, IEEE Trans. Robot. 30(5), 1260-1269 (2014); [2] B. Browatzki, V. Tikhanoff, G. Metta, H.H. Bülthoff, C. Wallraven: Active object recognition on a humanoid robot, Proc. IEEE Int. Conf. Robot. Autom. (ICRA), St. Paul (2012), pp. 2021-2028.

Chapter 61 — Robot Surveillance and Security

Wendell H. Chun and Nikolaos Papanikolopoulos

This chapter introduces the foundation for surveillance and security robots for multiple military and civilian applications. The key environmental domains are mobile robots for ground, aerial, surface water, and underwater applications. Surveillance literallymeans to watch fromabove,while surveillance robots are used to monitor the behavior, activities, and other changing information that are gathered for the general purpose of managing, directing, or protecting one’s assets or position. In a practical sense, the term surveillance is taken to mean the act of observation from a distance, and security robots are commonly used to protect and safeguard a location, some valuable assets, or personal against danger, damage, loss, and crime. Surveillance is a proactive operation,while security robots are a defensive operation. The construction of each type of robot is similar in nature with amobility component, sensor payload, communication system, and an operator control station.

After introducing the major robot components, this chapter focuses on the various applications. More specifically, Sect. 61.3 discusses the enabling technologies of mobile robot navigation, various payload sensors used for surveillance or security applications, target detection and tracking algorithms, and the operator’s robot control console for human–machine interface (HMI). Section 61.4 presents selected research activities relevant to surveillance and security, including automatic data processing of the payload sensors, automaticmonitoring of human activities, facial recognition, and collaborative automatic target recognition (ATR). Finally, Sect. 61.5 discusses future directions in robot surveillance and security, giving some conclusions and followed by references.

Tracking people for security

Author  Nikos Papanikolopoulos

Video ID : 683

Tracking of people in crowded scenes is challenging because people occlude each other as they walk around. The latest revision of the University of Minnesota's person tracker uses adaptive appearance models that explicitly account for the probability that a person may be partially occluded. All potentially occluding targets are tracked jointly, and the most likely visibility order is estimated (so we know the probability that person A is occluding person B). Target-size adaptation is performed using calibration information about the camera, and the reported target positions are made in real-world coordinates.

Chapter 20 — Snake-Like and Continuum Robots

Ian D. Walker, Howie Choset and Gregory S. Chirikjian

This chapter provides an overview of the state of the art of snake-like (backbones comprised of many small links) and continuum (continuous backbone) robots. The history of each of these classes of robot is reviewed, focusing on key hardware developments. A review of the existing theory and algorithms for kinematics for both types of robot is presented, followed by a summary ofmodeling of locomotion for snake-like and continuum mechanisms.

Modsnake swimming

Author  Howie Choset

Video ID : 169

The CMU Modsnake swimming in a pool.

Chapter 71 — Cognitive Human-Robot Interaction

Bilge Mutlu, Nicholas Roy and Selma Šabanović

A key research challenge in robotics is to design robotic systems with the cognitive capabilities necessary to support human–robot interaction. These systems will need to have appropriate representations of the world; the task at hand; the capabilities, expectations, and actions of their human counterparts; and how their own actions might affect the world, their task, and their human partners. Cognitive human–robot interaction is a research area that considers human(s), robot(s), and their joint actions as a cognitive system and seeks to create models, algorithms, and design guidelines to enable the design of such systems. Core research activities in this area include the development of representations and actions that allow robots to participate in joint activities with people; a deeper understanding of human expectations and cognitive responses to robot actions; and, models of joint activity for human–robot interaction. This chapter surveys these research activities by drawing on research questions and advances from a wide range of fields including computer science, cognitive science, linguistics, and robotics.

Human-robot jazz improvisation

Author  Guy Hoffman

Video ID : 236

The stage debut of Shimon, the robotic marimba player. Also, the world's first human-robot rendition of Duke Jordan's "Jordu", for human piano and robot marimba.

Chapter 27 — Micro-/Nanorobots

Bradley J. Nelson, Lixin Dong and Fumihito Arai

The field of microrobotics covers the robotic manipulation of objects with dimensions in the millimeter to micron range as well as the design and fabrication of autonomous robotic agents that fall within this size range. Nanorobotics is defined in the same way only for dimensions smaller than a micron. With the ability to position and orient objects with micron- and nanometer-scale dimensions, manipulation at each of these scales is a promising way to enable the assembly of micro- and nanosystems, including micro- and nanorobots.

This chapter overviews the state of the art of both micro- and nanorobotics, outlines scaling effects, actuation, and sensing and fabrication at these scales, and focuses on micro- and nanorobotic manipulation systems and their application in microassembly, biotechnology, and the construction and characterization of micro and nanoelectromechanical systems (MEMS/NEMS). Material science, biotechnology, and micro- and nanoelectronics will also benefit from advances in these areas of robotics.

Linear-to-rotary motion converters for three-dimensional microscopy

Author  Lixin Dong

Video ID : 492

This video shows the application of a linear-to-rotary motion converter in 3-D imaging using a scanning electron microscope. The motion converter consists of a SiGe/Si dual-chirality helical nanobelt (DCHNB). The experiment was done using nanorobotic manipulation. Analytical and experimental investigation shows that the motion conversion has excellent linearity for small deflections. The stiffness (0.033 N/m) is much smaller than that of bottom-up synthesized helical nanostructures, which is promising for high-resolution force measurement in nanoelectromechanical systems (NEMS). The ultracompact size makes it also possible for DCHNBs to serve as rotary stages for creating 3-D scanning probe microscopes or microgoniometers.

Chapter 47 — Motion Planning and Obstacle Avoidance

Javier Minguez, Florant Lamiraux and Jean-Paul Laumond

This chapter describes motion planning and obstacle avoidance for mobile robots. We will see how the two areas do not share the same modeling background. From the very beginning of motion planning, research has been dominated by computer sciences. Researchers aim at devising well-grounded algorithms with well-understood completeness and exactness properties.

The challenge of this chapter is to present both nonholonomic motion planning (Sects. 47.1–47.6) and obstacle avoidance (Sects. 47.7–47.10) issues. Section 47.11 reviews recent successful approaches that tend to embrace the whole problemofmotion planning and motion control. These approaches benefit from both nonholonomic motion planning and obstacle avoidance methods.

Robotic wheelchair: Autonomous navigation with Google Glass

Author  Personal Robotics Group - OSU

Video ID : 709

For people with extreme disabilities such as ALS or quadriplegia, it is often hard to move about on their own and interact with their environments due to their immobility. Our work - nicknamed "Project Chiron" - attempts to alleviate some of this immobility with a kit that can be used on any Permobil-brand wheelchair.

Chapter 44 — Networked Robots

Dezhen Song, Ken Goldberg and Nak-Young Chong

As of 2013, almost all robots have access to computer networks that offer extensive computing, memory, and other resources that can dramatically improve performance. The underlying enabling framework is the focus of this chapter: networked robots. Networked robots trace their origin to telerobots or remotely controlled robots. Telerobots are widely used to explore undersea terrains and outer space, to defuse bombs and to clean up hazardous waste. Until 1994, telerobots were accessible only to trained and trusted experts through dedicated communication channels. This chapter will describe relevant network technology, the history of networked robots as it evolves from teleoperation to cloud robotics, properties of networked robots, how to build a networked robot, example systems. Later in the chapter, we focus on the recent progress on cloud robotics, and topics for future research.

A multi-operator, multi-robot teleoperation system

Author  Nak Young Chong

Video ID : 84

A multi-operator, multi-robot teleoperation system for collaborative maintenance operations: Video Proc. of ICRA 2001. Over the past decades, problems and notable results have been reported mainly in the single-operator single-robot (SOSR) teleoperation system. Recently, the need for cooperation has rapidly emerged in many possible applications such as plant maintenance, construction, and surgery, and considerable efforts have therefore been made toward the coordinated control of multi-operator, multi-robot (MOMR) teleoperation. We have developed coordinated control technologies for multi-telerobot cooperation in a common environment remotely controlled from multiple operators physically distant from each other. To overcome the operators' delayed visual perception arising from network throughput limitations, we have suggested several coordinated control aids at the local operator site. Operators control their master to get their telerobot to cooperate with the counterpart telerobot using the predictive simulator, as well as video image feedback. This video explains the details of the testbed and investigates the use of an online predictive simulator to assist the operator in coping with time delay.

Chapter 6 — Model Identification

John Hollerbach, Wisama Khalil and Maxime Gautier

This chapter discusses how to determine the kinematic parameters and the inertial parameters of robot manipulators. Both instances of model identification are cast into a common framework of least-squares parameter estimation, and are shown to have common numerical issues relating to the identifiability of parameters, adequacy of the measurement sets, and numerical robustness. These discussions are generic to any parameter estimation problem, and can be applied in other contexts.

For kinematic calibration, the main aim is to identify the geometric Denavit–Hartenberg (DH) parameters, although joint-based parameters relating to the sensing and transmission elements can also be identified. Endpoint sensing or endpoint constraints can provide equivalent calibration equations. By casting all calibration methods as closed-loop calibration, the calibration index categorizes methods in terms of how many equations per pose are generated.

Inertial parameters may be estimated through the execution of a trajectory while sensing one or more components of force/torque at a joint. Load estimation of a handheld object is simplest because of full mobility and full wrist force-torque sensing. For link inertial parameter estimation, restricted mobility of links nearer the base as well as sensing only the joint torque means that not all inertial parameters can be identified. Those that can be identified are those that affect joint torque, although they may appear in complicated linear combinations.

Dynamic identification of Kuka LWR : Trajectory with load

Author  Maxime Gautier

Video ID : 483

This video shows a trajectory with a known payload mass of 4.6 (kg) used to identify the dynamic parameters and torque-sensor gains of the KUKA LWR manipulator. Details and results are given in the papers: A. Jubien, M. Gautier, A. Janot: Dynamic identification of the Kuka LWR robot using motor torques and joint torque sensors data, preprints 19th IFAC World Congress, Cape Town (2014) pp. 8391-8396 M. Gautier, A. Jubien: Force calibration of the Kuka LWR-like robots including embedded joint torque sensors and robot structure, IEEE/RSJ Int. Conf. Intel. Robot. Syst. (IROS), Chicago (2014) pp. 416-421

Chapter 20 — Snake-Like and Continuum Robots

Ian D. Walker, Howie Choset and Gregory S. Chirikjian

This chapter provides an overview of the state of the art of snake-like (backbones comprised of many small links) and continuum (continuous backbone) robots. The history of each of these classes of robot is reviewed, focusing on key hardware developments. A review of the existing theory and algorithms for kinematics for both types of robot is presented, followed by a summary ofmodeling of locomotion for snake-like and continuum mechanisms.

RDP experimental results

Author  Nabil Simaan

Video ID : 247

Demonstrates a prototype system for transurethral bladder cancer resection. This robot has a 5 mm snake with two segments and three working channels including a custom-made fiberscope, laser ablation and a gripper [1-3]. References: [1] A. Bajo, R. B. Pickens, S. D. Herrell, N. Simaan: A pilot ex-vivo evaluation of a telerobotic system for transurethral intervention and surveillance, The 5th Hamlyn Symp. Medical Robotics (2012), pp. 3-4; [2] A. Bajo, R. B. Pickens, S. D. Herrell, N. Simaan: Constrained motion control of multisegment continuum robots for transurethral bladder resection and surveillance, Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Karlsruhe (2013), pp. 5817-5822; [3] R. E. Goldman, A. Bajo, L. S. MacLachlan, R. Pickens, S. D. Herrell, N. Simaan: Design and performance evaluation of a minimally invasive telerobotic platform for transurethral surveillance and intervention, IEEE Trans. Biomed. Eng. 60(4), 918-925 (2013)

Chapter 26 — Flying Robots

Stefan Leutenegger, Christoph Hürzeler, Amanda K. Stowers, Kostas Alexis, Markus W. Achtelik, David Lentink, Paul Y. Oh and Roland Siegwart

Unmanned aircraft systems (UASs) have drawn increasing attention recently, owing to advancements in related research, technology, and applications. While having been deployed successfully in military scenarios for decades, civil use cases have lately been tackled by the robotics research community.

This chapter overviews the core elements of this highly interdisciplinary field; the reader is guided through the design process of aerial robots for various applications starting with a qualitative characterization of different types of UAS. Design and modeling are closely related, forming a typically iterative process of drafting and analyzing the related properties. Therefore, we overview aerodynamics and dynamics, as well as their application to fixed-wing, rotary-wing, and flapping-wing UAS, including related analytical tools and practical guidelines. Respecting use-case-specific requirements and core autonomous robot demands, we finally provide guidelines to related system integration challenges.

A robot that flies like a bird

Author  Festo

Video ID : 696

Plenty of robots can fly -- but none can fly like a real bird. That is, until Markus Fischer and his team at Festo built SmartBird, a large, lightweight robot, modeled on a seagull, that flies by flapping its wings. Enjoy this soaring demo from TEDGlobal 2011.