View Chapter

Chapter 34 — Visual Servoing

François Chaumette, Seth Hutchinson and Peter Corke

This chapter introduces visual servo control, using computer vision data in the servo loop to control the motion of a robot. We first describe the basic techniques that are by now well established in the field. We give a general overview of the formulation of the visual servo control problem, and describe the two archetypal visual servo control schemes: image-based and pose-based visual servo control. We then discuss performance and stability issues that pertain to these two schemes, motivating advanced techniques. Of the many advanced techniques that have been developed, we discuss 2.5-D, hybrid, partitioned, and switched approaches. Having covered a variety of control schemes, we deal with target tracking and controlling motion directly in the joint space and extensions to under-actuated ground and aerial robots. We conclude by describing applications of visual servoing in robotics.

IBVS on a 6-DOF robot arm (1)

Author  Francois Chaumette, Seth Hutchinson, Peter Corke

Video ID : 59

This video shows an IBVS on a 6-DOF robot arm with Cartesian coordinates of image points as visual features and a desired interaction matrix in the control scheme. It corresponds to the results depicted in Figure 34.2.

Chapter 18 — Parallel Mechanisms

Jean-Pierre Merlet, Clément Gosselin and Tian Huang

This chapter presents an introduction to the kinematics and dynamics of parallel mechanisms, also referred to as parallel robots. As opposed to classical serial manipulators, the kinematic architecture of parallel robots includes closed-loop kinematic chains. As a consequence, their analysis differs considerably from that of their serial counterparts. This chapter aims at presenting the fundamental formulations and techniques used in their analysis.

Quadrupteron robot

Author  Clément Gosselin

Video ID : 52

This video demonstrates a 4-DOF partially decoupled scara-type parallel robot (Quadrupteron). References: 1. P.L. Richard, C. Gosselin, X. Kong: Kinematic analysis and prototyping of a partially decoupled 4-DOF 3T1R parallel manipulator, ASME J. Mech. Des. 129(6), 611-616 (2007); 2. X. Kong, C. Gosselin: Forward displacement analysis of a quadratic 4-DOF 3T1R parallel manipulator: The Quadrupteron, Meccanica 46(1), 147-154 (2011); 3. C. Gosselin: Compact dynamic models for the tripteron and quadrupteron parallel manipulators, J. Syst. Control Eng. 223(I1), 1-11 (2009)

Chapter 56 — Robotics in Agriculture and Forestry

Marcel Bergerman, John Billingsley, John Reid and Eldert van Henten

Robotics for agriculture and forestry (A&F) represents the ultimate application of one of our society’s latest and most advanced innovations to its most ancient and important industries. Over the course of history, mechanization and automation increased crop output several orders of magnitude, enabling a geometric growth in population and an increase in quality of life across the globe. Rapid population growth and rising incomes in developing countries, however, require ever larger amounts of A&F output. This chapter addresses robotics for A&F in the form of case studies where robotics is being successfully applied to solve well-identified problems. With respect to plant crops, the focus is on the in-field or in-farm tasks necessary to guarantee a quality crop and, generally speaking, end at harvest time. In the livestock domain, the focus is on breeding and nurturing, exploiting, harvesting, and slaughtering and processing. The chapter is organized in four main sections. The first one explains the scope, in particular, what aspects of robotics for A&F are dealt with in the chapter. The second one discusses the challenges and opportunities associated with the application of robotics to A&F. The third section is the core of the chapter, presenting twenty case studies that showcase (mostly) mature applications of robotics in various agricultural and forestry domains. The case studies are not meant to be comprehensive but instead to give the reader a general overview of how robotics has been applied to A&F in the last 10 years. The fourth section concludes the chapter with a discussion on specific improvements to current technology and paths to commercialization.

Autonomous orchard vehicle for specialty-crop production

Author  Sanjiv Singh, Marcel Bergerman

Video ID : 91

In the United States, production of specialty crops (fruits and vegetables, tree nuts, dried fruits and horticulture and nursery crops, including floriculture) is very labor-intensive. The autonomous orchard vehicle presented in this video can be used year-round to automate tasks such as mowing, spraying, scouting for disease or insects, and estimating crop yield; or to augment humans for pruning, thinning, training trees, placing pheromone dispensers, and harvesting. Studies by the extension teams at The Pennsylvania and Washington State Universities report an increase in efficiency of up to 116% when workers perform operations on the upper part of trees onboard the vehicle, as compared to workers using ladders.

Chapter 21 — Actuators for Soft Robotics

Alin Albu-Schäffer and Antonio Bicchi

Although we do not know as yet how robots of the future will look like exactly, most of us are sure that they will not resemble the heavy, bulky, rigid machines dangerously moving around in old fashioned industrial automation. There is a growing consensus, in the research community as well as in expectations from the public, that robots of the next generation will be physically compliant and adaptable machines, closely interacting with humans and moving safely, smoothly and efficiently - in other terms, robots will be soft.

This chapter discusses the design, modeling and control of actuators for the new generation of soft robots, which can replace conventional actuators in applications where rigidity is not the first and foremost concern in performance. The chapter focuses on the technology, modeling, and control of lumped parameters of soft robotics, that is, systems of discrete, interconnected, and compliant elements. Distributed parameters, snakelike and continuum soft robotics, are presented in Chap. 20, while Chap. 23 discusses in detail the biomimetic motivations that are often behind soft robotics.

VSA-Cube arm: Drawing on a wavy surface (high stiffness)

Author  Centro di Ricerca "E. Piaggio"

Video ID : 472

A 3-DOF arm, built with VSA-cube units, performing a circle on a wavy surface with preset uniformly high stiffness.

Chapter 10 — Redundant Robots

Stefano Chiaverini, Giuseppe Oriolo and Anthony A. Maciejewski

This chapter focuses on redundancy resolution schemes, i. e., the techniques for exploiting the redundant degrees of freedom in the solution of the inverse kinematics problem. This is obviously an issue of major relevance for motion planning and control purposes.

In particular, task-oriented kinematics and the basic methods for its inversion at the velocity (first-order differential) level are first recalled, with a discussion of the main techniques for handling kinematic singularities. Next, different firstorder methods to solve kinematic redundancy are arranged in two main categories, namely those based on the optimization of suitable performance criteria and those relying on the augmentation of the task space. Redundancy resolution methods at the acceleration (second-order differential) level are then considered in order to take into account dynamics issues, e.g., torque minimization. Conditions under which a cyclic task motion results in a cyclic joint motion are also discussed; this is a major issue when a redundant manipulator is used to execute a repetitive task, e.g., in industrial applications. The use of kinematic redundancy for fault tolerance is analyzed in detail. Suggestions for further reading are given in a final section.

FlexIRob - Teaching null-space constraints in physical human-robot interaction

Author  AMARSi Consortium

Video ID : 818

The video presents an approach utilizing the physical interaction capabilities of compliant robots with data-driven and model-free learning in a coherent system in order to make fast reconfiguration of redundant robots feasible. Users with no particular robotics knowledge can perform this task in physical interaction with the compliant robot, for example, to reconfigure a work cell due to changes in the environment. For fast and efficient learning of the respective null-space constraints, a reservoir neural network is employed. It is embedded in the motion controller of the system, hence allowing for execution of arbitrary motions in task space. We describe the training, exploration, and the control architecture of the systems and present an evaluation of the KUKA Light-Weight Robot (LWR). The results show that the learned model solves the redundancy resolution problem under the given constraints with sufficient accuracy and generalizes to generate valid joint-space trajectories even in untrained areas of the workspace.

Chapter 69 — Physical Human-Robot Interaction

Sami Haddadin and Elizabeth Croft

Over the last two decades, the foundations for physical human–robot interaction (pHRI) have evolved from successful developments in mechatronics, control, and planning, leading toward safer lightweight robot designs and interaction control schemes that advance beyond the current capacities of existing high-payload and highprecision position-controlled industrial robots. Based on their ability to sense physical interaction, render compliant behavior along the robot structure, plan motions that respect human preferences, and generate interaction plans for collaboration and coaction with humans, these novel robots have opened up novel and unforeseen application domains, and have advanced the field of human safety in robotics.

This chapter gives an overview on the state of the art in pHRI as of the date of publication. First, the advances in human safety are outlined, addressing topics in human injury analysis in robotics and safety standards for pHRI. Then, the foundations of human-friendly robot design, including the development of lightweight and intrinsically flexible force/torque-controlled machines together with the required perception abilities for interaction are introduced. Subsequently, motionplanning techniques for human environments, including the domains of biomechanically safe, risk-metric-based, human-aware planning are covered. Finally, the rather recent problem of interaction planning is summarized, including the issues of collaborative action planning, the definition of the interaction planning problem, and an introduction to robot reflexes and reactive control architecture for pHRI.

Flexible robot gripper for KUKA Light Weight Robot (LWR): Collaboration between human and robot

Author  Robotiq

Video ID : 632

Flexible robot gripper on KUKA Light Weight Robot engaged in a proximal human-robot collaboration. The human-safe robot combined with a agile robot gripper demonstrates collaborative part feeding and part holding in assembly tasks.

Chapter 13 — Behavior-Based Systems

François Michaud and Monica Nicolescu

Nature is filled with examples of autonomous creatures capable of dealing with the diversity, unpredictability, and rapidly changing conditions of the real world. Such creatures must make decisions and take actions based on incomplete perception, time constraints, limited knowledge about the world, cognition, reasoning and physical capabilities, in uncontrolled conditions and with very limited cues about the intent of others. Consequently, one way of evaluating intelligence is based on the creature’s ability to make the most of what it has available to handle the complexities of the real world. The main objective of this chapter is to explain behavior-based systems and their use in autonomous control problems and applications. The chapter is organized as follows. Section 13.1 overviews robot control, introducing behavior-based systems in relation to other established approaches to robot control. Section 13.2 follows by outlining the basic principles of behavior-based systems that make them distinct from other types of robot control architectures. The concept of basis behaviors, the means of modularizing behavior-based systems, is presented in Sect. 13.3. Section 13.4 describes how behaviors are used as building blocks for creating representations for use by behavior-based systems, enabling the robot to reason about the world and about itself in that world. Section 13.5 presents several different classes of learning methods for behavior-based systems, validated on single-robot and multirobot systems. Section 13.6 provides an overview of various robotics problems and application domains that have successfully been addressed or are currently being studied with behavior-based control. Finally, Sect. 13.7 concludes the chapter.

Toto

Author  Maja J. Mataric

Video ID : 35

This is a video of the work done early 1990, showing Toto which introduced the use of distributed representation into behavior-based systems. Reference: M.J. Matarić: Integration of representation into goal-driven behavior-based robots, IEEE Trans. Robot. Autom. 8(3), 304–312 (1992)

Chapter 38 — Grasping

Domenico Prattichizzo and Jeffrey C. Trinkle

This chapter introduces fundamental models of grasp analysis. The overall model is a coupling of models that define contact behavior with widely used models of rigid-body kinematics and dynamics. The contact model essentially boils down to the selection of components of contact force and moment that are transmitted through each contact. Mathematical properties of the complete model naturally give rise to five primary grasp types whose physical interpretations provide insight for grasp and manipulation planning.

After introducing the basic models and types of grasps, this chapter focuses on the most important grasp characteristic: complete restraint. A grasp with complete restraint prevents loss of contact and thus is very secure. Two primary restraint properties are form closure and force closure. A form closure grasp guarantees maintenance of contact as long as the links of the hand and the object are well-approximated as rigid and as long as the joint actuators are sufficiently strong. As will be seen, the primary difference between form closure and force closure grasps is the latter’s reliance on contact friction. This translates into requiring fewer contacts to achieve force closure than form closure.

The goal of this chapter is to give a thorough understanding of the all-important grasp properties of form and force closure. This will be done through detailed derivations of grasp models and discussions of illustrative examples. For an indepth historical perspective and a treasure-trove bibliography of papers addressing a wide range of topics in grasping, the reader is referred to [38.1].

Grasp analysis using the MATLAB toolbox SynGrasp

Author  Monica Malvezzi, Guido Gioioso, Gionata Salvietti, Domenico Prattichizzo

Video ID : 551

In this video a examples of few grasp analysis are documented and reported. The analysis is performed using SynGrasp, a MATLAB toolbox for grasp analysis. It provides a graphical user interface (GUI) which the user can adopt to easily load a hand and an object, and a series of functions that the user can assemble and modify to exploit all the toolbox features. The video shows how to use SynGrasp to model and analyze grasping, and, in particular it shows how users can select and load in the GUI a hand model, then choose an object and place it in the workspace selecting its position w.r.t. the hand. The grasp is obtained closing the hand from an initial configuration, which can be set by the users acting on hand joints. Once the grasp is defined, it can be analyzed by evaluating grasp quality measures available in the toolbox. Grasps can be described either using the provided grasp planner or directly defining contact points on the hand with the respective contact normal directions. SynGrasp can model both fully and underactuated robotic hands. An important role in grasp analysis, in particular with underactuated hands, is played by system compliance. SynGrasp can model the stiffness at contact points, at the joints or in the actuation system including transmission. A wide set of analytical functions, continuously increasing with new features and capabilities, has been developed to investigate the main grasp properties: controllable forces and object displacement, manipulability analysis, grasp stiffness and different measures of grasp quality. A set of functions for the graphical representation of the hand, the object, and the main analysis results is provided. The toolbox is freely available at http://syngrasp.dii.unisi.it.

Chapter 17 — Limbed Systems

Shuuji Kajita and Christian Ott

A limbed system is a mobile robot with a body, legs and arms. First, its general design process is discussed in Sect. 17.1. Then we consider issues of conceptual design and observe designs of various existing robots in Sect. 17.2. As an example in detail, the design of a humanoid robot HRP-4C is shown in Sect. 17.3. To design a limbed system of good performance, it is important to take into account of actuation and control, like gravity compensation, limit cycle dynamics, template models, and backdrivable actuation. These are discussed in Sect. 17.4.

In Sect. 17.5, we overview divergence of limbed systems. We see odd legged walkers, leg–wheel hybrid robots, leg–arm hybrid robots, tethered walking robots, and wall-climbing robots. To compare limbed systems of different configurations,we can use performance indices such as the gait sensitivity norm, the Froude number, and the specific resistance, etc., which are introduced in Sect. 17.6.

Hexapod ParaWalker-II

Author  Yusuke Ota

Video ID : 520

A twin-frame walking robot, which is a reduced-DOF practical walking robot, developed by Dr. Ota and Prof. Hirose.

Chapter 69 — Physical Human-Robot Interaction

Sami Haddadin and Elizabeth Croft

Over the last two decades, the foundations for physical human–robot interaction (pHRI) have evolved from successful developments in mechatronics, control, and planning, leading toward safer lightweight robot designs and interaction control schemes that advance beyond the current capacities of existing high-payload and highprecision position-controlled industrial robots. Based on their ability to sense physical interaction, render compliant behavior along the robot structure, plan motions that respect human preferences, and generate interaction plans for collaboration and coaction with humans, these novel robots have opened up novel and unforeseen application domains, and have advanced the field of human safety in robotics.

This chapter gives an overview on the state of the art in pHRI as of the date of publication. First, the advances in human safety are outlined, addressing topics in human injury analysis in robotics and safety standards for pHRI. Then, the foundations of human-friendly robot design, including the development of lightweight and intrinsically flexible force/torque-controlled machines together with the required perception abilities for interaction are introduced. Subsequently, motionplanning techniques for human environments, including the domains of biomechanically safe, risk-metric-based, human-aware planning are covered. Finally, the rather recent problem of interaction planning is summarized, including the issues of collaborative action planning, the definition of the interaction planning problem, and an introduction to robot reflexes and reactive control architecture for pHRI.

Admittance control of a human-centered 3-DOF robotic arm using dfferential elastic actuators

Author  Marc-Antoine Legault, Marc-Antoine Lavoie, Francois Cabana, Philippe Jacob-Goudreau, Dominic Létourneau, François Michaud

Video ID : 610

This video shows the functionalities of a three-serial-DOF robotic arm where each DOF is actuated with a patent-pending differential elastic actuator (DEA). A DEA uses differential coupling between a high-impedance mechanical speed source and a low-impedance mechanical spring. A passive torsion spring (thus the name elastic), with a known impedance characteristic corresponding to the spring stiffness, is used, with an electrical DC brushless motor. A non-turning sensor connected in series with the spring measures the torque output of the actuator. Reference: M.-A. Legault, M.-A. Lavoie, F. Cabana, P. Jacob-Goudreau, D. Létourneau, F. Michaud: Admittance control of a human centered 3-DOF robotic arm using differential elastic actuators , Proc. IEEE/RSJ Int. Conf. Intel. Robot. Syst. (IROS), Nice (2008), pp. 4143–4144; doi: 10.1109/IROS.2008.4651039.