133
A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the field of Robotics The Robotics Institute Camegie Mellon University Pittsburgh, Pennsylvania 15213 January 1997 0 1997 Nina Barrameda Zumel Support for this research was provided in part through the following grants: NSF Grants IRI-9503648, IRI- 9528176.IRI-9157643, IRI-9010686, IRI-9213993. andNASA Fellowship NGT-51272. The views and conclusions expressed in this document are those ol the author, and do not necessarily reflect the views of NSF, NASA. or the US. Government.

A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

A Nonprehensile Method for Reliable Parts Orienting

Nina Banameda Zumel

CMU-RI-TR-97- 13

Submitted in partial fulfillment of the requirements for the degree of

Doctor of Philosophy in the field of Robotics

The Robotics Institute Camegie Mellon University

Pittsburgh, Pennsylvania 15213

January 1997

0 1997 Nina Barrameda Zumel

Support for this research was provided in part through the following grants: NSF Grants IRI-9503648, IRI- 9528176. IRI-9157643, IRI-9010686, IRI-9213993. andNASA Fellowship NGT-51272. The views and conclusions expressed in this document are those ol the author, and do not necessarily reflect the views of NSF, NASA. or the US. Government.

Page 2: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial
Page 3: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Abstract

Prehension may be defined as “The act of taking hold, seizing or gnsping, a with the hand” (Webster’s 3rd International Dictionary). Nonprehensele manipulation: then. can be de- fined as the manipulation of objects without grasping them. Manipulation without. prehension is a natural way of handling objects for both humans and machines. The ability to manip- ulate objects which may not be graspable increases the flexibility of a robot interacting with its environment, without adding complexity to the mechanical design. This research analyses the mechanics of nonprehensile contact between a simple, two degree of freedom manipulator and a part. The intent is to develop reliable but sensorless manipulation routines for use in an automated assembly environment. While nonprehensile, sensorless devices are in common use in such environments, existing parts orienting devices, such as bowl feeders or the SONY Automatic Parts Orienting System, must be custom designed for each specific task. To decrease the setup or changeover time for an assembly line, what is needed is a simple but more general device, which can be easily modified or reprogrammed in response to a change in tasks. 1% present a planning algorithm for sensorless parts orienting in the plane with two one degree of freedom palms. Our method finds feasible paths through the space of equivalent state config- urations of the object in the palms, without requiring that the palms maintain stable support of the object over the entire path. We show that such a device can reliably orient parts in the plane. Planning reorientations requires the geometric descriptions of the parts, the part’s center of mass, and an upper bound on the coe5cient of friction between the part and the palms. The plans produced by our algorithm are robust to uncertainties in the part’s initial state and in the coefficient of friction, as well as to small inaccuracies in manipulator calibration.

Page 4: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial
Page 5: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Acknowledgements

I would like to thank my advisor, Mike Erdmann, for his support, and for all the helpful discussions, some even about research. I would like to thank my parents for having supported me and encouraged me throughout my education. To the rest of my committee: Matt Mason, David Baraff, and Randy Brost, thank you for many useful comments on my dissertation, and on my work. Thanks to the members of the Manipulation Lab, past and present, especially Kevin Lynch: Srinivas Akella, Tammy Abell, Yan-Bin Jia, Wes Huang, Garth Zegliu, and Mark Moll.

My graduate school experience wouldn't have been the same without Tammy, Lin Chase, and Dina Berkowitz - the other threehbobabes. Nor without Garth, Wes, Chris Lee: Michael Witbrock, Tony Brusseau, Scott and Leanne Neal bi l ly , John and Mary Mark Ockerhlooni, Rich Goodwin, Susan Hinrichs and Alan Carroll.

Finally. thanks to my husband, John Mount, for his patience and his support throughout my years in graduate school.

Page 6: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial
Page 7: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Contents

1 In t roduct ion 1 1.1 Why Nonprehensile Manipulation? . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.2 Why two palm manipulation? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 1.3 Related Work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

1.3.1 Fine-motion Planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.3.2 Prehensile Manipulation and Force-Closure Grasps . . . . . . . . . . . . . 5 1.3.3 Nonprehensile Manipulation . . . . . . . . . . . . . . . . . . . . . . . . . . 6 1.3.4 Parts Orienting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 1.3.5 CaptureRegions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

1.4 Outline of the Thesis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

2 Analysis Tools 11 2.1 Configuration Space . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

2.1.1 Configuration Space Obstacles . . . . . . . . . . . . . . . . . . . . . . . . 12 2.1.2 Force Equations in configuration Space . . . . . . . . . . . . . . . . . . . 15

2.2.1 Friction Cones in Real Space . . . . . . . . . . . . . . . . . . . . . . . . . 16 2.2.2 EYiction Cones in Configuration Space . . . . . . . . . . . . . . . . . . . . 17

2.3 Centers of Rotation and Frictional Contact Problems . . . . . . . . . . . . . . . . 17 2.3.1 Finding Possible Centers of Rotation . . . . . . . . . . . . . . . . . . . . . 19

2.4 Cone Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 2.5 Impact Dynamics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

3.1 Energy Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26 3.2 Equivalence Regions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 3.3 Planning in the Frictionless Domain . . . . . . . . . . . . . . . . . . . . . . . . . 31 3.4 Experimental Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37

3.4.1 Robustness to Calibration . . . . . . . . . . . . . . . . . . . . . . . . . . . 44

4 Friction 47 4.1 Analysis techniques for planar systems . . . . . . . . . . . . . . . . . . . . . . . . 48

4.1.1 Friction Cones . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 4.1.2 Convex cones . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49

4.2 When does it slide and when does it roll? . . . . . . . . . . . . . . . . . . . . . . 50 4.3 Verification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.2 Friction Cones 16

3 Manipulation Without Grasping 25

i

Page 8: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

5 Uncertainty: Planning from an Unknown Init ial S t a t e 57 5.1 Fkictionless. low energy case . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57

5.1.1 Experimental Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58

5.2.1 Experimental Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62 5.2 Extensions with Friction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58

5.3 Is this Friction Model Adequate? . . . . . . . . . . . . . . . . . . . . . . . . . . . 63

6 Dynamics and Impact 67 6.1 Impact . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67

6.1.1 The Frictionless Case . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68 6.1.2 Energy loss from collision: one bounce . . . . . . . . . . . . . . . . . . . 69

6.2 Other Dynamic Effects. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71 6.2.1 Lagrange's equations in a rotating frame . . . . . . . . . . . . . . . . . . . 72 6.2.2 An Example with a Complete Transition Motion . . . . . . . . . . . . . . 75

7 Theoretical Results 79 7.1 Connectedness of Equivalence Regions . . . . . . . . . . . . . . . . . . . . . . . . 79 7.2 Sufficiency of pure tilts and fixed4 squeezes for plan execution . . . . . . . . . 82 7.3 Existence of Plans . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87 7.4 HomingSequences . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97

8 Conclusion 101 8.1 Future Work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101

8.1 . 1 Existence of Homing Sequences . . . . . . . . . . . . . . . . . . . . . . . . 101 8.1.2 Minimizing Dynamic Instability . . . . . . . . . . . . . . . . . . . . . . . . 102 8.1.3 Nonpolygonal objects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104 8.1.4 Three dimensional c a e . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106 8.1.5 Part Singulation and Pipelining . . . . . . . . . . . . . . . . . . . . . . . . 107 8.1.6 Sensors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107

8.2 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108

A Properties of the Potential Energy Curve 109

.. I1

Page 9: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

List of Figures

1.1 Stationary and Moving Parts Feeders . . . . . . . . . . . . . . . . . . . . . . . . . 4

2.1 Configuration Space obstacle for a square and a wall . . . . . . . . . . . . . . . . 13 2.2 Square making contact with wall at orientation 6’ = 0 . . . . . . . . . . . . . . . . 14 2.3 Potential curves for a part in cones with different openings . . . . . . . . . . . . 14 2.4 Object making point contact with an obstacle . . . . . . . . . . . . . . . . . . . . 16 2.5 Friction cone of point mass on palm . . . . . . . . . . . . . . . . . . . . . . . . . 16 2.6 Motion of Center of Gravity due to rotation about a rotation center . . . . . . . 18 2.7 Feasible CORs for one point contact . . . . . . . . . . . . . . . . . . . . . . . . . 20 2.8 Feasible centers of rotation for two point contact . . . . . . . . . . . . . . . . . . 20 2.9 Linear algebra formulation of inclusion problem . . . . . . . . . . . . . . . . . . . 22 2.10 System Geometry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

3.1 Contact triangles and Cone frames . . . . . . . . . . . . . . . . . . . . . . . . . . 26 3.2 Example Object . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 3.3 Potential energy curve of part in palms . . . . . . . . . . . . . . . . . . . . . . . . 28 3.4 Stable and unstable edges . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 3.5 Different contact formations which are in the same equivalence region . . . . . . 30 3.6 Equivalence region shadow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31 3.7 Tkajectory decomposition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 3.8 ‘Eansition graph for example object . . . . . . . . . . . . . . . . . . . . . . . . . 35 3.9 Example reorientation: from 8 = -x/2 on left palm to 6’ = 0 on left palm . . . . 36 3.10 Plastic cone manipulator used to test plans . . . . . . . . . . . . . . . . . . . . . 38 3.11 A plan which tended to fail . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39 3.12 A plan which tended to succeed . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40 3.13 A plan which generally succeeded . . . . . . . . . . . . . . . . . . . . . . . . . . . 41 3.14 This plan would fail because the part would get caught in thc gap between the

palms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42 3.15 A plan which would fail due to jamming . . . . . . . . . . . . . . . . . . . . . . . . 43

4.1 Friction cones at contact vcrtices . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 4.2 Considering the case of a clockwise tilt (0 < 0): Friction cone cont.ains CG . . . . 51 4.3 Again considering a clockwise tilt (0 < 0): Friction cone contains CG! and

181 < arctan . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 4.4 For a clockwise tilt: Friction cone contains CG3 and 101 > arctan . . . . . . . . 52 4.5 Object 1: “House” . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 4.6 Object 2: “Pseudotriangle” . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54

... 111

Page 10: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

4.7 Objcct 3: "Rectangle" . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54

5.1 Example homing sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59 5.2 Friction cone contains CG . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 5.3 Example homing sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61

6.1 System Geometry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68 6.2 Impact example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69 6.3 v- and v+ in configuration space . . . . . . . . . . . . . . . . . . . . . . . . . . . 70 6.4 Percent of Kinetic Energy retained after collision . . . . . . . . . . . . . . . . . . 71 6.5 Graph of maximum w,,, as a function of e . . . . . . . . . . . . . . . . . . . . . . 72

6.7 Radial motion of a point mass . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76

7.1 An example S . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80 7.2 Contact normals and gravity vector in cone frame . . . . . . . . . . . . . . . . . . 81 7.3 Orientation of left and right palms . . . . . . . . . . . . . . . . . . . . . . . . . . 82 7.4 Different contact formations which are in the same equivalent region . . . . . . . 83 7.5 Contact normals and gravity vector in realspace . . . . . . . . . . . . . . . . . . . 84 7.6 Trajectory decomposition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86 7.7 Connected and disconnected transition graphs . . . . . . . . . . . . . . . . . . . . 88 7.8 Edge and vertex labeling conventions . . . . . . . . . . . . . . . . . . . . . . . . . 88 7.9 Tilt transitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89 7.10 Determining the rotation sense of a part . . . . . . . . . . . . . . . . . . . . . . . 90 7.11 Valid tilt transfers from edge e0 on the left palm . . . . . . . . . . . . . . . . . . 92 7.12 Bounded and unbounded subpolygons . . . . . . . . . . . . . . . . . . . . . . . . 94 7.13 Construction for determining reachable edges . . . . . . . . . . . . . . . . . . . . . 95 7.14 Determining which edges can be reached . . . . . . . . . . . . . . . . . . . . . . . 96 7.15 Worst case scenario for Theorem 14 . . . . . . . . . . . . . . . . . . . . . . . . . 96 7.16 Worst case scenario for Theorem 15 . . . . . . . . . . . . . . . . . . . . . . . . . 98

8.1 Dynamic effects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103

A.l Feasible locations for the CG . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110 A.2 The center of gravity is not inside the cone at B = 80 . . . . . . . . . . . . . . . . . 110

6.6 Dynamiceffects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74

iv

Page 11: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

List of Tables

3.1 3.2

4.1 4.2 4.3

5.1 5.2 5 .3

Trials of the plan in Figure 3.12 at different manipulator calibrations . . . . . . . Maximum deviation from nominal calibration for thc trajectory in Figure 3.12 at different manipulator calibrations . . . . . . . . . . . . . . . . . . . . . . . . .

Sliding trials for “House” on right palm Sliding trials for “Pseudotriangle” . . . . . . . . . . . . . . . . . . . . . . . . . . Sliding trials for “Rectangle“ on right palm

Trials of homing sequences . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Trials of a homing sequence at different manipulator calibrations

. . . . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . . . . . . . . . . . . .

. . . . . . . . . Maximum deviation from nominal calibration for the plan in line 1 of Table 5.1 at different manipulator calibrations . . . . . . . . . . . . . . . . . . . . . . . . .

44

45

55 55 55

62 63

63

V

Page 12: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial
Page 13: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Chapter 1

Introduction

4 s for those things which are moved by other things, this must t,ake plxe in four ways; for locomotions caused by other things are four in kind (pulling, pushing, carrying, md turning) ...

Aristotle Physics, Book VI1 [9]

1.1 Why Nonprehensile Manipulation?

Prehension may be defined as “The act of taking hold, seizing or grasping, as with the hand” (Webster’s 3rd International Dictionary). Nonprehensile rnanipulatxon, then, can be defined as the manipulation of objects without grasping them. Manipulation witliont prehension is a natural way of handling objects for both humans and machines. The ability to manipulate objects which may not be graspable increases the flexibility of a robot interacting with its environment, without adding complexity to the mechanical design.

Nonprehensile manipulation also forms an intermediate point in the range of manipulation operations. At one end of this range we have operations for which complete control is necessary or desired over the complete duration of the operation: either complete control over the object, or complete control over the object’s interactions with the environment. Both power grasps and precision grasps fall into this category. Power grasps are force/form closure grafps. We will follow h’guyen [65] in our definitions of force and form closure.

Definition 1.1 (Forceclosure) A force-closure gmsp is defined as a grasp such that an arbi- trary force and moment cun be exerted on the gmsped object through the contacts. Equivalently, a n y motion of the object can be resisted by contact forces.

Definition 1.2 (Form-closure) Form-closure grasps are grasps such that the object is totally constrained by the contacts irrespective of the contuct foxe magnitudes.

In a power grasp, the object’s degrees of freedom are completely constrained throughout the manipulation. As a result, the object’s motion is insensitive to environmental dynamics, and the problem of controlling the object’s motion is equivalent to controlling the manipulator. Precision grasps are different, of course. Take robotic surgery as an example. One would not want the scalpel to be insensitive to its environment. Still, a robotic surgeon must have precise

Page 14: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

control over the motion of its scalpel, to avoid sensed obstacles, and perhaps some compliance to those parts of the environment it contacts. In other words; the scalpel must be completely controlled throughout the manipulations.

At t,he other end of the spectrum we have free flight motions of thrown or batted objects: the object’s degrees of freedom are only constrained at the beginning of (or at intermit,t,ent periods during) its trajectory, and no further control effort is required beyond the initial (or intermittent) forces. The subsequent motion, therefore, is extremely sensitive to environmental dynamics and initial conditions. Control of object motion is then linked to precise control of the manipulator/object interaction over short periods of time. Some examples are tossing or dropping things in a waste paper basket, kicking a door shut, or playing ping-pong.

In between these extremes lies a large class of operations during which complete constraint over the object to be manipulated is either undesirable or impractical, but some control over the object is desired over its entire trajectory, in order to bring the object reliably to a desired final state. Moving objects which are too large to be grasped, but must be pushed or rolled to a desired location, is one example. Other examples include shutting a drawer, or pushing a door shut without slamming it. Yet another example is transferring a portion from a laxge bag of dried beans into a relatively narrow-mouthed jar. One way to do this is to individually pick and place beans from the bag to the jar until the jar is full. This is an example of the first type of manipulation, form closure grasp manipulation, and it is reliable, but in this particular case, quite tedious and stupid. Another way is to scoop handfuls (or cupfuls) of beans and pour them into the jar. This works. An even better way is to find an appropriate type of funnel, and pour beans from the bag into the funnel until the jar is full. With respect to the beans (rather than the bag), this is a member of the third type of manipulation. Thcrc is some control over the trajectory of the beans: the funnel keeps them from spilling all over the floor, and directs them reliably into the jar. But the precise trajectory of each individual bean isn’t precisely known or controlled. It is a solution which is fast and simple to execute. Another example is coin sorting. One way to sort coins is to pick each coin up individually, determine the denomination of the coin, and place it into the appropriate stack. A better way is to dump all the coins into a device which can mechanically filter and sort the coins by their size and weight. We claim that nonprehensile manipulation is appropriate for exactly these type of tasks. Nonprehensile manipulation is also appropriate in many situations where, rather than force-closure, it is sufficient to ensure that the contact forces resist a specific external wrench. We will call this stable support [l]:

Definition 1.3 (Stable suppor t ) An object is stably supported against gravity (or more gen- erally, any known applied wrench) if the contact configuration balances the gravitational force and the object can resist small perturbations in its pose.

By resisting small perturbations in its pose, we mean that if the object is subjected to a small displacement, it will return to its original pose. A stably supported pose is a stablc eqriilibrinm state of the system.

1.2 Why two palm manipulation?

The examples of nonprehensile manipulation given above range from very large ungraspable objects at one end, to many small objects at the other. This work concerns itself with att,empt,ing

2

Page 15: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

to reliably and quickly orient small objects, although some results niay be useful in other domains. Directions of interest include (i) controlling the shape of constraint surfaces of systems in such a way that constraint and external forces naturally attract the system to the desired state, and (ii) exploiting the system dynamics in a similar fashion, much as in the research on underactuated manipulators. Palrnnr manzpuZation offers a simple domain in which to cxplorc these two directions, although we will mainly concentrate on the first.

Definition 1.4 (Palmar Manipulation) Palmar manipulation is the manipulation of nra ob- ject by its interactions with flat, nearly rigid manipulators.

Palmar manipulation is somewhat analogous to manipulating an object with the palm of a hand, without using the fingers.

Some direct “beans in a funnel” style examples of manipulation are bowl feeders aud Auto- matic Parts Orienting Systems [14], [40], where a large mass of parts in arbitrary oricntations are singulated and oriented by their interactions with (in the case of bowl feeders) fences and other obstacles, or (in the case of APOS systems) by an induced vibration and their interaction with pallets of special shapes. As an example, let us imagine such a pasts €ceder, where parts enter from one end in random orientations, and emerge at the bottom in a single orientation (Figure 1.1). Mani and Wilson 1571 designed a programmable parts orienting table where a part in arbitrary and unknown orientation is oriented (without sensors) by the motion of the table, which moves the part into contact with a stationary fence. Peshkin and others have stiidied the case of parts along a conveyer belt, with stationary fences along the way to do the orientation [68], [ZO]. One could also design a feeder where a moving part comes into contact with moving fences, to perform the same operation that a string of stationary fences would perform serially. That string of stationary fences would be replaced by some smaller number of moving fences. Akella, et.al. [4] have begun work on such a system, the One Joint Over a Conveyer (1 JOC) system, which can arbitrarily orient parts on a moving conveyer belt, using a onc dcgree of freedom arm.

The resulting design can be more compact than a conveyer with stationary fences. It can ako be as potentially versatile as the parts orienting table, in that the resulting mechanism can be reprogrammed for other parts, rather than rebuilding a new set of stationary fences.

For the above example task, and for other tasks for which nonprehensile manipulation is appropriate, we would like the final state of the system to be precisely determined, but precise control of intermediate states is less important. We can take advantage of this fact. We will show, using an analysis similar to that described by ninkle, et.al. [88],[90] that the state space of the manipulator and object can be divided into regions which are equivalent, in the sense that a particular state is easily reachable &om one of its equivalent states. The manipulation of an object is then a higher level (and coarser) problem of navigating from region to region. When the region containing the goal is achieved, then more careful motions can be used to fine- tune the position of the object. Hence control of the manipulators during the coarse motion need only be precise enough to make the regional transitions correctly, and the object will he propelled along a correct path to the goal.

For the rest of the thesis, we will use a manipulator consisting of two one degree of frccdom palms modeled as a cone connected at a central hinge. This is a simple cxample that still cap- tures some of the basic operations of a general two palm system. For this particular example, we will show that two basic operations into which manipulations can be decomposed fall naturally

3

Page 16: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Moving Fences

Stationary Fences

Figure 1.1: Stationary and Moving Parts Feeders

out of the equivalence region analysis described above. We believe that similar dccompositions will fall out of the analysis of other types of two palm systems.

When we move beyond the quasistatic domain, inertial forces and collision forces begm to matter. Coriolis and centrifugal forces must also be taken into account, so the object does not fly out of the palms, or out of the desired range of positions during the manipulation. For example, one would like to have the object make contact with the palms in such a way that the object does not bounce away from the expected stable position. Although we will not specifically derive velocity constraints, we will give qualitative examples of the sort of vclocity effects most common to this system.

1.3 Related Work

1.3.1 Fine-motion Planning

Our work and much of the sensorless work presented below is based on the framework developed by Lozano-Pkrez, et.a1.[52], for synthesizing compliant, fine-motion strategies for assembly tasks. This framework in turn based its analysis on the configuration space [51] approach for analysing geometric motion planning and collision avoidance problems. In configuration space, the pose and motion of an object with N degrees of freedom is represented as the motion of a point in N dimensional space. Although the framework in [52] was originally designed for sensor- based robotic assembly (with uncertainty), it h u been commonly used also for sensorless tasks which involve contact between a manipulator and a part, or a part and obstacles. In particular, the idea of preirnages, that is, regions of a part's configuration and state space for which a commanded velocity (including some bounded imprecision in the execution of the commanded velocity) is guaranteed to reach a goal, has proven to be a useful way of describing sensorless parts orienting strategies.

4

Page 17: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

1.3.2

The research in prehensile grasping and force-closure grasping is far too extensive to be surveyed here. We cite a few examples which take approaches which we have felt to be in some way similar in flavor to ours.

Trinkle and Paul [89] analyse the interaction of fingers and objects for the purpose of finding squeeze grasps to lift objects, both in the frictionless and frictional cases. They partition the various configurations of contact between the object and fingers into regions whcrc the object will either slide out of the grasp, jam, or be lifted off the support surface when a squeezing force is applied. Km and Cutkosky 1421 study the object-finger interaction for the case of a stable (either stably grasped or stably supported) object and fingers in sliding compliant contact with the object. The emphasis is on determining the relative trajectory and forces between the object and finger during the finger motion. Aiyama, Inaba; and Inoue [2] describe manipulation by pivoting: whereby an object is positioned without being fully grasped, but forces are applied in such a way as to “walk” the object into the goal pose. Because the moving contacts are now point contacts, resistance forces due to friction are diminished.

Brock [18] specifically allows slip in a controlled manner to reorient an object in a three fingered dextrous hand. When the fingers are in general position, the three contact,s points define a plane, the grasp plane. Define the force focus to be the point in space through which the three contact forces must pass. This point lies somewhere on the grasp plane, possibly at a point at infinity. If the three contact points are on a line, then, according to Brock’s formulatiom the force focus is somewhere on that line. For a given object and a given Coefficient of friction, one can generate a constraint state map, which describes regions in the grasp plane for which the motion of the object has the same constraints and freedoms. One can then cause a desired motion to the object by moving the force focus (varying the forces exerted on the object by each finger) into a region where the constraints on the object will cause the desired motion to happen. The Salisbury Hand, which was used in Brock’s experiments 1191, had a tactile sensor which directly measured contact location on the fingertips, as well as the normal and tangential forces a t the contact. In addition, Brock directly inferred the contact mode (sticking vs. slipping), by looking for high frequency components in the force readings; by comparing the mean values of normal and tangential force, he could also infer whether the presumed slipping was rotational or translational. There was, however, no feedback on the contact forcc, and no direct information on the object’s absolute position in the hand. Yoshikawa, et.al. [96] aLso study the use of controlled slip by a threefingered hand. They determine a unique force that will cause a finger to slip in a desired direction, while maintaining the stability of the object in the grasp.

Ponce and Faverjon [71] study three finger, forceclosure frictional grasps. They develop a conservative method of calculating grasps: independent contact regions. In an independent contact region, any triple of contact points such that there is one contact in each region will give forceclosure. These contact regions are a generalization of Ngyuen’s [65] formulation for tn.0 finger frictional forceclosure. Ponce and Faverjon’s formulation uses a minimum value of the coefficient of friction, pmin, such that the calculated grasps are force-closure for any coefficient of friction p > pL,in.

Poncc also develops a four-point frictionless grasp planner for the purposes of parts fixturing [72]. This approach is based on the idea of second order immobility, due to Rimon and Bur- dick, 1781 rather than on the traditional forceform closure approach. Second order immobility describes grasps which prevent all finite motion of an object, due to curvature effects, despite

Prehensile Manipulation and Force-Closure Grasps

5

Page 18: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

the fact that differential analysis may not identify the grasp as forcc or form closure. Fewer frictionless contacts are required for second order immobility than for complete force or form closure.

Brost and Goldberg [23] describe an algorithm for designing planar fixtures from a modular fixture kit. These fixtures are fow-point frictionless form-closure, and can be selected based on arbitrary criteria for optirnality. Wallack [92] presents two fixturing algorithms, one which completely enumerates all feasible fixtures for a given part and fixture kit, and a more efficient heuristic approximation to the enumeration algorithm.

Rimon and Blake [77] present the coging problem: to surround an object with a (frictionless) multifingered hand in such a way that, although the object can still move, it cannot escape the “cage” of the fingers. The configuration of the hand is described as a oneparameter set in such a way that as the parameter is decreased, the fingers approach the part, and ultimately grasp it. This is similar to the work by Brost [21], in that uncertainty in the part’s position can bc compensated for by an appropriate intial cage, and that uncertainty can be reduced as the cage parameter is decreased until the object is grasped.

Abell and Erdmann [l] use two finger stable support to plan handoffs of an object between sets of frictionless point fingers.

1.3.3 Nonprehensile Manipulation

One of the earliest examples of robotic nonprehensile manipulation is quasistatic pushing in the presence of friction ([58], [21], (531, [69], (201, [56]). In particular, Peshkin 1691 works out the minimum distance which a “fence” (or palm) must push an object so that it will bc guaranteed to come to rest aligned with the fence at the end of the motion. Goyal (381, (391 shows that the motion of an object on a frictional support surface can be determined if the pressure distribution of the object is known. Peshkin and Sanderson [69] and Lynch [53] analyze this situation when the pressure distribution is not known. Mani and Wilson, Peshkin, and others ([57], [68], [ZO]. [95]: 141, [3]) use the mechanics of pushing to design parts orienters or parts filters with a sequence of fences, similar in function to the vibratory bowl feeders and other orienting systems described by Boothroyd, et.06. [14].

When pushing a planar lamina, the gravitational and support forces are perpendicular t,o the plane of interest. Bat juggling [25], 1491 may also be considered as palmar manipulation of one (or more) objects, where now gravitational forces also have a componcnt in the plane of interest.

Bicchi, et. al. 1121, present mobility and manipulatibility analyses for general multi-limb ma- nipulators, including nonprehensile cooperating robots. For a given object/manipnlator pose, under the assumption of a force closure grasp, they present, among other things, a way to par- tition the manipulator joint s p x e into regions of differential motions with different qualitative behavior. Some of the regions identified could include regions where differential motion affccts manipulator pose but not object pose, regions where different freedoms of the part remain unconstrained, or regions where there is one-to-one correspondence between manipulator and object velocity. They can also identify allowable and unachievable object motions.

Yun [97] studies two manipulators with opcn palm end effectors manipulating an object by having one palm push from one end, and another palm push at the other end. Thc desired effect is to push with both palm hard enough so frictional forces counteract gravitational forces, biit not so hard as to damage the object. Coordinated pushing is then used to maneuver thc object as desired. This work was extended in Paljug, e t . d [66], [67]. Here, two planar p ~ l m are

6

Page 19: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

used to manipulate large objects in free space. A primary difference between the work of Paljug and Yun and the work described in this dissertation is the emphasis in the former on force closure. Rolling contacts between the palms and the object are permitted, but the contacts are not allowcd to slip or break. Hence, direct control over the object state must be msintained at all t,imes. In our present work, however, the object state is not directly controlled at all times, but merely guided towards the desired goal. This type of manipulation, and indeed much of the work on pushing may be considered passive manipulation, in contrast to the more active manipulation explored in the work of Paljug, et.ai., and in much research on grasping.

Examples of passive manipulation include the manipulation techniques of ’Ilinkle, et. ai. ([go], [36], [85], [86]). Their analysis and planning uses the idea of contact formations originally presented by Desai, and incorporated into a planner for dextrous manipulation by Tkinkle and Hunter [88]. The work described in this dissertation follows a similar method to Trinkle, et.al.. However, the paths through configurations space by [go] and [88] are apparently constrained to always correspond to stable grasps, whereas the method described in our work allows very small umtable motions during the transition from state to state.

Of particular interest in the above set of work is Farahat and Trinkle [36], as well as Trinkle and Zeng [91]. Farahat and Trinkle attempt to find upper bounds on the Coefficient of friction for which the plans found by a planner using the frictionless assumption will still work ~ in other words, all contacts will slide. Ttinkle and Zeng treat the coefficient of friction as a variable in the analysis performed by the planner, and determines the ranges of the coefficient of friction for which a particular contact mode will be feasible. These considerations are important, since the coefficient of friction cannot in general be precisely known.

Erdmann [33] is also exploring the use of friction and compliance in nonprehensile palmar manipulation. He studies ”slide transfers” of objects from a palm to another planar surfxe (such as another palm), and the different behaviors of the object for different velocities and ‘’transfer angles” of the palm.

A related concern is that of determining stable poses of assemblies in a gravitational field, when those assemblies are not rigidly attached. In this case, we will say that the assembly is stably supported [I] against gravity. The problem, both with and without friction, is addressed by Mattikalli, et.ai. [61], [62]. They show that for a fixed assembly (to make an analogy with our work: for palms at a fixed relative angle to each other, and a part in a particular equilibrium position in the palms), the orientations of the assembly for which stable support is maintained form a convex region on the surface of a unit sphere [62]. We will take advantage of this result in generating our reorientation plans.

Of particular interest is the effect of impact dynamics in the manipulation domain. Most previous strategies for planning manipulation tasks have relied on an assumption of quasi-stat,ic mechanics in the analysis of the physical system. This constrains the plans to situations that are slow moving, and in which contact dynamics can be neglected.

One can imagine situations where one cannot make these assumptions, or when a model of the contact dynamics would be useful. In making contact with an already moving or accelerating object, for instance, the inertial properties of the object affect the motion which results from the applied forces of collision. Knowledge of the magnitudes as well as the direction of forces and velocities becomes important. Juggling and table tennis are two such domains that have been explored in robotics.

Mason and Lynch [59], 1601 explore the use of dynamic properties for controlled club throw- ing. In [54], Lynch analyzes the conditions for desired goal states to be reachablc, both for

Page 20: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

pushing and for dynamic manipulation. In particular, he is interested in the conditions under which a one degree-of-freedom manipulator can take a part to a full-dimensional subspace of goal states. Arai and Khatib [7] studied the exploitation of inertial properties of objects for manipulation of objects in ways other than throwing. They base their approach on work by Arai and Tachi [SI in using dynamic coupling to control passive joints.

Some work has been done to study models of dynamic collision for use in robotic domains. Raibert [73] designed a dynamically stable hopping robot, modelling the bounce a spring and damper system with pcrfectly inelastic callision. This system was further analyzed by Koditschek and Buhler [49]. Andersson [6] designed a ping-pong playing robot which used a simple model of point-mass collision to predict the motion of the ball after striking. Wang [93] attempts to characterize the qualitative behavior change in the motion of objects upon collision. In [94], he presents simulations and analysis of systems with intermittent constraint.s, and uses models of those systems in planning manipulation tasks. In both cases, a rigid body model of impact is used. This model has the advantage of being relatively simple, although other researchers have shown inconsistencies do exist, particularly if one looks at energy dissipation ([82]). Buhler [25] analyses a planar puck juggling system. This system was extended to three dimension by Xzzi [79]. Planar bat juggling for polygonal objects was examined in [98].

1.3.4 Parts Orienting

The work by Brost [21] on the orientation of objects by “squeeze grasps” is analogous to palmar manipulation of one object with two hands, with gravity perpendicular to the plane. He finds sets of actions which reliably orient a part in the presence of uncertainty in the part’s location. Goldberg, and later Rao and Goldberg ([37], [74]) found algorithms for determining sequences of squeezes of a parallel jaw gripper which will reliably orient (up to symmetry) frictionless, polygonal or algebraic, planar parts from an arbitrary and unknown initial orientation, without sensors. Mason and Erdmann [34] use gravity to propel parts onto a flat surface, or into a corner formed by two perpendicular flat surfaces, in such a way that the resulting contact forces reliably orient a part. A three-dimensional generalization of this planner was presented in [35]. The computational complexity of a simplified version of this tray tilter, and of other parts feeding systems, was analyzed by Natarajan [64].

Examples of nonprehensile parts orienting systems include bowl feeders and Automatic Parts Orienting Systems [14], [40], where a large mass of parts in arbitrary orientations are singulatcd and oriented by their interactions with (in the case of bowl feeders) fences and other obstacles, or (in the case of APOS systems) by an induced vibration and their interaction with pallets of special shapes. Krishnasamy, et.al. have begun the analysis of APOS pallets, with the goal of automating their design [48]. Peshkin and others have studied the case of parts along a convcycr belt, with stationary fences along the way to orient them [68], [20]. Mani and Wilson [57] designed a programmable parts orienting table where a part in an arbitrary and unknown orientation is oriented (without sensors) by the motion of the table, which moves the part into contact with a stationary fence. Akella, et.al. [4], [3] have begun work on the One Joint Over a Conveyer (1 JOC) system, which can, without sensors, orient parts with arbitrary initial state on a moving conveyer belt, using a one degree of freedom arm.

Caine [26] developed a graphical tool which allows a designer of a bowl feeder track, or other parts orienting/hturing device, to directly manipulate the configuration space obstacles representing the part in the track. Although the inverse transformation from configuration space to real space is not always unique, Caine’s system performs an online differential modification

a

Page 21: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

of a given real space system in response to the designer’s manipulations in configuration space. Joskowicz and Sacks [41] prcsent an algorithm for the qualitative analysis of mechanisms. The qualitative state of a system is described in terms of positions, velocities, and contacts between parts, and by qualititive descriptions such as “engaged” or “disengaged”. Their algorithm identifies qualitatively equivalent regions of the system state space, and the transitions between regions. Hence, one can describe the behavior of a system for given initial conditions as a sequence of transitions from one qualitative state to another.

1.3.5 Capture Regions

Parts orienting algorithms, particularly the sensorless sort as described above, take advantage of the fact that stable object poses generally form a discrete set, thus constraining the search over the state space. Boothroyd, ef.aZ. [15] empirically derive the distributions of the stable resting aspects of a part, for use in designing bowl feeders. Mirtich, et.aZ. [G3] present variations of quasi-static estimation methods for estimating the pose statistics of dropped objects, as well as the use of dynamic simulation to directly simulate the pose statistics.

In his dissertation, Brost [22] describes the notion of a half-space invariant. In a system with a half-space invariant, the possible future configurations of a point originally at rest are constrained to lie in some half plane whose boundary goes through the original configuration of the system in configuration space. A variety of physical systems satisfy this condition, including an object falling in a gravitational field. He describes an algorithm to determine preimages of goals for such systems in canfiguration space.

Kriegman uses potential energy minima to constrain the possible poses of a 3D object resting on a flat surface, this reducing the search space for image recognition algorithms 1461. Hc latcr extended this work to the problem of determining capture regions of dropped 3D objects. If a part is placed on a plane perpendicular to gravity, in the absence of any initial kinetic energy the part will fall to a unique resting position if its initial pose was in the capture region of this resting position. In [47] he shows how to determine the capture regions of smooth objccts. In [75], knowledge of these capture regions is incorporated into a parts feeding system. In our work: we will also use the idea of capture regions to constrain the poses of a part resting in two palms, rather than on a single plane. We will show how moving the palms can move this part from one stable pose into the capture region of another pose.

Bohringcr, et.aZ. 1131 study the design of programmable vector fields, implemented on arrays of microelectromechanical vibrating actuators, or on macroscopic vibrating plates, to orient or filter parts. They use the vibratory motion to design “potential fields” such that thc part is drawn into a local minimum in the appropriate configuration.

1.4 Outline of the Thesis

Chapter 2 will review mathematical tools necessary for the analysis of a nonprehensilc manip- ulation system, and for designing a planner.

Chapter 3 will focus on finding plans for orienting objects reliably to known goal states from known initial states. All reorientation plans can bc decomposed into two basic types of manipulator motions. If a certain operation is feasible, all polygonal parts can be oriented: that is, thcy can be brought from any stable initial state to any stable goal state. Even when this operation is not feasible, we can find conditions under which a polygonal part can be

9

Page 22: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

oriented. We show that the plans found are repeatable, and robust to small errors in manipulator calibration.

Chapter 4 will focus on relaxing the requirement that all contacts slide? in order to ext.end the model to systems with higher coefficients of contact friction. Chapter 5 will prcscnt an extension of the basic algorithm to the case of orienting a part from an unknown initial state. The space of all possible manipulator motions can be reduced to a finite set of motions, such that a part can be oriented to a given final state if and only if a plan can be found using this set of motions. Again, these plans are repeatable and robust to calibration errors. Using the considerations of Chapter 4, the plans are also viable for any coefficient of friction between the part and the palms, up to the upper bound estimate of friction used to find the plans.

Chapter 6 will discuss ways of avoiding unpredicted effects due to higher kinetic energy. Chapter 7 will present theoretical results on the algorithmic complexity of the planner, as wcll as proofs of many of the assertions made in the previous chapters. Finally, Chapter 8 will present conclusions and directions for future work.

10

Page 23: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Chapter 2

Analysis Tools

Geometry furnished God with models for the Creation and was implanted in man, togcthcr with God's own likeness.

Johmnes Kepler Humonices Afundi, 1619 [44]

In the previous chapter, we discussed briefly the distinction between what we called active and passive methods of manipulation. Actiwe methods are those methods which activcly seck to completely control the object at all times throughout the course of a manipulation. Passive methods, in contrast, try to exploit mechanical constraints in order to achieve the desired goal, without directly controlling all the degrees of freedom of the object. To maintain force closure is an active concept; to maintain stable support is a passive concept. Sensorless techniques are passive, and sensor based techniques tend to he active. Active methods of manipulation ~ and, in fact, any closed-loop robotic task, such as mobile robot navigation -require a different style of analysis from passive, open-loop methods, such as those used in sensorless nonprehensile manipulation. Much of the work on pushing and parts orienting may be considered passive manipulation.

With closed-loop methods, sensory information is available, and the instantaneous state of the object is known, a t least approximately. Hence techniques which are local or differcntial in nature are entirely appropriate. Control theoretical methods, or any form of analysis which is based on the (possibly implicit) integration of differential equations fall into this category. Some global properties, such as the asymptotic stability of god states, or the controllability of the system, are considered in designing the control system. However, the act of manipulation in these cues is essentially that of reacting to the present state of the system, differentially. Furthermore, this style of thinking about the problem naturally leads to the desire to pick a specific trajectory through the state space which the object (not just the manipulator) is obliged to follow exactly on its way to the goal.

Sensorless techniques, in particular passive nonprehemile manipulation, require a different stylc of analysis. Since moment to moment information about the system state is not available, the analysis techniques are necessarily global and more qualitative in nature. Concepts such as regions of stability or regions of convergence become the only tools available. The evolution of the system state is expressed not in t e r m of velocity or acceleration, but in terms of directions of motion and lines of force, in a magnitude independent way. The idea of having the object follow an exact trajectory is often less feasible in the passive nonprehensile case.

11

Page 24: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

In principle, one could try to integrate out the differential equations corresponding to all possible scenarios and trajectories. In practice, it is better to try to represent these sets of diffcrcntial equations as some aggregate geometric entity, which can be reasoned about as a whole. One advantage of viewing t,he system state space in this inherently global way is that robustness issues automatically come under consideration. Because we have no way of detecting and correcting errors when they occur during a task, we must try to be robust in the face of uncertainty: uncertainty about the system state, errors in manipulator calibration, uncertainty about system geometry and parameters. We have not covered all of these issues explicitly in this thesis. We have covered a few, and have discovered that a few more have come along, “for free.” We achieve this robustness because in navigating around in the state of our global geometrical constructs, we can pick trajectories in the interior of “good regions.’’ In this way we avoid singularities and borderline cases. We cannot force the object to follow a predetermined trajectory, but by picking the global constraints correctly (in our case, the direction of the ambient potential field), we can still guide the object to a final desired goal in a reliable way.

In this chapter, we will briefly review some geometric constructs which have proven to be useful for sensorless manipulation. These constructs may also be useful for the analysis of closed loop systems, just as traditional dynamical systems analysis can also be useful in open loop domains. We present them here as having been particularly useful in solving the type of problem presented in this thesis. We will discuss Configuration Space, Friction Cones, Centers of Rotation, and Cone Analysis. We also include a section on Impact Dynamics.

2.1 Configuration Space

Configuration Space as an analysis tool for robotics was first presented by Lozano-PQrez [SI]. Using configuration space, the problem of determining the motion and interaction of rigid bodies can be reduced to the problem of determining the motion of a point body in a higher dimensional space. While configuration space analysis is primarily used for motion planning, it can also be used for mechanical analysis, much in the manner of the generalized coordinates of Classical Mechanics.

The configuration space (cspace) of an object has the same dimensionality as the object’s degrees of freedom. A planar object, therefore, generally has a three dimensional configuration space, and a three-dimensional object has a six dimensional configuration space. Since this work concerns itself with planar objects, we will discuss three dimensional configuration space, although most of what we say will generalize.

2.1.1 Configuration Space Obstacles

An object moving freely in the plane is equivalent to a point moving about in three diniensional cspace, where the three coordinates of the cspace correspond to the horizontal (z), vertical (y), and rotational (8) location of the object in the plane. Let the first two components, (z, y), describe the motion of the center of gravity (CG) of the planar object. The third component represcnts the object’s orientation in radians, but in order to make the cspace of the object independent of the measurement units of the planar system, it is normalized by multipying by the object’s radius of gyration, p . Imagine a planar object, and a planar ring of the same mass, infinitesimally thin, with uniform mass density over the ring. The moment of inertia of the planar object about its CG is 106j, that of the ring is mp2, where p is the radius of the ring and

12

Page 25: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 2.1: left: A square with sides 2 units long in the plane, with a wall a t y = 0 as an obstacle. right: The corresponding configuration space obstacle.

m is the mass of both the ring and the object. If the object and the ring have the same moment of inertia, then the radius of the ring is the radius of gyration. In other words, = mp2. Using these normalized coordinates, the position of an object is described in configuration space by the vector

r ..

An object moving in the plane among stationary obstacles is equivalent to a point mass moving through three dimensional cspace among stationary three-dimensional obstacles. Thc boundary of the cspace obstacles is defined by the positions and orientations of the planar object where it makes contact with the planar obstacles. See (501 for an excellent description of constructing cspace obstacles.

For example, consider a square with sides of length 2 in the plane with an infinite wall along the y = 0 axis as an obstacle. The center of gravity of the square is at its exact centcr. The cspace obstacle would be a curved wall in three space, whose cross section in the ( P O , y) plane would be piecewise sinusoidal, described by the equation y = d s i n ( 0 f :), with period ;. This cross section would be the same as z varied. See Figure 2.1.

To see how this surface is obtained, suppose that a t the orientation 0 = 0 the square sits against the wall as shown in Figure 2.2. The vector v g from the left vertex of the resting edge to the center of gravity makes an angle 7r/4 with the horizontal, and the height of the center of gravity at this state is y = lvo ls in~/4 = d s i n n / 4 . As 6' is increased, with the square maintaining contact with the wall a t vertex uo, the height of the center of gravity will vary as y = fi sin(8 + a/4) until vertex WQ makes contact with the wall, at 8 = s / 2 . By the symmetry of the square, the above curve will repeat itself at each vertex. Since the wall is infinite and flat, it does not matter where along the wall we first make contact, and so the surface of the cspace obstacle will not vary along the z direction. However, moving the wall (tilting it in the planc) would correspond to rotating the obstacle in cspace, since now the y coordinlttc of the rspace obstacle has an x dependency, as well.

As another example, let us look at a part held in two (infinite length) palms joined at

13

Page 26: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 2.2: Square making contact with wall at orientation 8 = 0.

Figure 2.3: left: A part held in two palms, at two different palm orientations (but the same relative angle between the palms). right: The curves in the (8, y) plane describing the poses of the part in contact with both palms simultaneously.

14

Page 27: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

their intersection. The set of poses for which the object makes contact with both palms' can be described as a curve parameterized by 8; the orientation of the object. This curve can be thought of as the intersection of the surfaces of the cspace obstacles which describe each of the palms. If we use the world reference frame of Figure 2.3, where gravity is antiparallel to the y axis, then the y coordinate of this curve is proportional to the potential energy of the object in the palms. In Figure 2.3, we show two such curves for a part in a pair of palms with a fixed angle relative to each other, at two different orientations with respect to gravity. Thc local minima of the curves correspond to the orientations of the part for which it is in stable equilibrium in the palms.

2.1.2

Velocity, acceleration, force and torque can also be represented in configuration space. Ve1ocit.y and acceleration vectors are derived from position vectors by time derivation, as in real space. Force and torque vectors represent the force exerted on the object, and the moment exert,ed about the object's center of gravity. Again, because force and torque have different units, thc torque component of the cspace force vector is normalized by p, the object's radius of gyration. This has the advantage that the standard force equation mx = F still holds in cspace:

Force Equations in Configuration Space

Ftictionless contact forces, which arise when the point mass in cspace contacts a cspace obstaclc, are described by the normal to the surface of the cspace obstacle at the contact point, in analogy to real space frictionless contact. The cspace contact force vector describes the forces exerted on the real space object and the moment about its center of gravity which arise from the real space contact forces.

For example, suppose an object makes point contact with an obstacle at a point r un the surface of the object, as in Figure 2.4. r is the vector from the object CG to the contact point, in some coordinate frame. Suppose the unit normal to the obstacle surface at the point of contact is n, in the same frame. Then the cspacc unit normal contact force vector is given by

where the numerator of the third component is the two dimensional cross product, r x2,] n, which gives the moment exerted about the CG by n. Any frictionless contact force exerted at this contact will be a nonnegative multiple of the vector F..

Tangential forces a t a contact, such as those arising from friction, are given similarly. If t is the unit tangent vector to the surface of the obstacle a t the contact point (such that t x z ~ n = l ) , then the cspace tangential force is given by

F t = [ 1 . (2.2)

Note, however, that Ft is usually not perpendicular to F.. 'For the purposes of this discussion, contact with the vertex will be considered contact with both palms.

15

Page 28: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 2.4: Object making point contact with an obstacle

f t

Figure 2.5: Friction cone of point mass on palm

2.2 Friction Cones

2.2.1

We will consider a point mass resting on a flat palm. (See Figure 2.5). If the coefficient of friction between the mass and the palm is p, then the frictional forcc exerted on the ma9s can be described by a friction cone. The friction cone is symmetric about the contact normal, with an half opening angle arctanp. Let the unit palm normal be n, and let t be such that the cross product o f t and n is positive unity. Then the friction conc is described by the relation

fiiction Cones in Real Space

lfil I Pfn,

Where f t and f,, are thc tangential and normal components of the contact force, respectively. If the force f exerted by the object on the palm lies somewhere inside the kiction cone, then friction will completely balance the exerted force, and the m a s will remain stationary. Otherwise;

16

Page 29: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

T friction will resist the exerted force with a contact force fan + pfn(sgn ft)t: where f,z = -f n and f r = -fTt. This force corresponds to the edge of the friction cone which points in the opposite tangential direction as f . For a point mass, it is easy to see that the tilt angle of the palm for which the point mass will begin to slide is given by [PI = arctanp.

For objects with extent: multiple frictional point contacts can be described by a friction cone at every contact. Whether or not a particular contact slides or rolls (sticks) depends on whether or not the forces experienced at that contact point lie inside the friction cone at that contact. For a line or edge-edge contact between two bodies, under a rigid-body assumption It is sufficient to consider only the friction cones at the endpoints of the contact.

2.2.2 Friction Cones in Configuration Space

Friction cones in configuration space for a single point contact are given analogously to those in real space. They are planar, and their edges are described by the vectors F, zk pFt, where F, and Ft are given by equations 2.1 and 2.2. As noted, however, F, and Ft are not perpendicular! and the cspace friction cone is not symmetric about F,. In fact, Ft may actually dip bclow Ft in certain cases, causing the frictional forces to actually “pull” the object into the obstacle. See [32] for a more rigorous treatment of cspace friction cones, and [55] for a discussion of the anomalous “pulling“ scenario.

In the case of mult.iple point contacts, we will depart from thc procedure used in [32], and treat the configuration space friction cone directly as the cone combination of each of the individual cones due to each contact.

Definition 2.1 (Cone combination) A cone combination of a set of vectom is the cone formed by all possible nonnegative combinations of the vectors.

A cone combination is similar to a convex combination of a set of vectors, except that in a convex combination, the weights on the vectors must sum to unity.

The question of whether or not an object can move, or must remain stationary, becomes the problem of checking whether or not the vector of applied forces lies within the aggregate cspace friction cone. This condition is actually only potential stability 1621: there is some nonnegative combination of frictional contact forces which can balance the applied gravitation force. Unlike in the frictionless case, where a part is stable if and only if the contact forces balance the applied forces, a part in a potentially stable frictional grasp or support is not necessarily guaranteed to be stable. For examples of this frictional indeterminancy. see [62]. To determine if a object is in a guaranteed stable configuration in the presence of friction? however, is computationally intractable [lo], whereas potential stability, which can be phrased as a question of cone containment, is no harder than linear programming.

2.3 Centers of Rotation and Frictional Contact Problems

Another way of representing the rigid motion of planar objects, which has the advantage of actually being representable in the plane, is as signed centers of rotation. The center of rotation of a rigid motion is that point in the plane which rotates without translation under the action of the rigid motion. For example, if one were to apply a pure torque to an object, the center of rotation of the resulting motion would be the center of gravity of the object, with an associatcd sign denoting whether the rotation was positive or negative. A pure translation has a center

17

Page 30: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

center

/ center of gravity

instantaneous motion of center of gravity

Figure 2.6: Motion of Center of Gravity due to rotation about a rotation center

of rotation at infinity. The method presented here is based on that given by Brost and ILla.;on [%I. Strictly speaking. since we are talking about forces, what we would like is really the center of acceleration: the one point in the plane which is instantaneously unaccelerated due to the action of a particular line of force. In general, the center of rotation and thc ccntcr of acceleration because the direction of motion and the direction of acceleration are generally not the same. Under the quasistatic assumption, however, the instantaneous velocity of thp object is low enough that the motion of the object will be dominated by the applied forces. and the center of rotation and the center of acceleration will coincide.

Given a center and direction of rotation, one can easily determine the resulting motion of an object of interest in the plane. Recall that the cspace force vectors have a third component which is taken with respect to the center of gravity of the object, and which is normalized by the radius of gyration of the object. Therefore, it is quite natural to take the CG of the object as the origin of our reference frame, and to take the radius of gyration as the unit of length. In the following, we will assume that this is so.

The quasistatic equation describing the instantaneous velocity of the object in the plane is

v = -w x r

[;] = -[!Ix[;] where v is the motion of the center of gravity due to some rigid motion, r is the center of rotation of that rigid motion with respect to the object’s center of gravity, and w is the rotation of the object. x denotes the cross product. This gives the motion of the object’s CG in the plane, a i d hence the first two components of the configuration space velocity vector. The third component would of course be w . Under the quasistatic assumption, the instantaneous acceleration of the object is in the same direction as the instantaneous velocity.

18

Page 31: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

This observation gives us a method for determining the feasibility of a motion under cilia- sistatic frictional contact. Suppose we have an object in known contact with an obstacle. We also know the external forces applied to the object. The equation of motion in configuration space is

i

where FA is the vector of applied forces, and fe is the frictional contact force at the ith contact. The problem is that the fci are generally not determined without knowing mx, but rnx can’t be determined without knowing the fci. As we will see, however, there is a way to determine fesible centers of rotation and their associated rotation senses. Given a center of rotation, r. and a direction of rotation, sgnw, the configuration space acceleration which wonld result is given by the vector

rnji cx [ y:z ] sgnw

as shown in Figure 2.6. The object acceleration is only proportional to this vector, with the constant of proportionality being the magnitude of the object rotation. From a postulated direction for mx, we can determine the directions of the resulting contact forces fc i? as will be shown in the next section. In cspace, these fci form a cone, Cpl of frictional contact force directions. In order for an acceleration direction to be physically plausible, there must be some nonnegative combination of the force directions FA and CF which sums to form rnx. The problem of finding feasible motions of the object subject to frictional contact can now be stated:

Determine whether rnx is contained in CF @Fa> (2.3)

where @ denotes the operation of cone combination.

2.3.1

We can use a kinematic analysis due to Reuleaux [76] to determine possible centers of rotation. Consider a point contact against the edge of a body, as shown in Figure 2.7. Any point to the left of the contact can only be a center of rotation with a positive rotation sense, otherwise the contact will penetrate the body. Points to the right of the contact can only be centers of rotation with negative rotation sense. Points on the line through the contact can rotate in either direction. Furthermore, any center of rotation not on this line will cause the object to break contact. Centers of rotation on the line will cause the contact to slide either left or right, depending upon whether or not the center of rotation is above or below the contact, and whether the rotation sense is positive or negative. A center of rotation at the contact point cause.1 the contact point to remain fixed. Note that we are making no statements about the physical plausibility of any of these centers of rotation, merely whether or not they are kinematically plausible, in the sense of not causing the contact to penetrate the object.

If we have more than one contact point, a s in Figure 2.8, we can perform the above analysis on each contact separately. Regions where the different contacts give conflicting rot,ation senses are regions which are not plausible rotation centers. Figure 2.8 shows the regions of plausible centers of rotation, with their rotation directions, as well as the motion of each contact point which would result for the centers of rotation in that region. If the ith character of the motion string is “b”, then the i th contact point will break contact. “1” means “slide left”, ‘Y’ means

Finding Possible Centers of Rotation

19

Page 32: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

+ b

Figure 2 . 7 Feasible centers of rotation (CORs) for one point contact, along with rotation senses and contact modes. The rotation sense is positive for counterclockwise rotation, negative for clockwise rotation. CORS not on the line of contact causc the contact to break (“b”). CORS on the line of contact can have either rotation sense. They can cause either left ( “ I ” ) or right (“r”) sliding, depending on the rotation sense and their location above or below the contact point. The contact point can have either rotation sense, and always remains fixed (“f;’).

+ bb

..........

+ bb

Figure 2.8: Feasible centers of rotation for two point contact

20

Page 33: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

“slide right”, and “f’ means “stays fixed”. For each region of centers of rotation, we can determine the direction of object motion; and the contact forces consistent with that motion. We can determine the contact force cone CF from the contact mode as follows. If contact point pi is in contact mode “1“ (left sliding), then that contact force in configuration space is on t.he right edge of the configuration space friction cone (the edge of the friction cone which opposes the motion). Therefore, we add the vector F.i +pFti to CF. Ifpi is in mode ”r” (right sliding) then add the vector Fni - pFti. If pi is in mode “f” (fixed), then the contact force is inside the friction cone. Therefore you add both edges F,i ?c pFti to CF. If pi is in mode lib” (break), then the contact has broken, and there is no contact force. Having determined Cv, along with the vector of applied forces and the vector of hypothesized acceleration, we can determine if a particular motion is feasible, as in Equation 2.3.

2.4 Cone Analysis

As stated above, we have expressed the problem of determining the motion of objects subject to contact constraints as the inclusion of certain vectors in convex cones; i e . , as nonnegative combinations of the vertices of those cones. This is a standard problem in linear programming, and in certain special cases, may also be easily solved by linear algebra. For planar problems, Brost and hfaqon [24] have shown how to solve this problem graphically, with two-dimensional diagrams. They took advantage of the duality between points in velocity space (centers of rotation) and lines of force in wrench space. In this dissertation, the problem will he presented as cones in three dimensional configuration space, since this method will generalize to higher dimensional problems, as well.

Let M be the matrix representing a convex cone with N vertices. Each vertex of the cone is represented by a three dimensional column vector of M. Let xteSt be the vector being tested for inclusion. Let 1 be the N dimensional vector of all ones, and c be the N dimensional weighting vector on the columns of M. Then one example of a linear program which may be used to test for inclusion is

Minimize cTI

Subject to: Mc = X t e s t

and Q 20,i= 1 : N.

This linear program will find the minimum nonnegative weights on the vertices of the cone represented by M such that the weighted vector adds up to xteSi, ifsuch weights exist. Otherwise, the linear program will determine that the problem is infeasible.

The above linear program is a general solution to the cone containment problem; in many of the specific cases which we run into in our system, the test vector xteSt is the negative of the gravity vector, and the third component of the test vector is zero. In this case, it is faster in practice to intersect M with the (2, y) plane by linear algebra, as in Figure 2.9, and compare the resulting lower dimensional cone with -xtest (where we have now dropped the zero valued third component). Sort this set of vectors in, e.g., counterclockwise order, and check the angles bet,ween adjacent vectors. If the maximum of these angles is less than x, then the sct of vectors positively spans the plane, and xteSt is contained in M. This check can be done in O(N1ogN) time. where N is the number of columns of M.

21

Page 34: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 2.9: If xteSt lies in the (z, y) plane, we can test inclusion by finding the intersection of M with the (z, g) plane

2.5 Impact Dynamics

Following [SO]: the impulse equations for a body of mass m colliding with point contact against a barrier (where it is assumed that mbarrjer >> m) are given by

m(vt+ - v t - ) = Pt m(un - w n ) = Pn

mp2(w+ - w-) = P, = P J C O S ~ + P,Zsin<

Here (see Figure 2.10), p is the radius of gyration of the object, w t is the relative velocity of the body tangential to the contact normal, and u, is the component normal to the contact. The superscript ”+” denotes the velocity term immediately after the moment of impact, and ”-”

denotes the velocity term upon contact, at the moment of impact. Pt and P, are the components of the impulse in the tangential and normal directions, respectively. is the angle of the line from the center of gravity of t,he object to the contact point with respect to the contact normal, in the counterclockwise direction. Note that 1 sin< is the moment arm of the torque applied by the contact normal force.

(2.4 - +

For a given cspace velocity (ut, w,, pw), the velocity of the contact point is given by

V)tC = ut + 1wcosc vnc = u,+lwsinc. (2.5)

Combining (2.4) with (2 .5) g‘ ives us

p2 + l2 cos’ < I2 sin < cos

mp2 pi +

mP2 sin cos p’ + i2 sin2 p.2 mP2

Pn vic+ = utc- +

v,,+ = uric- + pt 4- P, (2 .6)

Newton’s model for impact (see [80], [93], or [17]) divides the (normal) impulse into two parts, compression, when the colliding objects are moving into each other, and rest,itution, when the objects mow away from each other. Newton’s hypothesis is that the impulse of restitution and

22

Page 35: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 2.10 System Geometry

the impulse of compression are in the ratio e, called the coefficient of restitution. We define Pno as the impulse at full compression: that is, when u,, = 0. If we assume no friction, then Pi must be zero for the entire impact. Hence, we have the expressions for the final total impulse

Pi = 0; P, = (1 + e)P,o. (2.7) We can use (2.6) to solve for P,o by letting u,,+ = 0. Substituting those results into (2.7),

and using the last equation of (2.4) gives us the normal and rotational impulses in terms of the initial normal contact velocity.

-

2 + 12 sin2 tunc P, = - ( l + e )

Substituting this back into equation 2.4 now gives us an expression for the change in velocity due to impact, in terms of the initial velocity. This expression can then be rewritten

AV = -(1+ e)(nTv-)n (2.9)

by using the following definitions of the configuration space velocities and contact normds:

v = [i] AV = v+-v- (2.10)

Here, p is the radius of gyration of the object.

23

Page 36: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial
Page 37: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Chapter 3

Manipulation Without Grasping

A model is by definition that in which nothing hm to be changed, t h a t which works perfectly; whereas reality, as we see clearly, does not work and constantly falls to pieces; so we must force it, more or less roughly, to assume the form of t,he model.

Italo Calvin0 The model of models [27]

In this chapter, we make the following assumptions:

We will restrict ourselves to planar polygonal objects, although our methods should carry over without much difficulty to any planar object whose convex hull has a finite number of stable resting positions. Cylindrical objects can also be modeled m planar.

Force balance is achieved by the palms stably supporting the object against a known gravitational force. No other external forces are considered, hence complete force/form closure is not necessary.

We will assume that the motions of the manipulator are slow compared to gravity, so that the kinetic energy imparted to the object by the motion of the palm is dominated by the object’s potential energy.

We will asume that the contacts between the object and the palms are very low fric- tion (ie., the contacts are all sliding), so that we may approximate the system with a frictionless analysis.

We will model the two palms as a “cone” manipulator: two palms connected at a central hinge. This is a simple model that still captures many of the basic operations of a general two palm system.

To justify the last assumption, we notice that many (though by no means all) configurations of two palms which are capable of passively supporting an object can be modeled by the behavior of the object resting in a cone (Figure 3.1). This cone is formed by the intersection of the lines along which the palms lie. If we set a franie in the cone such that the y axis is the bisector of the cone, then all possible motions of the cone can be described as a combination of two motions. One motion is holding the y axis fixed and opening or closing the cone opening sy~nnietrically (a pure squeeze). The other is holding the cone opening coilstant and rotating the y axis (a pure tilt).

25

Page 38: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 3.1: Contact triangles and Cone frames

In later chapters, we will show how to relax the assumptions of low friction and low kinet,ic energy.

3.1 Energy Analysis

The motion of a polygonal object when in contact with the two palms can be determined by constructing the configuration space obstacle formed by the palms. Each palm generatcs an obstacle in configuration space, and the intersection of the surfaces of these two obstacles form a curve describing the poses of the part when it is making contact with both palms simultaneously. Taking two particular vertices of the polygon to be in contact with the palms, the feasible motions of the polygon can bc abstracted by the motion of a triangle in a cone, where onc vertex of the triangle is the center of gravity (CG) of the object (Figure 3.1), and the other two vertices are the points of contact with the left and right palms, respectively. Let $ be the angle of the cone opening, with the y axis of the cone frame bisecting the cone. The center of gravity location is given by CG = (CG,, CG,) in the cone frame. If, further, the cone frame is tilted at an angle ,6 counterclockwise with respect to the world frame, then the potential energy of the object is proportional to CG, sinP + CG, coso.

We can use the potential energy of the part to identify its equilibrium positions.

Definition 3.1 (Stable Equilibrium) A part is i n 0 stable equilibrium pose when the net force on the part is zero, and the part will resist small perturbations of its pose. This cor-responds to poses whew the potential energy is IocalIy mxnimized.

Definition 3.2 (Unstable Equilibrium) A part is i n an unstable equilibrium pose when the net force on the object is zero, but the object cannot resist small perturbations of its pose. This cornsponds to poses where the potential energy is locally maximized.

26

Page 39: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

li2

x

Figure 3.2: Example Object

For a givcn two point contact configuration (that is, for a givcn contact triangle), there is an interval I of object orientations for which this contact configuration is maintained as the object rotates. The potential energy of the object as a function of orientation either has a uniqile maximium in the interior of I , or it is monotonic (The proof is given in Appendix A). This means that if the cone is frictionless, then there is at most one unstable equilibrium orient,ation of the triangle balanced in the cone, and one or two stable resting orientations, corresponding to the t,riangle resting on one side or other of the cone. If we look at all the triangles formed by all possible pairs of vertices of the object, we can generate the cspace obstacle formed by the palms, and from the cspace obstacle determine the potential function curve of the object in a given cone tilted at a given orientation. Figure 3.3 shows a scaled example of such a curve, for the example object shown in Figure 3.2; in a cone opened x / 3 radians wide, with 0 = 0. In this particular case, the potential surfaces are directly proportional to the y-coordinat,e of thc configuration space constraint surfaces. Since the local minima of this curve rcprcsent the orientations where two triangles are simultaneously in contact with the cone, stable orientations of an object correspond to three point contact with the cone. Let z be the horizontal position of the object CG in the world frame, and 0 be the orientation of the object in the world frame. For a fixed value of 0, the curve defined by the intersection of the palms’ configuration space obstacles forms a one dimensional curve in three dimensional space, into which the constraint surface gradients point (Figure 3 . 3 ) . This curve, in turn, has local minima which attract thc system state. Assuming that the kinetic energy of a part is always low compared t.o to the depth of the potential wells, an object caught in a cone in a particular orientation will settle to a unique resting position determined by the initial position of the object upon contact, and the tilt of the cone with respect to gravity. Ensuring that the kinetic energy is low enough requires that the palms move slowly in comparison with gravity, and that gravity is low compared to some ambient viscosity, or to the coefficient of restitution of the impacts bctween the palms and the part. This ambient viscosity may even be the friction between the part and the palms, provided that the “all contacts slip“ condition is met. Determining the conditions for which

27

Page 40: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

POTENTIAL ENERGY FOR EXAMPLE OWECT. CONEIPIIJ. DJ

8

I D 1 2 3 4 5 6

THETA

Figure 3.3: For two palms k e d at -$ = n/3,/3 = 0, the intersection of the configuration space obstacles shown projected into the ( e , y) plane

the coefficient of friction simultaneously meets both the requirements on slipping contacts and energy dissipation will be addressed in Chapter 4. Determining the necessary conditions on the palm velocity and the coefficient of restitution is addressed in Chapter 6.

Once an object is in a stable state, the cone can be tilted back and forth within a certain range of 0 while maintaining stability. For those regions of 0 where stable contact is maintained,

as ap - _ - (3.1)

where 0 here is taken to mean object orientation in world coordinates. is fixed. If the object is already resting

stably in edge contact with one palm, then for some range of $, the cone can be widened or narrowed and the object will stay in stable contact with that palm. For the range of $ for which the object maintains stability,

ae 1

positive if the object is resting on the left palm, or negative if on the right palm'. Because we are looking at the low friction cme, we are assuming that jamming cannot occur, since the contacts are assumed always to slide.

The change in orientation of an object in response to the tilting and squeezing of the cone can he described by the equation

We now look at what happens as 4 is varied and

(3.2) _ - a$ - *?

E a0 = l 'aD-- .a$ (3.3) 2

E = -1, resting on left palm 1, resting on right palm

'This can be Seen by noting that the augle of the left palm in the cone frame is $ + 5, and the angle of the right palm is 5 - $

28

Page 41: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

stable edge unstable edge

Figure 3.4: The bottom edge of the polygon on the left is stable; the bottom edge of the polygon on the right is not.

over the range of $, 0 for which the object remains stably supported throughout the cone motion.

3.2 Equivalence Regions

We would like to use the above observations to plan object reorientations automatically. If we look, for the moment, at the object only after it has made contact with the cone, then thc cone/object configuration can be characterized as a point in the space (O,$>p) . We will call all stable resting configurations that correspond to a particular side of the object in edge contact with a particular palm equivalent configurations. For example, [see Figure 3.5), all stable configurations where rectangle side Q rests on the left palm are equivalent. Define contact formations (Desai, as cited in (881, (841, [85], 1861) as the set of contact configurations where the same vcrticcs of the object are making contact with the same edges of the cone. Note that thc definition of equivalent configurations forms a superset of the sets of stable contact formations corresponding to side a against the left palm, since for some configurations of the cone: the object makes three point contact, for others, two or four point contact.

Definition 3.3 (Equivalence Region) A set of equivalent configurations will be culled an equivalence region in (e, 4, 0) space. The projection of this set into the (4,p) plane i s the shadow of the equivalence region.

Referring to Equation (3.3), we see that an equivalence region in (8, $,p) space is a planar surface. Figure (3.6) shows the projection of this equivalence region into the (4, p) plane. The equivalence regions of most interest are those which correspond to stable edges? since desired goal states will most likely correspond to states in such regions.

Definition 3.4 (Stable Edge) A stable edge of an object is an edge on which the object can. rest on a horizontal palm, unsupported by the other palm, without tipping over, i n the face of small disturbances.

In other words, as shown in Figure 3.4, a stable edge is an edge e, such that, if one were to project the center of gravity onto e,, this projection would lie in the interior of the line segment e,. For stable edges, the equivalence regions can be shown to bc simply connected [see Chapter

29

Page 42: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

A. p = 2.75. p=O.196

Figure 3.5 Different contact formations which are in the same equivalence region

7): for any two configurations in an equivalence region, there is a stable trajectory from one configuration to another. Hence, if we have the point ( 8 d e s , $ d e s , 0 d d e s ) as our goal state, then an immediate subgoal is to reach the corresponding equivalence region.

We note here that the interior of what we are calling equivalence regions are supersets of what are called in [85] passive first order stability cells (passive FS cells). First order sfability corresponds to configurations of the object in the manipulator where the potential energy is a t an equilibrium point and any feasible infinitesimal perturbation of the object strictly increases the potential energy [84]. An FS cell is actiue if some of the joints of the manipulator must be compliance-controlled in order to maintain stability as the object is manipulated (this is generally t,rue if there are more joints than there are degrees of freedom of the object). An FS cell is passive if only position-control of the manipulator is necessary. Specifically, one of our equivalence regions contains a union of one or more passive FS cells, each one corresponding to a different contact formation. An equivalence region corresponds to a region in configuration space for which a completely (first order almost everywhere) stable path exists bet,ween any two points in the region.

Recall that for the low friction, low kinetic energy case, every configuration for the object and cone which lies on the intersection of the configuration space obstacles of both palms (except for the unstable equilibrium orientations) is attracted to a unique stable resting configuration. Then for a fixed cone, every stable object orientation 8, has a neighborhood of orientations which converge to 8,. Taking the union of all these neighborhoods in (e,$- 0) space gives the preimage Ps of an equivalence region, S.

Definition 3.5 (Preimage) The preimoge Ps of an equivalence region, S is the set of all configurations (8, $, 0) which converge to some configuration (es, $,0) such that (Os , $,o) E S.

In other words, 'Ps is a region of state space which is trapped in a potential energy well. The bottom of the energy well is the surface S. For a cone formed by palms of infinite lcngthl

30

Page 43: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

EaUIVALENCE REGION SHADOW FOR ’SIDE A, LEFT PALM 1.5

1

0.5

$ 0 m

0.5

-1

Figure 3.6: Equivalence region shadow for configurations of previous figure. The labeled points show the locations of the corresponding configurations in the previous figure.

the preimages cover the region of state space

(3.4)

For cone configurations (4,P) outside the region above, the mouth of the cone dips below the horizontal, so the object would spill out of the cone. Of course, once the finite length of the palms is taken into account, the preimages will no longer cover this region.

The boundaries of an equivalence region correspond to the edge of stability of a particular contact class, SO: there will be some directions of movement of the cone which will take the system state out of SO, causing the edge contact of interest to be lost. If that particular boundary region of SO lies in the preimage of another equivalence class, SI, then the object will fall into the stable contact corresponding to equivalence region SI. In other words, an object’s orientation can he brought from SO to SI by bringing the object to the appropriate boundary of SO and moving the cone in such a way that the cone state moves out of the shadow of SO, and into the shadow of SI. This transition is reliable even though the manipulator does not maintain stable support of the object during the transition from So to SI, as long as the object’s kinetic energy is low compared to its depth in the potential energy well.

3.3 Planning in the Frictionless Domain

We present here some theorems which will be relevant to planning reorientations. The proofs of these theorems will be presented in Chapter 7, and we have numbered them here as they are numbered in that chapter.

31

Page 44: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Let S be an equivalence region corresponding to a stable edge, and p, q be poiuts in S

Theorem 1 S and its projection into the ($> 8) plane are simply connected.

By a connected region we mean a region X such that if 2 1 E X and 2 2 E X , there is a curve scgmcnt whose endpoints are q and x2, and which is completely contained in X . By a simply connected region, we mean a connected region X without holes. For the r& of t,liis section we will refer to both the equivalence region S and its projection into the ($,/?) plane interchangeably as S, since (as discussed in Chapter 7) the two are homeomorphic, or topologically equivalent.

is Theorem 5 If p = b I , p y ) , q = (qI, qu) E S , and pz = qz = $, then the line segment completely contained in S .

In other words, if p , q are both in S, and both correspond to points with the same cone opening 4, then the pure tilt motion between them preserves the stable configuration of the part.

In addition to pure tilts (4 constant, p varying) and pure squeezes (0 constant, q5 varying), there is another type of simple movement of the palms related to pure squeezes: a fixed-6 squeeze. In a fixed-8 squeeze, the palm making edge contact with the object stays fixed, and the other palm opens and closes, resulting in the cone configuration changing, but the object orientation relative to the world frame remaining fixed as long as the state is stable. In the parameter space, this corresponds to = E ; , where E = -1 for the left palm held fixed, 1 for the right palm held fixed. A fixed-8 squeeze between two points in an equivalence region (one which corresponds to a stable edge) will be completely contained in that equivalence region, if a t both endpoints of the squeeze, the vertex contacts are the same: not only is the same resting edge on the same palm (which is the definition of an equivalence region), but the other palm is making contact with the same vertex at both endpoints of the squeeze.

Theorem 6 If p , q E S , p and q are vertex-equivalent, and has slope = E ; , then is completely contained in S .

So, for any start point and any subgoal point in an equivalence region corresponding to a

There is a pure tilt connecting the two points, or there is a fixed-@ squeeze connccting the two points. Then there is a single operation that will bring you from the start state t.o the sribgoal state.

stable edge e resting on palm k (where k is left or right), one of the following is true:

Define the b a s e h e of an equivalence region to be the curve in the equivalence region corresponding to palm k being horizontal. If there is not a pure tilt or fixed-@ squeeze connecting the two points, then draw the pure tilt line &om the start state to the baseline, and the pure tilt line from the goal state to the baseline. These are both guaranteed to be contained in the shadow of the equivalence region by Theorem 5. There will be some line (a fixed-@ line) contained in S which is parallel to the baseline and which passes through these two pure tilt lines. (At the very least, the baseline will satisfy this requirement). See Figure 3.7. Therefore, the subgoal can be achieved from the start state in at most two tilts and one fixed-8 squeeze.

For an unstable edge, equivalence regions as we have defined them may no longer be co11- nected. However, in each component of the equivalence region, the above results about pure

32

Page 45: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 3.7 Trajectory decomposition

tilts and fixed-0 squeezes still hold. The results are summarized below.

Theorem 8 Given any two points in an equivalence region S corresponding to a stable edge of a polygon P, there exists a path entirely contained in S. which can be decomposed into a t most two tilts and one fixed-@ squeeze.

If the equivalence region does not correspond to a stable edge, but the two points are in the same component of the equivalence region, there still exists a path between the two points composed only of pure tilts and jixed-0 squeezes which is entirely contained in that component.

Therefore, if there exists a path from an arbitrary start state to an arbitrary end state, where the transitions between equivalence regions are given b y pure tilt motions, the entire path between the start state and the goal state can be decomposed naturally into pure tilts and fixed8 squeezes.

Intuitively, pure tilts roughly correspond to pure rotations of the objects, and fixed4 squeezes roughly correspond to pure radial translation. Just as pure rotations and pure ra- dial translation span the plane when using polar coordinates, pure tilts and pure rotations span the motion space of the object in the palms.

In addition to moving around within a stable equivalence region, we also would like to know what motion will take us to a new equivalence region. Suppose that we orient the edgcs of the polygon so that edge ei2 is a ray whose origin is vertex vi, and the vertices (and edges) are ordered counterclockwise with respect to the center of gravity.

Lemma 9 FOT a cone with infinite length palms, suppose polygon P is resting stably on edge eo on the left palm. Let the right palm make contact wath vertex vk. Let the vector from the center of gravity of P to vertex Vk be Vk, and be the cone opening such that the right palm

'In the subscripts for the edges or vertices of A'-gons, i * k is shorthand for ( i + k)rnodulo N.

33

Page 46: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

is perpendicular to vk. Then:

For f A l l cone openings such that &'k+l < 6 < $ 'k , P will rotute to edge ek on the right palm, upon executing a pure clockwise tilt. If ek is stable, the part will stay in that configuration.

FOT all cone openings such that 41k < & < 4Lk-l, P will rotate to edge ek-3 on the right palm, upon executing a pure clockwise tilt. If the ek-1 is stable, the part will stay in that configuration.

In Chapter 7, it will also be shown that the arcs from one equivalence region to another are

In order to determine which orientations of a particular part can be brought to which other bidirectional.

orientations:

1. First, determine all the equivalence regions, (two for every flat face of the convex hull of the object) and their preimages.

2. Determine the boundary of each equivalence region, and divide each boundary into seg- ments, according to which preimage of another equivalence class that segment is contained in. If we use pure tilt motions to transit out of an equivalence region into the preimage of another equivalence region, then Lemma 9 shows that these boundary segments can be described by intervals of cone openings, 4. For example, suppose we start in an equiva- lence region, So, and divide the boundary into cone opening intervals I, as dcscribcd in Lemma 9. Then picking any cone opening $ in a particular interval I , and tilting in the appropriate direction will cause a transition to the same new equivalence region, &.

3. Construct the graph G whose nodes are the equivalence regions, with arcs denoting which equivalence regions transit into another. Each arc is labeled with the appropriate set of cone configurations (for the example above, the arcs would be labeled by the appropriate +interval), and the direction in cone configuration space in which the cone must be moved. Figure 3.8 shows G for our example object. The arcs in G were determined by using only pure tilts at the equivalence region boundaries to transit &om region to region. Different contact formations in each equivalence region are shown with an arc into the contact formation of another region which it transits to.

The graph G in Figure 3.8 was generated assuming that all configurations (&,o) are achiev- able. In reality. not all cone tilts and orientations will be achievable, because the finite length of the palms will prevent the object from being held in some cone configurations, and because of other physical limitations of the device. One possible limitation is the ability or inability to slide the part from one palm to the other without changing the part's orientation relative to the palm on which it rests; we will refer to such a motion as a sliding fransfer. Sliding transfers may not be possible on a specific device because of the space between the palms, or because of an obstruction (such as the joint) at the vertex of the cone formed by the palms. As shown in Section 3.4, such physical limitations can cause certain arcs of G to be completely eliminated.

The planning problem has now been segmented into two parts. Given the initial and desired final configurations of the system, the high level problem is how to get from the initial t,o the final equivalence region. This can be determined by straightforward graph search on G. If a

34

Page 47: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

-... ......................... '.... 10

Figure 3.8: Transition graph for example object. Transition motions are made by pure tilts in the appropriate direction. The arcs shown as dashed lines correspond to transitions which were eliminated by the planner, as explained in Section 3.4.

35

Page 48: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Initial State Goal State

$=2.55144, p = 0.295075

$=2.55144, p =-1.49717

;= 1.06705, P=-O.891915

Figure 3.9: Example reorientation: from 8 = - ~ / 2 on left palm to 0 = 0 on left palm

path through the graph exists, the reorientation is in principle possible, and the path determines a series of sets of equivalence regions which the cone trajectory must go through.

Once it has been established that a high level path exists, the lower level trajectory planning problem for each equivalence region (node) is to determine the trajectory which the cone must follow to reorient the part. The motions to transit &om one equivalence region to another are given by the arcs of G. To determine trajectories through equivalent regions, we can take advantage of the fact that equivalence regions are piecewise straight-line connected, as described in Theorem 8. Figure 3.9 shows an example reorientation for our example object.

Sufficient conditions for the existence of plans are summarized below. Again, the proofs will be presented in Chapter 7.

Definition 3.6 (Orientable) We will call a polygon orientable i j it can be brotrglat fmm an.g equivalence region associated with a stable edge, to any other equivalence region associated with a stable edge.

The relative angle aij between two edges ei and ej is the counterclockwise angle formed betvmen e; and ej .

36

Page 49: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Theorem 12 Let P be a wnuex polygon with N all stable edges, G the corresponding transition graph. In order for P to be orientable, it i s suficient that either:

1. Sliding transfers be possible: or

2. FOT every edge ei of P , there be at least two edges e j ,ek such that a i j , a i k 5 71.

I f exther of the above two cases is true, then the length of any reorientation plan is bomded by N . This plan can be found in O ( N 2 ) operations.

A triangle with all stable edges is an example of a part which satisfies the predicates of Theorem 12, but not Condition 2. Note, however, that Theorem 12 gives sufficient, but not necessary conditions. Hence it may be possible that a part with all stable edges which is orientable, even if neither Condition 1 nor 2 are true.

Theorem 14 If sliding transfers are possible, any polygon P is orientable. The path length from any initial state to any goal state i s bounded by 2 M , where M is the number of stable edges. It can be found in C7(Mz) operations.

The following is a paraphrase of Theorem 15

Theorem Ifsliding transfers aTe not possible, i n order for P to be orientable it is suficient that every stable edge ee,, when resting on the left palm, can reach two other stable edges eo,+, and e,%+, on the right palm by a clockwise tilt. I f P has M stable edges, the path from a n y initial state to any goal is bounded by 2M and can be found in a t most O ( M 2 ) operations.

An analogous result naturally holds in the counterclockwise case, that is, going from the right palm to the left palm, as well. The difference between Theorem 15 and Theorem 12 is that now P need not have all stable edges, and in Theorem 15, it is not the case that both the transitions from a given edge are bidirectional.

3.4 Experimental Results

The preceding algorithm was implemented in C on a Dec-station 5000/20. For the example object, the transition graph G (Figure 3.8) can be generated in about one minute. Once G is generated, reorientation plans can be found in one or two seconds. Plans were gencrated to bring the object from the initial stable orientation on a flat palm, to the goal stable orientation on the goal palm, much as in Figure 3.9. The plans were tested both in simulation and on a plastic cone manipulator (Figure 3.10), mounted on a tilted air table to reduce support friction. Note that for the transition graph Figure 3.8, which was generated assuming an ideal manipulator, every equivalence region can be reached from every other equivalence region. To generate plans which could be executed by the manipulator, motions corresponding to the object sliding from one palm to the other over the central hinge point, and configurations where < 0.5 were disallowed, and G regenerated. This resulted in certain arcs being completely eliminated from the graph, and they are shown as dashed arrows in Figure 3.8.

The planner can also be generalized to return a path from a given initial state to a generalized goal state. for example “resting flat on side a, either palm”. This can be done by adding nudes to G representing this general state, and reachable only from the nodes “side a , left palm” and “side a, right palm”. Naturally, if the original graph is already strongly connected, any

37

Page 50: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 3.10: Plastic cone manipulator used to test plans

generalized state is reachable from any initial state, where the initial state specifies both the resting side and resting palm.

For the example object, the plans simulated tended to either be “robust” to friction bctwcen the part and the palms as high as about p = 0.25, or be extremely sensitive to the frictionless approximation, failing for friction higher than p = 0.02. Simulation of the plan shown in Figure 3.9 showed that a static coefficient of friction p 5 0.25 would permit enough of the contacts to slide for the predictions from the frictionless approximation to be valid, and for the plan to succeed.

In the experiments conducted on the air table, the static coefficient of friction was approxi- mately 0.19, low enough for the “robust” plans to succeed. The palms were actuated by servo motors, run open loop, and only a minimum of effort was spent on calibration. The motor behavior was assumed to be linear. The motor encoder signals were read with the palm at two positions ~ for the right palm motor the encoder was read with the palm at 0 degrees and 90 degrees; for the left palm motor the encoder was read with the palm at 90 degrees and 180 degrees - and these readings were used to fit a line between palm orientation and encoder values for each motor.

To evaluate the reliability of the example plan, we ran 50 trials, starting the object in its initial orientation, 4 = -?r/2, at different arbitrary locations on the left palm. The varying initial configuration of the part led to variation of the part’s trajectory through its coIifiguration space, as expected. Nonetheless, of the 50 attempts, the manipulator failed to correctly reorient the object only 4 times. Despite the variation in the object’s trajectory, the object always stayed trapped in the correct region of the state space and hence would be propelled along to the correct final orientation. Each of the failures seemed to be due to a single rough spot on the right palm, which caused a contact to roll rather than slide.

Figure 3.11 shows a plan for our example part which tended to fail due to frictional in- stability. During the transition from the state (0 = 3.92699, $ = 2.67254, p = -0.234525) to the state (-?r/2, 2.67254, 0.234525), the part would fall off its resting edge to ariothcr edge, s

38

Page 51: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Initial State33 = 3.92699, right palm

.... .... "a

= 2.67254, = -0.234525

= 2.67254, = 0.234525

Goal State: 0 = - 72, left palm

Behavior expected under frictionless assumption

Behavior observed on manipulator

Figure 3.11: A plan which tended to fail

shown in the right column of the figure, even though the frictionless analysis showed that the pure tilt should have been entirely stable until the part was transferred to the left palm. Figure 3.12 shows another plan which was consistently successful for the same part.

Figures 3.13, 3.14, and 3.15 show successful plans for another part (Part Z), which was basically a triangle with its tips cut off. This part had three stable edges and two unstable edges. The plans for this part tended to be quite stable with respect to friction, and failure modes tended to be caused by the narrow portions of the part getting caught in the gap between the palms. The plan shown in Figure 3.14 is one such example. The plan shown in Figure 3.15 sometimes failed due to jamming: when the palms attempted to execute the squeeze to 4 = 0.675. sometimes the part would become jammed in the palms, and the palms would not be able to squeeze all the way down to the desired 4. When this occurred, often upon executing the next step in the plan (a purc tilt); the part would transit to the orientation 8 = 0 on the left palm, rather than the desired 0 = 2.05. This problem was intermittent, and when the palms were recalibrated, actually went away.

Although one of the plans for Part 2 had jamming problems, the plans for Part 2 did not suffer from the frictional instability which some of the plans for Part 1 did. This is becitusc for

39

Page 52: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 3.12: A plan which tended to succeed

40

Page 53: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

9 = 0.675, p=1.233

Goal State: = 2.05, left palm

Figure 3.13: A plan which generally succeeded.

41

Page 54: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Goal State: e = 2.05, left palm

Figure 3.14: This plan would fail because the part would get caught in the gap between the palms.

42

Page 55: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Goal State: e = 2.05, left palm

Figure 3.15: A plan which would fail due to jamming.

43

Page 56: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Run Left Palm Success Rai.io

Table 3.1: ’IYials of the plan in Figure 3.12 at different manipulator calibratinns

all the stable edges, Part 2 is “long and low”: that is, with the center of gravity as the origin, the tangential distances to the vertices of a given edge are long compared to the perpendicular distance to the edge itself. This is less true for Part 1; in particular, it is not true for the edges labelled “c” and “d” in Figure 3.2. A quantifiable definition of “long and low” is dependent on the coefficient of friction of the palms, and a analytical condition for frictional instability will be given in Chapter 4.

3.4.1 Robustness t o Calibration

A useful hut unexpected side effect of Lemma 9 is that orientation plans display robustness to small miscalibrations of the manipulator. To test this, we took the plan shown in Figure 3.12 and ran it with different palm calibrations. The results are summarized in Table 3.1. The motors arc assumed to he linear, so each calibration is a line describing the mapping between the motor encoder signal and the palm orientation. The calibration for the left palm was made with the palm at 90’ and 180’ degrees, and for the right palm at 0” and 90” degrees. The encoder signals at these positions for each test calibration are given in the Table 3.1> for comparison of the calibrations. The RMS error of a palm calibration C with respect to a reference calibration is the square root of the mean squared distance, in degrees, between corresponding points on the two lines, taken over the same interval of encoder signals. The errors are taken with respect to a nominal calibration, which is shown in line 1 of Table 3.1. Roughly, RMS error is the average magnitude of the discrepancy in degrees between the commanded position of the palm and the actual position of the palm. The right palm orientation was assumed to vary between 0 and 150 degrccs, and the left palm orientation was assumed to vary between 30 and 180 degrees. The success ratio is the number of successful reorientations over the the number of total trials.

The manipulator trajectory for the reorientation plan we used in these trials is generated by interpolating between the control positions shown in Figure 3.12. The interpolations are either pure tilts or hed-B squeezes, depending upon whether the quantity 4 or ap/&b is preserved between two given points (in other words: whether the line in (4, p) connecting the two puints is of thc form 4 = constant or c$-P = constant. In Table 3.2 we give the maximum deviation from the nominal for the trial trajectory, taken over the control positions. The maximum deviation is the difference in degrees 4test-&m that would result from the motor commands fur the test and nominal calibrations. Note that in Tables 3.1 and 3.2 we have taken the difference. not, from

44

Page 57: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Run Nominal

1

Maximum $ Error (dcgrces) -

Nominal Position ($, p) in radians

2.7948 (0.5664 . -1.0878)

3 -16.7844 4 -11.1896 5 -19.6084

the absolutely '.correct" calibration, but from a nominal calibration that we have determined to be approximately correct. The nominal position (over the control positions) for which the maximum error is achieved is given as ($, p) in radians, for compatibility with Figure 3.12.

The sign and positions of maximum error are consistent with the fact that many of the failures observed were due to the palms squeezing to such a small angle that the part was forced off the palms. Notc that Run 8, where the maximum crror is large but positive, performed quite well. Other failures were due to centrifugal force causing the part to slide off the palms; this whs not observed in the trials of the nominal calibration. This mode of failure is probably also due to the palms' relative angles being too small, forcing the part further out away from the cone vertex and incrcasing the centrifugal effects. Few of the errors observed (mostly in Run 7) were actually due to the part landing on the wrong side after a tilt.

( 0.5664 ~ -1.0878) (0.5664, -1.0878) 10.5664. -1.08781

45

6 7 8

0.3702 io.5664; i . 2 i i z j -19.6521 (0.5664, -1.0878) 22.3793 (0.5664: -1.0878)

Page 58: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial
Page 59: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Chapter 4

Friction

In other words, if the model does not succeed in transforming reality, reality must succeed in transforming the model.

Italo Calvin0 The model of models [27]

Empirically, some edges which are considered stable in the frictionless analysis may be unstable in practice, in the sense that the object may not stay on that edge even when the palms make motions which stay within the corresponding equivalence class. This may be because the object has sufficient energy to escape its energy well, or it may be because friction causcs a rolling contact where sliding was expected. In this chapter, we will evaluate the stability of edges with respect to their tendency to roll rather than slide.

Definition 4.1 (Frictional Instability) Suppose we have a stable edge e,, and its associated equivalence region; S , when resting on palm k. We will say e, i s frictionally unstable on palm k if there are trajectories through (0,4,0) space which are contained in S , but which Jail in practice because of frictional effects: contacts FOIL which are expected to slide.

After identifying frictionally unstable edges, the planner can be augmented with this infor- mation, in order to take Fictional effects into account.

Therc is a fundamental tradeoff between the completeness of a given model of the world and its complexity. Because in this work we are interested in designing a planner which is fast and relatively simple to use, in terms of the number and type of its input parameters. we must choose computational simplicity over completeness. The extent to which we consider friction in our world model is far from complete. We consider only two point contact (that is, contact with the resting palm, ignoring the other palm) when looking for rolling contact points, and so will be unable to detect jamming or wedging. We attempt to justify this on two grounds. The first, as we have mentioned, is computational speed. Rom an offline computation point of view, we will only consider the part’s resting edge and the resting palm (the two pieces of information which define an equivalence class), rather than consider all possible contact configurations, which gives 11s 2N cases to consider, rather than O ( N 2 ) . From an onlinc coniputation point. of view, we do not wish the overhead of sensors, so we must forgo exact knowledge of state; in particular, whether we are actually in two or three point contact. One can argue that this type of sensory information is binary in nature, and low overhead - a valid argument ~ but. by not having it, wc can also dispense with those model parameters which would he required

47

Page 60: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

to carry this information around. A lower parameter model of the world is more tractable, and naturally faster to compute. In our case, the frictional model is linear in the number of stable edges, rather than polynomial. We must distinguish between two and three point contact if the difference in these states crucially affects a decision which the planner must make. If in fact the decision can be made independently of this information, and still be a correct decision, thcn the information is not necessary to the planner.

The second point is that this manipulator technique fundamentally relies on low frictional contact in order to reliably reach potential energy minima without jamming. The potential energy based method of finding stable states is both easy to compute and robust. A minimal energy state in a frictionless world is still a minimal energy state in the presence of friction. An object which is stably supported in the absence of friction will still be stably supported in its presence. A grasp or stable support which is predicted using a particular coefficient, of friction, on the other hand, may not be stable if the actua,l coefficient of friction differs from that of the model. Hence, it can be brittle in the face of model uncertainty. Furthermore., because the location of minimal energy states varies smoothly (linearly) with the palm positions (as long as we remain inside a single equivalence region), the frictionless approach is also robust to small errors in palm calibration. A Fiction based system may not be. We will return to these points in Chapter 5, when we will compare our system to another sensorless two palm system 1331, which uses frictional grasps. For now, we will present the frictional contact model which we incorporated into our planner.

4.1 Analysis techniques for planar systems

A planar system has a three dimensional configuration space: two dimensions for location in the plane, and one for rotation. Similarly, it has a three dimensional force space: two components for translational force, and one for moment about the origin. In order to keep the dimensional units of the configuration space oonsistent, the orientation axis is given in units of orientation (in radians) times the radius of gyration of the object in question. Similarly, the torque component of the corresponding force space is given in units of (force times moment arm) divided by the radius of gyration. In both cases, this normalization ensures that all three axcs of the space are given in the same units: length, for configuration space, and force for force space. Therefore, the radius of gyration of the object of interest is a natural unit of length for performing force analysis. Since torques and rotations will generally be given with respect to the center of gravity (CG) of the object, the CG is the natural origin for our coordinate frame. In all the analysis given in this section, we will therefore use a coordinate system with the center of gravity of the object of interest as the origin, and the object’s radius of gyration as the unit of length.

Suppose we are given a diagram such as those in Figures 4.1 and 4.2, and then asked the question, ”What happens to this system when a particular force is applied?” In the quasistatic frictionless situation, there is a oncto-one mapping between forces and motion, so the question is casily answered. If there is friction, however, this mapping is no longer one-to-one, and the question becomes somewhat complicated. We would like to come up with a method for answering this question, at least in the qualitative sense. In Chapter 2, we reviewed some techniques for planar frictional quasistatic analysis, based on those presented in 1511, [76], [24], and [32]. We will now apply those techniques to the problem at hand.

48

Page 61: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 4.1: Friction cones at contact vertices

4.1.1 Friction Cones

We will consider a edge resting in two-point contact on a single palm. (See Figure 4.1). If the coefficient of friction between the object and the palm is p, then the frictional force at each contact can be described by the fraction cone at the contact vertex whose cone edges are

n * p t

Wherc n is the outward unit normal to the palm, and t is the unit tangent to the palm. For a point mass, it is easy to see that the tilt angle of the palm for which the point mass will begin to slide is given by = arctanp.

4.1.2 Convex cones

Now consider a body with extent. The contact forces on the body can be adequately represented, under the rigid body assumption, by only considering point contact forces; for edgcedge contact one need only consider the endpoints of the contact, as shown in Figure 4.1. The friction cones can be extended to three dimensional configuration space by representing each edge of each friction cone as a ray in three dimensional cspace

f = [ :; J , r X2D LL

wherc u is a unit vector in the direction of the friction cone edge, and T is the location of the contact point (the vertex of the friction cone) with respect to the CG, and X ~ D represents the two dimensional cross producti: rZuy - ryuz. In configuration space, all forces that can be exerted by the frictional contacts must be a nonnegative combination of these rays; in other words, they must be contained in the convex cone (the configuration space friction cone) formed

49

Page 62: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

by the rays. If we can represent all forces and accelerations of the object in configuration space? then the dynamic equations become questions of cone containment. To illustrate the point, let x represent the position of the object in configuration space, FA be the net external applied force and torque on the object, FContllCl be the force applied to the part by the mauipulator, and let C F be the configuration space friction cone. Then the dynamic cquat,ion describing the system is

mX = FA + FcOrLt.ct.

We can rest.ate this equation as

mx - FA is contained in CF.

In the problems we will be solving, we will generally know CF and F,, and will be hy- pothesizing object accelerations (actually, we will be hypothesizing object velocities, but under the quasistatic assumption, velocities and accelerations will be in the same direction. See the discussion in Section 2.3 of Chapter 2) . We can use the kinematic analysis due to Reuleaux which is described in Chapter 2 to find all feasible centers of rotation for the object motion. By converting the centers of rotation into cspace acceleration vectors, we can state the problem thus:

Determine whether mx is contained in CF @ Fa, (4.1)

where the left hand side of the relation can be derived from a postulated center of rotation. and fB denotes the operation of cone combination. In fact, we do not consider all the vectors which make up the cone C F , since for a postulated center of rotation, we can also determine the motion of all contact points, and hence which edges of the friction cone are active.

4.2 When does it slide and when does it roll?

Returning to Figure 4.1, we wish to determine the behavior of the object on the palm under the influence of gravity. For what orientations of the palm will the object remain stationary? For orientations of the palm steeper than that, will the object slide down the palm, or roll about a vertex? We can use the formulation from the previous section to determine the st.ability of an equivalence class with respect to the contact friction. That is, for each equivalence class: we can find an upper bound on the coefficient of friction such that for values of friction lower than this bound, if the part is in this equivalence class, it will behave as if its contacts with the palm which defines the equivalence class were frictionless: the contacts will slide, not roll.

Suppose we are tilting the palm clockwise (so that the tilt angle of the palm, p, is negative). Then the critical contact is the right vertex of the resting edge. Let h be the height of the center of gravity, and tuv be the tangential distance from the center of gravity to the right vertex. Consider the case shown in Figure 4.1, where the friction cone at the right contact does not contain the cent.er of gravity. It is easily shown, using the technique described above, that if the magnitude of the palm’s tilt angle is less than arctanp, the object will stick, i ~ s expected. For steeper tilt angles, the object will slide without rolling. Informally, the object will not rotate because the contact force at the right, vertex always points to the right of the center of gravity, exerting a counterclockwise moment about the center of gravity, which will be compensated for by the contact force at the left vertex.

50

Page 63: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

t

Figure 4.2: Considering the case of a clockwise tilt (0 < 0): Friction cone contains CG

Figure 4.3: Again considering a clockwise tilt (p < 0): Friction cone contains CG, and IpI < arctan y .

51

Page 64: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 4.4: For a clockwise tilt: Friction cone contains CG, and /PI > arctan %.

Now consider the case shown in Figure 4.2, where thc right friction cone contains the center of gravity. Recall that, we are considering a clockwise tilt, so 0 is negative. In this case, it can be shown that for 101 < arctan y , the object will stick, and for steeper tilt angles, the object will roll clockwise about the right vertex. This is because when IPI < arctan (Figure 4.3), the gravity vector points to the left of the right vertex, and so the compensating contact force at the right vertex will point to the right of the center of gravity. This contact force will exert a counterclockwise moment about the center of gravity, which will be compensated for by a contact force at the left vertex. Hence the object will not rotate. Because the applied forces at both contacts will be inside the friction cone, the object will stick, as well. For steeper tilt angles (Figure 4.4), gravity will point to the right of the right vertex, and the compensating force will point to the left of the center of gravity. This will exert a clockwise moment about the center of gravity, which will cause the left contact to break, and the object will rotate clockwisc ahoiit the right vertex.

The above can be summarized as follows: Consider an object resting on stable edge contact with a single palm. Let pcrit = y , and

a,,it = arctanp,,it. When the palm is tilted clockwise, one of the following cases occurs:

If p < pait, the object will stick if < arctan pa. For steeper tilt angles, the objcct will slide without rotating.

If p > pcTit> the object will stick if IPI < ac7it, For steeper tilt angles, the object will rotate clockwise about the right vertex.

Similar results hold for the left vertex whcn the palm is tilted counterclockwise. Using this result, we now have a stability criterion for a particular equivalence class with

respect to the contact friction of our system. If the equivalence class corresponds to resting on the left palm. we consider pcvjt for the right vertex of the resting edge. If the object is resting on the right palm, we consider p-it for the left vertex of the resting edgc. In either case! if

52

Page 65: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 4.5: Object 1: "House"

pmit is less than the system contact friction, the resting edge will have a tendency to roll as the palm tilts out of the horizontal, and the equivalence class may be considered to be frictionally unstable. Frictional instability is determined using only the direction of the next tilt motion (which we know), not the magnitude of the tilt (which we do not know, until after we have found the plan).

Although this stability criterion cannot be incorporated directly into the transition graph of Chapter 3 in a useful way, we can use this criterion to augment the transition graph which will be described in Chapter 5. This larger transition graph takes into account uncertainty in the state of the world, not only the uncertainty associated with friction: but that of the initial state of the system as well. If a certain motion canses the object to fall into an equivalence class which is frictionally unstable, we consider this motion t.0 have two possible outcomes. One is the equivalence class which is determined by the frictionless analysis. The other is the equivalence class which the object may roll to due to friction. For example, if a certain motion has a.q one of its possible output states the state (e,, left), and this state is frictionally unstable with respect to the contact friction of the system, then the object in state (e*, left) will have a tendency to roll clockwise. The next edge clockwise is edge ei-1, and so the state (e;-1, left) should also be considered as a possible output state. This augmentation will not he sufficient if the object has enough energy to roll over past edge ei-1 to another subsequent edge, but is valid under the assumption of low kinetic energy.

By considering both the sliding and the rolling possibilities, the resulting transition graphs will be valid for any coefficient of friction less than the coefficient used to actually construct the transition graph. It will not be valid for coefficients greater than this, however, since a greater coefficient of friction may cause previously stable edges to become frictionally unstable.

4.3 Verification

To test our friction model, we took three objects, shown in Figures 4.5, 4.6, 4.7. and tested them on the air table. The first object is the five sided figure we have been using as an example part. The second part has three stable and two unstable sides, and was also used as an exampie part in Chapter 3. The third part is a rectangle with width to height ratio of 3 2 .

For all three of the objects, we tested all stable sides under two conditions: sliding friction coefficient of approximately 0.2, and of approximately 0.9. We then compared the sliding vs.

53

Page 66: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 4.6 Object 2: “Pseudotriangle“

2 ;,I a

* 3

*

Figure 4.7: Object 3: “Rectangle”

54

Page 67: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Side a b

Table 4.1: Sliding trials for “House“ on right palm

pmrt p = 0.2 p = 0.9 0.79 slidc roll 1.27 slide slide

Side

a b d

Table 4.2: Sliding trials for “Pseudotriangle”

h i t left palm right palm left palm right palm p = 0.2 p = 0.9 p = 0.2 p = 0.9

0.55 0.88 slide roll slide roll 2.7 1.8 slide slide slide slide 1.75 2.17 slide slide slide slide

rolling behavior of each side of each part with the calculated values of pcrit for both the left and right palms. The results are summarized in Tables 4.1, 4.2, and 4.3. Since Object 1 is symmetric about the y axis, and Object 3 is symmetric about the z and y axes, we have only recorded the outcome to within symmetries.

Each table shows pmxt for each side, and the behavior of the part (rolling or sliding), when placed on the appropriate palm on that side. The palm was pre-positioned to an angle where sticking was no longer feasible. The outcomes observed were all consistent with the predictions made by the pLCrit calculation.

Table 4.3: Sliding t,rials for “Rectangle” on right palm

55

Page 68: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

56

Page 69: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Chapter 5

Uncertainty: Planning from an Unknown Initial State

In all fictional works, each time a man is confronted with several alternatives, he chooses one and eliminates the others; in the fiction of Ts'ui Pkn, he chooses-simultaneously-all of them. He creates in this way, diverse fut,ures, diverse times which themselves proliferatc and fork .... In the work of Ts'ui Pen, all possible outcomes occur; each one is the point of departure for other forkings. Sometimes, the paths of this labyrinth converge ...

Jorge Luis Borges The Garden of Forking Paths [lG]

Chapter 3 described a method for planning reorientations from arbitrary but known initial configuration, to a desired goal configuration. In many applications, such as parts feeding, the initial state of the object may not he known. If a reorientation plan can he found to reliably bring the object from any initial state to a single known final state, then the method from the. previous section can be applied to bring the object from that known state to any desired goal state. In this chapter we will focus on the problem of determining a palm trajectory which will always bring the part to a single final state.

5.1 Frictionless, low energy case

Under the assumptions about the system used in Chapter 3 (all contacts slide, kinetic energy is low), t,he transition from initial equivalence region to final equivalence region is unique for a given cone opening $. If there are 2N equivalence regions, then we can in principle build the Z Z N elements of the power set of the equivalence regions: that is, the set of all possible combinations of the equivalence regions. For instance, if we have a set of equivalence regions {A, B, C, D}, then the power set of this set of equivalence regions would be { {A}, {B}: {C}, ID}, {A: B}, {A, C}, {A, D}, ... {A, B, C, D}}. Given some set of palm motions, we can build a larger transition graph, GG where each node is an element of the power set, and each arc corresponds to a palm motion. Each arc then connects a set of initial states to its corresponding set of final states. For instance, suppose for a given palm motion, if the object was initially in state A: the motion will transfer the system state to C. If the object started in %ate B. t,he same palm motion will transfer the system to state D. Then the graph GG would include a node corresponding to the set {A} with an arc to a node corresponding to the set{C}, a node

57

Page 70: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

correspondong to thc set {B} with an arc to a node corresponding to the set {D}, and a node corresponding to the set {A, B} with an arc to a node corresponding to the set {C, D}. All the arcs in this example corrcspond to the same palm motions. We can then do breadth-first search over GG, starting from the set of all possible initial states, in the hope of finding a sequence of arcs that will take the system to a node where only one state is possible. We will call such a sequence of arcs a homing sequence.

Definition 5.1 (Homing Sequence) A homing sequence is a sequence of manipuiator rrao- tions such that no matter what the initial stale of the part is, the final state of the part is always the sanae.

If we wish to find a homing sequence which homes to a particular final state, we can do a breadth-first backchaining search from our desired final state, hoping to find a path backwards to the set of all possible initial states.

In practice, since an arc will generally correspond to bringing an object from resting on one palm to resting on the other palm, we do not have to consider all 22N elements of the power set. We will generally have to consider the set of all initial states, all combinations of equivalence regions corresponding to resting on the left palm, and all combinations of equivalence regions corresponding to resting on the right palm (excluding the empty set), for a total of 2(2” - 1) + 1 = 2(”+‘) - 1 sets of combinations of states.

Figure 5.1 shows a homing sequence found for our example object. For each cone opening considered, there -‘ere two possible motions: One type of motion considered was to start with the left palm horizontal and the palms fixed with cone opening #, and tilt both palms clockwise, keeping $ fixed, until the right palm is horizontal. The other type of motion was to start with the right palm horizontal, and tilt clockwise until the left palm is horizontal. In Figure 5.1, each arc is labeled with the # used, and the direction of the tilt.

In Chapter 7, we will address the questions of knowing whether or not a homing sequence is possible for a given object, and of finding a set of palm motions (or in our example, a set of #s) which is sufficient to produce a homing sequence.

5.1.1 Experimental Results

A planner to find homing sequences using the frictionless quasistatic msumption was written. The above plan was one of the sequences found for the example object. However, when the plan was tried on the airtable system, it failed regularly. The problem was the frictional instability of the circled state in the third stage of the plan shown in Figure 5.1. The object would often roll off this edge, into another state not anticipated by the planner. Interestingly, the object was reliably brought to the same final state from all initial states, just not the state anticipated by the planner. This suggests the possibility of learning the dynamics of the interaction of parts with the palms by observation, and constructing homing sequences from the learned transition paph. This approach was in fact used in [28] for another sensorless part orienting systcni.

5.2 Extensions with Friction

I f the assumptions about the system in the previous section are violated, then the object can end up in a state not anticipated by the planner. In terms of the power set graph, this means that an arc out of a particular node may not end up at a node that fully describes the possible states

58

Page 71: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

............................... All pmible states. p =

......................

+..- :.. .. ... p.. .......................... ....... $=la [ Tilt CW

Final State .............

n/3 ........ Tilt CW ............ .... ..... ..

; ...................... ....

0 = 2.09 Tilt CCW ...... ............... t

.................... $=ni3

Tilt CW ........................ t ....

.... ...... m...'' .................

................. \. ................ o=m3

.............. .... Tilt CW

......... ..a. ................

......... u Q = 2.09

Tilt CCW planner HilihoUt rc t ion

Figure 5.1: Example homing sequence. The circled configuration in the third stage would often collapse to another state, shown, which was not predicted by the planner.

59

Page 72: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

i ' ; : : / : i i i i i i : : . :

atpnwdhi ' e: : i : . . i

Figure 5.2: Friction cone contains CG ( p > 0.154). Edge 0 will either remain statlonary or rotate about its right vertex for clockwise rotations of the palm.

of the system. One reason for this could be the frictional instability of a particular nominally stable edge. If one of the edge contacts rolls, rather than slides, the palms may follow a path which is entirely contained in the equivalence region according to the frictionless analysis, and yet the object may transit to another, unpredicted state. This was one of the reasons that the plans generated by the algorithm in the previous section would fail in practice.

Fortunately, frictional instabilities can easily be incorporated into the power set approach, with the additional assumption that the object will roll to the next stable edge and stay there, rather than tumble further beyond to yet another stable edge. Chapter 4 describcs an analysis for identifying edges which are potentially unstable with respect to the contact friction of the system. By knowing which edges will likely have rolling contacts, and in which direction they will roll, we can identify the additional states which may result for a given palm motion. For example? in the configuration shown in Figure 5.2, h = 1.226 and w, = 0.1886, hence = 0.154. If the system coeRcient of friction po > pc,it, then we know that when the polygon is resting on the left palm on edge b it will have a tendency to roll over the right vertex, onto edge a. Note that this example is the symmetric counterpart to the problem case in Figure 5.1.

While generating the transition graph for the power set of the object states, we take both (a? left) and ( b , left) as possible end states for motions which the frictionless analysis says should result in a transition to state (b , left). This covers both the possibilities that the object will either slide or roll. We can then search this graph for a homing scquencc. Because we incorporate thc possibility of both sliding and rolling contacts, the transition graph and any resulting homing sequences will be valid for any coefficient of friction from 0 to ~ 0 , For frictional coefficients higher than pa, the graph may no longer be valid, since edges which were assumed to always slide may become frictionally unstable.

60

Page 73: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

AI1 possible states ..............................

.......................

...... ........_.

Tilt CCW planner with fneiim

Figure 5.3: Example homing sequence

61

Page 74: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Goal State 1 (# successes)/(# trials) I

12/15

15/15

Table 5.1: Trials of homing sequences

5.2.1 Experimental Results

The planner was extended to take frictional instability under consideration. Figure 5.3 shows a homing sequence found for our example object, using the set of cone openings shown to build the arcs. The coefficient of friction, PO, was taken to be about 0.2. The sequence was rim with the object started in all ten of t,he possible starting conditions, and was successfully brought to the goal state from each initial state. Then the object was dropped into the palms, into an arbitrary initial state, and the sequence was executed. Out of 30 such trials, the object failcd to reach the desired goal state 4 times.

The planner attempted to find homing sequences to home the example object to all possible final states. However, it could only find sequences for four of the possible ten final states, even though only two of the edges of the object had a frictional instability for a coefficient of friction of 0.2. Each of these sequences was tested, as above. The results are sumniarized in Table 5.1.

Although orientation plans for the other six resting states of the object were not found, those which were found were quite repeatable, as shown in Table 5.1.

This version of the planner can also be used to find frictionally reliable paths from known initial states as well as from unknown ones. Instead of backchaining all the way back to the set of all states, the backchaining terminates upon reaching a node which contains the desired initial state.

We also evaluated the plan shown in line 1 of Table 5.1 with respect to manipulator calibra- tion errors, using the same set of calibrations as in Section 3.4.1. The results are summarized in Table 5.2.

Table 5.3 gives the maximum 6 error and its position over the control positions of the trajectory. The same comments apply here as in Chapter 3. Many errors werc from tight

62

Page 75: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Run I Left Palm I Right Palm I Success Rat,io

Run Nominal

1

3 4 5 6 7 8

2

Maximum 4 Error (degrees) .

Nominal Position (4, p) in radials

2.7884 (0.7725! 1.1845)

-16.8026 (0.7725, -1.1845) -1 1.2017 (0.7725, -1.1845) -19.6392 (0.7725, -1.1845) 0.3702 (0.7725 , 1.1845)

-19.6392 (0.7725, 1.1845) 22.4034 (0.7725, -1.1845)

-8.4011 (0.7725, -1.1845)

Table 5.3: Maximum deviation from nominal calibration for the plan in line 1 of Table 5.1 at different manipulator calibrations

squeezes and centrifugal force causing the part to fall from the palms. The failures due to the part landing in an unpredicted state were seen mostly in Runs 5, 7 and 8. For Run 8: in fact, all the failures were due to unpredicted states.

5.3 Is this Friction Model Adequate?

As discussed in Chapter 4, the friction model which we use in our planner is far from complete. One notable disadvantage is that larger feasible coefficients of Fiction translate directly into larger model uncertainty. The drawback to using this model of frictional uncertainty is that it can render certain parts unorientable. For instance, the planner cannot find a ~ l y homing sequences for our example part if the frictiou parameter is higher than 0.73. This is the value of ,ucrzt for which the side labelled a in Figure 5.2 becomes frictionally unstable on the right palm. Also, by taking only twwpoint contact into account, we cannot recognize situations where perhaps the third contact will prevent the part from rolling. More importantly, we cannot recognize jamming.

In principle, orientation plans for more resting states can probably by found by setting a tighter bound on the friction parameter used by the system (specifying an exact coefficient of friction, or a minimum as well as a maximum bound). A tighter bound would eliminate some

63

Page 76: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

of the uncertainty in the outcome of certain motions in our model. However, assuming an exact value for the coefficicnt of friction is a nontrivial assumption ~ Kao and Cutkosky riot,e that “the coefficient of friction can easily vary by 30% with changes in surface texture or cluanliness” [42j - which we believe will reduce the robustness of t.he resulting plans. As it is, the planner will produce fewer plans as the frictional upper bound increases, but the plans are guaranteed to be frictionally robust up to that value of friction. Similarly, by only considering the two points of contact that are guaranteed to occur for a part in a given equivalence region, we do not ha\.e to worry about the exact position of the part in the palms at any given moment. As we mention in Chapter 4, we have chosen to use friction independent criteria to find shhlc regions. The friction model we have chosen to use is only detailed enough to identify certain places where our frictionless planner model may break down, but no more.

Let us compare our treatment of friction with the models used in other systems. The two palm manipulation system described by Erdmann in [33] assumes an exact knowledge of the coefficient of friction. Starting with the part in a known pose, and known contact configuration with the palms, Erdmann’s system splits the orientation space of the palms into sectors, each of which causes the same qualitative behavior of the part (slide, roll, etc.). Palm orientation is taken with respect to the part frame, with the center of gravity fixed at the origin. This plan is then fed into a simulator to verify the predicted pose of the part in the palms, as well as the palm coordinates in the world frame. From the simulations the trajec.tory of the palms is determined, assuming perfectly known position of the part at every step.

A significant cause of plan failure is the slipping of a contact which is expected to rolll either because the coefficient of friction is not as the planner expected, or because of inaccuracies of the manipulators when executing a specified motion. All transitions are executed in two-point contact. However as the author himself notes, in twwpoint frictional contact, ”equilibrium contact is possible if and only if one of. ..the sliding modes is possible”[33]. Hence! the reliance on twwpoint contact frictional stable support, rather than more robust three point contact first- order stable support, results in a general brittleness of the reorientation plans. Such brittleness can of course be offset by the use of sensors to detect slipping, which brings up a host of other complexities which are happily avoided by the system presented in the present work.

Paljug, et.ai. ([66], (671) present just such a system. Their emphasis is on force-closure grasps which are not form-closure, and their specific example is two planar 3-degree-of-freedom manipulators using palms to grasp a large object in a gravitational field. Thcy are also intcrested in how these two robots can reposition the object in the palms without regrasping. The issue in these tasks is the trade-off between grasp (squeezing) force, which should be minimized, and grasp stability. Their method of determining stable grasps depends on the presenc.e of friction (in that the contacts are expected not to slip), but is independent of the value of the coefficicnt of friction.

The arms are instrumented with tactile sensors on the palms to detect the contact point,; one of the arms also has a force/torque sensor at its wrist. In order to maintain the stability of the grasp, they specifically disallow slipping: that is, they try to hold the object in such a way that the contact normals are always in the interior of the friction cones. In order to maintain the objcct in the aggregate friction cone without having to know the exact Coefficient of friction? the planner (or grasp controller) constrains the normal of the palm to be aligned with the surface normal a t the contact. This requires that the surface geometry be known, at least in the neighborhood of the nominal contact points; also, the resulting nonlinear equations which must be solved by the planner are generally not solvable in closed form for geometries

64

Page 77: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

more complicated than spheres or cylinders. A more significant problem is that. a t le& for the cxperirnental setup described in 1671, orientation error and local surface normal are not directly sensed, but derived from other sensory measurements. The input needed for feedback is hence rather noisy. Their experimental work suggests that i n order for plans to succeed, the coefficient of friction must be large in order to tolerate large errors in palm orientation (with respect to the contact normal). If the crrors in palm orientation exceed the angle of the friction cone, the contacts will slip, and the grasp can be lost. Conversely, the actual initial conditions of t,he object in the plans must be close to the nominal initial conditions in order to keep palm orientation error at a minimum. Again, part of the problem was that the object used in the experiment was a sphere; so manipulation was again performed using two-point rather than three point contact; the system would no doubt be more effective on polyhedral parts. The experiments with the sphere show that while sensors can get you out of some of the difficulties of frictional uncertainty, they are not a complete cure for the problem.

In his dissertation, Lynch 1541 uses a technique somewhat complementary to ours in dealing with frictional uncertainty. Using a one-degreeof-freedom arm, he tries to find a manipulator trajectory which brings a part from a known initial state to a goal state by executing a sequence of dynamic and stable grasps, throws, rolls and catches. He implicitly models the contacts as having infinite friction; rolls are modeled as rotation about a pin joint. The surface of the arm is covered with a stiff foam to insure high friction contacts. The trajectory planning problem is formulated as a nonlinear constrained optimization problem over the space of manipulator acceleration profiles, with the initial and goal states of the part as input, and the Coefficient of friction ns a parameter to be minimized. The no-slip constraint is explicit in the problem formulation. The result is an open-loop manipulator trajectory which executes the desired reorientation and is maximally robust to friction, with respect to the no-slip assumption. Since the number of contacts is known at any state of the manipulation (two for a grasp, one for a roll? zero for a throw), Lynch was able to use the complete Coulomb model of friction in his planner. However, the planner had to directly simulate every trajectory which was evaluated during the optimization procedure, so the process of finding a reorientation plan was more computationally intensive than that used in our system. In empirical trials, the majority of problems seemed to be caused by the unmodeled compliance of the foam which lined the arm, and unmodelcd motor frequency response. This was especially true of throws, where a small error in the release state can be exacerbated during the ballistic phase, leading to systematic errors in the final state. There did not seem to be serious errors due to slipping, although slipping did in fact sonietimes occur.

From the examples of these three systems, in addition to our own system, one can see that there is a certain advantage to assuming an extreme situation with respect to the coefficient of friction - either no Fiction, or infinite Fiction. Of course, one must make sure that the environment is a reasonable approximation to whichever assumption one makes, and t,hat the reorientation plans one uses are tolerant of minor violations of that assumption.

Another drawback to our friction model is that we do not specify whether we are in two or three point contact when we are looking at the (frictional) contacts. Because of this. we cannot identify configurations in a frictionally unstable equivalence region which would not roll to another state because the third contact prevents this. We also cannot identify configiirations which could jam, due to friction. On the other hand, we do not know the exact cont,act configuration at all times; we do not know the exact palm trajectories until after we have found the plan ( ; .e . , the path through the graph), and even when we know the palm trajectories, we

65

Page 78: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

do not know the exact position of the part in the palms at all times during the exccut,ion of the plan. Thc part could be in two point contact when we assume it to be in three point contact, or vice versa. Rather than determining the part’s behavior cxactly under these circumstances. it stems better to identify potential violations of the all sliding assumption, when we can. We can also attempt to avoid potential jamming situations by minimizing the contact friction as much as we can, and perhaps putting a lower bound on the relative angle between the palms.

We close with another statement by Kao and Cutkosky:

Errors in modeling contact conditions and friction limit surface are more serious than short term violations of quasistatic motion [namely, stick-slip, inertial and viscous effects, so long as those effects are small on average: “short in duration, zero-niean and uncorrelated over the duration of the trajectory”[43]]. Fortunately, the sensitivity of the direction of sliding motion is low except when ... [the tangentid contact force] f, x 0. 143)

This is part of the conclusion of an exploration of the quantitative predictive power of the quasistatic model for dextrous manipulation (as the authors point out-and we have also pointed out, in Chapter 2-most quasistatic motion planning is primarily qualitative in its predictions). However, we believe that it is still a valid statement in our context, in that relying on an exact value for the coefficient of friction may not lead to reliable plans, if the estimated value is not correct. To the extent that we use imprecise knowledge of the coefficient of friction, or of the contact conditions, we will be unable to find optimal plans; perhaps we will not be able to find a plan at all. However, whatever plans we do find will be less likely to fail due to modelling error.

66

Page 79: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Chapter 6

Dynamics and Impact

There can be no space nor any part of space without gravitational potentials; for these confer upon space its metrical qualities, without which it cannot be imagined at all.

Albert Einstein Ether and Reiatauity [31]

When the velocities of the system are larger than the quasistatic bounds: forces and ve- locities are no longer in as close correspondence as has been assumed in the previous scctions. Centripetal and coriolis effects niay begin to be significant. In addition, nonzero relative ve- locities generate impact forces as contacts are made. We would like conditions on the relative motion of the hand and object such that the hand aquires the object. We would further like the position of the object in the gripper to be known, that is, the part comes to rest, in the palm in a predictable position, rather than tumbling to another position.

In this chapter, we will look at some conservative approximations which can be iised to estimate bounds on the manipulator velocity, in order to minimize dynamic effects. In addition to assuming knowledge of the CG and radius of gyration, we will use a rigid body impulsive impact model, as described by [XO] and used by (931, [94], and [98], with the mass of the hand being much greater than the mass of the object, so that the change in velocity due to collision takes place entirely in the motion of the object, and the motion of the hand is undected. We will also aSsume that at the moment of impact, the dominant force is the impact force.

6.1 Impact

We will show that taking into account the energy dissipation due to inelasticity of collisions can help us to bound the effects of impact forces on our system.

The object is parameterized by (q,z,,,pB), where (q,zn) are the coordinates of the center of gravity of the object with respect to the reference frame aligned with the contacting palm (see Figure 6.1) , 0 is thc orientation of the object, and p is thc radius of gyration of the object ([32]). For simplicity, at contact, we can abstract away the dimensions of the actual object! and think of the object as a rod, whose center of gravity is the same as the center of gravity of fhe object, located at length I from the contact point. The angle from the contact normal to the rod of length d in the counterclockwise direction will be called C.

67

Page 80: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Y

Figure 6.1: System Geometry

6.1.1 The Frictionless Case

We first look at the simplest case, where the contact Giction and the support friction are both zero. In this case, the equation describing the change in velocity at impact in terms of the preimpact velocity v- = Is,, i;, &IT is

AV = -(I + e)(iiTv-)fi (6.1)

(see Chapter 2), where e is the coefficient of restitution and

Upon impact, the contact point will bounce away from the hand, but we would like the object as a whole not to move away. One consideration is the energy constraints of the system. As a concrete example, let us look at what happens if we make a pure tilt transition from one equivalence region to another. As we make that transition, there is a brief interval of time during which the object loses stable contact with the palm, and falls into another stable contact configuration under the influence of gravity. We will model theinstant it attains the new stable contact &s an impulse. For the example in Figure (6.2), suppose that the cone has been rotating counterclockwise with an angular velocity w",,,,, and up until the moment portrayed in (6.2a)! the object has been tracking the movement of the cone. At the moment shown, the object is just about to lose stability, and will tilt into the preimage of the position shown in (6.2h). (The cone is at rest in (6.Zb). It is possible that the object will continue to rotate beyond the desired position. In order for that to happen, it must have enough energy to escape the potential well of the desired final resting position: in other words, E > m g a , where m is the mass of the object, g is the gravitational acceleration, and v% is the distance from the CG to the impacting (in this case, right) vertex of the object. To gain a little leeway, we can take advantage of energy

68

Page 81: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

(hl

Figure 6.2: Impact example

lost due to collisions. What we would like, then, is for enough energy to be lost after the first bounce' for the object to be trapped in the correct energy valley.

6.1.2 Energy loss from collision: one bounce

Assuming no friction, we can look at the impact in configuration space. The impact and rebound will occur in a plane, and we can characterize the impact by the direction of the contact normal and its perpendicular in that plane. Define a to be the angle the velocity vector makes with thc cspace normal at impact, CCW (actually, the negative of the velocity vector, so we get the small angle). Let v,, = nTv-n be the cspace normal velocity. and P), he its magnitude. Lct vt be the vector v- - v,,, and ut be its magnitude. vt is perpendicular to v,, so we get

a = arctan(wt, -w;). (6.3)

v t will be unaffected by the impact, and w,+ = --ev,-. If we "dimensionalize" hy (ua)- (Le. let it be of unit length) then tit- = tan a, sa

I I V - I I ~ = 1 + t a n 2 a

llV+1I2 = e' + tan' a. (6.4)

(See Figure 6.3.) Then

e' + tan' a 1 + tan2 (Y

~- llV+1l2 - llv- 112

= sin2 a + e' cos' a. (6.5)

'In fact, the first impact will impart a counterclockwise impulse on the object, which will not cause it to go imstable. So we could actually look at the energy lost after the second impact, if we could predict what. that impact would be. But it is eacier, and more conssrwtive, to simply look at the first impulse.

69

Page 82: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 6.3: v- and v+ in configuration space

or, in terms of the energy of the system, the proportion of kinetic energy retained by the system after impact (Figure 6.4 ) is

pK(a) = sin a + e cos a. (6.6) 2 2 2

This relation depends only on a, independent of the actual cspace normal, or the orientation of the object at impact. The energy, however, depends on the configuration of object. The CG of the object will be at a specific height (and thus, a spedic potential energy) for a given impact configuration (x = x, y, p8) (in world coordinates). Call the potential energy function P(x). Then

where To return to the example in Figure (6.2), let us assume that after the object loses stability,

the manipulator no longer imparts velocity to the object. This is reasonable, since the only contact is the object vertex to the cone vertex. Let us also assume, for the purposcs of empha- sizing the impact analysis, that centrifugal forces are negligible, in other words that the object will not go sliding up the left palm due to centrifugal forces. This is equivalent to supposing that the initial state of the cone and object were just slightly countcrclockwise of the position shown in Figure (6.2a), with zero initial velocity. The energy of the object as it loses stability is

(6.8)

The first term is the potential energy, the second term is the translational kinetic energy im- parted to the object by the rotating left palm, and the third term is the rotational kinetic

may be a function of x.

1 2 2 1 2 2

E, = mgv% + -13mw2,,, + -mp w

70

Page 83: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 6.4: Percent of Kinetic Energy retained aftcr collision

energy. p is the radius of gyration of the object. We will assume the objcct’s mass to be uniformly distributed; then p2 = 4.33

Upon making contact (Figure (6.2b)); the energy is

Ef- = 3mg + ( -13mw2,,, + -mp w (6.9) 1 1 2 2

i- mg(& - 3)) 2 2 The first term is again the potential energy. The second term is the kinetic energy, represented here as the initial kinetic energy plus the difference in the final and initial potcntial energies. Fkom equation (6.6): the energy remaining immediately after impact is thcn

1 2

(6.10) E ~ + = 3mg+ (s in2n+e2cosZa)( -pra(13+pZ)w2, , , i-mg(v“E-3)).

In order for the object to be caught in the correct energy valley. we want EJ+ < a m g .

effects) is then determined by the equation The answer to thc question “how slow is quasistatic?” (neglecting centrifugal and momentum

(1 - 2) cos2 a 2 ( a - 3)g w 2 men < . (6.11)

sin2 a + e2 cos2 a 13 + p2

For this system, COSCY = 0.148839, so a = 1.4214. Figure 6.5 shows the plot of thc square root of Equation (6.11) as a function of e.

In principle, this analysis can be extended to form the “n-bounce preimages” of each stable resting state, for arbitrary n. To extend it in this way, beyond n = 2, however, will cost more complex computation, of decreasing additional utility.

6.2 Other Dynamic Effects

Other velocity effects can arise from centrifugal or Coriolis forces; such as the object being thrown from the palms. As a simple example, suppose we have a point mass resting on onc of

71

Page 84: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 6.5: Graph of maximum w,,, as a function of e.

the (frictionless) palms. Set a kame fixed to the palm, with the origin at the hinge point, and the I: axis along the palm. The y axis points normal to the palm, towards the point mass. The palm rotates with a constant velocity, w . At time t = 0: the palm is in orientation Bo. Using the formulas for Lagrange’s equations in a rotating frame [83], we can derive the equations of the point mass.

6.2.1

For a system with N independent generalized coordinates and M constraints: Lagrange’s equa- tions of motion are given by the N equations, each of the form

Lagrange’s equations in a rotating frame

(6.12)

where qk are the N generalized coordinates, T is the kinetic energy of the system: Q k are the generalized forces on the system, X i are the M (unknown) Lagrange multipliers, and ajk are the coefficients of the M constraint relations

1v

ajiqi = 0, for j = 1 to M . i

(6.13)

If the system coordinates are in a frame which is rotating with respect to a fixed world frame, there are an additional three degrees of freedom associated with the motion of the rotating frame: (zo, yo? 8). There are also an additional three equations of motion [83]:

(6.14)

72

Page 85: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

where (E F,, Fg, C M) are the total forces and moments acting on the origin of the rotating axis.

For a point mass in the cone frame, there are two generalized coordinates, (qz, qy ) , taken with respect to the cone’s center of rotation, which are the position of the mass radially out on the palm and out along the normal to the palm, respectively (In other words, the palm is always parallel to the qr axis). There is also one constraint,

qy 2 0. (6.15)

The kinetic energy of the point mass (expressed in world coordinates) is

1 2

T = -m(P + $). (6.16)

The conversion from cone frame coordinates to world frame coordinates is given by

cos(00 + ut) - sin(80 + ut) ) ( ; ) (6.17)

cos(& + w t ) -sin(& + ut) (:) = ( sin(& +ut) cos(& + w t )

- sintoo + wt ) - C O S ( B ~ +ut) ) ( E ) (6.18)

The generalized forces on the system are given by

sin(eo + ut) Q = -w( cos(B0 +ut) (6.19)

F = O (6.20)

Plugging Equations 6.17 and 6.18 into the expression for T , Equation 6.16, and differen- tiating that expression according to Equations 6.12 and 6.14, results in an expression for the motion of the point mass in the rotating cone frame:

(6.21) (6.22)

X represents the contact force exerted on the point mass by the palm. If contact breaks, X = 0. Otherwise, qy = qy = qv = 0

Suppose, for example, the maw begins in a stationary state rest,ing on one of the palms at location (qz> 0) , as the palms begin to rotate. By Equation 6.21, there is a force q,w2 which moves the mass radially outward. If either qz or w is high enough, the mass can slide completely off the palm, as shown in Figure 6.6s. If the object does not slide off the palm, gravity can then pull the object back radially inward towards the vertcx. The object will then slide all the way down, transforming its initial potential energy into kinetic energy. This can cause it to continue sliding when it contacts the other palm, sometimes sliding off the palm, as shown in Figure 6.6b. More often, however, (in the case of objects with a rotational degree of freedom) the impact wit.h the other palm can transfer the kinetic energy from translational to rotational motion of the object, and the object may tumble and rotate in a way not predicted by the planner.

73

Page 86: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

2 acc rad = r 0

A

B

Figure 6.6: A: In the cone frame, the mass experiences a force radially outward as the cone rotates. If the radially outward component of the force on the mass dominates any forces radially inward (such as gravity), the part may fly off the palm. B: If the energy of the mass at the end of the motion is too high, when the part slides down the palm, much of its energy (minus what is lost in the impact and what is converted to rotational velocity) will be converted into sliding motion: and the part may slide off the palm. Part of the energy will be converted to rotational motion as well, and the part may rotate away from the desired edge.

74

Page 87: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

6.2.2

We will extend the example from Section 6.1.2, again using the configuration in Figure 6.2. This time we will analyze a complete but simplified transition motion, starting with the object at rest on the left palm. The palm then tilts with constant rotational velocity until t~he right palm is horizontal, stops, and waits for one second. The object then complctes any further motion under only the influence of gravity. Because we are only looking for an estimation of the gross behavior of the part, we will treat the object as a point mass on the left palm during its centrifugal motion, and ignore any flight phase due to the sudden deceleration of the palms (in other words, we assume that the object is always in contact with the palm).

The cone opening is 4 = r / 2 + arctan 2/3. This cone opening was chosen so that with the object resting on the left palm as in Figure 6.2, and the right palm horizontal, the contact normal with the right palm passes through the CG of the object. This will simplify the equations.

Let the units of measurement for this example be centimeters: and the origin of the world frame be the vertex of the cone. Imagine that we start with the object at rest on the horizontal left palm, five centimeters from the vertex of the cone (qs = -5 cm,qy = 0). The coefficient of restitution is e = 0.1. The gravitational acceleration is g = 98 cm/s', or one-tenth of the usiial gravitational acceleration. We do not want the object to fly off the edge of the left palm from centrifugal forces. We do want the object to transit to the configuration shown in Figure 6.2(b), without tumbling away. We wish to know how fast we can rotate the palms and still meet these two constraints. We will assume that the angular velocity of the palms, w, is constant throughout the tilting motion.

If we take the friction of the palm into account, with coefficient of friction p , thu equation for the radial acceleration of a point mass (assuming qy = qy = 0) is given by

An Example with a Complete Transition Motion

The term X comes from the force normal to the palm which the point mass experiences due to gravity and Coriolis forces.

We can integrate' Equation 6.23, assuming that the point mass never breaks contact with the palm. We will use a coefficient of friction f i = 0.2, and a coefficient of restitution of 0.1, to estimate how much velocity is lost when the point mass hits the right palm. Using various values of w, we find, for instance, that using a value of w = -2 rad/sec, that the mass will come to rest almost 6 centimeters out on the right palm (u is negative, because the rotation is clockwise). For w = -1 rad/sec, the mass comm to rest about 5 centimeters out on the right palm, and for w = -0.5 rad/sec, the mass comes to rest about 1 centimeter out on the right palm. See Figure 6.7.

Returning to the problemof our example rectangle from Section 6.1.2, we shall assume that our point inass analysis conservatively estimates the sliding behavior of the rectangle. For the an object with extent, some of the encrgy will go into rotational motion, as well as sliding. We still need to check that the object does not tumble away from the desired orientation, shown in Figure 6.2b. Let us take w = -0.5 rad/sec. Suppose the rectangle as oriented in

'A11 nuniericd integrations in this section were done using the second and third order Rungc-Kutta routine in MATLAB (ODE23).

75

Page 88: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 6.7: Radial motion of a point mass on a cone with 6 = 2.1588, tilting clockwise at -2.. -1, and -0.5 rad/sec respectively. In each case the mass starts at rest on a horizontal left palm; 5 centimeters from the cone vertex.

Figure 6.2b is 7.5 cm tall, 5 cm wide; this is in the same proportions as the rectangle in the figure. The rectangle will make contact with the right palm when q2 = -3.75 cni. This occurs approximately at thit = 1.4 sec. Since this is less than the time it takes for the right palni to reach the horizontal, the cone is still rotating. From our numerical integration, we can determine qx and 42. Using Equations (6.17) and (6.18), assuming that qu = 2.5 cm., and (i, = 0, we can determine the position and velocity of the rectangle's center of gravity (in configuration space):

( ) = ( -63:) cm (6.24)

(6.25)

80 + W t h i t -0.72

16.18 ( ) = ( -!:::) cm/sec.

The potential energy of the rectangle at impact P = mg y = 426m, in units of g-cm2/sec2. The kinetic energy K = $nxTx = 220m. The right palm at the moment of impact is oriented at 8 = 0.265 with respect to the world frame. Because we have chosen 4 so that the contact normal of the right palm on impact passes through the center of gravity, as in Figure 62a, the contact normal is given by = [-0.2620.965 O]*. Hence, the impact angle y = 2.5. The energy remaining after impact (using a coefficient of restitution e = 0.1) is given by:

Et = P + pK(y)K, (6.26)

where pK(y) (see Equation (6.6)) gives the percent of kinetic energy remaining after impact as a function of impact angle and coefficient of restitution. Plugging in all the numbers from our example into Equation (6.26), we determine that E+ = 502m. The energy barrier which

76

Page 89: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

must be Overcome to tumble to a new resting configuration is Eburri~,. = n z g m = 442 m. Therefore, using a cone rotation velocity of -0.5 rad/sec, it is still possible that, thc the part can tumble away from the desired orient,ation shown in Figure 6.2b.

Thcse estimates are quite conservative, and when we try this rotation on the alr table, we find that we can use a manipulator velocity of up to about 2 radlsec in magnitude. and the reorientation succeeds. There are other reorientations which will not succeed with a manipulator vclocity this high. In practice, we have found approximately 0.4 to 0.5 rad/sec to he a fairly safe range of rotational velocity for most of the trajectories we have tested.

77

Page 90: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

78

Page 91: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Chapter 7

Theoretical Results

... out of the pictures which are all that we can really see, we imagine a world of solid things ... this world is constructed so as to fulfill a certain code of rules, some called axioms, and some called definitions, and some called postulates, and some =sumed in the course of demonstration ... .

William Kingdon Clifford The Postulates of the Science of Space. 1872 [29]

In this chapter, we present the proofs of results used in previous chapters. All of these proofs refer to the frictionless version of the planner.

7.1 Connectedness of Equivalence Regions

First, we present some results on the connectedness of the equivalence rcgions, and on the decomposition of manipulator trajectories. Once a high level path from start to goal has been found by searching the state transition graph, this high level path must be instantiated as a specific trajectory for the palms to follow. We will show that all manipulator trajectories can be composed from two simple types of motions.

By a connected region we mean a region X such that if q E X and z.2 E X : there is a curve segment whose endpoints are q and zzl and which is completely contained in X . By a simply connected region, we mean a connected region X without holes. More formally, il simply connected region is a connected region X that can be continuously shrunk to a single point.

A stable edge of an object is an edge on which the object can rest on a horizontal palm, unsupported by the other palm, without tipping over? in the face of small disturbances. In other words, a stable edge is an edge e, such that, if one were to project the center of gravity onto e,, this projection would lie in the interior of the line segment e,.

In this chapter, except where noted, we will assume that we have palms of infinite length; in other words, that the palms are much longer than the object, so that arbitrarily small cone opcnings arc feasible. We will also aSsume frictionless contact.

Let S be an equivalence region corresponding to a stable edge, and p , q be points in S.

Theorem 1 S and its projection d o the (d, p ) plane are simply connected

First we recall the description of S from Chapter 3:

79

Page 92: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

EaUIVALENCE REGION SHADOW FOR 'SIDE A. LEFT PALM' 1.5

1

0.5

: o m

-0.5

-1

-1.5 0 0.5 1 1.5 2 2.5 3 3.5

PHI

Figure 7.1: An example S

€ ae = i . a ~ - - . a $ 2

E = -1; resting on left palm 1, resting on right palm

over the range 'Ps of ($,@) for which the object remains stably supported

(7.1)

The expression for 6' describes a continuous, one to one and onto mapping from Ps to S. Its inverse is simply the projection operation n(#, /3, e) = ($, p), which is also continuous. Hencc S and Ps are homeomorphic to each other ((111). Homeomorphisms preserve topological properties such as simple connectedness, so S and Ps are topologically indistinguishable. In the following, we will use the notation S to refer either to an equivalence region corresponding to a stable edge, or its projection into the (6, 8) plane.

In order to prove Theorem 1, we will need the following lemmas. First, we need to show that if a planar set is made up of cross sections which are themselves connected sets (line intervals), and all of the cross sections are connected to each other, then that set is simply connccterl.

Lemma 2 Let S C R', and let Sd = {(z, y) E Slz = #} C 92 be the $-cross sections of S. Let Z be an interval in 8. If:

There exists Q function A,) : 1 ct $2' such that f($) E Sd and 8.) is continuous.

All S, are themselves connected (line intervals);

snzx$2=s

then S is simply connected

80

Page 93: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

X

Figure 7.2: Contact normals and gravity vector in cone frame.

Given a feasible value for 6, the function f picks a point from the &cross section, S,, and does this in a continuous manner as 4 is varied. The last condition of the theorem simply guarantces that we pick our interval Z long enough that f exists in all the +cross sections of S.

Proof: (Lemma 2) First, we prove connectedness. Let p = (pz,py),q = (yz,q,) t S. We wish to show that there is a path between p and q7 entirely contained in S. If p , = qz, then by hypothesis, we are done. Otherwise, we look at the c a e p , # q,. We know that there exists a connected path from f(pz) to f(4%); namely, the f-image of the interval [pz, yz]. By composing this path with the path from p, to f ( p Z ) , and the path from f ( y z ) to qr> we have a complete path satisfying our requirements, and so S is connected.

Next, we will prove simple connectedness. The mapping

g(z,y,t)= ( 1 - f ) ( s c , 3 ) + t f ( z )

continuously deforms the region S into the curve f(z) as t varies from 0 to 1. By the continnity o f f , this curve can be shrunk to a single point, and we are done. 0

We now need to show that our set S is, in fact, made up of connected &cross sections, in this case cross sections formed by constant cone openings. Then we need t,o show the existence of an appropriate function f .

Lemma 3 FOT a particular equivalence region s, and the cone Cone(&,, p), with fixed 40, the range of fo r which ( $ 0 , p) E S is an interval in 32.

Phrased more simply: If we hold the opening of the cone h e d , with the object in a stable position within the cone, we can tilt the cone in a ccrtain range of 0, and the object will stay in the same stable fixed position relative to the cone frame. The range of 0 for which the object is stable in that particular orientation is an interval. Hence, the &cross sections of S are also intervals.

Proof: (Lcmma 3) With respect to the cone frame, the contact normals in configura- tion space are fixed, and the negative of the applied force due to gravity, -c(aj: varies

81

Page 94: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

n - ( X I 2 +$I2 t p)

Figure 7.3: Orientation of left and right p a l m

lsinp cosp 01 (Figure 7.2). Note that 0 is constrained to lie between -n/2 a id n/2. Hence,G is a one-to-one function of p. The condition for stability is then that -G(P) be expressible ar a nonnegative combination of the contact normals, i.e. that -G(P) be contained in the cone in force-torque space formed by the contact normals. The trajectory of -G(,Oi) is an arc of a circle, and so its intersection with the cone is closed and connected. Hence, the rangc of stable j3 is an interval, by the continuity of G. 0

Lemma 4 The function f(4) = (4, - E - ) where E = -1 i f the object i s resting on the left = . ' palm, E = 1 the object is resting on the nght palm, i s defined on the half-open intered (0, n], and satisfies the conditions in Lemma 2.

Proof: (Lemma 4) If a cone is in the configuration (4,0), it. is easy to show (see Figure 7.3) that the left palm makes an angle + p with the horizontal axis, and the right palm makes an angle 9 +p. If E = -1! then at the point f(& the left palm is a t an angle + 9 = T, If c = 1, then at the point f($), the right palm is at an angle 9 - 9 = 0. In either case, the palm on which the object is resting is horizontal, and since the resting edge is, by hypothesis, stable, f($) E So, over the interval 0 < # 5 n, and f(#) is obviously continuous.

Wc note that the cone opening 6 must lie in the half-open interval (0, n]; hencc if we pick this our i n t , e rd I, we have satisfied the third condition of Thcorem 1. The proof that S is simply connected is then a straightforward application of Lemmas 2,3, and 4.

7.2 Sufficiency of pure tilts and fixed4 squeezes for plan exe- cution

We will aSsume that the palms have at least sufficient freedom to open flat (Cone(n,O)), and that they have symmetric rotational freedom. We will also assume that the palms havc infinitc extent.

82

Page 95: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

A. + = 2.75. B = 0.1%

Figure 7.4: Different contact formations which are in the same equivalent region

In the following, let E = 1 if S is an equivalence region corresponding to the object resting on the right palm Let E = -1 if the object is resting on the left palm.

Theorem 5 (Pure Tilts) I f p = (pz,py),q = (q3,qv) E S, ond pz = qz = 4, then the lire segment 1- i s completely contained in S.

In other words, if p , q are both in S, and both correspond to points with the same cone opening 4, then the pure tilt motion between them preserves the stable configuration of the part. This follows directly from Lemma 3.

Unfortunately, equivalence regions are not in general convex: if ,O is held constant and 4 varied, the intersection of that line with the shadow of S will not in general be an interval (see Figure 7.1).

In addition to pure tilts ($ constant, ,O varying) and pure squeezes (0 constant, 4 varying), there is another type of simple movement of the palms related to pure squeezes: a fixed-6 squeeze. In a fixed-0 squeeze, the palm making edge contact with the object stays fixed, and the other palm opens and closes, resulting in the cone configuration changing, but the object orientation relative to the world frame remaining 6xed as long as the state is stable. In the parameter space, this corresponds to = €4, where E = -1 for the left palm held fixed, 1 for the right palm held fixed. Like a pure tilt, a 6x4-0 squeeze between two (appropriately collincar) points in S will be completely contained in the equivalence region, subject to the following constraint.

Recall that an equivalence region is defined by the stable edge contact between a particular edge and a. given palm, without considering the third contact with the other palm Herlcc, an equivalence region can further be separated into smaller vertex-equivalent subregions, where in each subregion the contact formation is the same. For example, for an equivalence region corresponding to the right palm making contact with edge a, one snbregion could correspond to the left palm making (one point) contact with vertex c, and another subregion could corre- spond to the left palm making contact with vertex d, etc. In Figure 7.4, the top and middle

83

Page 96: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 7.5: Contact normals and gravity vector in realspace.

configurations correspond to points in two different subregions of the region represented in Fig- ure 7.1. (In the top pose, the object vertex which is in the vertex of the conc is making two point contact: contact simultaneously with both palms.) We will show that a fixed4 squeeze is completely contained in S if its endpoints are in the same subregion of S. Note that a point in S of four-point contact (as in the bottom configuration of figure 3.5) is in the closure of two different subregions (possibly even two different regions), but will not be considered to be a member of either region for the purposes of the next theorem.

Theorem 6 (Fixed-8 Squeezes) u p , q E S , p and q are wertex-equivalent, and p 7 has slope 2 = E:, then is compfeteiy contained in S.

Proof: Without loss of generality, assume that the left palm is making edge contact with a particular edge of the object, and the right palm is making one point contact with a vertex. Let f i ~ l , f i ~ z be the (force-torque) contact normals of the left palm in configuration space, and ? L R be the contact normal of the right palm. Let G be the force vector corresponding to gravity. See Figure (7.5). If f i ~ 1 , r i ~ z . G are coplanar (which is true when the left palm is horizontal), the stability of the object is independent of the right palm, and the theorem is immediately true. Thcrefore, we will only consider the case where ??,I, 6 ~ 2 , G are in general position. By the definition of a fixed-8 squeeze, h~ l ,??~z , and G are fixed, and r i ~ varies with 4. The stability criterion is that -G is in the positive span of ALL, n ~ z , and r i ~ :

(7.2)

k.3 is strictly positive because ?LLI,~LLZ, and G are linearly independent. This equation can be rewritten:

84

Page 97: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

So, thc fixed4 squeeze will correspond to a line segment in ($, 0) space which is entirely contained in (the projection of) S if and only if the trajectory swept out by 4~ only enters and leaves the cone formed by f ? ~ 1 , f t ~ 2 , and G at most once each.

In the frame with the left palm aligned with the z axis, and the object center of gravity as the origin, f i ~ = [-sin$, -COS$, -r,cos$ + rysin$], as $ varies from 0 to T . [rz,rv] is the (fixed) vector from the CG t,o the vertex in contact with the right palm. The condition for stability is then

Notice that as $ varies, the curve swept out by - 6 ~ lies in a plane P in forcetorque space which goes through the origin. The intersection of this plane with the cone described by [ f q l f i ~ 2 GI is either only the origin, in which cme we are done, or else the intersection is a two dimensional cone in P. We wish to show that - f ? ~ only enters and leaves this cone at most once each.

The plane P CUI be rotated into the (z, y) plane by the full rank transformation

(7.5)

which fnnctions as a projection into the (z, y) plane for all points in P. Therefore the stability criterion is that the circular arc [sin 4 COS $1 only pass in and out of a cone at most once each. Since the trajectory of - f i ~ does not make a full revolution, this is clearly true, and wc are done. 0

Since subregions of a given equivalence region will have as the boundary between them a region of four point contact which is in the closure of both subregions, we can transit from one subregion to another by doing a fixed4 squeeze to take us to the four point contact region, and then another fixed4 squeeze into the new subregion.

Theorem 7 For the equivalence regions a j cone with palms of equal finite length: but o full 180 degrees of rotational freedom for each palm, Theorems 5 and 6 still hnld.

Proof: For a cone, finite palm length corresponds to a lower bound on possible $, but not of possible 0 for a given possible $. In other words, the new boundary of the equivalence region

85

Page 98: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 7.6: Trajectory decomposition

is a line of the form q5 = constant. Therefore, the pure tilt and pure squeeze properties still hold. 0

Armed with Theorems 5, 6, and 7, we can now see that for our manipulator, we can plan motions from one boundary point to another by finding piecewise linear (in (q5> 0) space) motions composed of pure tilts and k e d - 8 squeezes, without having to keep track of anything except the valid range of /3 which is contained in S for each q5.

In fact, for an object which has all statically stable sides, we know that all the equivalence regions contain the point corresponding to the cone Cone(x,O): in other words, the cntire line (call it the “baseline”) corresponding to the bottom palm being horizontal i4 contained in each equivalence region. The baseline is the edge of the equivalence region which corresponds to the line o($) = E?, where E = 1 for the object resting on the left palm, -1 for the object resting on khe right palm. So, for any start point and any subgoal point in an equivalence region corresponding to a stable edge, one of the following is true:

a There is a pure tilt connecting the two points, or there is a fixed-6 squeeze connecting the two points. Then there is a single operation that will bring you from the start state to the subgoal state.

If there is not a pure tilt or &xed-8 squeeze connecting the two points, then draw the pure tilt line from the start state to the baseline, and the puce tilt line from the goal state to the baseline. These are both guaranteed to be contained in the shadow of the cqiiivalcnce region by Theorem 5. There will be some line (a fixed-8 line) contained in S which is parallel to the baseline and which passes through thesc two pure tilt lines. (At the very least: the baseline will satisfy this requirement). See Figure 7.6. Therefore, the subgoal can be achieved from the start state in at most two tilts and one fixed-0 squeeze.

For an unstable edge, equivalence regions as we have defined them are no longer connected. However, in each component of the equivalence region, the above results about pure tilts and fixed-8 squeezes still hold.

86

Page 99: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

The results are summarized below.

Theorem 8 (Path Planning) Given any two points in an equiualence region S corresponding to a stable edge of a polygon P, there exists a path entirely contained in S . which can be decomposed into at most two tilts and one $xed-8 squeeze.

If the equivalence region does not correspond to a stable edge, but the two points are in the same component of the equimlence region, there still exists a path between the two points composed only of puw tilts and fized-0 squeezes which is entirely contained in that com.ponent.

Therefore, i f thew exists a path from an arbitmry start state to an arbitrary end state, where the transitions between equivalence regions are given by pure tilt motions, th.e entire path between the start state and the god state can be decomposed naturally into pure tilts and fixed-8 squeezes.

7.3 Existence of Plans

For planning paths from known start states, breadth-first search over the transition graph associated with a part will find a minimal length reorientation plan, assuming the plan exists. For a part with all stable edges, a reorientation plan between any two stable states exists if and only if the transition graph is strongly connected. A strongly connected graph is one where there is a directed path from any node to any other node. For a part with some unstable edges we would like there to be a directed path from any stable edge on either palm to any other stable edge on either palm. We can say in this case? that the subgraph of nodes of the transition graph corresponding to the stable edges of the part is a strongly connected component of the transition graph. In either case, if the stable states of a polygon P form a strongly connected component of the transition graph, we will call P orientable. An arbitrary polygon P is not always orientable. Consider the triangle in Figure 7.7. If the sliding transfer motion is possible ( i .e . bidirectional arcs from the equivalence region (edge, left) to (edge,right)), then the graph is strongly connected. If these sliding motions are not possible, then the graph is disconnected int,o three clique-pairs. We present some conditions which are sufficient to determine whether a part P is orientable.

Let us orient the edges of the polygon so that edge eil is a ray whose origin is vcrtex vi, and the vertices (and edges) are ordered counterclockwise with respect to the center of gravity. When the polygon is in a fixed position [say 8 = 0), each edge e< then forms an angle ai with the horizontal. Then the relative angle between edges e i , and e3 can be defined to be ai, = aj -ai. See Figure 7.8.

Lemma 9 For a cone with infinite length palms, suppose polygon P is resting stably o n edge eo on the left palm. Let the right palm make contact with vertex uk. Let the vector from the center of gmwity of P to uertez VI: be vk, and $Lk be the cone opening such that the right palm is perpendicular to vk. Then:

FOT all cone openings such that q5Lk+l < 6 < &Lk, P will rotate to edge ek on the right palm, upon executing a pure clockwise fdt. If ek ds stable, the part will stay in that configuration.

'In the subscripts for polygon edges or vertices, or of the nodes of the transition graphs G or G' (whirl, WIN he presented later), z f k is shorthand for ( t f k ) modulo h'.

87

Page 100: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

................................ i ___.-. ......... I

........ .-..

.

...................................................... . / ~

Figure 7.7 If sliding transfer motions (shown as dashed lines) are physically feasible, then the transition graph for this object is strongly connected. Otherwise, it is disconnected into three cliques

"5

e

e,

)"' .............. ...... 0 v1

V

Figure 7.8: Edge and vertex labeling conventions

88

Page 101: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 7.9: For # > c$'~, object will transit to edge ek-1 on the right palm. For $ < 41k, object will transit to edge ek on the right palm.

0 For all cone openings such that $lk < C$ < P will rotate to edge ck-1 on the right palm, upon executing a pure clockwise tilt. If the ek-1 is stable, the part will stay in that configuration.

In general, the object may also slide as well as rotate as the palms rotate! but since equiv- alence rcgions are determined solely by edge-palm contact - in other words, by orientation in the palm frame - only the rotational motion of the object is significant for our purposes. First we will show that the contact with the right palm determines the feasible rotation sense of the part. We will use the following terminology. Suppose we have a vector n at a point p. Let t be another vector at p, perpendicular to n, such that (t! n) form a right handed frame at p. Wc will say that a point x is to the right of n if t T ( x - p) > 0. Similarly, x is to the left of n if t"(x - p) < 0. Note that any point on the line which is defined by the vector n and the point p may be used as the origin; the left and right regions will remain the same.

Lemma 10 A part P is resting in equilibrium on edge eo on the (not necessarily horizontal] left palm. The right palm is also making contact with the part, and its contact normal i s n3,

emanatiny from the contact point between P and the right palm. If the center of gravity of P is to the left of n3, the part can only remain stable OT m0ke a positive rotation as the cone rotates clockwise. If the center of g m v i f y is to the right of n3, the part can only remain stable or make a negative rotation as the cone Totates clockwise.

We arc ignoring the case where ng goes through the center of gravity, as it is not needed for the proof of Lemma 9.

Proof: Referring to Figure 7.10, let nl, n2 bc the lines through the contact. normals 011 the left palm (with n1 to the left of n2, as in the figure), and let 723 be the line through n3, thc corltxt normal on the right palm. In the cone frame, these lines are held fixed, and as the cone tilts, the gravity vector G sweeps counterclockwise in a rcggion contained in the region which starts

89

Page 102: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

..?* ...._._.___________. ... .... ..

-......

Figure 7.10: Determining the rotation sense of a part

with the left palm horizontal and ends with the right palm horizontal. G is anti-parallel to n1,2 when the left palm is horizontal, and anti-parallel to n3 when the right pahi is horizontal. As shown in Lemma 3, some arc [possibly empty) of gravity’s trajectory corresponds to the object being in equilibrium; by hypothesis, this arc, P I , is non-empty and contains our start state. If edge eo is stable, then the cone orientation where G is anti-paallel to n1,2 is contained in Pr , and without loss of generality, we may consider the left palm horizontal to be our start state. Otherwise, all of 01 must be counterclockwise of this orientation, and since we are sweeping counterclockwise, we need not consider it.

As we rotate G , at some point force balance will no longer be feasible, and the object must rotate to another stable state (on the right palm). When equilibrium is no longer feasible, the part will move in a direction which minimizes potential energy: the instantaneous vclocity of the center of gravity must make a positive dot product with G . If G is anti-parallel to n3, then it is obvious that if the center of gravity is to t,he left of n3, the part can only minimize its potential energy by falling to the left: a positive rotation. If the center of gravity is to the right, the object can only make a negative rotation. In either case, the terms of the lcmnla are satisfied, and we are done. We now consider the case when G is in the interior of the feasible range of gravity directions.

By doing a kinematic analysis, we find that there are only two feasible centers of rotation at the moment force balance is lost. One is the point of intersection of nl and n3 (labeled II in Figure 7.10), which corresponds to contact 2 breaking. 11 must have a positive rotation sense to prevent contact 2 from penetrating the palm. The other feasible center of rotation 1s the intersection of 7 ~ 2 and n3 (labeled 1 2 ) . 12 must have a negative rotation sense.

90

Page 103: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Drawing lines 11 and 12 parallel to G and passing through 11 and 12, respcctively, we make the following observations. Taking -G as a directional rcferencc {and any point on 61 as the origin), the instantaneous motion vector of every point to the left’ of I1 will make a positive dot product with G only if I1 is the center of rotation. Hence, if the center of gravity is to the lcft of 11, the part will make a positive rotation. The instantancous motion vector of every point to the right of Iz [now using a point on 12 as the origin) will only make a positive dot product with G if 12 is the center of rotation. Therefore if the center of gravity is to the right of 12, the part will make a negative rotation. No point in between 11 and 12 can ever make a positive dot product with G . Hence, if the center of gravity is between 11 and 12, the part will remain in equilibrium.

Making this construction for the (equilibrium) starting configuration of the ohjcct and the cone, we observe that the center of gravity must lie in the region between this original 11 and 12. Some subset of this original region is to the left of n3, and some subset to the right. We will call the interior of the left region, plus the segment of 11 which intersects P , Lo. Wc will call the interior of the right region, plus the segment of 12 which intersects P, R,. Recall that we arc explicitly ignoring the case where a3 passes through the center of gravity. Also, notc that LO and Ra are fixed regions defined with respect to the start state; thcy do not change as the gravity direction rotates.

As the cone tilts, 11 and I2 will pivot about 11 and 12, remaining parallel to G. It is easy to see that if the center of gravity is in Lo, it must always be either between and 12 or to thc left of 11 (using -G as the directional reference). If the center of gravity is in &, it must always be between 11 and 12 or to the right of 12 (using -G as the directional referencc). Thc lemma is therefore proved. 0

We can now prove Lemma 9. Proof: (Lemma 9) We use the same reference framc as in Lemma 10. Using an argunient

similar to the one in the first paragraph of the proof of Lemma 10, we first argue that at some point during the cone tilt, force balance will in fact no longer be feasible. At the very least, forcc balance (for the initial pose of the object in the palms) will not be feasible when the right pahi is horizontal; this is when G is anti-parallel to n3. Notice from Figure 7.9 t.hat if 4 > q 5 l k ? then the center of gravity is to the left of n3. By Lemma 10, when force balance is no longer feasible, the part will rotate counterclockwise, to edge ek-1 on the right palm.

It is possible that as the part rotates counterclockwise, the part will make edge palm contact between the left palm and the edge of the part clockwise of eo (edge B N - ~ , by our labeling convcntion) before the right palm makes contact with edge ek-1. If this happens, the left palm loses contact with the vertex at 712, but maintains contact with the vertex at nl, which is common to both edges eo and eN-1. Let us assume that when the part loses stability, it rotates instantaneously from edge eo on the left p a , h to edge e N - 1 on the left palm, so that gravity maintains the same orientation during the transition. The part will rotate counterclockwise about 11 in such a way that the motion of the center of gravity makes a positive dot product with gravity - the center of gravity is on the left of the line I, (with -G as the directional reference). As the part rotates, the line I 1 (and the rotation point II) will move. but. maintain the same orientation. Recall from Chaptcr 3 that if a part is in two point contnct with the palms (one contact per palm), with gravity in a fixed direction with respect to the palms, the potential energy curve of the part is either concave down, with a single maximuni in the interior of the range of feasible orientations for those two contacts, or it has no maximum in the interior of this

‘Note that I 1 is always to the left of Zz with respect to -G for all valid directions of -G .

91

Page 104: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

e2

v2

e0 v l Figure 7.11: If edge e0 is resting on the left palm, then the vectors vi formed at vertices v1, u2, and u3 form strictly acute angles with eo. Hence, there are pure tilt motions to transfer the part to one of edges e l , e2, or e3 on the right palm.

range. The unique local maximum (unstable equilibrium) will correspond to a coilfiguration where the center of gravity lies on the line I1 . Since the potential energy cannot increase, the centcr of gravity must remain strictly to the left of the moving 11 . When edge ex-1 makes contact with the left palm, three point contact will be reestablished, with the former 121 now playing the role of nz. Hence, the center of gravity must be strictly to the left of the new l z . It must either be between the new 11 and 12, or to the left of both of them.

If the center of gravity is in the closed region between the new i l and /2 we are again in the situation described by Lemma 10, which we can apply again to get the same amwer (counterclockwise rotation). If the center of gravity is still to the left of the new l l ? the part will continue to rotate counterclockwise, until in fact it reaches edge ek-1 on the right palm.

If 6 < #lk, then the center of gravity is to the right of n3. By Lemma 10, when force balance is no longer feasible, the part will rotate clockwise; by a similar argument as above, it will rotate to edge eb on the right palm. 0

If edge e k is not stable, the part may not remain on edge e k , but may transfer to the nearest (in the sense of having the nearest local minima of potential energy) stable edge. In fact, thc part can be made to transfer to that nearest cdge by tilting until the right palm is horizontal, and opening both palms flat.

In the case of only stable edges, however, it is ewy to show using Lemma 9 that one can transfer from, e.g. edge eo to any edge e, such that the vector vj forms a strictly acute anglc with edge eo (see Figure 7.11). From this follows the (weaker) conclusion that one can hence transfer from edge eo to any stable edge ej which has a positive relative angle less t h m or equal to x. If eo is resting initially on the right palm, a similar result holds for all edges ei with relative angle ai - a0 negative and greater than - x . Hence, if there is an arc of the transition graph connecting two stable edges (ei, left) with ( e j , right), and ai3 5 x: this arc is bidirectiod: that

92

Page 105: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

is! it corresponds to two directed arcs in opposite directions3

Lemma 11 For a cone with infinite length palms, if a polygon P i u resting stably on edge eo on the left palm, there is a cone trajectory that will transfer P to rest on any stable edge e; on the right palm if the relative (GCW) angle between e, and ea is nonzero and less than or equal to x. The corresponding arc of the transition graph is bidirectional.

Using this fact, we can find our first set of sufficient conditions for P to be orientable.

Theorem 12 Let P be a convex polygon with N all stable edges, G the corresponding transition graph. In order for P to be orientable, it i s suficient that either:

1. Sliding transfers be possible, or

2. FOP. every edge e, of P , there be at least two edges e j , ek such th.at L Y , ~ , ( ~ i k 5 x.

If either of the above two cases is true, then the length of any reorientation plan i s bounded by N . This plan can be found in S ( N 2 ) operations.

Proof: By Lemma 11, every node (eo, left) has at least one (bidirectional) arc, to (el, right), since two adjwent edges must have relative angle less than x. We can then collapse the graph G into a smaller graph G', with N nodes. Each node pi of G' corresponds to the node pair ((ei,left), (e;+l,right)). Suppose that case 1 of the theorem is true. Then (ei,left) is connected to (ei,right). With respect to G', this means that every node pi is connected bidirectionally to node pi-1. Suppose case 2 of the theorem is true. Then edges ei+l and ei+a both have relative angles with edge ei less than or equal to n. Hence, by Lemma 11, (e,, left) is connected bidirectionally to (ei+z, right). This means that in GI, node pi is connected to node p;+1. In either case, G', and hence G, contains a cycle, and is therefore strongly connected. The length of the cycle in G is 2N, and the length of the shortest path between any two nodes of G is no more than N . If we search G using breadth-first search, this minimum length path will be found in k * 2N operations, where k is the maximum number of children of any given node in G. Since k can be no more than N , a path can be found in S ( N 2 ) operations. 0

For a polygon P with unstable edges, we can construct a sort of subpolygon, I", which has all stable edges. For each edge e; consider the half plane formed by all points in the plane which makc a nonnegative dot product with the outward facing edge normal. Call that half plane Hi.

Every vertex of P which is connected to two stable edges is also in P'. For each unstable cdge e, take the edges e c w and eccw which are the closest stable edges to e, going clockwise and counterclockwise, respectively. Let the intersection of the extensions of eCw and eCcW bc 2. If z is in H,, then z is a new vertex of P'. Otherwise, P' is unbounded between eCw and eccw. If none of the edges of P' are unbounded, then P' is bounded. Figure 7.12 shows an example of a bounded and an unbounded subpolygon. Make the one to one correspondence betwcen the edges of P' and the stable edges of P. Any bidirectional arcs in the transition graph of P' which are gotten by the application of Lemma 11 will also be in the transition graph of P, since the operation of forming P' preserves the relative angles between the stable cdges. However, an unbounded P' no longer has thc property that adjacent edges must have relative angle less than x . In fact, if an edge eo of P' has as its counterclockwise adjacent edge

"It is more succinctly represented as an undirected ax, of course, but we will choose t,o represent it. a5 two dirccted arcs to distinguish it from arcs which are truly directed, that is, one-way only.

93

Page 106: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 7.12: The top polygon has a bounded subpolygon. The bottom polygon has an un- bounded subpolygon

an unbounded edge, then it is true that the next counterclockwise edge after that will make a relative angle with eo of greater than or equal to ?r. Nonetheless, we can still extend Theorem 12 to any polygon whose subpolygon P' is bounded and satisfies the the conditions of the theorem.

Corollary 13 A n y polygon P whose subpolygon P' is bounded and satisfies the conditions of Theorem 12 i3 orientable. The length of a n y path is bounded by M , the number of stable states: and can be found in O ( M 2 ) operations, after P' has been constructed.

If P has N sides, M of which are stable, conskructing P' takes time O ( N ) . Theorem 12 and its Corollary are useful for "eyeballing" polygons and determining quickly

whether their transition graphs might be strongly connected. In fact, if condition 1 of t,hc theorem (namely, that sliding transfer are possible) is satisfied, we will show later that a,ny polygon is orientable. Sliding transfers may not always be practical, however, since the palms may not actually make contact at the cone vertex, or there may be an obstacle such as a motor or hinge near the vertex. In the caSe where sliding transfers are disallowed, Theorem 12 is a fairly weak theorem, and there are many orientable polygons which do not satisfy its preconditions.

In order to tell which edges can be reached from a given edge ei on the left palm, one can make use of the following construction (see Figure 7.13). Color each stable edge of the polygon P a different color, and color any unstable edges with the color of its nearcst stable edge (in the potential energy sense, as before). Then draw a circle around P , with its center of gravity as the center of the circle. Each colored set of edges of P can then be projected up into an arc of this circle, which will be considered to be also colored appropriately. Label each arc cyi; each arc ai contains within itself the projection of exactly one stable edge, e,,. We will call this circle C p . Now draw a line 1, through the center of the circle parallel to the inward pointing normal of edge e,;, ni. Let ti be a vector perpendicular to ni such that the frame (t,,ni) is a right-handed frame. Set this frame so that its origin is at the intersection of li and eo;. Then when Cp is rotated so that this frame is aligned with the world frame (that frame whcre gravity

94

Page 107: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 7.13: Construction for determining reachable edges. Note that edges e0 and e4 corrc spond to the same arc on the circle. This is because edge e0 is the stable edge to which the unstable edge e4 will fall.

is anti-parallel to the vertical axis), we have a description of the oricntation of P when it is resting on the stable edge e,;. We can iise the frame (ti, ni) to orient the plane with respect to Y l i .

Definition 7.1 (Open right half plane) The line I ; divides the plane into two harf planes. The open h a y plane of directions which make a positive dot product with ti is the open right half plane with respect to ni)

Any arc of the circle (other than ai) which reaches into open right half plane with respect to n; corresponds to a stable edge of P which is reachable using a clockwise tilt starting from the state (eoi, left palm). This follows from Lemma 9; it is a generalization of the observat.ion that from an edge eo one can reach any edge ei such that the vector from the center of gravity to the vertex vi makes a strictly acute angle with eo. See Figure 7.14. Similarly, any arc of the circle (other than ai) in the open left half of the plane corresponds to a stable edge of P which is reachable from edge e,; using a counterclockwise tilt starting state (e,; , right palm). We can then build a transition graph G for the arcs ai of Cp. Suppose that the state (eao, left palm) can reach the state (e,,, right palm). The corresponding transition is bidirectional if the right endpoint of 010 is in the open left half plane with respect to nk.

Theorem 14 If sliding transfers are possible, any polygon P is orientable. The path length from any initial state to any goal state is bounded bg ZM, where M i s the number of stable edges. It CWL be found in O ( M 2 ) operations.

Proof: Recall that the time to find a path through a graph by breadth-first search is bounded by N k , where N is the number of nodes and k is the maximum number of children of any node. Every node of G (2M of them) has at most M children, so we only need to prove

95

Page 108: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

n1

......... ... ........................ ..................

: : . .... . ./ .... ....

,A, /* ..\

. i ....... .....

...... ......................... %..

Figure 7.14: If P is resting on edge e0 on the left palm, it can reach edgcs e l or e2 on the right palm by a clockwise tilt. If P is resting on edge e l on the right palm, it can reach edges e3 or e2 on the left palm by a counterclockwise tilt.

G

DO 91 P2 01

Figure 7.15: Worst case scenario for Theorem 14

Page 109: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

that G is strongly connected Construct the circle diagram Cp. There are M colored arcs cy; in C p , cach one containing the projection of one stable cdge, e,,. Construct thc lines 1, and the frames (ti,ni) ac, described previously. Since we know that the nodes (eni,left) and (eU,,right) have a bidirectional arc between t,hem (sliding transfer), we an collapse G into a smaller graph G'. A node pi of G' corresponds to the node pair ((ea,,left), (e-,,right)), G will be strongly connected if and only if G' is strongly connected. If every arc of C p can reach its neighboring counterclockwise arc bidirectionally, then we are in a situation analogous to Case 1 of Theorem 12, and we are done.

Otherwise, suppose that arc cy0 cannot reach its neighboring counterclockwise arc, hidirec- tionally. This case also breaks down into two cases. It may be the case that P has only one stable edge; in that case, G' is a single node, and hence trivially strongly connect,ed, and we are done.

Suppose that P has more than one stable edge. Ifcq cannot reach any other counterclockwise arc bidirectionally. then there are no normals ni in the open right half plane of no. Hence, all the normals ni are in the same closed half plane: the closed left half plane of nu. no will be the normal the furthest in the counterclockwise direction. Hence, it is the case that (err i : left] can be brought to (eaj+, , right) bidirectionally for all i greater than 0. Therefore (see Figurc 7.151, for the graph G', every node pi is connected to pi+l for i > 0. The graph G' forms a path of length M , and G forms a path of length 2 M , and we are done. 0

Theorem 15 if slidiny tmnsfers are not possible, in oaier for P to be orientable it is suficient that every arc a; of C p can reach two other arcs a,+l and a;+2 going counterclockwise. That is, ai+l and cy(+? both reach into the open right h.alf plane of ni. The path from a n y anitial state to any goal is bounded by 2M and mn be found in at most S ( M 2 ) operations.

This theorem can be restated as in Chapter 3:

I f sliding tmnsfers are not possible, in order for P to be orientable it is suficient that every stable edge e,, , when resting on the left palm, can reach two other stable edges e,,+, and on the right palm by a clockwise tilt. I fP has M stable edges; the path from any initial state to any goal is bounded by 2M and can he found in at most S ( M 2 ) operations.

Proof: If ai+l and ai+2 both reach into the open right half plane of ni, then ai+, niust be completely contained in that open half right plane. Hence nit, is in the open right half plane, and (ea , , left) can be brought to (eo,+, , right) bidirectionally. So we can again collapse G into a smaller graph GI, where the nodes pi correspond to the node pairs ((e,, , left)? (ee,+] ~ right)). We also know that (ea+, left) can reach right) at least unidirectionally. Hencc, node pi of G' can reach node pi+^ at least unidirectionally, for all a. G' therefore forms a directed cycle of length M , as seen in Figure 7.16, and G forms a directed cycle of length 2 M . 0

An analogous result naturally holds in the clockwise case, as well.

7.4 Homing Sequences

As described in Chapter 5, if we wish to find a plan to orient a part to a known final state from an arbitrary unknown initial state, we can construct a larger transition graph whose nodes are the elements of the power set of the set of equivalence regions, and whose arcs are cone motions.

97

Page 110: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Figure 7.16: Worst case scenario for Theorem 15

One of the questions which we wish to address is the discretization of cone motion space. How many different cone motions, or low finely do we have to sample the cone motion space, if we want to guarantee that we will find an orientation plan, if one exists? We would also like to find conditions for which a polygon P can he oriented to a particular goal from any arbitrary initial state.

We recall Lcmma 9:

For a cone with infinite length palms, suppose polygon P is resting stably on edge eo on the left palm. Let the right palm make contact with vertex wk. Let the vector from the center of gravity of P to vertex vk be vk, and be the cone opening such that the right palm is pcrpendicular to vk. Then:

For all cone openings such that dLk+l < 4 < $lk, P will rotate to edge ek on the right palm, upon execuhg a pure clockwise tilt. If ek is stable, the part will stay in that configuration.

For all cone openings such that $Lk < $ < @Lk-l! P will rotate to edge ek-1

on the right palm, upon executing a pure clockwise tilt. If the ek- l is stable? the part will stay in that configuration.

We can construct such intervals for a polygon with unstable edges by performing a similar procedure on Cp. Orient C p so that no is parallel to the y axis. Label the endpoints of each arc in a manner analogous to the labelling of polygon vertices: every arc ai has two “vertices” (endpoints) P),; and v*,+~, going counterclockwise. vu, is the vector from the center of Cp to v a i . If edge edo is resting on the left palm, then let dLj be the cone opening such that the right palm is perpendicular to vnjr for i > 0. Then again,

1. For all cone openings such that $Li+l < 6 < q$Li, upon executing a clockwise tilt, I’ will rotate to arc ai, and hence to edge eaz as the unique stable edge within that arc.

98

Page 111: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

2. For all cone openings such that 41i < 4 < 41i-1., upon exccuting a pure clockwise tilt. P will rotate to edge em,-, on the right palin.

3. If a sliding transfer of edge e,, to the right palm is feasible, it will occur upon executing a clockwise tilt, for $ > 4;. This follows from item 2.

This follows from Lemma 9. We can now determine how finely wc must sample cone motion space in order to guarantee finding a plan, if one exists.

Theorem 16 Suppose we have a polygon P, and a wne with infinite length palms. If transitions between equivalence regions are executed using pure tilts, then there is pfinite set of cone motions such that a (frictionless) homing sequence ezists if and only if i t can be constructed f iorn this finite set of cone motions.

Proof: Assume we determined all the intervals of cone openings for all the stable edges of the object on the left palm, as described above. Sort the endpoints (both upper and lower) of all the intervals into a sequence {(i}. Let the interval Ii be the interval from [i to Do the same for the right palm, and call those intervals Ji. Pick a sequence of cone openings, one out of each interval, y, E I, and p, 6 Ji.

Let flmO5($) = (?r - $)/2.0. Omax($) corresponds to a cone with cone opening 4 tilted until the left palm is horizontal; -Aac(4) corresponds to the right palm horizontal. By using 3$mez($), we guarantee that when we tilt; for example, right, that at the end of tlie tilt the object niust be resting in edge-palrn contact with the right palm, and vice-versa if we tilt left. If a homing sequence exists for P, it can be found by searching only over the set of cone motions

(yi, Pmaz(yi)) + (~i , -Pmnz(Ti)) (tilts from left palm to right palm)

(tilts from right palm to left palm) (pi, -Prnoz(~i)) -+ (pi, P m a r b i ) )

plus the appropriate fixed4 squeezes to move from any (-yi; Pmllx(yi)) to any (yj: Omaz(yj)), and from any (pi, -PmOz(p i ) ) to any ( p j , -P,naz(pj)).

Each value in the sequence { C i } represents a cone opening where some initial cquivalence region &i stops transiting to equivalence region Ej upon executing a pure tilt (for cone openings lcss than ci), and begins transiting to equivalence region & (for cone opening greater than ci). Hence, the endpoints of e x h interval 1, (or Ji) represent critical cone openings where the behavior of the system will change for some sets of equivalence regions. No such critical points will occur inside any interval 1, ( J i ) , by construction. Each interval I , ( J i ) represents an interval of cone motions whose effect is identical on any given set of equivalence regions. Since the number of intervals is finite, there are only a finite number of equivalent sets of cone motions. By our construction, we have found them all, and if there exists a homing sequence, it will have to be composed of this finite set of motions. 0

We can construct our power set t,ransition graph using the set of cone motions as obtained in Theorem 16. Then by Theorem 16, a breadth-first search through the hypergraph is guaranteed to find the shortest homing sequence for our object, if one exists, Breadth-first backchaining scarch from a particular desired goal state back to the maximum hyperset is likewise guaranteed to find the shortest path to a desired state, if one exists.

99

Page 112: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial
Page 113: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Chapter 8

Conclusion

Visualizing vividly the condition BS a whole may mean an essential advance; and x-pa- rating the condition into appropriate parts may be an important step forward. Whcn we have found a figure that we can easily imagine, or a notation that we c a n easily retain, wc can reasonably believe that we have made some progress.

G. Polya How t o Solve It (70]

8.1 Future Work

8.1.1 Existence of Homing Sequences

Clearly, in order for a part to be homed to any arbitrary goal state, it must be orientable. However, not all orientable parts can be homed t,o any arbitrary state. As an obvious example, a regular polygon of uniform mass distribution cannot be homed to any arbitrary edge. Any edge of a regular polygon will behave in exactly the same way for any given cone motion, and hence there is no cone motion which will bring two initial states both to a single cnd statc. Without such merging of the states, no homing sequence can exist.

A non-square rectangle with uniform m a s distribution is another orientable part which cannot be homed to any arbitrary goal. According to our planner, however, it can: be homed t,o either palm, to any stable orientation modulo T. Intuitively, this is because thcre exists an interval of cone openings which will bring both the long edge and the short edge on a given palm to a long edge on the opposite palm. Hence there is some reduction of state; but we cannot tell which long edge we are resting on, because we cannot mechanically distinguish onc from the other. If the rectangle does not have uniform mass distribution, it is possible that it may again bc homed to any arbitrary state, since now a given edge may not look exactly like its opposite counterpart.

Definition 8.1 (Group) 1811 A group is an odemd pair (G: o ) such that G i s a .set? o i .3 an assocaatiue binary upemtion an G , and the% a i s t s e E G such that

i f a E G , t h e n a o e = e o a = a

i j a E G , then there ezists a-' E G such than a o a-' = a-l o a = e

101

Page 114: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

The element e is known as thc identity of G. The set of in-theplane, symmetry prcserving rotations on a polygon, together with the operation which composes rotations., forms a group, whose identity is the 0 (or cquivalently, 2a) rotation. When we say symmetry preserving, we are also including the location of the center of gravity. For example, a regular n-gon with uniform mass distribution has associated with it the group { K / n , 2 i~ /n , .,.,%}. The example polygon we have been using, depicted in Figure 3.2 of Chapter 3, has associated with it the group ( 2 ~ ) : there is no symmetry preserving rotation of this polygon which remains i t i the planc, other than the identity. These groups are called cyclic groups, because all of their elements can be generated by repeated composition of the smallest rotation in the group.

We make the following conjecture:

Conjecture An orientable polygon can be horned to any arbitrary stable state if i t s associ- ated cyclic group i s only the identity. Otherwise, it can be homed at best to any given orientation modulo the smallest mtation of the associlated cyclic group.

Informally, we conjecture that any orientable polygon Cali be homed up to symmetry.

8.1.2 Minimizing Dynamic Instability

Up to this point, the analysis used by the planner has assumed that the state of thc system can be described entirely by positional parameters: the orientation of thc palms, and object. and which palm the object is resting upon (or was resting upon last). In other words, the state of the object is described only by its potential energy and by the (possibly frictional) contact forces applied to the object by the palms. Under these assumptions, the only way to change the state of the object is by changing the contact forces upon the object. State changes due to velocity effects have been ignored. Velocity effects can be effects due to momcntum or kinetic energy, such as tumbling or impact. They can also be effects due to centrifugal or Coriolis forces, such as the object being thrown from the palms or sliding off a palm due to centrifugal motion.

Unpredicted state changes due to centrifugal or Coriolis forces can be minimized by keeping the rotational velocity of the palms sufficiently low, and by avoiding abrupt accelerations and decelerations. Far the experimental system used to test the plans, the rotational velocity of the palms has been approximately constant in magnitude, in the range of about 0.4 to 0.5 radians per second. Although this leads to abrupt decelerations at the cnd of a motion, the dynamic effects due to these decelerations have not generally been observed to causc plan failure.

A more significant cause of plan failure has been excess kinetic energy of the object. In some cases, after a tilt has been executed to bring the object to a new resting state 011 a new palm, the translational energy given to the object by the palm motions will cause the object to continue to slide tangentially on the resting palm, until the object slidcs off the palm. In other cases, the rotational energy imparted to the object by the palm motions will cause it to tumble from its nominal resting state to another resting state not predicted by the planner.

The most common cause of this excess kinetic energy is a palm trajectory where a motion corresponding to a very small cone opening is followed by a tilt. This pinching of the object by the palms moves the objects radially outward on its resting palm. If the palms then execute a tilt, the effect is similar to that of a long tether which is anchored at one end, and has a mass attached to the other end. If the tether is then swung in a circle about its fixed end, it exerts a force on the mass radially inward proportional to rw2 , where T is thc length of the tethcr and w is the velocity of the rotation. The mass exerts a force of equal magnitude and

102

Page 115: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

2 acc rad = r W

A

B

Figurc 8.1: A: In the cone frame, if the radially outward component of the forcc on the m a s dominates any forces radially inward, the part may fly off the palm. B: If the energy of the mass at the end of the motion is too high, when the part slides down the palm, much of its energy (minus what is lost in the impact and what is converted to rotational velocity) will be converted into sliding motion, and the part may slide off the palm.

103

Page 116: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

opposite direction (radially outward) on the tether. If the tether were then to st,rctch or break in response to that force, the mass would then move radially outward. In the same way. the object on the palms wants to slide radially outward on its resting palm. and may possibly slide entirely off the palm. Even after the tilt is finished, the object will have somc residual, radially outward velocity left.

Even if the tilt is successfully executed, and the object does not slide off the palms, it is sometimes the case that the next motion corresponds to the palms opening very widc. In this case, the object starts out radially far from the vertex of the cone being formed by the two palms, and gravity pulls the object towards the vertex, usually so that the object can be transferred to the other palm. The object will then slide all the way down, tramforming its initial potential energy into kinetic energy This can cause it to continue sliding when it contacts thc other palm; sometimes off the palm. More often, however, the impact with the other palm can transfer the kinetic energy from translational to rotational motion of the object, and the object will tumble and rotate in a way not predicted by the planner. An algorithm for designing palm trajectories to minimize dynamic effects a t higher joint velocities would be useful. Alternatively, a method of predicting dynamically unstable moves, much as we can identify frictionally unstable moves: would enable us to easily expand the planner framcwork which we already have.

We have already considered one way of trying to minimize dynamic effects for the plans which the existing planner generates. Recall that by Lemma 9, there are intervals of cone openings, I,, each with an associated tilt direction, such that pure tilts for any cone opening in Ii can cause the same transition for a particular initial state, or set of possiblc initial states. Consider the two scenarios mentioned previously; in order to minimize the centrifugal effects in the first scenario, one must maximize the cone opening of the pinch, to keep the radial distance of the object from the cone vertex as small as possible. To minimize the dynamic effects in the second scenario, one must minimize the cone opening which follows the pinch (or open the palms very slowly) in order to keep the kinetic energy of the object as small as possible. Both of these objectives can be met simultaneously by minimizing the difference between successive cone openings in a given trajectory.

It follows from Lemma 9 that every arc of the power set transition graph represeuts a set of motions, or an interval of cone openings with an associated rotation direction. If we wish to minimize the difference between successive cone openings in a palm trajectory, we can do so by picking the cone openings at the endpoints of the cone opening intervals, or at least near the endpoints, if we wish to leave a little slack to account for the inaccuracies in palm positioning of the physical system. Which endpoint we pick depends on the cone openings required by the tilts preceeding and succeeding a given tilt. In principle, minimizing the difference bebween successive cone openings should minimize the dynamic effects in the scenarios above.

We took a few homing sequences which the existing planner produced, but which failed due to dynamic effects when run at our customary joint velocity (0.5 radians per second), and 0ptimize.d them as above. Unfortunately, this first attempt at optimization was not, successful. Plans which tended to fail due to dynamic effects when run at our default joint velocity still failed after optimization, at the same joint velocity. However, it is still plausible that. with some additional modifications, some version of this optimization can be made to work.

8.1.3 Nonpolygonal objects

The generalization of our planar planner to nonpolygoual objects should be relatively straiglit- forward in the case of a part whose set of equilibrium resting poses on a horizontal plane is

104

Page 117: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

discrete. In the following, we will discuss the frictionless case. Kriegman [4G] givcs t,he condi- t i o ~ ~ ~ under which a particular pose of a planar, piecewise smooth part will be stablc in one or two point contact on a horizontal (infinite length)‘ palm.

For a piecewise smooth planar part, there are three types of faces with which a palm can make contact: a flat edge; a boundary point which is smooth (that is, a point at which the cnrve describing the boundary of the part is differentiable) - we will refer to this as a smooth point; and a boundary point which is not smooth - we will refer to this as a uertex. A palm can only make contact with an edge if the edge is aligned with the palm. A palm can only make contact with a smooth point if the tangent to the part’s boundary at the smooth point is aligned with the palm. A palm can make contact at a vertex in some range of relative orientations. There are four types of two point cont,act: with an edge, with two smooth points, with two vertices, or with a smooth point and a vertex. Clearly, all these two-point contacts are analogous to the edge contact we have examined throught this dissertation, with similar conditions for stability. The conditions for stable one point cont.act are as follows:

1. The tangent of the part’s boundary curve at the contact point is aligned with the palm.

2. The line from the contact point to the center of gravity lies on the normal of the palm at the contact point.

3. The length of this line is strictly less than the radius of curvature of the part at the contact point.

Condition 1 says that a stable one point contact can only occur at a smooth point. A smooth point which satisfies Conditions 1 and 2 but not Condition 3 corresponds to an unstable equilibrium contact. For brevity, we will refer to smooth points which satisfy Conditions 1 and 2 as smooth equilibrium points. Note that an actual stable edge has some point in its interior which satisfies all three conditions, since a straight line has an infinite radius of curvature.

One attempt at extending the planner is to generalize the concept of “edge“ to edges or points on the boundary of the part corresponding to any equilibrium one or two point contact with the palm. Those which are stable correspond to stable edges, those which are not correspond to unstable edges. If we can then build concisely described equivalence regions, analogoiis to those in the polygonal case, for a piecewise smooth object, we can extend the planner to handle more general parts.

Unfortunately, the nonpolygonal case differs from the polygonal case in that, for the polygo- nal case, all equivalence regions of stable configurations of the part in the two palms correspond directly to a given edge making contact with a given palm. This is no longer true in the non- polygonal case. The part can make either two or three point contact with the two palnls. If it is making three point contact, one of the palms is making two point contact, and hence is making “edge” contact. It seems feasible that there is a corresponding equivalence region of st,able states, with the same nice properties as in the polygonal case: simple conncctedess if the “edge” is stable, piecewise linear stable paths through the equivalence region, ctc.

However, the analogy is not be true in the two point contact case (that is, onc point coiltact with each palm). If the part is making two point contact with the cone, either both of the palins are making vertex contact, or at least one of the palms is making contact with a smooth

’We use the convention of an infinite palm simply to indicate that we are ignoring cont.art between a part and the end of the palm

105

Page 118: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

point. By the results in Appendix A, two point vertex contact is never stable. Hence, in order for a two point contact configuration to be stable, at least one of the contacts must bc with a. smooth point.

For a two point contact pose in the palms, the center of rotation will be at the intersection of the lines through the contact normals. If one draws a line parallel to gravity through this point, then in order for the part to be in equilibrium, the center of gravity must lie on this line. Hence, it is possible for a nonpolygonal piecewise smooth part to be in stable two point contact, even if neither of the contact points are sniooth stable equilibrium points. For example, consider a circular disc with an ofEset center of gravity. This part has only one smooth stable equilibrium point, on the radius which passes through the center of gravity. Call this radial line rcc. Whatever the opening or orientation of the cone, it is clear that the center of rotation is always the center of the disc, and is is equally clear that the part will always rotate in the palms until TCG is parallel to the direction of gravity, and remain there, stably.

It may be possible to draw an analogy to the polygonal c a e if one considers unstable smooth equilibrium to be a generalization of vertices. Then an ”edge” is the segment of the part boundary between two “vertices”, a “vertex” being either an actual vertex or an unstable smooth equilibrium point. If the “edge” is an actual stable edge, or contains a smooth equilibrium point, then it is stable; otherwise, it is unstable. An ellipse, for example, would haw two “vertices” and two stable “edges”. The circle in the example above would have one “vertex” and one stable “edge”. Stablc “edges“, like stable polygonal edges: have the property that the orientation of the part is completely determined on a horizontal palm by specifying which ”edge” is in contact with the palm. There would still be some scenarios which are not seen in the polygonal case: such as a single ”edge” making contact with both palms, but it seems feasible that the polygonai planner can be extended to this case.

We have not yet addressed the case where there is an continuum of smooth equilibrium points, for example an arc of a circle where the location of the center of gravity happens to coincide with the radius of the circle. It may be desirable to consider this arc a a special case “edge”, since in somc sense, none of the points on this arc can be distinguished from one another.

8.1.4 Three dimensional case

Kriegman has also presented a method of finding resting poses for three ditnensioiial parts resting on a plane perpendicular to gravity which have a piecewise smooth convex hull [46], as well a s the stable resting poses and capture regions for smooth parts 1471. Once a workable model of a “three dimensional cone” is determined, one could extend these algorithms to find the stable resting poses of a three dimensional part in this three dimensional cone.

There are a number of possibilities for extending our principles to the threc dimensional case, including the use of both palms and fingers as constraints. If one uses fingers, however, then the convexity or nonconvexity of the part becomes an issue, whereas in the case of only palms, only the convex hull of the part matters.

In our planar system, we constrain two degrees of freedom, so the objcct statc can bc described simply by the part orientation, plus which palm is making edge contact with the part. The analogy to three dimensions would seem to be three constraints, leaving the object state to he described by its three orientatation parameters, and its relationship to the t h e e palms (or fingers). It may be possible to use four constraints. One could fix one of the degrecs

106

Page 119: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

of freedom of the part to be rotation about the z axis, and then orient thc part up to rotation about z.

Some possibilities for three dimensional systems include

Three or four fingers. Abell and Erdmann [l] presented a two finger stable support. reorientation planner for convex polygonal planar parts. A three dimensional analogue is no doubt possible.

e Four palms arranged as two two-dimensional cones set in perpendicular frames. A varia- tion might be one pair of palms and two fingers.

e One tiltablc support plane (like t,he bottom of a tray tilter) and two or Lhrce palms, rather like the corner of a box with no top whose sides are hinged.

A problem with these higher dimensional formulations is that it is much harder to determine the configuration space constraint surfaces and the potential energy surfaces or curves in higher dimension. A possibility which may be computationally more tractable is to treat the problem as successive planar problems. Suppose for the sake of discussion that the convex hull of a part is polyhedral. If we have a support plane (tilted so that there a gravitional force in the support plane) and two palms in the plane, then there is one face of the polyhedron which is contacting the support plane, and the projection of the part onto the support plane whirh forms the polygon which the palms manipulate. There may be configurations of this polygon for which the part will switch which face contacts the support plane, or we might have some niechanism, such as a wiper to actively change the contacting face. At any rate, the orientation problems in three dimensions are reduced to a succession of orientation problems in the plane.

8.1.5 Part Singulation and Pipelining

In order for a manipulator such as the one we have discussed to be practical in assembly line situations, we must consider part singulation: how to separate the parts sufficiently so that they do not interfere with each other in the manipulator.

We must also consider feed rate. If an assembly line requires a feed rate of, for example, a part every five seconds, then our parts orienter must be able to reorient a part in less than five seconds, or we must be able to orient multiple parts in parallel so that there are always parts available to the rest of the line while the orienter is working on the current batch. One can imagine having a line of these manipulators operating in tandem to orient multiple parts. However, the problem of making sure only a single part lands in each manipulator remains.

8.1.6 Sensors

While we hrtve modeled our orientation procedures as openloop and sensorless, it may bc desir- able to have some sensory feedback in order to determine when an error in the plan has occurred. One would like this sensory data to be minimal, in keeping with the criteria of simplicity and speed. Determining what sort of sensory feedback, and how to incorporate it, is a task worth addressing in the future.

107

Page 120: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

8.2 Conclusion

We have presented a model of nonprehensile manipulation, using two one degree of freedom palms, and developed a planning method for part reorientation with our model. Our method finds feasible paths through the space of equivalent state configurat,ions of the object in the palms, without requiring that the palms maintain stable support of the object over the cntire path. We have shown that such a device can reliably orient parts in the plane. This devicc has demonstrated a number of points.

First, simple low degree of freedom devices can be used for reliable, fast manipulation of objects. In parts orienting scenarios, one would like to avoid complex mechanisms and sensors; which may break down or need careful recalibration. In addition, integrating sensor input into a manipulation algorithm increases the computational complexity, and may slow the action of the device. Sensory feedback is of course necessary in unknown or unstructured environments. However, for tasks in a structured environment, where the same action is repeated continuously, manipulators such as the one studied in this dissertation have a distinct advantage.

Second, because the devices are mechanically simple, the analysis of their mechanics is also relatively simple. To change the task from one object to another, or to change the goal state for the same object, requires only a simple software modification. APOS trays or bowl feeders, which have the same strengths of quick, reliable performance for a given task, must be custom designed to each task, whereas devices such as this one can be used for a variety of tasks. The planner we have designed is efficient, and flexible. Planning reorientations for a variety of objects requires the geometric descriptions of the objects: vertices, center of gravity, radius of gyration, and an upper bound estimate on the coefficient of Fiction between the part a id the palms.

Third, by not relying on force closure grasps, we can exploit gravitational forces to guide the object into the correct state, without excessively precise control over the manipulator motions. Nor do we need extremely precise knowledge of frictional or restitutional coefficients. Rough estimates are sufficient. The primary mechanical analysis used by the planner is frictionless and quasistatic. Knowledge of frictional and dynamic forces is only approximate, yet. the rcsulting plans are robust to init.ia1 conditions, friction and to small errors in the calibration of the manipulator.

Other issues such as parts singulation, higher throughput and more gcneral object shape must be addressed in order to make such a device as we have described truly practical. How- ever, we believe that the continued development of devices such as the one prcsented in this dissertation is necessary to meet the demands of modern industrial automation.

108

Page 121: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Appendix A

Properties of the Potential Energy Curve

There is the story of how he informed Halley of one of his most fundamental discoveries of planetary motion. ’Yes,’ replied Halley, ‘but how do you know that? Have you proved it?’ Newton was taken abac!- ‘Why, I’ve known it for years,’ he replied. ‘If you give me a few days, 1’11 certainly find a proof for it’-% in due course he did.

John Maynard Keynes Newton, the Man (451

In Chapter 3, we asserted that the potential curve of a part in two point contact with the palms (one point per palm) would be either monotonic or have a single maximum in the interior of the range of part orientations for which this two point contact is maintained. We will now prove this assertion.

Assume we have a part P in two point contact with a pair of infinite length palms, one contact per palm. The palms have a relative angle r#. Thc cone frame is defined with the origin at the vertex of the cone formed by the two palms, such that the y axis is along the cone bisector, pointing into the cone’s interior. The cone frame is oriented at an angle 0 in the world frame (where gravity is antiparallel to the y axis). This two point contact is maintained over some range of part orientations, I . There is also an orientation of the part, 00, such that the two contacts have the same y coordinate, in the cone frame. We say the center of gravity is above the vertex of the cone if the y coordinate of the center of gravity in the cone frame is positive.

Theorem 17 FOT any location of the center of gravity such that the center of gravity i s con- tained inside the cone when P i s in orientation 00, the potential energy of P as n function of orientation B will either be monotonic or have a single maximum within the interior of I .

For Theorem 17, the range of valid center of gravity locations (excluding issues of collision) is shown as the shaded portion in Figure A.l . This valid region also includes the palms theInselves.

Suppose that at 8 = B o , the center of gravity is not inside the cone, but is still above the cone vertex, as in Figure A.2. There may still be orientations of the object contained in the interval [-(x - $)/2 + 00, (n - 4)/2 + 801 for which the object is completely contaiiied in the cone. Suppose, without loss of generality, that Bo = 0. Then specifically, there may Irc an interval I + = [Blf, 02f ] such that all 0 in It satisfy 0 < 81+ < B < Bzf 5 9: and for all 8 in

109

Page 122: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

- - - d

Figure A . l : The shaded portion shows the range of locations of the center of gravity satisfying the conditions of Theorem 17.

Figure A.2: The center of gravity is not inside the cone at 8 = B o .

110

Page 123: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

I+, the center of gravity is contained in the cone. Or, there may he an interval I - = [el-. 02-1 such that all R in I - satisfy 5 01- < 8 < 02- < 0; and for all B in I - : the center of gravity is contained in the cone. If either interval exists, then any orient.atiori of the part in the existing interval is a valid Orientation.

Theorem 18 For any location of the center of grawity such that the center of grauitgr i s outside the cone but above its wertez when P is in orientation 00, either

1. neither I + nor I - exist, OT

2. the potential energy of P as a function of orientation 0 will either be monotonic or have a single mazimum within the interior of the interval of valid orientations.

We will prove Theorem 17, and then sketch the proof of Theorem 18. Theorem 17, we will give a set of simple assertions about trigonometric functions.

Assertion 1 If either sinx or cosx is taken over an internal I of x of length at most r, then it will either be monotonic or have exactly one extremum in the interior of I .

Assertion 2 Let arctanz(y,x) be the four quadrant arctangent of the point (x, y) (in other words, the range of arctan2 is [-T, T]). Then

Before proving

~ c o s x + ~ s i n z = J Z Z T c o s ( z arct tan?(^,^)) = m s i n ( x + arctan:!(A,B))

Assertion 3 Consider the function

f ( E ) = Ncos E + A4 sinz.

Its derivative is f'(x) = - N s i n x + M c o s z .

If N > 0 , and 0 5 x < ~ / 2 , then f ' ( - x ) 2 f ' ( x ) . Therefore, by Assertions 1 and 2, ezther f is monotonic (if both deriwatives have the same sign), o r it has a single maximum between --z and x. If N = 0, then f is monotonic between -x and x.

Now let us consider a rod of length d in the interior of a cone with opening 4. The cone Game is as described above. Let the orientation of the rod be 00, when the rod is horizontal (in the cone frame). Without loss of generality, let 00 = 0. The endpoints of the rod are given by pi = (plr ,ply) and pr = (prs,pry). It is clear that the range of valid orientations of the rod such that the left endpoint pl stays on the left palm, and the right endpoint p r stays on the right palm is given by I = [-(r - 4 ) / 2 > (T - 4 ) / 2 ] . The locations of the endpoints in the cone frame as a function of orientation are given by

x ( 0 ) 2 0

111

Page 124: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

where the function K(@) is to he determined. The contact constraints are expressed by the cquatioris

-1 (-4.3) PlY - - - _L = 2%.

P1z t ang P,,

Combining Equations A.l , A.2, and A.3, we derive an expression for the left endpoinl.:

(A.4)

We next consider the endpoints of this rod t.0 be the contacting vertices of uur part P. Again, let 0 = 0 when the rod is horizontal in the cone frame. The location of the left vertex with respect to the center of gravity is

where ri is the distance to the left vertex, and 8, is the angle to the left vertex, both with respect to the center of gravity.

The center of gravity location in cone coordinates is thcn given by

d 1 CG(@) = --(cos@ - tan 2 sin $

The direction of gravity in the cone frame is G = (- sinp, -cos @IT. The potential energy as a function of 6' for a fixed f l is then given by Pa(@) = -@CG(O).

Theorem 19 Over the range I = [-(T - $)/2, (T - 4)/2], Po(@) is either monotonic or has Q

singie atremum in the interior of I .

Proof: By cranking through the algebra, the potential energy function can bc written

PO(€!) = NcosB+Msin8

d 1 4 N = - r i s i n ( 8 ~ + ~ ) + - - ~ 0 ~ ( ~ + ~ ) 2 sin $

By Assertion 2, Pg can be written as a pure sine or cosine. The range of valid cone openings is (O,.]; hence, the interval of valid orientations I has length strictly less than T . By Assertion 1, Po is therefore either monotonic or has a single extremum in the interior of I . 0

Assertion 4

112

Page 125: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

The endpoints of the rangc of valid /? correspond to cone orientations such thst the right and left palms, rcspectively, are horizontal. We can now prove Theorem 17.

Proof: (Theorem 17) First, we note that the orientations of the left and right palms in the world frame are given by

@left = (a+4)/2+0 $right = ( f l -4) /2+0

By Assertion 4, the p a l m are therefore always in the closed Quadrants I or I1 of the plane; that is, sin&ft 2 0 and sin@?ight 1 0. By hypothesis, the center of gravity is inside the conc at the orientation 13 = 0; hence it lies in the closed Quadrants I or I1 of the planc. Therefore, the y component of the centcr of gravity location: CG,, is always greater than or equal t.0 zero. But CG, is also proportional to the potential energy of the part, with a positive constant of proportionality:

CGJO = o ) Ps(e= 0) = Ncos(0) fMs in (0 ) = N

Therefore, N is nonnegative for any valid value of /?. By Assertions 3 and 4, it follows that either Pa is monotonic or it has a single maximum in the interior of thc range of valid part orientations. 0

The sketch of the proof of Theorem 18 is as follows. reparameterize Pg by 01 = 0 - elf , then we get a new function

Suppose that I + is valid. If we

Po+(a) = N cos(u + 81') + Msin(a + @ I + ) ,

where N and M are as defined in the proof of Theorem 19. This can be rewritten

Ppt (a) = N + cos a + M + sina,

valid over the interval 0 5 01 5 (e,+ -elf) , which is of length strictly less than ~ / 2 . All values of 01 in t,his interval satisfy the conditions of Assertion 3. By hypothesis, at thc orientation o = 0 the center of gravity is inside the cone, and hence in either Quadrant I or I1 of the world frame. Using the same reasoning as in the proof of Theorem 17, we can say

CG,(a= 0) K Pa*(u = 0 ) = N + COS(O) + M+ sin(0) = N+>O

Therefore, Pg+ is either monotonic or has a inaxiniurn in the interior of I+. If I - is valid, then we can reparameterize by a = 8 - el-, and derive an expression for the

potential energy valid over the range 0 5 LY 5 6'- - el-, and the same result follows.

113

Page 126: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

114

Page 127: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

Bibliography

[I] T. Abell and M. Erdmann. “Stably Supported Rotations of a Planar Polygon with Two Frictionless Contacts“? Proceedings of the 1995 IEEE/RSJ Internatzonal Conference on Intelligent Robots and Systems, 1995.

[2] Y. Aiyama, M. Inaba, and H. Inoue. “Pivoting: A New Method of Graspless Manipulation of Object by Robot Fingers”, Proceedings ofthe 1YYS ZEEE/RSJ 1nternation.al Conference on Intelligent Robots and Systems, 1993.

[3] S. Akella. Robotic Parts TTansfer and Orienting for Flezible Assembly. P h D Thesis, Robotics Institute, Carnegie Mellon University, 1996.

[4] S. Akella, W. Huang, K. M. Lynch, and M. T. Mason. “Planar manipulation on a conveyor with a one joint robot”, presented at the 1995 International Symposium on Robotics Research, 1995.

[5] S. Akella and M. T. Mason. “Posing Polygonal Objects in t,he Plane by Pushing!’, Pro- ceedings of the 19Y2 IEEE International Conference on Robotics and Automation, pp. 2255-2262, 1992.

[6] R. L. Andersson. “Understanding and applying a robot ping-pong player’s cxpert con- troller”, Proceedings of the 1989 IEEE international Conference on Robotics and Au- tomation, 1989.

[7] H. Arai and 0. Khatib; “Experiments with Dynamic Skills”, Proceedings of t h ~ 1994 Japan-USA Symposium on Flexible Automation, 1994.

[SI H. Arai and S. Tack. ‘Position Control of a Manipulator with passive joints using Dy- namic Coupling”, IEEE Tmnsactions on Robotics and Automation, vol. 7, no. 4: pp, 528-534, 1991.

[Y] Aristotle. Physics, Book VII. From Aristofle Selected Works, H. G. Apostle and L. P. Gerson, trans. Peripatetic Press, Grinnell, Iowa, 1986.

[lo] D. B a r d . “Issues in Computing Contact Forces for Non-penetrating Rigid Bodies”, Al- g o r i t h m k , VOl. 10, pp. 292-352, 1993.

[ll] D. .J. Bell. Mathematics of Linear and Nonlinear Systems, Clarendon Press, Oxford! 1990.

[12] A. Bicchi, C. Melchiorri, D. Balluchi. “On the Mobility and Manipulability of General Mnltiple Limb Robots”, IEEE Dansactions an Robotics and Automation, vol. 11, no. 2, pp. 215-228, 1995.

115

Page 128: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

[l3] K. F. Bohringer, B. R. Donald, N. C. MacDonald. “What Programmable Vect,or Fields Can and Cannot Do: Force Field Algorithms for MEMS and Vibratory Plate Parts Feed- ers”, Proceedings of the 1996 IEEE International Conference on Robotics and Automation, vol. 1, pp. 822-829, 1996.

[14] G. Boothroyd, C. Poli and L. E. Murch. Automatic Assembly, M. Dekker, XPW York, 1982.

[15] G. Boothroyd, A. H. Redford, C. Poli, L. E. Murch. “Statistical Distributions of Natural Resting Aspects of Parts for Automatic Handling’!, Manufacturing Engineering Transac- tions, vol. 1, pp. 93-105, 1972.

[16] J. L. Borges. “The Garden of Forking Paths”, Labyrinths, New Direct.ions, New York. 1964.

[17] Raymond M. Brach. Mechanical Impact Dynamics, John Wiley & Sons, New York, 1991.

[18] D. L. Brock. “Enhancing the Dexterity of a Robot Hand using Controlled Slip”? Proceed- ings of the 1988 IEEE Conference on Robotics and Automation, 1988.

[19] D. L. Brock. Enhancing the Dezterity of a Robot Hand using Controlled Slxy M.S. Thesis, Massachusetts Institute of Technology, 1987. Available as Technical Rcport AI-TR 992.

[ZO] M. Brokowski, M. Peshkin, and K. Goldberg. “Curved Fences for Part Alignment”, Prc- ceedings of the 1993 IEEE International Conference on Robotics and Automation, 1993.

[21] R. C. Brost. “Automatic Grasp Planning in the Presence of Uncertainty”! International Journal of Robotics Research, vol. 7 , no. 1, 1988.

[22] R. C. Brost. Analysis and Planning of Planar Manipulation Tasks. Ph.D. Thesis, School of Computer Science, Carnegie Mellon University, January 1991. Available as CMU-CS- 91-149.

[23] R. C. Brost and K. Y . Goldberg. ”A Complete Algorithm for Designing Planar Fixtures Using Modular Components”, IEEE Transactions on Robotics and Automation, vol. 12> no. 1, pp. 31-46, 1996.

[24] R. C. Brost and M. T. Mason. “Graphical Analysis of planar rigid-body dynamics with multiple frictional contacts”. In H. Muira and S. Arimoto, editors, Robotics Research: The Fifth International Symposium, pp. 293-300. Cambridge, Massachusetts, 1990, MIT Press.

I251 M. Buhler. Robotic Tasks with Intermittent Dynamics, Ph.D. Thesis, Yale University, 1990.

[26] M. Caine. “The Design of Shape Interactions Using Motion Constraints“, Proceedings of the 1994 IEEE Conference on Robotics and Automation, vol. 1, pp. 366-371, 1994.

[27] I. Calvino. “The model of models”! MT. Palomar, Harcourt Brace Jovanovich, Sari Dicgo, 1985.

116

Page 129: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

[ZS] A. Christiansen. Automatic Aquisition of Task Theories for Robotic h‘anipulation,, Ph.D. Thesis, Computer Science, Carnegie Mellon University, 1992. Available as Technical Re- port CMU-CS-92.111.

[29] W. K. Clifford. “The Postulates of the Science of Space”: The World of Mathematics, Vol. 1, J . R. Newman, ed. Simon and Sehuster, New York, 1956.

[30] J . P. Den Hartog. Mechanics, Dover Publications, New York, 1948.

[31] A. Einstein. ‘Ether and Relativity“, Sidelights on Relativity, Dover Publications, New York, 1983.

[32] M. A. Erdmann. “On a Representation of Friction in Configuration Space”, International Journal of Robotics Research, vol. 13, no. 3, June 1994.

[33] M. A. Erdmann. “An Exploration of Nonprehensile Two-Palm Manipulation: Planning and Execution”, presented at The International Symposium of Robotics Research, 1995.

[34] M. A. Erdmann and M. T. Mason. “An Exploration o f Sensorless Manipulation!’, IEEE Jourrkal of Robotics €4 Automation, vol. 4: no. 4, 1988.

[35] M. Erdmann, M. T. Mason, and G. Vaneek, Jr . ”Mechanical Parts Orienting: The Case of a Polyhedron on a Table”, Algorithmica, vol. 10, pp. 226-247, 1993.

[36] A. 0. Farahat and J. C. llinkle. “An Investigation of Dextrous Manipulation Planning using C-Functions and Stability Functions”, Proceedings of the 1 9 E IEEE/RSJ Interna- tional Conference on Intelligent Robots and Systems, 1992.

[37] K. Y. Goldberg. “Orienting Polygonal Parts without Sensors”, Algorithmica, vol. 10: pp. 201-225, 1993.

[38] S. Goyal, A. Ruina and J. Papadopoulos. “Planar Sliding with Dry Friction 1: Limit Surface and Moment Function”, Wear, vol. 143 no. 2, 1991.

[39] S. Goyal, A. Ruina and J. Papadopoulos. “Planar Sliding with Dry Friction 2: Dynamics of Motion”, Wear, uol. 143 no. 2, 1991.

140) H. Hitakawa. “Advanced parts orientation system has wide application”, Assembly Au- tomation, vol. 8, no. 3, 1988.

[41] L. Joskowicz and E. Sacks. Unifying Kinematics and Dynammics for the Automatic Anal- ysis of Machines. IBM Technical Report RC 15573, 1990.

[42] I. Kao and M. R. Cutkosky. “Quasistatic Manipulation with Compliance and Sliding”, International Journal of Robotics Reseawh, vol 11, No. 1, February 1992.

[43] I. Kao and M. R. Cutkosky. “Comparison of Theoretical and Experimental Force/Motion Trajectories for Dextrous Manipulation With Sliding”, International Journal of Robotics Research, vol. 12, No. 6, December 1993.

[44] J. Kepler. Gesammelte Werke, heraus gegeben unter der Leitung von Walther von Duck und Max Caspar. Miinchen, C. H. Beck, 1937. cited in R. Torretti. Philosophy of Geometry from Riemann to Poinmr-6, D. Reidel Publishing, Dordrecht, 1984.

117

Page 130: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

[45] J. M. Keynes. “Kewton, the Man“, exerpted in The World of Mathematics, Vnl. 1) J. R. Newman, ed. Simon and Schuster, New Ynrk, 1956.

[46] D. J. Kriegnian. “Computing Stable Poses of Picccwise Smooth Objects”, Computer Vi- sion, Graphics, and Image Processing: Image Understanding, vol. 55, no. 2; pp. 109-118, March 1992.

[47] D. J. Kriegman. “Let Them Fall Where They May: Capture Regions of Curved 3D Objects”, Proceedings, IEEE International Conference of Robotics and Automation, 1994.

[48] J. Krishnasamy, M. J. Jakiela, D. E. Whitney, ”Mcchanics of Vibration-assistcd Entrap- ment with Application to Design”, Proceedings of the 1996 IEEE International Conference on Robotics and Automation, pp. 838-845, 1996.

[49] D, Koditschek and M. Buhler. “Analysis of a Simplified Hopping Robot!!, International Journal of Robotics Research, vol. 10, no. 6, December 1991.

[50] J. C. Latombe. Robot Motion Planning, Klewer Academic Publishers, Norwell! 1991.

151) T. Lozano-PQrez. “Spatial Planning: A Configuration Space Approach“, IEEE Transac- tions on Computers, vol. C-32, no. 2, pp. 108-120, 1983.

[52] T. Lozano-Phrez, M. T. Mason and R. H. Taylor. “Automatic Synthesis of Fine-Motion Strategies for Robots”, International Journal of Robotics Research, vol. 3, no. 1, 1984.

(531 K. M. Lynch. “The Mechanics of Fine Manipulation by Pushing”: Proceedings of the 1992 IEEE International Conference on Robotics and Automation, 1992.

[54] K. M. Lynch. Nonprehensde robotic manipulation: Contmllahility and planning. P1i.D. Thesis, Robotics Institute, Carnegie Mellon University, March 1996. Available as CMU- RI-TR-96-05.

[55] K. M. Lynch and M. T. Mason. “Pulling by Pushing, slip with Infinite Friction, and Perfectly Rough Surfxes”, International Journal of Robotics Research, vol. 14, no. 2, pp. 174-183, 1995.

[5S] K. M. Lynch and M. T. Mason. “Stable Pushing: Mechanics, Controllability, and Plan- ning”, The First Workshop on the Algorithmic Foundations of Robotics, AK Peters, Boston, 1995.

[57] M. Mani and W. Wilson. “A Programmable Orienting System for Flat Parts”, Proceedings, North American Research institute conference XI& 1985.

[58] M. Mason. ‘Mechanics and Planning of Manipulator Pushing Operations“, International Journal of Robotics Research, vol. 5, no. 3, Fall 1986.

[59] M. Mason and K. Lynch. “Dynamic Manipulation”, Proceedings of the 1993 IEEE/RS.I International Conference an Intelligent Robots and Systems, 1993.

[60] M. M a o n and K. Lynch. “Throwing a Club Early Results!‘, presented at The I,~.te~nu- tional Symposium of Robotics Research, Hidden Valley, PA: Oct. 2-5, 1993.

118

Page 131: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

[61] R. Mattikalli, D. Bar&, P. Khosla, and B. Repetto. “Gravitational Stability of Frictionless Assemblies”, IEEE Transactions on Robotics and Automation, vol 11, no. 3> pp. 374-388,

. 1995.

[62] R. Mattikalli, D. Bar&, and P. Khosla. “Finding All Stable Orientations of Assemblies with Ekiction”, IEEE Transactions on Robotics and Automation, vol 12, no. 2; pp. 331-342, 1996.

[63] B. Mirtich, Y. Zhuang, K. Goldberg, J. Craig, R. Zanutta, B. Carlisle, and J. Canny. “Estimating Pose Statistics for Robotic Part Feeders”, Proceedings of the 1996 IEEE International Conference on Robotics and Automation, vol 2, pp. 1140-1146, 1996.

[64] B. K. Natarajan. “Some Paradigms for the Automated Design of Parts Feeders”: Inter- national Journal of Robotics Research, vol. 8, no. 6, pp. 98.109, 1989.

[65] V. Nguyen. “Constructing Force-Closure Grasps”, International Journnl of Robotics Re- search, vol. 7, no. 3, pp. 3-16, June 1988.

[66] E. Paljug, X. Yun. “Experimental Resuks of Two Robot Arms Manipulating Large Ob- jects“ Proceedings of the 1993 IEEE International Conference on Robotics and Automa- tion, 1993.

[67] E. Paljug, X. Yun, and V. Kumar. “Control of Rolling Contacts in Multi-Arm Manipula- tion”, IEEE Ilbansactions on Robotics & Automation, vol. 10; no. 4, August 1994.

[68] M. A. Peshkin and A. C. Sanderson. “Planning Robotic Manipulation Strategies“, lEEE Journal of Robotics t3 Automation, vol. 4, no. 5, October 1988.

[G9] M. A. Peshkin and A. C. Sanderson. “The Motion of a Pushed, Sliding Workpiece!’, IEEE Journal of Robotics €4 Automation, vol. 4, no. 6 , December 1988.

[70] G. Polya. How to Solve It, Princeton University Press, Princeton, 1957.

[71] J. Ponce and B. Faverjon. “On Computing Three-Finger Force-Closure Grasps of Polyg- onal Objects”, IEEE Thnsactions on Robotics and Automation, vol. 11, no. 6> 1995.

1721 J. Ponce. “On Planning Immobilizing Fixtures for ThrecDimemional Polyhedral Parts”, Proceedings of the 1996 IEEE Conference on Robotics and Automation, vol. 2> pp. 509-514, 1996.

[73] M. H. Raibert. Legged Robots that Balance, The MIT Press, Cambridge, MA, 1986.

[74] A. S, Rao and K. Y . Goldberg. “Manipulating Algebraic Parts in the Plane“? IEEE lhnsact ions on Robotics @ Automation, vol. 11, no. 4, pp. 598-602, August 1995.

[75] A. Raa; D. J. Kriegman, and K. Y . Goldberg. “Complete Algorithms €or Feeding Polyhc dral Parts Using Pivot Grasps”, IEEE Thnsactions on Robotics €9 Automation, vol. 12, no. 2, pp. 331-342, April 1996.

[76] F. Reuleaux. The Kinematics of Machinery, Dover Publications, New York, 1963.

119

Page 132: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

[77] E. Rimon and A. Blake. “Caging 2D Bodics by 1-Parameter Two-Finger Gripping Sys- tcms”, Proceedings of the 1996 IEEE Intewiational Conference on. Robotics und Aut0m.a- tion, vol. 2, pp. 1458-1464, 1996.

1781 E. Rimon and J. Burdick. “Mobility of Bodies i n Contact I A new 2nd order mobility index for multifingered grasps”, Proceedings of the 1994 IEEE International Conference o n Robotics and Automation, pp. 2329-2335, 1994.

[79] A. A. Rizzi and D. E. Koditschek “Progress in Spatial Robot Juggling“, Proceedings of the 199.2 IEEE International Conference on Robotics und Automation, 1992.

[SO] E. J. Routh. Dynamics of a System of Rigid Bodies, Vol. 1, Dover Publications, New York, 1960.

[81] W. R. Scott. G o u p Theory, Dover Publications, New York, 1987.

[82] W. J. Stronge. “Rigid body collisions with friction”, Proceedings of the Royal Socaety of London, A 431, 1990.

[83] W. T. Thomson. htroduction to Space Dynamics, Dover Publications, New York, 1986.

[84] J. C. lkinkle. “On the Stability and Instantaneous Velocity of Grasped Ftictionless Ob- jects”, IEEE Transactions on Robotics tY Automution, vol. 8: no. 5 , pp. 560-572, October 1992.

[85] J. C. Trinkle, A. 0. Farahat, and P. F. Stiller. “First Order Stability Cells of Active Frictionless R.igid Body Systems”, Proceedings of the 1993 IEEE International conference on Robotics and Automation, 1993.

[86] 3. C. Trinkle, A. 0. Farahat, and P. F. Stiller, P. F. ‘Second Order Stability Cells of Frictionless Rigid Body Systems”, proceedings of the 1994 IEEE International Conference on Robotics and Automation, 1994.

[87] J. C. Trinkle, A. 0. Faxahat, and P. F. Stiller. “First Order Stability Cells of Active Multi-Rigid-Body Systems“ IEEE Transactions on Robotics and Automation, vol. 11, no. 4: pp. 545-557, 1995.

[88] J. C. Trinkle and J. J. Hunter. “A Framework for Planning Dextrous Manipulation’!, Pmceedings of the I S S l IEEE International Conference on Robotics and Automation, 1991.

(891 J. C. Trinkle, R. P. Paul. “Planning for Dexterous Manipulation with Sliding Contacts”, International Journal of Robotics Research, vol. 9, no. 3, June 1990.

[go] J. C. Trinkle, R. C. Ram, A. 0. Farahat, and P. F. Stiller. “Dextrous Manipulation Planning and Execution of an Enveloped Slippery Workpiece”, Proceedings of the f 993 IEEE International Conference on Robotics and Automation, 1993.

1911 .I. C. Trinkle and D. C. Zeng. “Prediction of the Quasistatic Planar Motion of a Contacted Rigid Body”, IEEE k n s a c t i o n s on Robotics Automation, vol. 11 no. 2, April, 1995.

120

Page 133: A Nonprehensile Method for Reliable Parts Orienting · 2008. 10. 19. · A Nonprehensile Method for Reliable Parts Orienting Nina Banameda Zumel CMU-RI-TR-97- 13 Submitted in partial

[92] A. S. Wall&. “Generic Fixture Design Algorithms for Minimal Modular Fixture Toolk- its”, Proceedings of the 1996 IEEE International Conference on Robotics and Automation, 1996.

[93] Y, LVang. On Impact Dynamics of Robotic Operations, Technical Report CRIU-RI-TR-86- 14, Robotics Institute, Carnegie Mellon University, 1986.

[94] Y. Wang. Dynamic Analysis and Simulation of Mechanical Systems with Intermittent Constraints, Ph.D. Thesis, Mechanical Engineering, Carnegie Mellon University, 1989.

[95] J. Weigley, K. Y. Goldberg, M. Peshkin, and M. Brokowski. ‘’A Complete Algnrit,hni for Designing Passive Fences to Orient Parts”, Proceedings of the 1996 JEEE International Conference on Robotics and Automation, 1996.

[96] T. Yoshikawa, Y. Yokokohji and A. Nagayama. “Object Handling bu Thrcc-Fingered Hands using Slip Motion”, Proceedings of the 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 99-105, 1993.

[97] X. Yun. “Object Handling Using Two Arms without Grasping”, International Journal of Robotics Research, vol. 12; no. 1, Feb. 1993.

[98] N. B. Zumel and M. A. Erdmann. “Balancing of a Planar Bouncing Object“? Proceedings of the 1994 JEEE International Conference on Robotics and Automation, 1994.

[99] N. B. Zumel and M. A. Erdmann. “Nonprehensile Two Palm Manipulation with Non- Equilibrium Transitions between Stable States”, Proceedings of the 1996 IEEE Interna- tional Conference on Robotics and Automation, 1996.

121