Vision-assisted control for manipulation using virtual fixtures

Alessandro Bettini, Panadda Marayong, Samuel Lang, Allison M. Okamura, Gregory Hager

Research output: Contribution to journalArticle

Abstract

We present the design and implementation of a vision-based system for cooperative manipulation at millimeter to micrometer scales. The system is based on an admittance control algorithm that implements a broad class of guidance modes called virtual fixtures. A virtual fixture, like a real fixture, limits the motion of a tool to a prescribed class or range of motions. We describe how both hard (unyielding) and soft (yielding) virtual fixtures can be implemented in this control framework. We then detail the construction of virtual fixtures for point positioning and curve following as well as extensions of these to tubes, cones, and sequences thereof. We also describe an implemented system using the JHU Steady Hand Robot. The system uses computer vision as a sensor for providing a reference trajectory, and the virtual fixture control algorithm then provides haptic feedback to implemented direct, shared manipulation. We provide extensive experimental results detailing both system performance and the effects of virtual fixtures on human speed and accuracy.

Original languageEnglish (US)
Pages (from-to)953-966
Number of pages14
JournalIEEE Transactions on Robotics
Volume20
Issue number6
DOIs
StatePublished - Dec 2004

Fingerprint

End effectors
Computer vision
Cones
Trajectories
Robots
Feedback
Sensors

Keywords

  • Human-machine systems
  • Robot control
  • Virtual fixtures
  • Visual servoing

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Electrical and Electronic Engineering

Cite this

Vision-assisted control for manipulation using virtual fixtures. / Bettini, Alessandro; Marayong, Panadda; Lang, Samuel; Okamura, Allison M.; Hager, Gregory.

In: IEEE Transactions on Robotics, Vol. 20, No. 6, 12.2004, p. 953-966.

Research output: Contribution to journalArticle

Bettini, Alessandro ; Marayong, Panadda ; Lang, Samuel ; Okamura, Allison M. ; Hager, Gregory. / Vision-assisted control for manipulation using virtual fixtures. In: IEEE Transactions on Robotics. 2004 ; Vol. 20, No. 6. pp. 953-966.
@article{a04d1fce144a488688274b153a4c2abb,
title = "Vision-assisted control for manipulation using virtual fixtures",
abstract = "We present the design and implementation of a vision-based system for cooperative manipulation at millimeter to micrometer scales. The system is based on an admittance control algorithm that implements a broad class of guidance modes called virtual fixtures. A virtual fixture, like a real fixture, limits the motion of a tool to a prescribed class or range of motions. We describe how both hard (unyielding) and soft (yielding) virtual fixtures can be implemented in this control framework. We then detail the construction of virtual fixtures for point positioning and curve following as well as extensions of these to tubes, cones, and sequences thereof. We also describe an implemented system using the JHU Steady Hand Robot. The system uses computer vision as a sensor for providing a reference trajectory, and the virtual fixture control algorithm then provides haptic feedback to implemented direct, shared manipulation. We provide extensive experimental results detailing both system performance and the effects of virtual fixtures on human speed and accuracy.",
keywords = "Human-machine systems, Robot control, Virtual fixtures, Visual servoing",
author = "Alessandro Bettini and Panadda Marayong and Samuel Lang and Okamura, {Allison M.} and Gregory Hager",
year = "2004",
month = "12",
doi = "10.1109/TRO.2004.829483",
language = "English (US)",
volume = "20",
pages = "953--966",
journal = "IEEE Transactions on Robotics",
issn = "1552-3098",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "6",

}

TY - JOUR

T1 - Vision-assisted control for manipulation using virtual fixtures

AU - Bettini, Alessandro

AU - Marayong, Panadda

AU - Lang, Samuel

AU - Okamura, Allison M.

AU - Hager, Gregory

PY - 2004/12

Y1 - 2004/12

N2 - We present the design and implementation of a vision-based system for cooperative manipulation at millimeter to micrometer scales. The system is based on an admittance control algorithm that implements a broad class of guidance modes called virtual fixtures. A virtual fixture, like a real fixture, limits the motion of a tool to a prescribed class or range of motions. We describe how both hard (unyielding) and soft (yielding) virtual fixtures can be implemented in this control framework. We then detail the construction of virtual fixtures for point positioning and curve following as well as extensions of these to tubes, cones, and sequences thereof. We also describe an implemented system using the JHU Steady Hand Robot. The system uses computer vision as a sensor for providing a reference trajectory, and the virtual fixture control algorithm then provides haptic feedback to implemented direct, shared manipulation. We provide extensive experimental results detailing both system performance and the effects of virtual fixtures on human speed and accuracy.

AB - We present the design and implementation of a vision-based system for cooperative manipulation at millimeter to micrometer scales. The system is based on an admittance control algorithm that implements a broad class of guidance modes called virtual fixtures. A virtual fixture, like a real fixture, limits the motion of a tool to a prescribed class or range of motions. We describe how both hard (unyielding) and soft (yielding) virtual fixtures can be implemented in this control framework. We then detail the construction of virtual fixtures for point positioning and curve following as well as extensions of these to tubes, cones, and sequences thereof. We also describe an implemented system using the JHU Steady Hand Robot. The system uses computer vision as a sensor for providing a reference trajectory, and the virtual fixture control algorithm then provides haptic feedback to implemented direct, shared manipulation. We provide extensive experimental results detailing both system performance and the effects of virtual fixtures on human speed and accuracy.

KW - Human-machine systems

KW - Robot control

KW - Virtual fixtures

KW - Visual servoing

UR - http://www.scopus.com/inward/record.url?scp=10944261380&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=10944261380&partnerID=8YFLogxK

U2 - 10.1109/TRO.2004.829483

DO - 10.1109/TRO.2004.829483

M3 - Article

AN - SCOPUS:10944261380

VL - 20

SP - 953

EP - 966

JO - IEEE Transactions on Robotics

JF - IEEE Transactions on Robotics

SN - 1552-3098

IS - 6

ER -