A Mixed-Reality Training Environment for Upper Limb Prosthesis Control

Avinash Sharma, Christopher L. Hunt, Asheesh Maheshwari, Luke Osborn, Gyorgy Levay, Rahul R. Kaliki, Alcimar B. Soares, Nitish V Thakor

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Adjusting to an amputation can often times be difficult for the body. Post-surgery, amputees not only have to incur expensive rehabilitation treatment costs, but also have to wait for up to several months before receiving a properly fitted prosthesis. We developed a mixed-reality training environment where amputees can train, at their own time and convenience, and interact with holographic objects, while also receiving tactile and proprioceptive feedback. We incorporate positional information through inertial sensors, touch and proprioception information through vibrational feedback, all integrated into an augmented-reality (AR) environment viewed through the Microsoft HoloLens TM. Training tasks were designed to account for limb rotation and object relocation in a three-dimensional space with a correct palm orientation essential for an intuitive grasp and release of objects. Our results showed an improved performance in training time, overshoot and completion rate with vibratory feedback (of both touch and proprioception) over without feedback. Furthermore, EMG activity was analyzed to estimate the muscular effort during each task.

Original languageEnglish (US)
Title of host publication2018 IEEE Biomedical Circuits and Systems Conference, BioCAS 2018 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538636039
DOIs
StatePublished - Dec 20 2018
Externally publishedYes
Event2018 IEEE Biomedical Circuits and Systems Conference, BioCAS 2018 - Cleveland, United States
Duration: Oct 17 2018Oct 19 2018

Other

Other2018 IEEE Biomedical Circuits and Systems Conference, BioCAS 2018
CountryUnited States
CityCleveland
Period10/17/1810/19/18

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Health Informatics
  • Instrumentation
  • Signal Processing
  • Biomedical Engineering

Fingerprint Dive into the research topics of 'A Mixed-Reality Training Environment for Upper Limb Prosthesis Control'. Together they form a unique fingerprint.

  • Cite this

    Sharma, A., Hunt, C. L., Maheshwari, A., Osborn, L., Levay, G., Kaliki, R. R., Soares, A. B., & Thakor, N. V. (2018). A Mixed-Reality Training Environment for Upper Limb Prosthesis Control. In 2018 IEEE Biomedical Circuits and Systems Conference, BioCAS 2018 - Proceedings [8584739] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BIOCAS.2018.8584739