A Novel Task-Specific Upper-Extremity Rehabilitation System with Interactive Game-Based Interface for Stroke Patients

Veena Jayasree-Krishnan, Dhruv Gamdha, Brian S. Goldberg, Shramana Ghosh, Preeti Raghavan, Vikram Kapila

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present a novel task-specific upper-extremity rehabilitation system that uses an instrumented cup and an interactive gaming environment to promote patient engagement during repetitive rehabilitative exercise. The designed system tracks the movement of the cup as a stroke patient uses her forearm to perform a complex goal-oriented and task-specific activity, namely, grasping, lifting, and tilting the cup to drink from it. A force sensitive resistive sensor is mounted on the cup to constantly monitor the grasp force and the cup is endowed with rich features allowing a webcam to track and estimate its location and pose with the aid of state-of-the-art machine learning algorithms. This bi-manual forearm rehabilitation system is designed to enable stroke patients to perform an activity of daily living, namely, grasping, lifting, and tilting, repetitively, at their home as an exercise, so that they can relearn the motions of arm, wrist, and hand related to drinking.

Original languageEnglish (US)
Title of host publication2019 International Symposium on Medical Robotics, ISMR 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538678251
DOIs
StatePublished - May 8 2019
Externally publishedYes
Event2019 International Symposium on Medical Robotics, ISMR 2019 - Atlanta, United States
Duration: Apr 3 2019Apr 5 2019

Publication series

Name2019 International Symposium on Medical Robotics, ISMR 2019

Conference

Conference2019 International Symposium on Medical Robotics, ISMR 2019
CountryUnited States
CityAtlanta
Period4/3/194/5/19

Fingerprint

Patient rehabilitation
Learning algorithms
Learning systems
Sensors

Keywords

  • machine vision
  • pose estimation
  • rehabilitation
  • Stroke
  • virtual environment

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Vision and Pattern Recognition
  • Biomedical Engineering

Cite this

Jayasree-Krishnan, V., Gamdha, D., Goldberg, B. S., Ghosh, S., Raghavan, P., & Kapila, V. (2019). A Novel Task-Specific Upper-Extremity Rehabilitation System with Interactive Game-Based Interface for Stroke Patients. In 2019 International Symposium on Medical Robotics, ISMR 2019 [8710184] (2019 International Symposium on Medical Robotics, ISMR 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ISMR.2019.8710184

A Novel Task-Specific Upper-Extremity Rehabilitation System with Interactive Game-Based Interface for Stroke Patients. / Jayasree-Krishnan, Veena; Gamdha, Dhruv; Goldberg, Brian S.; Ghosh, Shramana; Raghavan, Preeti; Kapila, Vikram.

2019 International Symposium on Medical Robotics, ISMR 2019. Institute of Electrical and Electronics Engineers Inc., 2019. 8710184 (2019 International Symposium on Medical Robotics, ISMR 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Jayasree-Krishnan, V, Gamdha, D, Goldberg, BS, Ghosh, S, Raghavan, P & Kapila, V 2019, A Novel Task-Specific Upper-Extremity Rehabilitation System with Interactive Game-Based Interface for Stroke Patients. in 2019 International Symposium on Medical Robotics, ISMR 2019., 8710184, 2019 International Symposium on Medical Robotics, ISMR 2019, Institute of Electrical and Electronics Engineers Inc., 2019 International Symposium on Medical Robotics, ISMR 2019, Atlanta, United States, 4/3/19. https://doi.org/10.1109/ISMR.2019.8710184
Jayasree-Krishnan V, Gamdha D, Goldberg BS, Ghosh S, Raghavan P, Kapila V. A Novel Task-Specific Upper-Extremity Rehabilitation System with Interactive Game-Based Interface for Stroke Patients. In 2019 International Symposium on Medical Robotics, ISMR 2019. Institute of Electrical and Electronics Engineers Inc. 2019. 8710184. (2019 International Symposium on Medical Robotics, ISMR 2019). https://doi.org/10.1109/ISMR.2019.8710184
Jayasree-Krishnan, Veena ; Gamdha, Dhruv ; Goldberg, Brian S. ; Ghosh, Shramana ; Raghavan, Preeti ; Kapila, Vikram. / A Novel Task-Specific Upper-Extremity Rehabilitation System with Interactive Game-Based Interface for Stroke Patients. 2019 International Symposium on Medical Robotics, ISMR 2019. Institute of Electrical and Electronics Engineers Inc., 2019. (2019 International Symposium on Medical Robotics, ISMR 2019).
@inproceedings{70e66ccb19e14199a43db6367e442209,
title = "A Novel Task-Specific Upper-Extremity Rehabilitation System with Interactive Game-Based Interface for Stroke Patients",
abstract = "We present a novel task-specific upper-extremity rehabilitation system that uses an instrumented cup and an interactive gaming environment to promote patient engagement during repetitive rehabilitative exercise. The designed system tracks the movement of the cup as a stroke patient uses her forearm to perform a complex goal-oriented and task-specific activity, namely, grasping, lifting, and tilting the cup to drink from it. A force sensitive resistive sensor is mounted on the cup to constantly monitor the grasp force and the cup is endowed with rich features allowing a webcam to track and estimate its location and pose with the aid of state-of-the-art machine learning algorithms. This bi-manual forearm rehabilitation system is designed to enable stroke patients to perform an activity of daily living, namely, grasping, lifting, and tilting, repetitively, at their home as an exercise, so that they can relearn the motions of arm, wrist, and hand related to drinking.",
keywords = "machine vision, pose estimation, rehabilitation, Stroke, virtual environment",
author = "Veena Jayasree-Krishnan and Dhruv Gamdha and Goldberg, {Brian S.} and Shramana Ghosh and Preeti Raghavan and Vikram Kapila",
year = "2019",
month = "5",
day = "8",
doi = "10.1109/ISMR.2019.8710184",
language = "English (US)",
series = "2019 International Symposium on Medical Robotics, ISMR 2019",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2019 International Symposium on Medical Robotics, ISMR 2019",

}

TY - GEN

T1 - A Novel Task-Specific Upper-Extremity Rehabilitation System with Interactive Game-Based Interface for Stroke Patients

AU - Jayasree-Krishnan, Veena

AU - Gamdha, Dhruv

AU - Goldberg, Brian S.

AU - Ghosh, Shramana

AU - Raghavan, Preeti

AU - Kapila, Vikram

PY - 2019/5/8

Y1 - 2019/5/8

N2 - We present a novel task-specific upper-extremity rehabilitation system that uses an instrumented cup and an interactive gaming environment to promote patient engagement during repetitive rehabilitative exercise. The designed system tracks the movement of the cup as a stroke patient uses her forearm to perform a complex goal-oriented and task-specific activity, namely, grasping, lifting, and tilting the cup to drink from it. A force sensitive resistive sensor is mounted on the cup to constantly monitor the grasp force and the cup is endowed with rich features allowing a webcam to track and estimate its location and pose with the aid of state-of-the-art machine learning algorithms. This bi-manual forearm rehabilitation system is designed to enable stroke patients to perform an activity of daily living, namely, grasping, lifting, and tilting, repetitively, at their home as an exercise, so that they can relearn the motions of arm, wrist, and hand related to drinking.

AB - We present a novel task-specific upper-extremity rehabilitation system that uses an instrumented cup and an interactive gaming environment to promote patient engagement during repetitive rehabilitative exercise. The designed system tracks the movement of the cup as a stroke patient uses her forearm to perform a complex goal-oriented and task-specific activity, namely, grasping, lifting, and tilting the cup to drink from it. A force sensitive resistive sensor is mounted on the cup to constantly monitor the grasp force and the cup is endowed with rich features allowing a webcam to track and estimate its location and pose with the aid of state-of-the-art machine learning algorithms. This bi-manual forearm rehabilitation system is designed to enable stroke patients to perform an activity of daily living, namely, grasping, lifting, and tilting, repetitively, at their home as an exercise, so that they can relearn the motions of arm, wrist, and hand related to drinking.

KW - machine vision

KW - pose estimation

KW - rehabilitation

KW - Stroke

KW - virtual environment

UR - http://www.scopus.com/inward/record.url?scp=85066340352&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85066340352&partnerID=8YFLogxK

U2 - 10.1109/ISMR.2019.8710184

DO - 10.1109/ISMR.2019.8710184

M3 - Conference contribution

T3 - 2019 International Symposium on Medical Robotics, ISMR 2019

BT - 2019 International Symposium on Medical Robotics, ISMR 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -