Real-Time robot tracking and following with neuromorphic vision sensor

Abhishek Mishra, Rohan Ghosh, Ashish Goyal, Nitish V Thakor, Sunil L. Kukreja

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we consider the problem of robotic motion tracking and following with neuromorphic vision sensors. We formulate the problem in a leader-follower paradigm. The objective of the follower robot is to perform real-Time motion segmentation of a scene and follow the leader robot. Motion segmentation using a neuromorphic vision sensor mounted on a mobile robot is a challenging task due to events created by movements of the platform (self-movement). Current approaches for tracking do not perform well during sensor ego-motion or need a priori knowledge about the object being tracked. To address these limitations, we designed an algorithm based on clustering space-Time events induced by a neuromorphic sensor followed by a classification procedure. This technique is based on a distance transformation of existing sets. After clustering, a binary class label is assigned to each: (1) background or (2) moving object. The classifier uses event rates of clusters to determine proper class labels. The proposed technique forms an important module for the creation of collectively intelligent multi-pedal robots that utilize neuromorphic vision sensors. The utility and robustness of our algorithm is demonstrated as a real-Time online system implemented on two hexapod robots.

Original languageEnglish (US)
Title of host publication2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics, BioRob 2016
PublisherIEEE Computer Society
Pages13-18
Number of pages6
Volume2016-July
ISBN (Electronic)9781509032877
DOIs
StatePublished - Jul 26 2016
Externally publishedYes
Event6th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics, BioRob 2016 - Singapore, Singapore
Duration: Jun 26 2016Jun 29 2016

Other

Other6th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics, BioRob 2016
CountrySingapore
CitySingapore
Period6/26/166/29/16

ASJC Scopus subject areas

  • Artificial Intelligence
  • Biomedical Engineering
  • Mechanical Engineering

Fingerprint Dive into the research topics of 'Real-Time robot tracking and following with neuromorphic vision sensor'. Together they form a unique fingerprint.

  • Cite this

    Mishra, A., Ghosh, R., Goyal, A., Thakor, N. V., & Kukreja, S. L. (2016). Real-Time robot tracking and following with neuromorphic vision sensor. In 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics, BioRob 2016 (Vol. 2016-July, pp. 13-18). [7523451] IEEE Computer Society. https://doi.org/10.1109/BIOROB.2016.7523451