Audio-Visual beamforming with the Eigenmike microphone array an omni-camera and cognitive auditory features

Daniel R. Mendat, James E. West, Sudarshan Ramenahalli, Ernst Niebur, Andreas G. Andreou

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Audio-visual beamforming involves both an acoustic sensor and an omni-camera to form a composite 3D audio-visual representation of the environment. Information from the respective modalities is combined in the process of acoustic localization taking into account high level cognitive features of the signals, namely the presence of specific sounds - speech and tones - which have characteristic signatures in specific spectral bands. We compare the results from two systems. One is a custom-built architecture based on the MH Acoustics Eigenmike microphone array and a consumer grade omni-camera (Bloggie). The other is the commercially available Visisonics Audio-Visual (AV) camera. We show that the performances of the two systems are comparable.

Original languageEnglish (US)
Title of host publication2017 51st Annual Conference on Information Sciences and Systems, CISS 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509047802
DOIs
StatePublished - May 10 2017
Event51st Annual Conference on Information Sciences and Systems, CISS 2017 - Baltimore, United States
Duration: Mar 22 2017Mar 24 2017

Other

Other51st Annual Conference on Information Sciences and Systems, CISS 2017
CountryUnited States
CityBaltimore
Period3/22/173/24/17

ASJC Scopus subject areas

  • Signal Processing
  • Information Systems and Management
  • Computer Networks and Communications
  • Information Systems

Fingerprint Dive into the research topics of 'Audio-Visual beamforming with the Eigenmike microphone array an omni-camera and cognitive auditory features'. Together they form a unique fingerprint.

Cite this