Abstract
Motion detection is paramount for computational vision processing. This is however a particularly challenging task for a neuromorphic hardware in which algorithms are based on interconnected spiking entities, as the instantaneous visual stimuli reports merely on luminance change. Here we describe a neuromorphic algorithm, in which an array of neuro-oscillators is utilized to detect motion and its direction over an entire field of view. These oscillators are induced via phase shifted Gabor functions, allowing them to oscillate in response to motion in one predefined direction, and to dump to zero otherwise. We developed the algorithm using the Neural Engineering Framework (NEF), making it applicable for a variety of neuromorphic hardware. Our algorithm extends the existing growing set of approaches aiming at utilizing neuromorphic hardware for vision processing, which enable to minimize energy exploitation and silicon area while enhancing computational capabilities.
| Original language | English |
|---|---|
| Pages (from-to) | 54-63 |
| Number of pages | 10 |
| Journal | Neurocomputing |
| Volume | 374 |
| DOIs | |
| State | Published - 21 Jan 2020 |
| Externally published | Yes |
Bibliographical note
Funding Information:This work was initiated during a research summer program at the center for theoretical neuroscience, at the University of Waterloo. The authors would like to thank the faculty and students of the center for the discussions, and particularly to Dr. Terrence C. Stewart and Prof. Chris Eliasmith. This work was supported by research grants from the I-CORE (51/11), the Minerva foundation, the ISF foundation (1396/15), and the European Research Council (ERC-StG 757732), and by Dr. and Mrs. Alan Leshner; the Lubin-Schupf Fund for Women in Science; the Charles and David Wolfson Charitable Trust; and Ms. Lois Pope. E. E. T. was supported by the Dean of Faculty postdoctoral fellowship at Weizmann Institute of Science. M.R.-E. is incumbent of the Sara Lee Schupf Family Chair. The Titan Xp used in this work was generously granted by the NVIDIA Corporation.
Funding Information:
This work was supported by research grants from the I-CORE (51/11), the Minerva foundation, the ISF foundation (1396/15), and the European Research Council ( ERC-StG 757732 ), and by Dr. and Mrs. Alan Leshner; the Lubin-Schupf Fund for Women in Science; the Charles and David Wolfson Charitable Trust; and Ms. Lois Pope. E. E. T. was supported by the Dean of Faculty postdoctoral fellowship at Weizmann Institute of Science . M.R.-E. is incumbent of the Sara Lee Schupf Family Chair. The Titan Xp used in this work was generously granted by the NVIDIA Corporation.
Publisher Copyright:
© 2019
Keywords
- Motion detection
- Nengo
- Neural engineering framework
- Neuromorphic vision sensor
- Optical flow
- Spike-based camera emulator