Fusing Cochlea and Retina Events in a Deep Belief Network – Prof. Shih-Chii Liu (UZH-ETH Zurich)

From the MFI 2022 Workshop on Event Sensor Fusion
https://sites.google.com/view/eventsensorfusion2022/home

This talk summarizes the highly-cited 2013 paper Real-time classification and sensor fusion with a spiking deep belief network, where DVS and DAS silicon retina and cochlea outputs were fused in a spiking DBN to improve recognition of ambiguous MNIST digits. This talk will also describe the implementation on the Minitaur FPGA accelerator.