Resources and Tools
Most Recent
Dynex
A digital twin of a physical neuromorphic quantum computing machine, which is operated on hundreds of thousands of GPUs in parallel, delivering unparalleled quantum computing performance at scale for real-world applications....
Event-based Normal Flow EstimatorNew
Dehao Yuan
It is an easy-to-use API for event-based normal flow prediction. Official GitHub repo for "Learning Normal Flow Directly from Event Neighborhoods"....
Address-Event RepresentationNew
Tobi Delbruck
Java tools for Address-Event Representation (AER) neuromorphic vision and audio sensor processing. An open source project for real time sensory-motor processing for event-based sensors and systems...
Jetson-Symbolics + NeuromorphicsNew
Robert Trelease
Integrating Symbolic Programming and Neuromorphic Modeling with NVIDIA Jetson and GPU-based DNN/ML Systems for Edge Labs...
Neuromorphics Daily ArxivNew
Dengyu Wu
Neuromorphic paper list, a comprehensive collection of the latest research in the field, is carefully curated and automatically updated every day at 8:00 am GMT to ensure readers have access to the most up-to-date information available....
Prophesee DatasetNew
Prophesee
Prophesee’s latest automotive object detection dataset is some 3.5 TB in size for under 40h of recordings with a single camera....
Application > Autonomous Vehicles
Maqueda, Ana I et al.
A deep neural network approach that unlocks the potential of event cameras on a challenging motion-estimation task: prediction of a vehicle's steering angle....
Reinforcement Learning Meets Visual Odometry
Nico Messikommer et. al.
This approach introduces a neural network, operating as an agent within the VO pipeline, to make decisions such as keyframe and grid-size selection based on real-time conditions....
Low Latency Automotive Vision with Event Cameras
Gehrig, Daniel and Scaramuzza, Davide
A hybrid event- and frame-based object detector that preserves the advantages of each modality and thus does not suffer from this trade-off. Our method exploits the high temporal resolution and sparsity of events and the rich but low temporal resolution information in standard images to generate efficient, high-rate object detections, reducing perceptual and computational latency....
State Space Models for Event Cameras
Zubic, Nikola et. al.
This workutilize SSMs for temporal aggregation, which enables faster training by either utilizing the S4 model or S5 parallel scans. By their nature, these models allow deployment at different frequencies than those used at training time since they have a learnable timescale parameter....
Deep Visual Odometry with Events and Frames
Pellerito, Roberto et. al. from UZH-RPG
An end-to-end learned image- and event-based VO system. It leverages novel Recurrent, Asynchronous, and Massively Parallel (RAMP) encoders capable of fusing asynchronous events with image data....
Application > Event-based Vision
Dehao Yuan
It is an easy-to-use API for event-based normal flow prediction. Official GitHub repo for "Learning Normal Flow Directly from Event Neighborhoods"....
Address-Event RepresentationNew
Tobi Delbruck
Java tools for Address-Event Representation (AER) neuromorphic vision and audio sensor processing. An open source project for real time sensory-motor processing for event-based sensors and systems...
Low Latency Automotive Vision with Event Cameras
Gehrig, Daniel and Scaramuzza, Davide
A hybrid event- and frame-based object detector that preserves the advantages of each modality and thus does not suffer from this trade-off. Our method exploits the high temporal resolution and sparsity of events and the rich but low temporal resolution information in standard images to generate efficient, high-rate object detections, reducing perceptual and computational latency....
State Space Models for Event Cameras
Zubic, Nikola et. al.
This workutilize SSMs for temporal aggregation, which enables faster training by either utilizing the S4 model or S5 parallel scans. By their nature, these models allow deployment at different frequencies than those used at training time since they have a learnable timescale parameter....
Deep Visual Odometry with Events and Frames
Pellerito, Roberto et. al. from UZH-RPG
An end-to-end learned image- and event-based VO system. It leverages novel Recurrent, Asynchronous, and Massively Parallel (RAMP) encoders capable of fusing asynchronous events with image data....
Retina : Low-Power Eye Tracking with Event Camera and Spiking Hardware
Pietro Bonazzi and others
A neuromorphic methodology for eye tracking, harnessing pure event data captured by a Dynamic Vision Sensor (DVS) camera. The framework integrates a directly trained Spiking Neuron Network (SNN) regression model and leverages a state-of-the-art low power edge neuromorphic processor - Speck, collectively aiming to advance the precision and efficiency of eye-tracking systems....
ADDER-codec-rs
Andrew C. Freeman
A unified framework for event-based video. Encoder/transcoder/decoder for ADΔER (Address, Decimation, Δt Event Representation) video streams. Includes a transcoder for casting framed video into an ADΔER representation in a manner which preserves the temporal synchronicity of the source, but enables many-frame intensity averaging on a per-pixel basis and extremely high dynamic range....
DCEIFlow
Zhexiong Wan and others
A deep learning-based dense and continuous optical flow estimation framework from a single image with event streams, which facilitates the accurate perception of high-speed motion....
Event-Driven Visual-Tactile Sensing and Learning for Robots
Tasbolat Taunyazov
NeuTouch is a neuromorphic fingertip tactile sensor that scales well with the number of taxels. The proposed Visual-Tactile Spiking Neural Network (VT-SNN) also enables fast perception when coupled with event sensors. The system is evaluated on two robot tasks: container classification and rotational slip detection....
NxTF: An API and Compiler for Deep Spiking Neural Networks on Intel Loihi
Bodo Rueckauer and others
An open-source software platform for compiling and running deep spiking neural networks (SNNs) on the Intel Loihi neuromorphic hardware platform. The paper introduces the NxTF API, which provides a simple interface for defining and training SNNs using common deep learning frameworks, and the NxTF compiler, which translates trained SNN models into executable code for the Loihi chip....
NeuroKit2
Nanyang Technological University
A user-friendly package providing easy access to advanced biosignal processing routines. Researchers and clinicians without extensive knowledge of programming or biomedical signal processing can analyze physiological data with only two lines of code....
Telluride Decoding Toolbox
Telluride Engineering Workshop Participants - Institute of Neuromorphic Engineering
A set of tools that allow users to decode brain signals into the signals that generated them. It can determine whether the signals come from visual or auditory stimuli, and whether they are measured with EEG, MEG, ECoG or any other neural response for decoding. This toolbox is provided as Matlab and Python code, along with documentation and some sample EEG and MEG data....
Application > Robotics
Nico Messikommer et. al.
This approach introduces a neural network, operating as an agent within the VO pipeline, to make decisions such as keyframe and grid-size selection based on real-time conditions....
Low Latency Automotive Vision with Event Cameras
Gehrig, Daniel and Scaramuzza, Davide
A hybrid event- and frame-based object detector that preserves the advantages of each modality and thus does not suffer from this trade-off. Our method exploits the high temporal resolution and sparsity of events and the rich but low temporal resolution information in standard images to generate efficient, high-rate object detections, reducing perceptual and computational latency....
State Space Models for Event Cameras
Zubic, Nikola et. al.
This workutilize SSMs for temporal aggregation, which enables faster training by either utilizing the S4 model or S5 parallel scans. By their nature, these models allow deployment at different frequencies than those used at training time since they have a learnable timescale parameter....
Deep Visual Odometry with Events and Frames
Pellerito, Roberto et. al. from UZH-RPG
An end-to-end learned image- and event-based VO system. It leverages novel Recurrent, Asynchronous, and Massively Parallel (RAMP) encoders capable of fusing asynchronous events with image data....
Microsaccade-inspired Event Camera for Robotics
UMD PRG
A new event-based vision system that can acquire more environmental information than traditional event cameras. It can maintain a high-informational output while preserving the advantages of event cameras, such as HDR and high temporal resolution....
YARP integration for event-cameras and other neuromorphic sensors
Robotology
Libraries that handle neuromorphic sensors, such as the dynamic vision sensor, installed on the iCub can be found here, along with algorithms to process the event-based data. Examples include, optical flow, corner detection and ball detection. Demo applications for the iCub robot, and tutorials for running them, include saccading and attention, gaze following a ball, and vergence control....
Spiking Oculomotor Network for Robotic Head Control
Loannis Polykretis and others
This package is the Python and ROS implementation of a spiking neural network on Intel's Loihi neuromorphic processor mimicking the oculomotor system to control a biomimetic robotic head....
Spiking Neural Network for Mapless Navigation
Guangzhi Tang and others
A PyTorch implementation of the Spiking Deep Deterministic Policy Gradient (SDDPG) framework. The hybrid framework trains a spiking neural network (SNN) for energy-efficient mapless navigation on Intel's Loihi neuromorphic processor....
Collections
Dengyu Wu
Neuromorphic paper list, a comprehensive collection of the latest research in the field, is carefully curated and automatically updated every day at 8:00 am GMT to ensure readers have access to the most up-to-date information available....
Flightmare
Song, Yunlong et al.
A flexible modular quadrotor simulator that supports event camera. Flightmare is composed of two main components: a configurable rendering engine built on Unity and a flexible physics engine for dynamics simulation....
NIR – Neuromorphic Intermediate Representation
Institute of Neuromorphic Engineering
NIR is a set of computational primitives, shared across different neuromorphic frameworks and technology stacks. The goal of NIR is to decouple the evolution of neuromorphic hardware and software, ultimately increasing the interoperability between platforms and improving accessibility to neuromorphic technologies....
NIRTorch
Institute of Neuromorphic Engineering
PyTorch helpers for the Neuromorphic Intermediate Representation (NIR). This is a no frills python package to enable torch based libraries to translate to NIR....
YARP integration for event-cameras and other neuromorphic sensors
Robotology
Libraries that handle neuromorphic sensors, such as the dynamic vision sensor, installed on the iCub can be found here, along with algorithms to process the event-based data. Examples include, optical flow, corner detection and ball detection. Demo applications for the iCub robot, and tutorials for running them, include saccading and attention, gaze following a ball, and vergence control....
Neuromorphic Computing Guide
Michael Royal
A guide covering Neuromorphic Computing including the applications, libraries and tools that will make you better and more efficient with Neuromorphic Computing development....
NEUROTECH
NEUROTECH
Creators and leaders of the Neuromorphic Computing Technology community in Europe, by catalyzing research and collaboration....
Open Neuromorphic Collection
Open Neuromorphic
Open Neuromorphic (ONM) provides two things: (i) A curated list of software frameworks to make it easier for everyone to find the tool. (ii)A platform for your code. If you wish to create a new repository or migrate your existing code to ONM, please get in touch with us. You will be made a member of this organisation immediately....
Python Tutorial for Spiking Neural Network
Shikhar Gupta
This is a Python implementation of a hardware efficient spiking neural network. It includes modified learning and prediction rules which could be realised on hardware in an energy efficient way. The aim is to develop a network which could be used for on-chip learning and prediction....
Neuromatch Academy Tutorials
Neuromatch Academy
We have curated a curriculum that spans most areas of computational neuroscience (a hard task in an increasingly big field!). We will expose you to both theoretical modeling and more data-driven analyses. This section will overview the curriculum....
Event-Based Vision Resources
Guillermo Gallego and others
A collection of resources related to event-based vision, a type of computer vision that processes visual data as a stream of events, rather than traditional frame-based methods. The repository contains links to relevant papers, datasets, and tutorials to help further research and development in this field....
Data Sets
Prophesee
Prophesee’s latest automotive object detection dataset is some 3.5 TB in size for under 40h of recordings with a single camera....
VisEvent
Xiao Wang et. al.
A large-scale benchmark dataset for reliable object tracking by fusing RGB and event cameras. The dataset consists of 820 video pairs captured under low illumination, high speed, and background clutter scenarios, and it is divided into a training and a testing subset, each of which contains 500 and 320 videos, respectively....
NatSGD
NatSGD: A Dataset with Speech, Gestures, and Demonstrations for Robot Learning in Natural Human-Robot Interaction
Recent advancements in multimodal Human-Robot Interaction (HRI) datasets have highlighted the fusion of speech and gesture, expanding robots’ capabilities to absorb explicit and implicit HRI insights. However, existing speech-gesture HRI datasets often focus on...
Tonic
Institute of Neuromorphic Engineering
A tool to facilitate the download, manipulation and loading of event-based/spike-based data. It's like PyTorch Vision but for neuromorphic data!...
A Low Power, Fully Event-Based Gesture Recognition System
IBM Research
This dataset was used to build the real-time, gesture recognition system described in the CVPR 2017 paper titled “A Low Power, Fully Event-Based Gesture Recognition System.” The data was recorded using a DVS128. The dataset contains 11 hand gestures from 29 subjects under 3 illumination conditions and is released under a Creative Commons Attribution 4.0 license....
Neuromorphic-Caltech101 (N-Caltech101) dataset
Garrick Orchard and others
A spiking version of the original frame-based Caltech101 dataset. The N-Caltech101 dataset was captured by mounting the ATIS sensor on a motorized pan-tilt unit and having the sensor move while it views Caltech101 examples on an LCD monitor as shown in the video below....
BR Keyword Spotting Power Benchmarks
Applied Brain Research
This dataset contains power benchmarking code for running a simple two-layer, 256-neuron-per-layer neural network keyword spotter on both neuromorphic and conventional hardware devices....
EV-IMO: An Event Camera Motion Segmentation Dataset
Perception and Robotics Group, University of Maryland
a collection of indoor datasets for motion segmentation and ego-motion estimation gathered with a variety of event-based sensors. The dataset features 6 DoF poses for Camera and Independently Moving Objects updated at 200 Hz, and pixel-wise object masks at 40 Hz. Depth maps and classical camera frames are also available for most sequences....
Machine Learning
Robert Trelease
Integrating Symbolic Programming and Neuromorphic Modeling with NVIDIA Jetson and GPU-based DNN/ML Systems for Edge Labs...
NEST
The Neural Simulation Technology Initiative
NEST is a simulator for spiking neural network models that focuses on the dynamics, size and structure of neural systems rather than on the exact morphology of individual neurons. The development of NEST is coordinated by the NEST Initiative....
Spyx
A compact spiking neural network library built on top of DeepMind's Haiku package, offering the flexibility and extensibility of PyTorch-based frameworks while enabling the extreme perfomance of SNN libraries which implement custom CUDA kernels for their dynamics....
Sinabs
Synsense
A python library for the development and implementation of Spiking Convolutional Neural Networks (SCNNs). The library implements several layers that are spiking equivalents of CNN layers. In addition it provides support to import CNN models implemented in torch conveniently to test their spiking equivalent implementation....
Retina : Low-Power Eye Tracking with Event Camera and Spiking Hardware
Pietro Bonazzi and others
A neuromorphic methodology for eye tracking, harnessing pure event data captured by a Dynamic Vision Sensor (DVS) camera. The framework integrates a directly trained Spiking Neuron Network (SNN) regression model and leverages a state-of-the-art low power edge neuromorphic processor - Speck, collectively aiming to advance the precision and efficiency of eye-tracking systems....
Neuromorphic Platforms
Dynex
A digital twin of a physical neuromorphic quantum computing machine, which is operated on hundreds of thousands of GPUs in parallel, delivering unparalleled quantum computing performance at scale for real-world applications....
NEST
The Neural Simulation Technology Initiative
NEST is a simulator for spiking neural network models that focuses on the dynamics, size and structure of neural systems rather than on the exact morphology of individual neurons. The development of NEST is coordinated by the NEST Initiative....
BindsNET
BindsNET
A deep learning platform built on top of the PyTorch. It is used for the simulation of spiking neural networks (SNNs) and is geared towards machine learning and reinforcement learning....
Microsaccade-inspired Event Camera for Robotics
UMD PRG
A new event-based vision system that can acquire more environmental information than traditional event cameras. It can maintain a high-informational output while preserving the advantages of event cameras, such as HDR and high temporal resolution....
Neuromorphic FPGA
TENNLab
A simple and minimalist—but highly scalable—Field-Programmable Gate Array implementation of neuromorphic computing defined by Univeristy of Tennesse Knoxville (UTK) TENNLab research....
Beam-Prop
Alexandros Pitilakis and others
Beam Propagation Method (BPM) for planar photonic integrated circuits (PIC), implemented in MATLAB with finite-differences....
A Complete Neuromorphic Solution to Outdoor Navigation and Path Planning
Tiffany Hwu and others
A complete neuromorphic solution to outdoor navigation and path planning. The proposed solution is based on a spiking neural network that mimics the biological nervous system of insects. The solution is tested in a real-world scenario and demonstrates promising results in terms of accuracy and efficiency....
In-Memory Computing on a Photonic Platform
Carlos Rios and others
A photonic platform that can combine integrated optics with collocated data storage and processing to enable all-photonic, in-memory computations. By employing nonvolatile photonic elements based on a special phase-change material, it can achieve direct scalar and matrix-vector multiplication, featuring a novel single-shot Write/Erase and a drift-free process....
A Million Spiking-Neuron Integrated Circuit with a Scalable Communication Network and Interface
Paul Merolla and others
A scalable and flexible non–von Neumann architecture that leverages contemporary silicon technology. It includes a 5.4-billion-transistor chip with 4096 neuro synaptic cores interconnected via an intra chip network that integrates 1 million programmable spiking neurons....
Blender RobotDesigner of the Neurorobotics Platform (NRP)
Human Brain Project (HBP)
A modeling tool that can generate geometric, kinematic and dynamic models, as well as sensor placement that can be used in the simulation environment of NRP – or any ROS/Gazebo-based environment....
NeuRRAM neuromorphic chip
Stanford University
The NeuRRAM neuromorphic chip is a state-of-the-art “compute-in-memory” hybrid circuit that executes computations in memory. It can perform complex cognitive operations without requiring a network connection to a central server. The device is also incredibly adaptable and supports many neural network models and topologies....
HBP Neuromorphic Computing Platform
Human Brain Project
The Neuromorphic Computing systems SpiNNaker and BrainScaleS allow neuroscientists and engineers to perform experiments with configurable neuromorphic computing systems. The systems are part of the EBRAINS research infrastructure, which is created by the Human Brain Project (HBP)....
Loihi 2
Intel
Intel Labs’ second-generation neuromorphic research chip, codenamed Loihi 2, and Lava, is an open-source software framework, which will drive innovation and adoption of neuromorphic computing solutions. Loihi2 is the latest iteration of Intel's Loihi neuromorphic computing platform and is available for partners who want to collaborate with the corporation to explore what it can do....
Sensors > Audio
Juan Pedro Dominguez-Morales
An open-source cross-platform Python module for analyzing and processing spiking information obtained from neuromorphic auditory sensors. It is primarily focused to be used with a NAS, but can work with any other cochlea sensor....
Xylo Audio HDK
Synsense
A low-power digital SNN inference chip, including a dedicated audio interface. The Xylo-Audio HDK includes an on-board microphone and direct analog audio input for audio processing applications....
Dynamic Audio Sensor
iniLabs
An asynchronous event-based silicon cochlea. The board takes stereo audio inputs; the custom chip asynchronously outputs a stream of address-events representing activity in different frequency ranges. As such it is a silicon model of the cochlea, the auditory inner ear....
Sensors > Touch
Institute for Cognitive Systems, Technical University of Munich
A multimodal tactile-sensing module for humanoid robots. By integrating various sensing technologies, this module enables robots to perceive complex tactile information such as force, pressure, temperature, and texture....
Event-Driven Visual-Tactile Sensing and Learning for Robots
Tasbolat Taunyazov
NeuTouch is a neuromorphic fingertip tactile sensor that scales well with the number of taxels. The proposed Visual-Tactile Spiking Neural Network (VT-SNN) also enables fast perception when coupled with event sensors. The system is evaluated on two robot tasks: container classification and rotational slip detection....
Skin-Inspired Flexible and Stretchable Electrospun Carbon Nanofiber Sensors for Neuromorphic Sensing
Debarun Sengupta and others
An approach entailing carbon nanofiber–polydimethylsiloxane composite-based piezoresistive sensors, coupled with spiking neural networks, to mimic skin-like sensing....
Prosthesis with Neuromorphic Multilayered E-dermis
Luke Osborn and others
A multilayered electronic dermis (e-dermis) with properties based on the behavior of mechanoreceptors and nociceptors to provide neuromorphic tactile information for an amputee....
Sensors > Vision
UMD PRG
A new event-based vision system that can acquire more environmental information than traditional event cameras. It can maintain a high-informational output while preserving the advantages of event cameras, such as HDR and high temporal resolution....
Speck smart vision sensor
Synsense
Speck is a neuromorphic vision system-on-chip, combining an event-based vision sensor with spiking CNN cores for inference on vision tasks. The Speck HDK includes an interchangeable lens, and full resources for developing neuromorphic vision applications....
Metavision and the IMX636ES Sensor
Sony and Prophesee
Metavision Sensing and Software offer all the resources to work with event-driven cameras. The sensational IMX636ES is the new event-driven sensor created by a collaboration between Sony and PROPHESEE. The Metavision software offers 95 algorithms, 67 code samples and 11 ready-to-use applications to be used with this new generation of cameras....
DVXplorer Series
Inivation AG
A high-resolution event-based sensors that only output event streams. Compared to the DAVIS series, it can provide (640 x 480) resolution, but is not able to output greyscale images....
DAVIS346
Inivation AG
A dynamic and active pixel vision sensor (DAVIS), which addresses the lack of greyscale output of the DVXplorer series by utilising asynchronous DVS events and synchronous global shutter frames concurrently. The active pixel sensor (APS) circuits and the DVS circuits within a pixel share a single photodiode....
Software and Tools
Tobi Delbruck
Java tools for Address-Event Representation (AER) neuromorphic vision and audio sensor processing. An open source project for real time sensory-motor processing for event-based sensors and systems...
SpikingJelly
SpikingJelly is a comprehensive, open-source deep learning framework designed for Spiking Neural Networks (SNNs), built on top of PyTorch. It provides a robust set of tools and features for researchers, developers, and enthusiasts looking to harness the power of SNNs for neuromorphic computing and beyond....
Spyx
A compact spiking neural network library built on top of DeepMind's Haiku package, offering the flexibility and extensibility of PyTorch-based frameworks while enabling the extreme perfomance of SNN libraries which implement custom CUDA kernels for their dynamics....
BindsNET
BindsNET
A deep learning platform built on top of the PyTorch. It is used for the simulation of spiking neural networks (SNNs) and is geared towards machine learning and reinforcement learning....
Dynamic Neural Fields
Lava
Dynamic Neural Fields (DNF) are neural attractor networks that generate stabilized activity patterns in recurrently connected populations of neurons. These activity patterns form the basis of neural representations, decision making, working memory, and learning....
State Space Models for Event Cameras
uzh-rpg
Introduce state-space models (SSMs) with learnable timescale parameters to event-based vision. This design adapts to varying frequencies without the need to retrain the network at different frequencies....
SAMNA
Synsense
Samna is the developer interface to the SynSense toolchain and run-time environment for interacting with all SynSense devices....
Sinabs
Synsense
A python library for the development and implementation of Spiking Convolutional Neural Networks (SCNNs). The library implements several layers that are spiking equivalents of CNN layers. In addition it provides support to import CNN models implemented in torch conveniently to test their spiking equivalent implementation....
Microsaccade-inspired Event Camera for Robotics
UMD PRG
A new event-based vision system that can acquire more environmental information than traditional event cameras. It can maintain a high-informational output while preserving the advantages of event cameras, such as HDR and high temporal resolution....
Retina : Low-Power Eye Tracking with Event Camera and Spiking Hardware
Pietro Bonazzi and others
A neuromorphic methodology for eye tracking, harnessing pure event data captured by a Dynamic Vision Sensor (DVS) camera. The framework integrates a directly trained Spiking Neuron Network (SNN) regression model and leverages a state-of-the-art low power edge neuromorphic processor - Speck, collectively aiming to advance the precision and efficiency of eye-tracking systems....
ADDER-codec-rs
Andrew C. Freeman
A unified framework for event-based video. Encoder/transcoder/decoder for ADΔER (Address, Decimation, Δt Event Representation) video streams. Includes a transcoder for casting framed video into an ADΔER representation in a manner which preserves the temporal synchronicity of the source, but enables many-frame intensity averaging on a per-pixel basis and extremely high dynamic range....
Spike-driven Transformer V2
Man Yao et al.
A general Transformer-based SNN architecture, whose goals are: (1) Lower-power, supports the spike-driven paradigm that there is only sparse addition in the network; (2) Versatility, handles various vision tasks; (3) High-performance, shows advantages over CNN-based SNNs; (4) Meta-architecture, inspires future next-generation Transformer-based neuromorphic chip designs....
Gated Attention Coding for Training High-performance and Efficient Spiking Neural Networks
Xuerui Qiu et al.
A plug-and-play module that leverages the multi-dimensional gated attention unit to efficiently encode inputs into powerful representations before feeding them into the SNN architecture....
pyNAVIS: an open-source cross-platform Neuromorphic Auditory VISualizer
Juan Pedro Dominguez-Morales
An open-source cross-platform Python module for analyzing and processing spiking information obtained from neuromorphic auditory sensors. It is primarily focused to be used with a NAS, but can work with any other cochlea sensor....
PyAER
Yuhuang Hu
Low-level Python APIs for Accessing Neuromorphic Devices. A combination of a Pythonic libcaer and a light-weight "ROS". PyAER serves as an agile package that focus on fast development and extensibility....
BrainPy
brainpy
A flexible, efficient, and extensible framework for computational neuroscience and brain-inspired computation based on the Just-In-Time (JIT) compilation (built on top of JAX, Numba, and other JIT compilers)....
Brian2
brain-team
A free, open source simulator for spiking neural networks. It is written in the Python programming language and is available on almost all platforms....
BindsNET
BindsNET
A spiking neural network simulation library geared towards the development of biologically inspired algorithms for machine learning. This package is used as part of ongoing research on applying SNNs to machine learning (ML) and reinforcement learning (RL) problems in the Biologically Inspired Neural & Dynamical Systems (BINDS) lab....
DCEIFlow
Zhexiong Wan and others
A deep learning-based dense and continuous optical flow estimation framework from a single image with event streams, which facilitates the accurate perception of high-speed motion....
cuSNN
TU-Delft
cuSNN is a C++ library that enables GPU-accelerated simulations of large-scale Spiking Neural Networks (SNNs)....
LAVA-DL
Lava
A library of deep learning tools within Lava that support offline training, online training and inference methods for various Deep Event-Based Networks....
OpenEB
Prophesee
An open source project associated with Metavision SDK. It enables anyone to get a better understanding of event-based vision, directly interact with events and build their own applications or plugins....
Tonic
Institute of Neuromorphic Engineering
A tool to facilitate the download, manipulation and loading of event-based/spike-based data. It's like PyTorch Vision but for neuromorphic data!...
Norse
Norse
Norse expands PyTorch with primitives for bio-inspired neural components, bringing two advantages: a modern and proven infrastructure based on PyTorch and deep learning-compatible spiking neural network components....
SNN-ANN Conversion
Andrzej Kucik and Gabriele Meoni
A package that deploy spiking neural networks (SNN) in land cover and land use classification tasks. In particular, a VGG-16 -based artificial neural network (ANN) classifier is converted into an SNN using KerasSpiking. After fine-tuning of the converted model, the accuracy depreciation as well as a potential improvement in the energy consumption are compared on selected hardware platforms....
LSNN: Long short-term memory Spiking Neural Networks
Guillaume Bellec and others
A tensorflow 1.12 library and a tutorial to train a recurrent spiking neural networks. This model uses a method of network rewiring to keep a sparse connectivity during training, which is called DEEP-R....
Rockpool
SynSense
An open-source Python package for simulating, training and deploying spiking neural network applications. Includes simulations and deployment to SynSense hardware....
LSNN: Long short-term memory Spiking Neural Networks
Guillaume Bellec and others
A tensorflow 1.12 library and a tutorial to train a Long short-term memory Spiking Neural Network. The proposed model uses a method of network rewiring to keep a sparse connectivity during training, which is called DEEP R....
ABR Keyword Spotting Power Benchmarks
Peter Blouw and others
A power benchmarking code for running a simple two-layer, 256 neuron per layer neural network keyword spotter on both neuromorphic and conventional hardware devices. On conventional devices a Tensorflow version of the keyword spotter is used, while on neuromorphic devices (Loihi), an architecturally identical Nengo version is used....
EVDodgeNet: Deep Dynamic Obstacle Dodging with event cameras
Perception and Robotics Group, UMD
A project that explores the use of event cameras in dynamic obstacle dodging tasks. Unlike traditional cameras. The project uses deep learning techniques to train a neural network to predict the trajectory of moving obstacles and generate control signals for a drone to avoid collisions in real-time....
IBM Analog Hardware Acceleration Kit
IBM
An open source Python toolkit for exploring and using the capabilities of in-memory computing devices in the context of artificial intelligence. The toolkit is fully GPU accelerated and can be used to conveniently estimate the impact of material properties and non-idealities of future analog technology on the accuracy for arbitrary ANNs....
MNSIM 2.0: A behavior-level modeling tool for memristor-based neuromorphic computing systems
Zhenhua Zhu and others
A behavior-level modeling tool for designing and simulating memristor-based neuromorphic computing systems. MNSIM 2.0 provides a high-level model of the memristive devices and their circuits, allowing for efficient and accurate simulation of large-scale systems....
Metavision SDK
Prophesee
A C++ and Python SDK for event-based data processing. It includes algorithms available via APIs, code samples and documentation allowing you to develop event-based applications ready to go to production. The algorithms are written in C++ for performance reasons, but are also provided through a Python API through bindings of the C++ code....
NeuroSim: A circuit-level macro model for benchmarking neuro-inspired architectures in online learning
Laboratory for Emerging Devices and Circuits, Georgia Institute of Technology
An integrated framework to emulate the deep neural networks (DNN) inference performance or on-chip training performance on the hardware accelerator based on near-memory computing or in-memory computing architectures....
NengoDL: Deep learning integration for Nengo
Applied Brain Research
A simulator for Nengo models. That means it takes a Nengo network as input and allows the user to simulate that network using some underlying computational framework (in this case, TensorFlow). In practice, this means that the code for constructing a Nengo model is exactly the same as it would be for the standard Nengo simulator....
Nengo: Large-Scale Brain Modeling in Python
Applied Brain Research
A Python library for building and simulating large-scale neural models. Nengo can create sophisticated spiking and non-spiking neural simulations with sensible defaults in a few lines of code. In addition, Nengo is highly versatile. You can define your own neuron types and learning rules, drive robots, and even simulate your model on a completely different neural simulator or neuromorphic hardware....
EfficientSNN
Riccardo Massa and others
An efficient spiking neural network for recognizing gestures with a DVS Camera on the Loihi neuromorphic processor. It can be used for analyzing the DNN-to-SNN conversion through SNNToolbox, and the codes for pre-processing the DvsGesture dataset to make it possible to train in the DNN domain....
sPyNNaker – PyNN Simulations on SpiNNaker Hardware
SpiNNaker - University of Manchester
SpiNNaker is a novel computer architecture inspired by the working of the human brain. A SpiNNaker machine is a massively parallel computing platform, targeted toward three main areas of research: Neuroscience, Robotics, and Computer Vision. This package provides standard code for PyNN implementations for SpiNNaker....
snnTorch
Jason Eshraghian
A Python package for performing gradient-based learning with spiking neural networks. It extends the capabilities of PyTorch, taking advantage of its GPU accelerated tensor computation and applying it to networks of spiking neurons....
Spytorch
Friedemann Zenke
An open-source project that provides a PyTorch-based library for deep learning with spiking neural networks (SNNs). The library aims to make it easy to train and evaluate SNNs. This library provides a range of tools and functionality to help researchers and practitioners work with SNNs in a flexible and intuitive way, including support for common SNN models and training algorithms....
Lava
Intel
An open-source software framework for developing neuro-inspired applications and mapping them to neuromorphic hardware. Includes various useful packages including a Neuromorphic Constrained Optimization Library....