Software Tools

Open-source software tools from the Sensors group are mostly hosted at https://github.com/SensorsINI and include

  1. jAER project (hosted at github in next repo) - the granddaddy of event-sensor tools that allows sensor applications with retinas and cochleas, recording, playing back, running algorithms. Most of the robots show in the sensors YouTube channel were implemented in jAER. See inilabs jAER user guide page for up to date support.
  2. SensorsINI - jAER and other sensors group tools.
  3. snn_toolbox - Bodo Rueckauer's ANN to SNN conversion tools.
  4. ADaPTION  - Moritz Milde's reduced weight+state precision Caffe CNN training tools.
  5. ddd17-utils - DDD17 DAVIS Driving Dataset tools for collecting real automobile end-to-end data and exporting it to machine learning tools.
  6. v2e - video to events accurate emulation of event camera from video
  7. Phased LSTM - Danny Neil's PLSTM tools for dramatically speeding up RNN training using "time gates". Great for sensor fusion RNNs that integrate sensors with wide ranging time scales.

In preparation

  1. DeltaRNN - Danny Neil's tools for training RNNs that use only delta updates, similar to a spiking RNN. The RNN memory access can be reduced by 5-10X easily using this technique without loss of classification accuracy.

See also software tools from

  1. inivation - DV and other code to support DVS and DAVIS cameras designed by Sensors group and others
  2. RPG (ROS interface for DVS and DAVIS cameras) - (github ROS DVS page) - Robot Operating System event sensor interfaces