2017

DDD17: End-To-End DAVIS Driving Dataset

Binas, Jonathan, Neil, Daniel, Liu, Shih-Chii et al.

Understand

Event cameras, such as dynamic vision sensors (DVS), and dynamic and active-pixel vision sensors (DAVIS) can supplement other autonomous driving sensors by providing a concurrent stream of standard active pixel sensor (APS) images and DVS temporal contrast events.

  • The APS stream is a sequence of standard grayscale global-shutter image sensor frames.
  • The DVS events represent brightness changes occurring at a particular moment, with a jitter of about a millisecond under most lighting conditions.
  • They have a dynamic range of >120 dB and effective frame rates >1 kHz at data rates comparable to 30 fps (frames/second) image sensors.

Built on

  • Off-Road Obstacle Avoidance through End-to-End Learning

    LeCun, Yann, Muller, Urs, Ben, Jan, Cosatto, Eric, and Flepp, Beat · 2005

    Earlier work this paper cites.

  • A 128x128 120 dB 15 μ \mu s latency asynchronous temporal contrast vision sensor

    Lichtsteiner, P., Posch, C., and Delbruck, T · 2008

    Earlier work this paper cites.

  • A 240 × \times 180 130 dB 3 μ \mu s latency global shutter spatiotemporal vision sensor

    Brandli, C., Berner, R., Yang, M., Liu, S-C., and Delbruck, T · 2014

    Earlier work this paper cites.

Similar

  • Retinomorphic Event-Based Vision Sensors: Bioinspired Cameras With Spiking Output

    Posch, C., Serrano-Gotarredona, T., Linares-Barranco, B., and Delbruck, T · 2014

    Cited alongside, same era.

  • End to end learning for self-driving cars

    Original

    Bojarski, Mariusz, Del Testa, Davide, Dworakowski, Daniel, Firner, Bernhard, Flepp, Beat, Goyal, Prasoon, Jackel, Lawrence D, Monfort, Mathew, Muller, Urs, Zhang, Jiakai, et al · 2016

    Cited alongside, same era.

  • Steering a predator robot using a mixed frame/event-driven convolutional neural network

    Moeys, D. P., Corradi, F., Kerr, E., Vance, P., Das, G., Neil, D., Kerr, D., and Delbrück, T · 2016

    Cited alongside, same era.

Then

  • Learning a driving simulator

    Original

    Santana, Eder and Hotz, George · 2016

    Later among the works it cites.

  • Live Demonstration: Convolutional Neural Network Driven by Dynamic Vision Sensor Playing RoShamBo

    Lungu, Iulia-Alexandra, Corradi, Federico, and Delbruck, Tobias · 2017

    Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…