Neuro-LIFT: A Neuromorphic, LLM-based Interactive Framework for Autonomous Drone FlighT at the Edge

A. Delorme, J. Gautrais, R. Van Rullen, and S. Thorpe, “Spikenet: A simulator for modeling large networks of integrate and fire neurons,” Neurocomputing , vol. 26, pp. 989–996, 1999

1999

Earlier work this paper cites.

P. Lichtsteiner, C. Posch, and T. Delbruck, “A 128 × \times 128 120 db 15 μ \mu s latency asynchronous temporal contrast vision sensor,” IEEE journal of solid-state circuits , vol. 43, no. 2, pp. 566–576, 2008

2008

Earlier work this paper cites.

C. Posch, D. Matolin, and R. Wohlgenannt, “A qvga 143 db dynamic range frame-free pwm image sensor with lossless pixel-level video compression and time-domain cds,” IEEE Journal of Solid-State Circuits , vol. 46, no. 1, pp. 259–275, 2010

2010

Earlier work this paper cites.

A. Amir, B. Taba, D. Berg, T. Melano, J. McKinstry, C. Di Nolfo, T. Nayak, A. Andreopoulos, G. Garreau, M. Mendoza et al. , “A low power, fully event-based gesture recognition system,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2017, pp. 7243–7252

2017

Earlier work this paper cites.

T. Brown, B. Mann, and et al

2020

Earlier work this paper cites.

C. Lee, A. K. Kosta, A. Z. Zhu, K. Chaney, K. Daniilidis, and K. Roy, “Spike-flownet: event-based optical flow estimation with energy-efficient hybrid neural networks,” in European Conference on Computer Vision . Springer, 2020, pp. 366–382

2020

Earlier work this paper cites.

A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clark et al. , “Learning transferable visual models from natural language supervision,” in International conference on machine learning . PMLR, 2021, pp. 8748–8763

2021

Earlier work this paper cites.

A. Ramesh, M. Pavlov, G. Goh, S. Gray, C. Voss, A. Radford, M. Chen, and I. Sutskever, “Zero-shot text-to-image generation,” in International conference on machine learning . Pmlr, 2021, pp. 8821–8831

2021

Earlier work this paper cites.

J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. L. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat et al. , “Gpt-4 technical report,” arXiv preprint arXiv:2303.08774 , 2023

Original

2023

Cited alongside, same era.

D. Driess, F. Xia, M. S. Sajjadi, C. Lynch, A. Chowdhery, B. Ichter, A. Wahid, J. Tompson, Q. Vuong, T. Yu et al. , “Palm-e: An embodied multimodal language model,” arXiv preprint arXiv:2303.03378 , 2023

Original

2023

Cited alongside, same era.

A. K. Kosta and K. Roy, “Adaptive-spikenet: event-based optical flow estimation using spiking neural networks with learnable neuronal dynamics,” in 2023 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, 2023, pp. 6021–6027

2023

Cited alongside, same era.

M. Nagaraj, C. M. Liyanagedera, and K. Roy, “Dotie-detecting objects through temporal isolation of events using a spiking architecture,” in 2023 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, 2023, pp. 4858–4864

2023

S. Hu, L. Shen, Y. Zhang, Y. Chen, and D. Tao, “On transforming reinforcement learning with transformers: The development trajectory,” IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 46, no. 12, pp. 8580–8599, 2024

2024

Later among the works it cites.

C. Cui, Y. Ma, X. Cao, W. Ye, Y. Zhou, K. Liang, J. Chen, J. Lu, Z. Yang, K.-D. Liao et al. , “A survey on multimodal large language models for autonomous driving,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , 2024, pp. 958–979

2024

Later among the works it cites.

S. Sanyal and K. Roy, “Asma: An adaptive safety margin algorithm for vision-language drone navigation via scene-aware control barrier functions,” 2024. [Online]. Available: https://arxiv.org/abs/2409.10283

Original

2024

Later among the works it cites.

V. Bhat, P. Krishnamurthy, R. Karri, and F. Khorrami, “Hifi-cs: Towards open vocabulary visual grounding for robotic grasping using vision-language models,” arXiv preprint arXiv:2409.10419 , 2024

Original