Fetching the paper…
Reading the bibliography…
We introduce Dynamic Retrieval-Augmented Expert Networks (DRAE), a groundbreaking architecture that addresses the challenges of lifelong learning, catastrophic forgetting, and task adaptation by combining the dynamic routing capabilities of Mixture-of-Experts (MoE); leveraging the knowledge-enhancement power of Retrieval-Augmented Generation (RAG); incorporating a novel hierarchical reinforcement learning (RL) framework; and coordinating through ReflexNet-SchemaPlanner-HyperOptima (RSHO).DRAE dynamically routes expert models via a sparse MoE gating mechanism, enabling efficient resource allocation while leveraging external knowledge through parametric retrieval (P-RAG) to augment the learning process.
Variational inference for bayesian mixtures of factor analysers
Zoubin Ghahramani and Matthew Beal. 1999 · 1999
Earlier work this paper cites.
Approximately optimal approximate reinforcement learning
Sham Kakade and John Langford. 2002 · 2002
Earlier work this paper cites.
Reinforcement learning for humanoid robotics
Jan Peters, Sethu Vijayakumar, and Stefan Schaal. 2003 · 2003
Earlier work this paper cites.
Kinds of programming
Armando Solar-Lezama and Joshua B. Tenenbaum. 2007 · 2007
Earlier work this paper cites.
End-to-end memory networks
Sainbayar Sukhbaatar, Jason Weston, Rob Fergus, and 1 others. 2015 · 2015
Earlier work this paper cites.
Manipulators and Manipulation in high dimensional spaces
Vikash Kumar. 2016 · 2016
Earlier work this paper cites.
Andrei A Rusu, Neil C Rabinowitz, Guillaume Desjardins, Hubert Soyer, James Kirkpatrick, Koray Kavukcuoglu, Razvan Pascanu, and Raia Hadsell. 2016 · 2016
Earlier work this paper cites.
Meta-learning with memory-augmented neural networks
Adam Santoro, Sergey Bartunov, Matthew Botvinick, Daan Wierstra, and Timothy Lillicrap. 2016 · 2016
Earlier work this paper cites.
The option-critic architecture
Pierre-Luc Bacon, Jean Harb, and Doina Precup. 2017 · 2017
Earlier work this paper cites.
Model-agnostic meta-learning for fast adaptation of deep networks
Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017 · 2017
Earlier work this paper cites.
Overcoming catastrophic forgetting in neural networks
James Kirkpatrick and et al. 2017 · 2017
Earlier work this paper cites.
Tanks and temples: Benchmarking large-scale scene reconstruction
Arno Knapitsch, Jaesik Park, Qian-Yi Zhou, and Vladlen Koltun. 2017 · 2017
Earlier work this paper cites.
Outrageously large neural networks: The sparsely gated mixture-of-experts layer
Noam Shazeer and et al. 2017 · 2017
Earlier work this paper cites.
Feudal networks for hierarchical reinforcement learning
Alexander Sasha Vezhnevets, Simon Osindero, Tom Schaul, Nicolas Heess, Max Jaderberg, David Silver, and Koray Kavukcuoglu. 2017 · 2017
Earlier work this paper cites.
Memory aware synapses: Learning what (not) to forget
Rahaf Aljundi, Francesca Babiloni, Mohamed Elhoseiny, Marcus Rohrbach, and Tinne Tuytelaars. 2018 · 2018
Earlier work this paper cites.
A tutorial on dirichlet process mixture modeling
Yuelin Li, Elizabeth Schofield, and Mithat Gönen. 2019 · 2019
Earlier work this paper cites.
Local light field fusion: Practical view synthesis with prescriptive sampling guidelines
Ben Mildenhall, Pratul P Srinivasan, Rodrigo Ortiz-Cayon, Nima Khademi Kalantari, Ravi Ramamoorthi, Ren Ng, and Abhishek Kar. 2019 · 2019
Earlier work this paper cites.
Continual lifelong learning with neural networks: A review
German I Parisi, Ronald Kemker, Jose L Part, Christopher Kanan, and Stefan Wermter. 2019 · 2019
Earlier work this paper cites.
Retrieval-augmented generation for knowledge-intensive nlp tasks
Patrick Lewis, Manuel Perez, Andrzej Piktus, and et al. 2020 · 2020
Earlier work this paper cites.
Mvsnerf: Fast generalizable radiance field reconstruction from multi-view stereo
Anpei Chen, Zexiang Xu, Fuqiang Zhao, Xiaoshuai Zhang, Fanbo Xiang, Jingyi Yu, and Hao Su. 2021 · 2021
Earlier work this paper cites.
Lora: Low-rank adaptation of large language models
Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021
Cited alongside, same era.
A lifelong learning approach to mobile robot navigation
Bo Liu, Xuesu Xiao, and Peter Stone. 2021 · 2021
Cited alongside, same era.
Nerf: Representing scenes as neural radiance fields for view synthesis
Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. 2021 · 2021
Cited alongside, same era.
Hierarchical reinforcement learning: A comprehensive survey
Shubham Pateria, Budhitama Subagdja, Ah-hwee Tan, and Chai Quek. 2021 · 2021
Cited alongside, same era.
Ibrnet: Learning multi-view image-based rendering
Qianqian Wang, Zhicheng Wang, Kyle Genova, Pratul P Srinivasan, Howard Zhou, Jonathan T Barron, Ricardo Martin-Brualla, Noah Snavely, and Thomas Funkhouser. 2021 · 2021
Cited alongside, same era.
Navsim: Data-driven non-reactive autonomous vehicle simulation and benchmarking
Daniel Dauner, Marcel Hallgarten, Tianyu Li, Xinshuo Weng, Zhiyu Huang, Zetong Yang, Hongyang Li, Igor Gilitschenski, Boris Ivanovic, Marco Pavone, and 1 others. 2024 · 2024
Later among the works it cites.
From local to global: A graph rag approach to query-focused summarization
Darren Edge, Ha Trinh, Newman Cheng, Joshua Bradley, Alex Chao, Apurva Mody, Steven Truitt, and Jonathan Larson. 2024 · 2024
Later among the works it cites.
Spoc: Imitating shortest paths in simulation enables effective navigation and manipulation in the real world
Kiana Ehsani, Tanmay Gupta, Rose Hendrix, Jordi Salvador, Luca Weihs, Kuo-Hao Zeng, Kunal Pratap Singh, Yejin Kim, Winson Han, Alvaro Herrasti, and 1 others. 2024 · 2024
Later among the works it cites.
Lightrag: Simple and fast retrieval-augmented generation
Zirui Guo, Lianghao Xia, Yanhua Yu, Tu Ao, and Chao Huang. 2024 · 2024
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Hierarchical reinforcement learning for integrated recommendation
Ruobing Xie, Shaoliang Zhang, Rui Wang, Feng Xia, and Leyu Lin. 2021 · 2021
Cited alongside, same era.
pixelnerf: Neural radiance fields from one or few images
Alex Yu, Vickie Ye, Matthew Tancik, and Angjoo Kanazawa. 2021 · 2021
Cited alongside, same era.
Transfuser: Imitation with transformer-based sensor fusion for autonomous driving
Kashyap Chitta, Aditya Prakash, Bernhard Jaeger, Zehao Yu, Katrin Renz, and Andreas Geiger. 2022 · 2022
Cited alongside, same era.
Intelligent problem-solving as integrated hierarchical reinforcement learning
Manfred Eppe, Christian Gumbsch, Matthias Kerzel, Phuong DH Nguyen, Martin V Butz, and Stefan Wermter. 2022 · 2022
Cited alongside, same era.
Generalizable patch-based neural rendering
Mohammed Suhail, Carlos Esteves, Leonid Sigal, and Ameesh Makadia. 2022 · 2022
Cited alongside, same era.
Lifelong robotic reinforcement learning by retaining experiences
Annie Xie and Chelsea Finn. 2022 · 2022
Cited alongside, same era.
Motiondiffuse: Text-driven human motion generation with diffusion model
Mingyuan Zhang, Zhongang Cai, Liang Pan, Fangzhou Hong, Xinying Guo, Lei Yang, and Ziwei Liu. 2022 · 2022
Cited alongside, same era.
Xu Owen He. 2024 · 2024
Later among the works it cites.
Heng Li, Minghan Li, Zhi-Qi Cheng, Yifei Dong, Yuxuan Zhou, Jun-Yan He, Qi Dai, Teruko Mitamura, and Alexander G Hauptmann. 2024 · 2024
Later among the works it cites.
Skilldiffuser: Interpretable hierarchical planning via skill abstractions in diffusion-based task execution
Zhixuan Liang, Yao Mu, Hengbo Ma, Masayoshi Tomizuka, Mingyu Ding, and Ping Luo. 2024 · 2024
Later among the works it cites.
Diffusiondrive: Truncated diffusion model for end-to-end autonomous driving
Bencheng Liao, Shaoyu Chen, Haoran Yin, Bo Jiang, Cheng Wang, Sixu Yan, Xinbang Zhang, Xiangyu Li, Ying Zhang, Qian Zhang, and 1 others. 2024 · 2024
Later among the works it cites.
A closer look into mixture-of-experts in large language models
Ka Man Lo, Zeyu Huang, Zihan Qiu, Zili Wang, and Jie Fu. 2024 · 2024
Later among the works it cites.
Learning from massive human videos for universal humanoid pose control
Jiageng Mao, Siheng Zhao, Siqi Song, Tianheng Shi, Junjie Ye, Mingtong Zhang, Haoran Geng, Jitendra Malik, Vitor Guizilini, and Yue Wang. 2024 · 2024
Later among the works it cites.
Learning more generalized experts by merging experts in mixture-of-experts
Sejik Park. 2024 · 2024
Later among the works it cites.
Hybridrag: Integrating knowledge graphs and vector retrieval augmented generation for efficient information extraction
Bhaskarjit Sarmah, Dhagash Mehta, Benika Hall, Rohan Rao, Sunil Patel, and Stefano Pasquali. 2024 · 2024
Later among the works it cites.
Kunal Sawarkar, Abhilasha Mangal, and Shivam Raj Solanki. 2024 · 2024
Later among the works it cites.
Octo: An open-source generalist robot policy
Octo Model Team, Dibya Ghosh, Homer Walke, Karl Pertsch, Kevin Black, Oier Mees, Sudeep Dasari, Joey Hejna, Tobias Kreiman, Charles Xu, and 1 others. 2024 · 2024
Later among the works it cites.
Sparse diffusion policy: A sparse, reusable, and flexible policy for robot learning
Yixiao Wang, Yifei Zhang, Mingxiao Huo, Ran Tian, Xiang Zhang, Yichen Xie, Chenfeng Xu, Pengliang Ji, Wei Zhan, Mingyu Ding, and 1 others. 2024 · 2024
Later among the works it cites.
Para-drive: Parallelized architecture for real-time autonomous driving
Xinshuo Weng, Boris Ivanovic, Yan Wang, Yue Wang, and Marco Pavone. 2024 · 2024
Later among the works it cites.
Drama: An efficient end-to-end motion planner for autonomous driving with mamba
Chengran Yuan, Zhanqi Zhang, Jiawei Sun, Shuo Sun, Zefan Huang, Christina Dao Wen Lee, Dongen Li, Yuhang Han, Anthony Wong, Keng Peng Tee, and Marcelo H. Ang Jr. 2024 · 2024
Later among the works it cites.
Deeprag: Thinking to retrieval step by step for large language models
Xinyan Guan, Jiali Zeng, Fandong Meng, Chunlei Xin, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun, and Jie Zhou. 2025 · 2025
Closest in time.
Parametric retrieval augmented generation
Weihang Su, Yichen Tang, Qingyao Ai, Junxi Yan, Changyue Wang, Hongning Wang, Ziyi Ye, Yujia Zhou, and Yiqun Liu. 2025 · 2025
Closest in time.