Fetching the paper…
Reading the bibliography…
We present Large Language Model for Mixed Reality (LLMR), a framework for the real-time creation and modification of interactive Mixed Reality experiences using LLMs.
Game Development and Production
Erik Bethke. 2003 · 2003
Earlier work this paper cites.
Unity Game Engine
Unity Technologies. 2005 · 2005
Earlier work this paper cites.
Tilt Brush
Google. 2016 · 2016
Earlier work this paper cites.
Procedurally Generated Virtual Reality From 3D Reconstructed Physical Space. In Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology . 191–200
Misha Sra, Sergio Garrido-Jurado, Chris Schmandt, and Pattie Maes. 2016 · 2016
Earlier work this paper cites.
A Survey on the Procedural Generation of Virtual Worlds
Jonas Freiknecht and Wolfgang Effelsberg. 2017 · 2017
Earlier work this paper cites.
Interactive Example-Based Terrain Authoring With Conditional Generative Adversarial Networks
Eric Guerin, Julie Digne, Eric Galin, Adrien Peytavie, Christian Wolf, Bedrich Benes, and Benoit Martinez. 2017 · 2017
Earlier work this paper cites.
Ai2-Thor: An Interactive 3d Environment for Visual Ai
Eric Kolve, Roozbeh Mottaghi, Winson Han, Eli VanderBilt, Luca Weihs, Alvaro Herrasti, Matt Deitke, Kiana Ehsani, Daniel Gordon, Yuke Zhu, et al · 2017
Earlier work this paper cites.
Mixed Reality Toolkit
Microsoft. 2017 · 2017
Earlier work this paper cites.
Oasis: Procedurally Generated Social Virtual Spaces From 3d Scanned Real Spaces
Misha Sra, Sergio Garrido-Jurado, and Pattie Maes. 2017a · 2017
Earlier work this paper cites.
Context-Aware Online Adaptation of Mixed Reality Interfaces. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology . 147–160
David Lindlbauer, Anna Maria Feit, and Otmar Hilliges. 2019 · 2019
Earlier work this paper cites.
Unity Render Streaming
Unity Technologies. 2019 · 2019
Earlier work this paper cites.
Roslyn C# - Runtime C# Compiler
Trivial Interactive. 2019 · 2019
Earlier work this paper cites.
Loki: Facilitating Remote Instruction of Physical Tasks Using Bi-Directional Mixed-Reality Telepresence. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology . 161–174
Balasaravanan Thoravi Kumaravel, Fraser Anderson, George Fitzmaurice, Bjoern Hartmann, and Tovi Grossman. 2019 · 2019
Earlier work this paper cites.
AuthorIVE: Authoring Interactions for Virtual Environments Through Disambiguating Demonstrations
Stephanie Claudino Daffara, Federico Saldarini, Balasaravanan Thoravi Kumaravel, and Bjørn Hartmann. 2020 · 2020
Earlier work this paper cites.
Do RNN and LSTM Have Long Memory?. In International Conference on Machine Learning . PMLR, PMLR, 11365–11375
Jingyu Zhao, Feiqing Huang, Jia Lv, Yanjie Duan, Zhen Qin, Guodong Li, and Guangjian Tian. 2020 · 2020
Earlier work this paper cites.
Program Synthesis With Large Language Models
Jacob Austin, Augustus Odena, Maxwell Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie Cai, Michael Terry, Quoc Le, et al · 2021
Earlier work this paper cites.
Semanticadapt: Optimization-Based Adaptation of Mixed Reality Layouts Leveraging Virtual-Physical Semantic Connections. In The 34th Annual ACM Symposium on User Interface Software and Technology . 282–297
Yifei Cheng, Yukang Yan, Xin Yi, Yuanchun Shi, and David Lindlbauer. 2021 · 2021
Earlier work this paper cites.
Keep Me Updated! Memory Management in Long-Term Conversations
Sanghwan Bae, Donghyun Kwak, Soyoung Kang, Min Young Lee, Sungdong Kim, Yuin Jeong, Hyeri Kim, Sang-Woo Lee, Woomyoung Park, and Nako Sung. 2022 · 2022
Earlier work this paper cites.
Pangu-Coder: Program Synthesis With Function-Level Language Modeling
Fenia Christopoulou, Gerasimos Lampouras, Milan Gritta, Guchun Zhang, Yinpeng Guo, Zhongqi Li, Qi Zhang, Meng Xiao, Bo Shen, Lin Li, et al · 2022
Earlier work this paper cites.
Nerf: Neural Radiance Field in 3d Vision, a Comprehensive Review
Kyle Gao, Yina Gao, Hongjie He, Denning Lu, Linlin Xu, and Jonathan Li. 2022 · 2022
Earlier work this paper cites.
Jigsaw: Large Language Models Meet Program Synthesis. In Proceedings of the 44th International Conference on Software Engineering . 1219–1231
Naman Jain, Skanda Vaidyanath, Arun Iyer, Nagarajan Natarajan, Suresh Parthasarathy, Sriram Rajamani, and Rahul Sharma. 2022 · 2022
Earlier work this paper cites.
Gang Li, Heliang Zheng, Chaoyue Wang, Chang Li, Changwen Zheng, and Dacheng Tao. 2022 · 2022
Cited alongside, same era.
Codegen: An Open Large Language Model for Code With Multi-Turn Program Synthesis
Erik Nijkamp, Bo Pang, Hiroaki Hayashi, Lifu Tu, Huan Wang, Yingbo Zhou, Silvio Savarese, and Caiming Xiong. 2022 · 2022
Cited alongside, same era.
Dreamfusion: Text-to-3d Using 2d Diffusion
Ben Poole, Ajay Jain, Jonathan T Barron, and Ben Mildenhall. 2022 · 2022
Cited alongside, same era.
Learning Transferable Visual Models From Natural Language Supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021 · 2022
Cited alongside, same era.
Large Language Models are Few-Shot Health Learners
Xin Liu, Daniel McDuff, Geza Kovacs, Isaac Galatzer-Levy, Jacob Sunshine, Jiening Zhan, Ming-Zher Poh, Shun Liao, Paolo Di Achille, and Shwetak Patel. 2023b · 2023
Closest in time.
Jailbreaking Chatgpt via Prompt Engineering: An Empirical Study
Yi Liu, Gelei Deng, Zhengzi Xu, Yuekang Li, Yaowen Zheng, Ying Zhang, Lida Zhao, Tianwei Zhang, and Yang Liu. 2023a · 2023
Closest in time.
RoCo: Dialectic Multi-Robot Collaboration With Large Language Models
Zhao Mandi, Shreeya Jain, and Shuran Song. 2023 · 2023
Closest in time.
Mixed Reality Mobile Remoting
Microsoft. 2023 · 2023
Closest in time.
OpenAI. 2023 · 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Jasmine Roberts, Andrzej Banburski-Fahey, and Jaron Lanier. 2022a · 2022
Cited alongside, same era.
Surreal VR Pong: LLM Approach to Game Design. In 36th Conference on Neural Information Processing Systems (NeurIPS 2022)
Jasmine Roberts, Andrzej Banburski-Fahey, and Jaron Lanier. 2022b · 2022
Cited alongside, same era.
DALL·E 2
OpenAI. 2022 · 2022
Cited alongside, same era.
Craft an Iron Sword: Dynamically Generating Interactive Game Characters by Prompting Large Language Models Tuned on Code. In The Third Wordplay: When Language Meets Games Workshop
Ryan Volum, Sudha Rao, Michael Xu, Gabriel A DesGarennes, Chris Brockett, Benjamin Van Durme, Olivia Deng, Akanksha Malhotra, and Bill Dolan. 2022 · 2022
Cited alongside, same era.
Hexplane: A Fast Representation for Dynamic Scenes. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 130–141
Ang Cao and Justin Johnson. 2023 · 2023
Cited alongside, same era.
Palm-E: An Embodied Multimodal Language Model
Danny Driess, Fei Xia, Mehdi SM Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, et al · 2023
Cited alongside, same era.
A Survey on Remote Assistance and Training in Mixed Reality Environments
Catarina G Fidalgo, Yukang Yan, Hyunsung Cho, Mauricio Sousa, David Lindlbauer, and Joaquim Jorge. 2023 · 2023
Cited alongside, same era.
A Real-World Webagent With Planning, Long Context Understanding, and Program Synthesis
Izzeddin Gur, Hiroki Furuta, Austin Huang, Mustafa Safdari, Yutaka Matsuo, Douglas Eck, and Aleksandra Faust. 2023 · 2023
Cited alongside, same era.
Closest in time.
SayPlan: Grounding Large Language Models Using 3D Scene Graphs for Scalable Task Planning
Krishan Rana, Jesse Haviland, Sourav Garg, Jad Abou-Chakra, Ian Reid, and Niko Suenderhauf. 2023 · 2023
Closest in time.
Texture: Text-Guided Texturing of 3d Shapes
Elad Richardson, Gal Metzer, Yuval Alaluf, Raja Giryes, and Daniel Cohen-Or. 2023 · 2023
Closest in time.
Text-to-4d Dynamic Scene Generation
Uriel Singer, Shelly Sheynin, Adam Polyak, Oron Ashual, Iurii Makarov, Filippos Kokkinos, Naman Goyal, Andrea Vedaldi, Devi Parikh, Justin Johnson, et al · 2023
Closest in time.
ObjectStitch: Object Compositing With Diffusion Model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 18310–18319
Yizhi Song, Zhifei Zhang, Zhe Lin, Scott Cohen, Brian Price, Jianming Zhang, Soo Ye Kim, and Daniel Aliaga. 2023 · 2023
Closest in time.
Sketchfab
Sketchfab, Inc. 2023 · 2023
Closest in time.
Voyager: An Open-Ended Embodied Agent With Large Language Models
Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, and Anima Anandkumar. 2023d · 2023
Closest in time.
Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Models
Qingyue Wang, Liang Ding, Yanan Cao, Zhiliang Tian, Shi Wang, Dacheng Tao, and Li Guo. 2023a · 2023
Closest in time.
Augmenting Language Models With Long-Term Memory
Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, and Furu Wei. 2023b · 2023
Closest in time.
Chat-3D: Data-Efficiently Tuning Large Language Model for Universal Dialogue of 3D Scenes
Zehan Wang, Haifeng Huang, Yang Zhao, Ziang Zhang, and Zhou Zhao. 2023c · 2023
Closest in time.
Embodied Task Planning With Large Language Models
Zhenyu Wu, Ziwei Wang, Xiuwei Xu, Jiwen Lu, and Haibin Yan. 2023 · 2023
Closest in time.
XAIR: A Framework of Explainable AI in Augmented Reality. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems . 1–30
Xuhai Xu, Anna Yu, Tanya R Jonker, Kashyap Todi, Feiyu Lu, Xun Qian, João Marcelo Evangelista Belo, Tianyi Wang, Michelle Li, Aran Mun, et al · 2023
Closest in time.
MotionGPT: Finetuned LLMs Are General-Purpose Motion Generators
Yaqi Zhang, Di Huang, Bin Liu, Shixiang Tang, Yan Lu, Lu Chen, Lei Bai, Qi Chu, Nenghai Yu, and Wanli Ouyang. 2023a · 2023
Closest in time.
A Survey of Large Language Models
Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, et al · 2023
Closest in time.
MemoryBank: Enhancing Large Language Models With Long-Term Memory
Wanjun Zhong, Lianghong Guo, Qiqi Gao, and Yanlin Wang. 2023 · 2023
Closest in time.
InstructPipe: Building Visual Programming Pipelines with Human Instructions
Zhongyi Zhou, Jing Jin, Vrushank Phadnis, Xiuxiu Yuan, Jun Jiang, Xun Qian, Jingtao Zhou, Yiyi Huang, Zheng Xu, Yinda Zhang, et al · 2023
Closest in time.
Pointclip V2: Prompting Clip and Gpt for Powerful 3d Open-World Learning. In ICCV , Vol. 2. 5
Xiangyang Zhu, Renrui Zhang, Bowei He, Ziyu Guo, Ziyao Zeng, Zipeng Qin, Shanghang Zhang, and Peng Gao. 2023 · 2023
Closest in time.