Fetching the paper…
Reading the bibliography…
Large Language Models (LLMs) have demonstrated a remarkable ability to capture extensive world knowledge, yet how this is achieved without direct sensorimotor experience remains a fundamental puzzle.
A free energy principle for a particular physics
Friston, K., 2019 · 1906
Earlier work this paper cites.
A mathematical theory of communication
Shannon, C.E., 1948 · 1948
Earlier work this paper cites.
Distributional structure
Harris, Z., 1954 · 1954
Earlier work this paper cites.
Convention: A Philosophical Study
Lewis, D.K., 1969 · 1969
Earlier work this paper cites.
Collected papers of charles sanders peirce. volume 5
Peirce, C.S., 1974 · 1974
Earlier work this paper cites.
Shakey the robot. volume 323
Nilsson, N.J., et al., 1984 · 1984
Earlier work this paper cites.
Making the world differentiable: on using self supervised fully recurrent neural networks for dynamic reinforcement learning and planning in non-stationary environments. volume 126
Schmidhuber, J., 1990 · 1990
Earlier work this paper cites.
Integrated architectures for learning, planning, and reacting based on approximating dynamic programming, in: Machine learning proceedings 1990. Elsevier, pp. 216–224
Sutton, R.S., 1990 · 1990
Earlier work this paper cites.
Peirce on signs: Writings on semiotic
Peirce, C.S., 1991 · 1991
Earlier work this paper cites.
A stroll through the worlds of animals and men: A picture book of invisible worlds
Von Uexküll, J., 1992 · 1992
Earlier work this paper cites.
The synthetic modeling of language origins
Steels, L., 1997 · 1997
Earlier work this paper cites.
The Symbolic Species: The Co-Evolution of Language and the Brain
Deacon, T.W., 1998 · 1998
Earlier work this paper cites.
A probabilistic earley parser as a psycholinguistic model, in: Language Technologies 2001: The Second Meeting of the North American Chapter of the Association for Computational Linguistics, NAACL 2001, Pittsburgh, PA, USA, June 2-7, 2001, The Association for Computational Linguistics
Hale, J., 2001 · 2001
Earlier work this paper cites.
Semiotics the Basics
Chandler, D., 2002 · 2002
Earlier work this paper cites.
Information maximization in noisy channels : A variational approach, in: Thrun, S., Saul, L.K., Schölkopf, B. (Eds.), Advances in Neural Information Processing Systems 16 [Neural Information Processing Systems, NIPS 2003, December 8-13, 2003, Vancouver and Whistler, British Columbia, Canada], MIT Press. pp. 201–208
Barber, D., Agakov, F.V., 2003 · 2003
Earlier work this paper cites.
The emergence and evolution of linguistic structure: from lexical to grammatical communication systems
Steels, L., 2005 · 2005
Earlier work this paper cites.
Constructing a language: A usage-based theory of language acquisition
Tomasello, M., 2005 · 2005
Earlier work this paper cites.
Elements of Information Theory
Cover, T.M., Thomas, J.A., 2006 · 2006
Earlier work this paper cites.
Emergent multi-agent communication in the deep learning era
Lazaridou, A., Baroni, M., 2020 · 2006
Earlier work this paper cites.
Bayesian Brain: Probabilistic Approaches to Neural Coding
Doya, K., Ishii, S., Pouget, A., Rao, R.P.N. (Eds.), 2007 · 2007
Earlier work this paper cites.
Expectation-based syntactic comprehension
Levy, R., 2008 · 2007
Earlier work this paper cites.
Natural pedagogy
Csibra, G., Gergely, G., 2009 · 2009
Earlier work this paper cites.
Philosophical Investigations
Wittgenstein, L., 2009 · 2009
Earlier work this paper cites.
The free-energy principle: a unified brain theory?
Friston, K., 2010 · 2010
Earlier work this paper cites.
Mastering atari with discrete world models
Hafner, D., Lillicrap, T., Norouzi, M., Ba, J., 2020 · 2010
Earlier work this paper cites.
Modeling the Cultural Evolution of Language
Steels, L., 2011 · 2011
Earlier work this paper cites.
Life as we know it
Friston, K., 2013 · 2013
Earlier work this paper cites.
The predictive mind
Hohwy, J., 2013 · 2013
Earlier work this paper cites.
Distributed representations of words and phrases and their compositionality, in: Advances in Neural Information Processing Systems (NeurIPS), pp. 3111–3119
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J., 2013b · 2013
Earlier work this paper cites.
Semi-supervised learning with deep generative models, in: Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N., Weinberger, K. (Eds.), Advances in Neural Information Processing Systems, Curran Associates, Inc
Kingma, D.P., Mohamed, S., Jimenez Rezende, D., Welling, M., 2014 · 2014
Earlier work this paper cites.
Developmental robotics: From babies to robots
Cangelosi, A., Schlesinger, M., 2015 · 2015
Earlier work this paper cites.
Continuous control with deep reinforcement learning
Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., Wierstra, D., 2015 · 2015
Earlier work this paper cites.
Learning structured output representation using deep conditional generative models, in: Cortes, C., Lawrence, N.D., Lee, D.D., Sugiyama, M., Garnett, R. (Eds.), Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, December 7-12, 2015, Montreal, Quebec, Canada, pp. 3483–3491
Sohn, K., Lee, H., Yan, X., 2015 · 2015
Earlier work this paper cites.
Sequence to sequence–video to text, in: Proceedings of the IEEE international conference on computer vision, pp. 4534–4542
Venugopalan, S., Rohrbach, M., Donahue, J., Mooney, R., Darrell, T., Saenko, K., 2015 · 2015
Earlier work this paper cites.
Show and tell: A neural image caption generator, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 3156–3164
Vinyals, O., Toshev, A., Bengio, S., Erhan, D., 2015 · 2015
Earlier work this paper cites.
Learning to communicate to solve riddles with deep distributed recurrent q-networks
Foerster, J.N., Assael, Y.M., de Freitas, N., Whiteson, S., 2016b · 2016
Earlier work this paper cites.
Learning multiagent communication with backpropagation
Sukhbaatar, S., Fergus, R., et al., 2016 · 2016
Earlier work this paper cites.
Symbol emergence in robotics: a survey
Taniguchi, T., Nagai, T., Nakamura, T., Iwahashi, N., Ogata, T., Asoh, H., 2016 · 2016
Earlier work this paper cites.
Information dropout: Learning optimal representations through noisy computation
Achille, A., Soatto, S., 2018 · 2017
Earlier work this paper cites.
Deep variational information bottleneck, in: 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings, OpenReview.net
Alemi, A.A., Fischer, I., Dillon, J.V., Murphy, K., 2017 · 2017
Earlier work this paper cites.
Natural language does not emerge ’naturally’ in multi-agent dialog, in: Palmer, M., Hwa, R., Riedel, S. (Eds.), Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, EMNLP 2017, Copenhagen, Denmark, September 9-11, 2017, Association for Computational Linguistics. pp. 2962–2967
Kottur, S., Moura, J.M.F., Lee, S., Batra, D., 2017 · 2017
Earlier work this paper cites.
Multi-agent actor-critic for mixed cooperative-competitive environments
Lowe, R., Wu, Y.I., Tamar, A., Harb, J., Pieter Abbeel, O., Mordatch, I., 2017 · 2017
Earlier work this paper cites.
A variational approach to niche construction
Constant, A., Ramstead, M.J.D., Veissière, S.P.L., Campbell, J.O., Friston, K.J., 2018 · 2018
Earlier work this paper cites.
Learning attentional communication for multi-agent cooperation
Jiang, J., Lu, Z., 2018 · 2018
Earlier work this paper cites.
Multi-agent deep reinforcement learning with extremely noisy observations
Kilinc, O., Montana, G., 2018 · 2018
Earlier work this paper cites.
The markov blankets of life: autonomy, active inference and the free energy principle
Kirchhoff, M., Parr, T., Palacios, E., Friston, K., Kiverstein, J., 2018 · 2018
Earlier work this paper cites.
Reinforcement learning and control as probabilistic inference: Tutorial and review
Levine, S., 2018 · 2018
Cited alongside, same era.
Emergence of grounded compositional language in multi-agent populations, in: Proceedings of the AAAI conference on artificial intelligence, AAAI Press. pp. 1495–1502
Mordatch, I., Abbeel, P., 2018 · 2018
Cited alongside, same era.
Symbol emergence in cognitive developmental systems: a survey
Taniguchi, T., Ugur, E., Hoffmann, M., Jamone, L., Nagai, T., Rosman, B., Matsuka, T., Iwahashi, N., Oztop, E., Piater, J., et al., 2018 · 2018
Cited alongside, same era.
Efficient compression in color naming and its evolution
Zaslavsky, N., Kemp, C., Regier, T., Tishby, N., 2018 · 2018
Cited alongside, same era.
Anti-efficient encoding in emergent communication, in: Wallach, H., Larochelle, H., Beygelzimer, A., d'Alché-Buc, F., Fox, E., Garnett, R. (Eds.), Advances in Neural Information Processing Systems, Curran Associates, Inc
Toward more human-like ai communication: A review of emergent communication research
Brandizzi, N., 2023 · 2023
Later among the works it cites.
Multi-agent reinforcement learning with emergent communication using discrete and indifferentiable message, in: 2023 15th International Congress on Advanced Applied Informatics Winter (IIAI-AAI-Winter), pp. 366–371
Ebara, H., Nakamura, T., Taniguchi, A., Taniguchi, T., 2023 · 2023
Later among the works it cites.
Reasoning with language model is planning with world model URL: https://openreview.net/forum?id=VTWWvYtF1R
Hao, S., Gu, Y., Ma, H., Hong, J.J., Wang, Z., Wang, D.Z., Hu, Z., 2023 · 2023
Later among the works it cites.
Recursive Metropolis-Hastings naming game: Symbol emergence in a multi-agent system based on probabilistic generative models
Inukai, J., Taniguchi, T., Taniguchi, A., Hagiwara, Y., 2023 · 2023
Later among the works it cites.
Multi-view dreaming: Multi-view world model with contrastive learning
Kinose, A., Okada, M., Okumura, R., Taniguchi, T., 2023 · 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Chaabouni, R., Kharitonov, E., Dupoux, E., Baroni, M., 2019a · 2019
Cited alongside, same era.
Anti-efficient encoding in emergent communication, in: Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, December 8-14, 2019, Vancouver, BC, Canada, pp. 6290–6300
Chaabouni, R., Kharitonov, E., Dupoux, E., Baroni, M., 2019b · 2019
Cited alongside, same era.
Symbol emergence as an interpersonal multimodal categorization
Hagiwara, Y., Kobayashi, H., Taniguchi, A., Taniguchi, T., 2019 · 2019
Cited alongside, same era.
Actor-attention-critic for multi-agent reinforcement learning, in: International Conference on Machine Learning, pp. 2961–2970
Iqbal, S., Sha, F., 2019 · 2019
Cited alongside, same era.
Social influence as intrinsic motivation for multi-agent deep reinforcement learning, in: Proceedings of the 36th International Conference on Machine Learning (ICML), PMLR. pp. 3040–3049
Jaques, N., Lazaridou, A., Hughes, E., Gulcehre, C., Ortega, P., Strouse, D., Leibo, J.Z., De Freitas, N., 2019 · 2019
Cited alongside, same era.
Learning to schedule communication in multi-agent reinforcement learning
Kim, D., Moon, S., Hostallero, D., Kang, W.J., Lee, T., Son, K., Yi, Y., 2019 · 2019
Cited alongside, same era.
On variational bounds of mutual information, in: Chaudhuri, K., Salakhutdinov, R. (Eds.), Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA, PMLR. pp. 5171–5180
Poole, B., Ozair, S., van den Oord, A., Alemi, A.A., Tucker, G., 2019 · 2019
Cited alongside, same era.
Learning transferable cooperative behavior in multi-agent teams, in: Proceedings of the 19th International Conference on Autonomous Agents and MultiAgent Systems, International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC. p. 1741â1743
Agarwal, A., Kumar, S., Sycara, K., Lewis, M., 2020 · 2020
Cited alongside, same era.
Later among the works it cites.
Emergent world representations: Exploring a sequence model trained on a synthetic task, in: The Eleventh International Conference on Learning Representations (ICLR)
Li, K., Hopkins, A.K., Bau, D., Viégas, F., Pfister, H., Wattenberg, M., 2023 · 2023
Later among the works it cites.
Recent advances in natural language processing via large pre-trained language models: A survey
Min, B., Ross, H., Sulem, E., Veyseh, A.P.B., Nguyen, T.H., Sainz, O., Agirre, E., Heintz, I., Roth, D., 2023 · 2023
Later among the works it cites.
Nakamura, T., Taniguchi, A., Taniguchi, T., 2023 · 2023
Later among the works it cites.
Metropolis-Hastings algorithm in joint-attention naming game: experimental semiotics study
Okumura, R., Taniguchi, T., Hagiwara, Y., Taniguchi, A., 2023 · 2023
Later among the works it cites.
Emergent communication with attention, in: Goldwater, M.B., Anggoro, F.K., Hayes, B.K., Ong, D.C. (Eds.), Proceedings of the 45th Annual Meeting of the Cognitive Science Society, CogSci 2023, Sydney, NSW, Australia, July 26-29, 2023, cognitivesciencesociety.org
Ri, R., Ueda, R., Naradowsky, J., 2023 · 2023
Later among the works it cites.
World models and predictive coding for cognitive and developmental robotics: frontiers and challenges
Taniguchi, T., Murata, S., Suzuki, M., Ognibene, D., Lanillos, P., Ugur, E., Jamone, L., Nakamura, T., Ciria, A., Lara, B., Pezzulo, G., 2023a · 2023
Later among the works it cites.
Emergent communication through Metropolis-Hastings naming game with deep generative models
Taniguchi, T., Yoshida, Y., Matsui, Y., Hoang, N.L., Taniguchi, A., Hagiwara, Y., 2023b · 2023
Later among the works it cites.
Neuro-symbolic causal reasoning meets signaling game for emergent semantic communications
Thomas, C.K., Saad, W., 2023 · 2023
Later among the works it cites.
On the word boundaries of emergent languages based on harris’s articulation scheme, in: The Eleventh International Conference on Learning Representations (ICLR), ICLR 2023, Kigali, Rwanda, May 1-5, 2023, OpenReview.net
Ueda, R., Ishii, T., Miyao, Y., 2023 · 2023
Later among the works it cites.
Covla: Comprehensive vision-language-action dataset for autonomous driving
Arai, H., Miwa, K., Sasaki, K., Yamaguchi, Y., Watanabe, K., Aoki, S., Yamamoto, I., 2024 · 2024
Closest in time.
Revisiting feature prediction for learning visual representations from video
Bardes, A., Garrido, Q., Ponce, J., Chen, X., Rabbat, M., LeCun, Y., Assran, M., Ballas, N., 2024 · 2024
Closest in time.
Revla: Reverting visual domain limitation of robotic foundation models
Dey, S., Zaech, J.N., Nikolov, N., Van Gool, L., Paudel, D.P., 2024 · 2024
Closest in time.
Understanding world or predicting future? a comprehensive survey of world models
Ding, J., Zhang, Y., Shang, Y., Zhang, Y., Zong, Z., Feng, J., Yuan, Y., Su, H., Li, N., Sukiennik, N., et al., 2024 · 2024
Closest in time.
Language models represent space and time, in: The Twelfth International Conference on Learning Representations (ICLR)
Gurnee, W., Tegmark, M., 2024 · 2024
Closest in time.
Position: The platonic representation hypothesis, in: Proceedings of the 41st International Conference on Machine Learning, PMLR. pp. 20617–20642
Huh, M., Cheung, B., Wang, T., Isola, P., 2024 · 2024
Closest in time.
Emergent communication with stack-based agents
Kato, D., Ueda, R., Naradowsky, J., Miyao, Y., 2024 · 2024
Closest in time.
Real-world robot applications of foundation models: a review
Kawaharazuka, K., Matsushima, T., Gambardella, A., Guo, J., Paxton, C., Zeng, A., 2024 · 2024
Closest in time.
Openvla: An open-source vision-language-action model
Kim, M.J., Pertsch, K., Karamcheti, S., Xiao, T., Balakrishna, A., Nair, S., Rafailov, R., Foster, E., Lam, G., Sanketi, P., et al., 2024 · 2024
Closest in time.
Compositionality and generalization in emergent communication using Metropolis-Hastings naming game, in: 2024 IEEE International Conference on Development and Learning (ICDL), IEEE. pp. 1–7
Le Hoang, N., Matsui, Y., Hagiwara, Y., Taniguchi, A., Taniguchi, T., 2024 · 2024
Closest in time.
Dissociating language and thought in large language models
Mahowald, K., Ivanova, A.A., Blank, I.A., Kanwisher, N., Tenenbaum, J.B., Fedorenko, E., 2024 · 2024
Closest in time.
Reflectance estimation for proximity sensing by vision-language models: Utilizing distributional semantics for low-level cognition in robotics
Osada, M., Garcia Ricardez, G.A., Suzuki, Y., Taniguchi, T., 2024 · 2024
Closest in time.
Peters, J., de Puiseau, C.W., Tercan, H., Gopikrishnan, A., De Carvalho, G.A.L., Bitter, C., Meisen, T., 2024 · 2024
Closest in time.
Emergence of continuous signals as shared symbols through emergent communication, in: 2024 IEEE International Conference on Development and Learning (ICDL), IEEE. pp. 1–6
Saito, I., Nakamura, T., Taniguchi, A., Taniguchi, T., Hayamizu, Y., Zhang, S., 2024 · 2024
Closest in time.
Collective predictive coding hypothesis: Symbol emergence as decentralized bayesian inference
Taniguchi, T., 2024 · 2024
Closest in time.
Constructive approach to bidirectional causation between qualia structure and language emergence
Taniguchi, T., Oizumi, M., Saji, N., Horii, T., Tsuchiya, N., 2024 · 2024
Closest in time.
Reinterpreting signaling and referential games as generative models, in: Language Gamification - NeurIPS 2024 Workshop
Ueda, R., 2024 · 2024
Closest in time.
Lewis’s signaling game as beta-vae for natural word lengths and segments, in: The Twelfth International Conference on Learning Representations (ICLR), ICLR 2024, Vienna, Austria, May 7-11, 2024, OpenReview.net
Ueda, R., Taniguchi, T., 2024 · 2024
Closest in time.
Can language models serve as text-based world simulators?, in: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Wang, R., Todd, G., Xiao, Z., Yuan, X., Côté, M.A., Clark, P., Jansen, P., 2024 · 2024
Closest in time.
Multimodal continuous symbol emergence using a probabilistic generative model based on gaussian processes, in: 2024 IEEE International Conference on Development and Learning (ICDL), IEEE. pp. 1–6
You, Z., Ebara, H., Nakamura, T., Taniguchi, A., Taniguchi, T., 2024 · 2024
Closest in time.
3D-VLA: A 3d vision-language-action generative world model
Zhen, H., Qiu, X., Chen, P., Yang, J., Yan, X., Du, Y., Hong, Y., Gan, C., 2024 · 2024
Closest in time.
A survey of multi-agent deep reinforcement learning with communication
Zhu, C., Dastani, M., Wang, S., 2024 · 2024
Closest in time.
V-JEPA 2: Self-supervised video models enable understanding, prediction and planning
Assran, M., Bardes, A., Fan, D., Garrido, Q., Howes, R., Komeili, M., Muckley, M., Rizvi, A., Roberts, C., Sinha, K., Zholus, A., Arnaud, S., Gejji, A., Martin, A., Hogan, F.R., Dugas, D., Bojanowski, P., Khalidov, V., Labatut, P., Massa, F., Szafraniec, M., Krishnakumar, K., Li, Y., Ma, X., Chandar, S., Meier, F., LeCun, Y., Rabbat, M., Ballas, N., 2025 · 2025
Closest in time.
Mastering diverse control tasks through world models
Hafner, D., Pasukonis, J., Ba, J., Lillicrap, T., 2025 · 2025
Closest in time.
Matsui, Y., Yamaki, R., Ueda, R., Shinagawa, S., Taniguchi, T., 2025 · 2025
Closest in time.
Decentralized collective world model for emergent communication and coordination
Nomura, K., Aoki, T., Taniguchi, T., Horii, T., 2025 · 2025
Closest in time.
Emergent language: a survey and taxonomy
Peters, J., Waubert de Puiseau, C., Tercan, H., Gopikrishnan, A., Bitter, C., de Carvalho, G.A.L., Meisen, T., 2025 · 2025
Closest in time.
Large language models implicitly learn to see and hear just by reading
Verma, P., Pilanci, M., 2025 · 2025
Closest in time.
Reward-independent messaging for decentralized multi-agent reinforcement learning
Yoshida, N., Taniguchi, T., 2025 · 2025
Closest in time.
From text to motion: grounding gpt-4 in a humanoid robot \CJK@punctchar
Yoshida, T., Masumori, A., Ikegami, T., 2025 · 2025
Closest in time.
Show, attend and tell: Neural image caption generation with visual attention, in: International conference on machine learning, pp. 2048–2057
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhudinov, R., Zemel, R., Bengio, Y., 2015 · 2057
Closest in time.