Fetching the paper…
Reading the bibliography…
While large language models (LLMs) are increasingly being used for program synthesis, they lack the global view needed to develop useful abstractions; they generally predict programs one at a time, often repeating the same functionality.
Hierarchical grouping to optimize an objective function
Ward Jr, J. H · 1963
Earlier work this paper cites.
Understanding natural language
Winograd, T · 1972
Earlier work this paper cites.
Turtle geometry: The computer as a medium for exploring mathematics
Abelson, H. and DiSessa, A · 1986
Earlier work this paper cites.
Applications and implementation: an experimental comparison of cellular (group technology) layout with process layout
Flynn, B. B. and Jacobs, F. R · 1987
Earlier work this paper cites.
The evolution of ecological specialization
Futuyma, D. J. and Moreno, G · 1988
Earlier work this paper cites.
Learning to parse database queries using inductive logic programming
Zelle, J. M. and Mooney, R. J · 1996
Earlier work this paper cites.
Rule learning by seven-month-old infants
Marcus, G. F., Vijayan, S., Bandi Rao, S., and Vishton, P. M · 1999
Earlier work this paper cites.
Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning
Sutton, R. S., Precup, D., and Singh, S · 1999
Earlier work this paper cites.
Recent advances in hierarchical reinforcement learning
Barto, A. G. and Mahadevan, S · 2003
Earlier work this paper cites.
Code complete
McConnell, S · 2004
Earlier work this paper cites.
Curriculum learning
Bengio, Y., Louradour, J., Collobert, R., and Weston, J · 2009
Earlier work this paper cites.
Scikit-learn: Machine learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., and Duchesnay, E · 2011
Earlier work this paper cites.
Think python
Downey, A · 2012
Earlier work this paper cites.
Foundations of rule learning
Fürnkranz, J., Gamberger, D., and Lavrač, N · 2012
Earlier work this paper cites.
Human-level concept learning through probabilistic program induction
Lake, B. M., Salakhutdinov, R., and Tenenbaum, J. B · 2015
Earlier work this paper cites.
Productivity and reuse in language: A theory of linguistic computation and storage
O’Donnell, T. J · 2015
Earlier work this paper cites.
Neural module networks
Andreas, J., Rohrbach, M., Darrell, T., and Klein, D · 2016
Earlier work this paper cites.
The price of linguistic productivity: How children learn to break the rules of language
Yang, C · 2016
Earlier work this paper cites.
Semantic parsing for task oriented dialog using hierarchical representations
Gupta, S., Shah, R., Mohit, M., Kumar, A., and Lewis, M · 2018
Earlier work this paper cites.
Textworld: A learning environment for text-based games
Côté, M.-A., Kádár, A., Yuan, X., Kybartas, B., Barnes, T., Fine, E., Moore, J., Hausknecht, M., El Asri, L., Adada, M., et al · 2019
Earlier work this paper cites.
Transformers: State-of-the-art natural language processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., Davison, J., Shleifer, S., von Platen, P., Ma, C., Jernite, Y., Plu, J., Xu, C., Scao, T. L., Gugger, S., Drame, M., Lhoest, Q., and Rush, A. M · 2020
Earlier work this paper cites.
Dreamcoder: Bootstrapping inductive program synthesis with wake-sleep library learning
Ellis, K., Wong, L., Nye, M., Sablé-Meyer, M., Morales, L., Hewitt, L., Cary, L., Solar-Lezama, A., and Tenenbaum, J. B · 2021
Earlier work this paper cites.
Measuring mathematical problem solving with the math dataset
Hendrycks, D., Burns, C., Kadavath, S., Arora, A., Basart, S., Tang, E., Song, D., and Steinhardt, J · 2021
Cited alongside, same era.
Ethical and social risks of harm from language models
Weidinger, L., Mellor, J., Rauh, M., Griffin, C., Uesato, J., Huang, P.-S., Cheng, M., Glaese, M., Balle, B., Kasirzadeh, A., et al · 2021
Cited alongside, same era.
Leveraging language to learn program abstractions and search heuristics
Wong, L., Ellis, K. M., Tenenbaum, J., and Andreas, J · 2021
Cited alongside, same era.
Do as i can and not as i say: Grounding language in robotic affordances
Ahn, M., Brohan, A., Brown, N., Chebotar, Y., Cortes, O., David, B., Finn, C., Fu, C., Gopalakrishnan, K., Hausman, K., Herzog, A., Ho, D., Hsu, J., Ibarz, J., Ichter, B., Irpan, A., Jang, E., Ruano, R. J., Jeffrey, K., Jesmonth, S., Joshi, N., Julian, R., Kalashnikov, D., Kuang, Y., Lee, K.-H., Levine, S., Lu, Y., Luu, L., Parada, C., Pastor, P., Quiambao, J., Rao, K., Rettinghouse, J., Reyes, D., Sermanet, P., Sievers, N., Tan, C., Toshev, A., Vanhoucke, V., Xia, F., Xiao, T., Xu, P., Xu, S., Yan, M., and Zeng, A · 2022
Cited alongside, same era.
Voxposer: Composable 3D value maps for robotic manipulation with language models
Huang, W., Wang, C., Zhang, R., Li, Y., Wu, J., and Fei-Fei, L · 2023
Later among the works it cites.
Decomposed prompting: A modular approach for solving complex tasks
Khot, T., Trivedi, H., Finlayson, M., Fu, Y., Richardson, K., Clark, P., and Sabharwal, A · 2023
Later among the works it cites.
AgentBench: Evaluating LLMs as agents
Liu, X., Yu, H., Zhang, H., Xu, Y., Lei, X., Lai, H., Gu, Y., Ding, H., Men, K., Yang, K., et al · 2023
Later among the works it cites.
Chameleon: Plug-and-play compositional reasoning with large language models
Lu, P., Peng, B., Cheng, H., Galley, M., Chang, K.-W., Wu, Y. N., Zhu, S.-C., and Gao, J · 2023
Later among the works it cites.
Faithful Chain-of-Thought Reasoning
Lyu, Q., Havaldar, S., Stein, A., Zhang, L., Rao, D., Wong, E., Apidianaki, M., and Callison-Burch, C · 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Chen, W., Ma, X., Wang, X., and Cohen, W. W · 2022
Cited alongside, same era.
Language models as zero-shot planners: Extracting actionable knowledge for embodied agents
Huang, W., Abbeel, P., Pathak, D., and Mordatch, I · 2022
Cited alongside, same era.
What makes good in-context examples for GPT-3?
Liu, J., Shen, D., Zhang, Y., Dolan, B., Carin, L., and Chen, W · 2022
Cited alongside, same era.
Dynamic prompt learning via policy gradient for semi-structured mathematical reasoning
Lu, P., Qiu, L., Chang, K.-W., Wu, Y. N., Zhu, S.-C., Rajpurohit, T., Clark, P., and Kalyan, A · 2022
Cited alongside, same era.
New and improved embedding model, 2022
OpenAI · 2022
Cited alongside, same era.
Benchclamp: A benchmark for evaluating language models on semantic parsing
Roy, S., Thomson, S., Chen, T., Shin, R., Pauls, A., Eisner, J., and Van Durme, B · 2022
Cited alongside, same era.
Summarization programs: Interpretable abstractive summarization with neural modular trees
Saha, S., Zhang, S., Hase, P., and Bansal, M · 2022
Cited alongside, same era.
Few-shot semantic parsing with language models trained on code
Shin, R. and Van Durme, B · 2022
Cited alongside, same era.
Later among the works it cites.
Clin: A continually learning language agent for rapid task adaptation and generalization
Majumder, B. P., Mishra, B. D., Jansen, P., Tafjord, O., Tandon, N., Zhang, L., Callison-Burch, C., and Clark, P · 2023
Later among the works it cites.
Augmented Language Models: a Survey
Mialon, G., Dessì, R., Lomeli, M., Nalmpantis, C., Pasunuru, R., Raileanu, R., Rozière, B., Schick, T., Dwivedi-Yu, J., Celikyilmaz, A., et al · 2023
Later among the works it cites.
Adapt: As-needed decomposition and planning with language models
Prasad, A., Koller, A., Hartmann, M., Clark, P., Sabharwal, A., Bansal, M., and Khot, T · 2023
Later among the works it cites.
Creator: Tool creation for disentangling abstract and concrete reasoning of large language models
Qian, C., Han, C., Fung, Y., Qin, Y., Liu, Z., and Ji, H · 2023
Later among the works it cites.
ToolLLM: Facilitating large language models to master 16000+ real-world APIs
Qin, Y., Liang, S., Ye, Y., Zhu, K., Yan, L., Lu, Y., Lin, Y., Cong, X., Tang, X., Qian, B., et al · 2023
Later among the works it cites.
Code llama: Open foundation models for code
Roziere, B., Gehring, J., Gloeckle, F., Sootla, S., Gat, I., Tan, X. E., Adi, Y., Liu, J., Remez, T., Rapin, J., et al · 2023
Later among the works it cites.
Identifying the risks of LM agents with an LM-emulated sandbox
Ruan, Y., Dong, H., Wang, A., Pitis, S., Zhou, Y., Ba, J., Dubois, Y., Maddison, C., and Hashimoto, T · 2023
Later among the works it cites.
Toolformer: Language models can teach themselves to use tools
Schick, T., Dwivedi-Yu, J., Dessì, R., Raileanu, R., Lomeli, M., Zettlemoyer, L., Cancedda, N., and Scialom, T · 2023
Later among the works it cites.
ProgPrompt: Generating situated robot task plans using Large Language Models
Singh, I., Blukis, V., Mousavian, A., Goyal, A., Xu, D., Tremblay, J., Fox, D., Thomason, J., and Garg, A · 2023
Later among the works it cites.
ViperGPT: Visual inference via Python execution for reasoning
Surís, D., Menon, S., and Vondrick, C · 2023
Later among the works it cites.
Voyager: An open-ended embodied agent with large language models
Wang, G., Xie, Y., Jiang, Y., Mandlekar, A., Xiao, C., Zhu, Y., Fan, L., and Anandkumar, A · 2023
Later among the works it cites.
Learning adaptive planning representations with natural language guidance
Wong, L., Mao, J., Sharma, P., Siegel, Z. S., Feng, J., Korneev, N., Tenenbaum, J. B., and Andreas, J · 2023
Later among the works it cites.
React: Synergizing reasoning and acting in language models
Yao, S., Zhao, J., Yu, D., Du, N., Shafran, I., Narasimhan, K. R., and Cao, Y · 2023
Later among the works it cites.
Large language models as analogical reasoners
Yasunaga, M., Chen, X., Li, Y., Pasupat, P., Leskovec, J., Liang, P., Chi, E. H., and Zhou, D · 2023
Later among the works it cites.
Craft: Customizing LLMs by creating and retrieving from specialized toolsets
Yuan, L., Chen, Y., Wang, X., Fung, Y. R., Peng, H., and Ji, H · 2023
Later among the works it cites.
Trove: Inducing verifiable and efficient toolboxes for solving programmatic tasks
Wang, Z., Fried, D., and Neubig, G · 2024
Closest in time.