Fetching the paper…
Reading the bibliography…
Large language models (LLMs) have shown promise in transforming machine learning research, yet their capability to faithfully implement novel ideas from recent research papers-ideas unseen during pretraining-remains unclear.
Codebert: A pre-trained model for programming and natural languages
Zhangyin Feng, Daya Guo, Duyu Tang, Nan Duan, Xiaocheng Feng, Ming Gong, Linjun Shou, Bing Qin, Ting Liu, Daxin Jiang, et al · 2020
Earlier work this paper cites.
Codebleu: a method for automatic evaluation of code synthesis
Shuo Ren, Daya Guo, Shuai Lu, Long Zhou, Shujie Liu, Duyu Tang, M. Zhou, Ambrosio Blanco, and Shuai Ma · 2020
Earlier work this paper cites.
Super: Evaluating agents on setting up and executing tasks from research repositories
Ben Bogin, Kejuan Yang, Shashank Gupta, Kyle Richardson, Erin Bransom, Peter Clark, Ashish Sabharwal, and Tushar Khot · 2024
Earlier work this paper cites.
Mle-bench: Evaluating machine learning agents on machine learning engineering
Jun Shern Chan, Neil Chowdhury, Oliver Jaffe, James Aung, Dane Sherburn, Evan Mays, Giulio Starace, Kevin Liu, Leon Maksin, Tejal Patwardhan, et al · 2024
Earlier work this paper cites.
The road less scheduled
Aaron Defazio, Xingyu Yang, Ahmed Khaled, Konstantin Mishchenko, Harsh Mehta, and Ashok Cutkosky · 2024
Earlier work this paper cites.
Mlagentbench: Evaluating language agents on machine learning experimentation
Qian Huang, Jian Vora, Percy Liang, and Jure Leskovec · 2024
Earlier work this paper cites.
R2e: Turning any github repository into a programming agent environment
Naman Jain, Manish Shetty, Tianjun Zhang, King Han, Koushik Sen, and Ion Stoica · 2024
Earlier work this paper cites.
SWE-bench: Can language models resolve real-world github issues?
Carlos E Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R Narasimhan · 2024
Earlier work this paper cites.
Agentreview: Exploring peer review dynamics with llm agents
Yiqiao Jin, Qinlin Zhao, Yiyang Wang, Hao Chen, Kaijie Zhu, Yijia Xiao, and Jindong Wang · 2024
Earlier work this paper cites.
The ai scientist: Towards fully automated open-ended scientific discovery
Chris Lu, Cong Lu, Robert Tjarko Lange, Jakob Foerster, Jeff Clune, and David Ha · 2024
Earlier work this paper cites.
The ai review lottery: Widespread ai-assisted peer reviews boost paper scores and acceptance rates
Giuseppe Russo Latona, Manoel Horta Ribeiro, Tim R. Davidson, Veniamin Veselovsky, and Robert West · 2024
Earlier work this paper cites.
Zachary S Siegel, Sayash Kapoor, Nitya Nagdir, Benedikt Stroebl, and Arvind Narayanan · 2024
Earlier work this paper cites.
Scicode: A research coding benchmark curated by scientists, 2024
Minyang Tian, Luyu Gao, Shizhuo Dylan Zhang, Xinan Chen, Cunwei Fan, Xuefei Guo, Roland Haas, Pan Ji, Kittithat Krongchon, Yao Li, Shengyan Liu, Di Luo, Yutao Ma, Hao Tong, Kha Trinh, Chenyu Tian, Zihan Wang, Bohao Wu, Yanyu Xiong, Shengzhu Yin, Minhui Zhu, Kilian Lieret, Yanxin Lu, Genglin Liu, Yufeng Du, Tianhua Tao, Ofir Press, Jamie Callan, Eliu Huerta, and Hao Peng · 2024
Earlier work this paper cites.
CodeJudge: Evaluating code generation with large language models
Weixi Tong and Tianyi Zhang · 2024
Cited alongside, same era.
Diffusion model alignment using direct preference optimization
Eric Wallace et al · 2024
Cited alongside, same era.
Data unlearning in diffusion models
Silas Alberti, Kenan Hasanaliyev, Manav Shah, and Stefano Ermon · 2025
Cited alongside, same era.
Advantage alignment algorithms
Juan Agustin Duque, Milad Aghajohari, Tim Cooijmans, Razvan Ciuca, Tianyu Zhang, Gauthier Gidel, and Aaron Courville · 2025
Cited alongside, same era.
Juraj Gottweis, Wei-Hung Weng, Alexander Daryin, Tao Tu, Anil Palepu, Petar Sirkovic, Artiom Myaskovsky, Felix Weissenberger, Keran Rong, Ryutaro Tanno, et al · 2025
Cited alongside, same era.
Hugging face papers, 2025
Hugging Face · 2025
Turning up the heat: Min-p sampling for creative and coherent llm outputs
Minh Nguyen, Andrew Baker, Clement Neo, Allen Roush, Andreas Kirsch, and Ravid Shwartz-Ziv · 2025
Closest in time.
Optimal stepsize for diffusion sampling
Jianning Pei, Han Hu, and Shuyang Gu · 2025
Closest in time.
Simon Schug, Seijin Kobayashi, Yassir Akram, João Sacramento, and Razvan Pascanu · 2025
Closest in time.
Tabdiff: a mixed-type diffusion model for tabular data generation
Juntong Shi, Minkai Xu, Harper Hua, Hengrui Zhang, Stefano Ermon, and Jure Leskovec · 2025
Closest in time.
Can llms generate novel research ideas? a large-scale human study with 100+ nlp researchers
Chenglei Si, Diyi Yang, and Tatsunori Hashimoto · 2025
Closest in time.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Your vit is secretly an image segmentation model
Tommie Kerssies, Niccolò Cavagnero, Alexander Hermans, Narges Norouzi, Giuseppe Averta, Bastian Leibe, Gijs Dubbelman, and Daan de Geus · 2025
Cited alongside, same era.
Robust weight initialization for tanh neural networks with fixed point analysis
Hyunwoo Lee, Hayoung Choi, and Hyunju Kim · 2025
Cited alongside, same era.
Repa-e: Unlocking vae for end-to-end tuning with latent diffusion transformers
Xingjian Leng, Jaskirat Singh, Yunzhong Hou, Zhenchang Xing, Saining Xie, and Liang Zheng · 2025
Cited alongside, same era.
Mistral ocr, March 2025
Mistral · 2025
Cited alongside, same era.
latexpand: Flatten latex files by replacing input and include
Matthieu Moy · 2025
Cited alongside, same era.
Mlgym: A new framework and benchmark for advancing ai research agents
Deepak Nathani, Lovish Madaan, Nicholas Roberts, Nikolay Bashlykov, Ajay Menon, Vincent Moens, Amar Budhiraja, Despoina Magka, Vladislav Vorotilov, Gaurav Chaurasia, Dieuwke Hupkes, Ricardo Silveira Cabral, Tatiana Shavrina, Jakob Foerster, Yoram Bachrach, William Yang Wang, and Roberta Raileanu · 2025
Cited alongside, same era.
Paperbench: Evaluating ai’s ability to replicate ai research
Giulio Starace, Oliver Jaffe, Dane Sherburn, James Aung, Jun Shern Chan, Leon Maksin, Rachel Dias, Evan Mays, Benjamin Kinsella, Wyatt Thompson, Johannes Heidecke, Amelia Glaese, and Tejal Patwardhan · 2025
Closest in time.
Mcts-judge: Test-time scaling in llm-as-a-judge for code correctness evaluation
Yutong Wang, Pengliang Ji, Chaoqun Yang, Kaixin Li, Ming Hu, Jiaoyang Li, and Guillaume Sartoretti · 2025
Closest in time.
” principal components” enable a new language of images
Xin Wen, Bingchen Zhao, Ismail Elezi, Jiankang Deng, and Xiaojuan Qi · 2025
Closest in time.
On conformal isometry of grid cells: Learning distance-preserving position embedding
Dehong Xu, Ruiqi Gao, Wen-Hao Zhang, Xue-Xin Wei, and Ying Nian Wu · 2025
Closest in time.
Tianzhu Ye, Li Dong, Yuqing Xia, Yutao Sun, Yi Zhu, Gao Huang, and Furu Wei · 2025
Closest in time.
Gps: A probabilistic distributional similarity with gumbel priors for set-to-set matching
Ziming Zhang, Fangzhou Lin, Haotian Liu, Jose Morales, Haichong Zhang, Kazunori Yamada, Vijaya B Kolachalama, and Venkatesh Saligrama · 2025
Closest in time.
Transformers without normalization
Jiachen Zhu, Xinlei Chen, Kaiming He, Yann LeCun, and Zhuang Liu · 2025
Closest in time.