Evaluating Sakana's AI Scientist: Bold Claims, Mixed Results, and a Promising Future?

Parallelizing stochastic gradient descent for least squares regression: mini-batching, averaging, and model misspecification

Prateek Jain, Sham M Kakade, Rahul Kidambi, Praneeth Netrapalli, and Aaron Sidford. 2018 · 2018

Earlier work this paper cites.

e-Fold Cross-Validation for Recommender-System Evaluation. In International Workshop on Recommender Systems for Sustainability and Social Good (RecSoGood) at the 18th ACM Conference on Recommender Systems (ACM RecSys)

Moritz Baumgart, Lukas Wegmeth, Tobias Vente, and Joeran Beel. 2024 · 2024

Earlier work this paper cites.

Our use of AI-tools for writing research papers. In Intelligent Systems Group, Blog

Joeran Beel. 2024 · 2024

Earlier work this paper cites.

Green Recommender Systems: A Call for Attention

Joeran Beel, Alan Said, Tobias Vente, and Lukas Wegmeth. 2024a · 2024

Earlier work this paper cites.

E-fold Cross-validation: A Computing and Energy-efficient Alternative to K-fold Cross-validation with Adaptive Folds [Proposal]

Joeran Beel, Lukas Wegmeth, and Tobias Vente. 2024b · 2024

Earlier work this paper cites.

"AI Scientist" Can Discover New Science! (Self-Improving AI = AGI)

Matthew Berman. 2024 · 2024

Earlier work this paper cites.

Chain of Ideas: Revolutionizing Research Via Novel Idea Development with LLM Agents

Original

Long Li, Weiwen Xu, Jiayan Guo, Ruochen Zhao, Xingxuan Li, Yuqian Yuan, Boqiang Zhang, Yuming Jiang, Yifei Xin, Ronghao Dang, Deli Zhao, Yu Rong, Tian Feng, and Lidong Bing. 2024 · 2024

Earlier work this paper cites.

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery

Original

Chris Lu, Cong Lu, Robert Tjarko Lange, Jakob Foerster, Jeff Clune, and David Ha. 2024 · 2024

Cited alongside, same era.

From Theory to Practice: Implementing and Evaluating e-Fold Cross-Validation. In International Conference on Artificial Intelligence and Machine Learning Research (CAIMLR)

Christopher Mahlich, Tobias Vente, and Joeran Beel. 2024 · 2024

Cited alongside, same era.

A new era of discovery

James Manyika. 2024 · 2024

Cited alongside, same era.

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery

Sakana. 2024 · 2024

Cited alongside, same era.

Sakana “AI Scientist”

Sakana.AI. 2024 · 2024

Cited alongside, same era.

Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers

SakanaAI New AI AGENT Researcher STUNS The ENITRE INDUSTRY!

TheAIGRID. 2024 · 2024

Later among the works it cites.

Artificial Intelligence, Scientific Discovery, and Product Innovation

Original

Aidan Toner-Rodgers. 2024 · 2024

Later among the works it cites.

AI-Driven Review Systems: Evaluating LLMs in Scalable and Bias-Aware Academic Reviews

Original

Keith Tyser, Ben Segev, Gaston Longhitano, Xin-Yu Zhang, Zachary Meeks, Jason Lee, Uday Garg, Nicholas Belsten, Avi Shporer, Madeleine Udell, Dov Te’eni, and Iddo Drori. 2024 · 2024

Later among the works it cites.

Are We There Yet? Revealing the Risks of Utilizing Large Language Models in Scholarly Peer Review

Original

Rui Ye, Xianghe Pang, Jingyi Chai, Jiaao Chen, Zhenfei Yin, Zhen Xiang, Xiaowen Dong, Jing Shao, and Siheng Chen. 2024 · 2024

Later among the works it cites.