Fetching the paper…

Reading the bibliography…

2025

Evaluation Report on MCP Servers

Luo, Zhiling, Shi, Xiaorong, Lin, Xuanrui et al.

Original
PDF
Post on X

Understand

With the rise of LLMs, a large number of Model Context Protocol (MCP) services have emerged since the end of 2024.

However, the effectiveness and efficiency of MCP servers have not been well studied.
To study these questions, we propose an evaluation framework, called MCPBench.
We selected several widely used MCP server and conducted an experimental evaluation on their accuracy, time, and token usage.

Evaluation Report on MCP Servers · Around

Built on

Deepseek-v3 technical report, 2024
DeepSeek-AI · 2024
Earlier work this paper cites.
Qwen2.5 technical report
Original
Qwen Team · 2024
Earlier work this paper cites.

Similar

A preview of xiyan-sql: A multi-generator ensemble framework for text-to-sql, 2025
Yingqi Gao, Yifu Liu, Xiaoxia Li, Xiaorong Shi, Yin Zhu, Yiming Wang, Shiqi Li, Wei Li, Yuntao Hong, Zhiling Luo, Jinyang Gao, Liyu Mou, and Yu Li · 2025
Cited alongside, same era.
https://modelcontextprotocol.io
Model context protocol
Cited in the paper.
mysql-mcp-server
designcomputer
Cited in the paper.
brave-search
erdnax123
Cited in the paper.
exa-mcp-server
exa labs
Cited in the paper.
bing-search-mcp
leehanchung
Cited in the paper.
firecrawl-mcp-server
mendableai
Cited in the paper.
postgres
modelcontextprotocol
Cited in the paper.
duckduckgo-mcp-server
nickclyde
Cited in the paper.
tavily-mcp
tavily ai
Cited in the paper.
xiyan-mcp-server
XGenerationLab
Cited in the paper.

Then

Fact, fetch, and reason: A unified evaluation of retrieval-augmented generation, 2025
Satyapriya Krishna, Kalpesh Krishna, Anhad Mohananey, Steven Schwarcz, Adam Stambler, Shyam Upadhyay, and Manaal Faruqui · 2025
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…