ThriftLLM: On Cost-Effective Selection of Large Language Models for Classification Queries

Understand

In recent years, large language models (LLMs) have demonstrated remarkable capabilities in comprehending and generating natural language content, attracting widespread attention in both industry and academia.

• An increasing number of services offer LLMs for various tasks via APIs.
• Different LLMs demonstrate expertise in different domains of queries (e.g., text classification queries).
• Meanwhile, LLMs of different scales, complexities, and performance are priced diversely.