Professional Certification Benchmark Dataset: The First 500 Jobs For Large Language Models

Understand

The research creates a professional certification survey to test large language models and evaluate their employable skills.

• It compares the performance of two AI models, GPT-3 and Turbo-GPT3.5, on a benchmark dataset of 1149 professional certifications, emphasizing vocational readiness rather than academic performance.
• GPT-3 achieved a passing score (>70% correct) in 39% of the professional certifications without fine-tuning or exam preparation.
• The models demonstrated qualifications in various computer-related fields, such as cloud and virtualization, business analytics, cybersecurity, network setup and repair, and data analytics.