2023

An In-depth Look at Gemini's Language Abilities

Akter, Syeda Nahida, Yu, Zichun, Muhamed, Aashiq et al.

Understand

The recently released Google Gemini class of models are the first to comprehensively report results that rival the OpenAI GPT series across a wide variety of tasks.

  • In this paper, we do an in-depth exploration of Gemini's language abilities, making two contributions.
  • First, we provide a third-party, objective comparison of the abilities of the OpenAI GPT and Google Gemini models with reproducible code and fully transparent results.
  • Second, we take a closer look at the results, identifying areas where one of the two model classes excels.

Reading the bibliography…