Statistical multi-metric evaluation and visualization of LLM system predictive performance

Sensitivity of decisions to probability estimation errors: A reexamination

Peter C Fishburn, Allan H Murphy, and Herbert H Isaacs · 1968

Earlier work this paper cites.

Multiobjective optimization in river basin development

Lucien Duckstein and Serafim Opricovic · 1980

Earlier work this paper cites.

Methods for Multiple Attribute Decision Making , pages 58–191

Ching-Lai Hwang and Kwangsun Yoon · 1981

Earlier work this paper cites.

Statistical Power Analysis for the Behavioral Sciences

Jacob Cohen · 1988

Earlier work this paper cites.

Calculating and synthesizing effect sizes

III Turner, Herbert M and Robert M Bernard · 2006

Earlier work this paper cites.

New effect size rules of thumb

Shlomo S Sawilowsky · 2009

Earlier work this paper cites.

Statsmodels: Econometric and statistical modeling with python

Skipper Seabold and Josef Perktold · 2010

Earlier work this paper cites.

Using effect size—or why the p value is not enough

Gail M Sullivan and Richard Feinn · 2012

Earlier work this paper cites.

Comparative analysis of some prominent mcdm methods: A case of ranking serbian banks

Dragisa Stanujkic, Bojan Djordjevic, and Mira Djordjevic · 2013

Cited alongside, same era.

A multiple criteria decision making method based on relative value distances

Huan-jyh Shyur, Liang Yin, Hsu-shih Shih, and Chi-bin Cheng · 2015

Cited alongside, same era.

Summary and analysis of extension program evaluation in R

Salvatore S. Mangiafico · 2016

Cited alongside, same era.

Choosing between methods of combining-values

Nicholas A Heard and Patrick Rubin-Delanchy · 2018

Cited alongside, same era.

The harmonic mean p-value for combining dependent tests

Daniel J Wilson · 2019

Cited alongside, same era.

The spotis rank reversal free method for multi-criteria decision-making support

Jean Dezert, Albena Tchamova, Deqiang Han, and Jean-Marc Tacnet · 2020

Simultaneous confidence intervals for ranks with application to ranking institutions

Diaa Al Mohamad, Jelle J Goeman, and Erik W van Zwet · 2022

Later among the works it cites.

pymcdm—the universal library for solving multi-criteria decision-making problems

Bartłomiej Kizielewicz, Andrii Shekhovtsov, and Wojciech Sałabun · 2023

Later among the works it cites.

Using combinatorial optimization to design a high quality llm solution

Original

Samuel Ackerman, Eitan Farchi, Rami Katan, and Orna Raz · 2024

Later among the works it cites.

CrossCodeEval: A diverse and multilingual benchmark for cross-file code completion

Yangruibo Ding, Zijian Wang, Wasi Ahmad, Hantian Ding, Ming Tan, Nihal Jain, Murali Krishna Ramanathan, Ramesh Nallapati, Parminder Bhatia, Dan Roth, et al · 2024

Later among the works it cites.

Performances are plateauing, let’s make the leaderboard steep again, 2024

Clementine Fourrier, Nathan Habib, Konrad Szafer Alina Lozovskaya, and Thomas Wolf · 2024

Later among the works it cites.