FusionBench: A Unified Library and Comprehensive Benchmark for Deep Model Fusion

Understand

Deep model fusion is an emerging technique that unifies the predictions or parameters of several deep neural networks into a single better-performing model in a cost-effective and data-efficient manner.

• Although a variety of deep model fusion techniques have been introduced, their evaluations tend to be inconsistent and often inadequate to validate their effectiveness and robustness.
• We present FusionBench, the first benchmark and a unified library designed specifically for deep model fusion.
• Our benchmark consists of multiple tasks, each with different settings of models and datasets.