ALPINE: An adaptive language-agnostic pruning method for language models for code

Understand

Language models of code have demonstrated state-of-the-art performance across various software engineering and source code analysis tasks.

• However, their demanding computational resource requirements and consequential environmental footprint remain as significant challenges.
• This work introduces ALPINE, an adaptive programming language-agnostic pruning technique designed to substantially reduce these models' computational overhead.
• The proposed method offers a pluggable layer that can be integrated with all Transformer-based models.