2021

OpenPrompt: An Open-source Framework for Prompt-learning

Ding, Ning, Hu, Shengding, Zhao, Weilin et al.

Understand

Prompt-learning has become a new paradigm in modern natural language processing, which directly adapts pre-trained language models (PLMs) to $cloze$-style prediction, autoregressive modeling, or sequence to sequence generation, resulting in promising performances on various tasks.

  • However, no standard implementation framework of prompt-learning is proposed yet, and most existing prompt-learning codebases, often unregulated, only provide limited implementations for specific scenarios.
  • Since there are many details such as templating strategy, initializing strategy, and verbalizing strategy, etc.
  • need to be considered in prompt-learning, practitioners face impediments to quickly adapting the desired prompt learning methods to their applications.

Reading the bibliography…