Towards Safer Chatbots: Automated Policy Compliance Evaluation of Custom GPTs

Understand

User-configured chatbots built on top of large language models are increasingly available through centralized marketplaces such as OpenAI's GPT Store.

• While these platforms enforce usage policies intended to prevent harmful or inappropriate behavior, the scale and opacity of customized chatbots make systematic policy enforcement challenging.
• As a result, policy-violating chatbots continue to remain publicly accessible despite existing review processes.
• This paper presents a fully automated method for evaluating the compliance of Custom GPTs with its marketplace usage policy using black-box interaction.