NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Rails

Understand

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

• Guardrails (or rails for short) are a specific way of controlling the output of an LLM, such as not talking about topics considered harmful, following a predefined dialogue path, using a particular language style, and more.
• There are several mechanisms that allow LLM providers and developers to add guardrails that are embedded into a specific model at training, e.g.
• using model alignment.