Guardrails and AI Safety

Guardrails and AI Safety

Policy Enforcement — Stack

Policy enforcement › Stack

37 of 57 in this book · 2 min read

Technology landscape as of 2026-10-10. Knowledge cutoff May 2026.

Selection criteria

The component's job is to let a non-engineer's rule take effect safely and provably, so the criteria are mostly about authoring, distribution, and evidence.

  • Authoring audience. Whether the people who own the rules can read and write them, or whether every change requires a translator.
  • Versioning and effective dates. Whether a rule set is an addressable version with a validity window, so a past decision can be replayed against the rules of that day.
  • Scoping primitives. First-class support for tenant, jurisdiction, channel, and segment rather than conditionals bolted into each rule.
  • Conflict handling. Whether the engine detects overlapping or contradictory rules statically, or discovers them at evaluation time in whatever order they happen to run.
  • Testability. Whether a rule set can be exercised against fixtures in a pipeline before it reaches traffic, like any other deployable artifact.
  • Obligation support. Whether a decision can carry a required action — append this text, log this field, notify this party — rather than only permitting or denying.
  • Distribution and staleness. How a new version reaches every evaluator, how long that takes, and what runs in the interim.
  • Decision records. Whether each evaluation emits which rules ran, which matched, and under which version.

Options

Option Best for Watch out for
General policy engines (Open Policy Agent with Rego, Cedar, Casbin) Rules that must be reviewed, tested, versioned, and distributed independently of any application A specialist language; compliance owners will not write it, so a translation step and its drift are permanent
Expression languages embedded in the application (CEL, JSONLogic, a typed rule DSL) Lightweight conditions evaluated in-process with no extra deployment Grows into an unversioned pile of conditionals; scoping and effective dates have to be built by hand
Business rules engines (Drools and comparable platforms) Organisations with existing rule governance and non-engineering authors Heavyweight for per-request evaluation, and the authoring tools assume a batch rather than a serving workload
Conversational policy frameworks (NeMo Guardrails with Colang, Guardrails AI validators) Rules about dialogue shape — permitted topics, required phrasing, mandated refusal flows Policy is expressed in the dialogue layer, which makes it hard to apply to actions and to non-chat surfaces
A model adjudicating a written rule Commitments too contextual to express as predicates, such as whether an answer constitutes advice Non-deterministic, costly per request, and the evidence it produces is an opinion rather than a trace
Feature-flag platforms (OpenFeature, LaunchDarkly, Unleash) Switching a rule on or off quickly, per tenant, during an incident Not a policy store: no effective dates, no conflict detection, and flag state drifts between environments
Structural removal — capability withheld, tool unregistered, data source disconnected Commitments that must hold even if the model is persuaded or the checker fails Coarse; removes the capability for everyone rather than for the case the rule was about