Papers
arxiv:2610.31062

SCOPE: Compiling Natural-Language Policies into Neurosymbolic Predicate Programs

Published on Oct 22
ยท Submitted by
Levi
on Oct 23
ยท Plurai Plurai
Authors:
,

Abstract

SCOPE compiles compound policies into optimized neural-symbolic programs that achieve high accuracy, stability, and interpretability on inexpensive models.

Policy enforcement for LLM agents has shifted from single-turn content moderation to compound, application-specific policies evaluated over multi-turn transcripts and tool-call trajectories. Fine-tuned guardrail models are efficient but degrade on compound policies, and while LLM-as-a-judge approaches achieve higher accuracy, they incur high inference cost and tend to produce unstable predictions. Neurosymbolic methods offer a natural alternative, decomposing the policy into narrow neural decisions composed under explicit logic. However, existing symbolic layers lack the required expressiveness and are optimized against fixed data rather than the policy itself. To address this, we introduce SCOPE, which compiles a policy into an executable program of neural predicates executed by small models, deterministic extractors, and code that composes their outputs. The program is optimized jointly with its training data, using adversarial generation of counterexamples that target where the program deviates from the policy. We evaluate SCOPE on a benchmark of real-world policy tasks against prompt optimization, task decomposition, and workflow generation methods, achieving the highest average accuracy across tasks and models. Programs optimized with the weakest executor transfer to other models without further optimization. This allows them to be deployed in production on inexpensive models, where they reach accuracy comparable to frontier reasoning models. Unlike these monolithic models, SCOPE produces substantially more stable predictions, and each verdict is interpretable through the predicate outputs that produced it. Additionally, we validate the key components of our method through an ablation study. SCOPE thus enables reliable, interpretable, and efficient policy enforcement at production scale.

Community

Paper submitter

Compiling a policy into predicates run by small models fits deployments where every call to a large judge is too expensive. Two questions. How small did the weakest executor get in your experiments, and did any predicate run well on a CPU-only model? And for policies written in a language other than English, does the compiled program keep the English predicate prompts, or do you regenerate them in the policy's language? I am thinking of Brazilian Portuguese policies checked on modest hardware.

ยท
  1. The predicates in the paper are not fitted to CPU. However, in our product, we combine this work with our previous work:
    https://arxiv.org/pdf/2604.25203
    This combination allows us to use predicates that are really SLMs that can fit into a CPU

  2. In our product, we support multiple languages.

Being able to trace each verdict back to the predicate outputs that produced it matters as much as the accuracy gain. When a guardrail blocks something, the person reviewing it needs to see which part of the policy fired, not just a yes or no from a judge model.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2610.31062
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.31062 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.31062 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.31062 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.