Guardrails AI Tracing

In this example we will instrument a small program that uses the Guardrails AI framework to protect their LLM calls.

Install

pip install openinference-instrumentation-guardrails guardrails-ai

Setup

Connect your application to Phoenix with the register function:

Run Guardrails

From here, you can run Guardrails as normal:

from guardrails import Guard
from guardrails.hub import TwoWords
import openai

guard = Guard().use(
    TwoWords(),
)
response = guard(
    llm_api=openai.chat.completions.create,
    prompt="What is another name for America?",
    model="gpt-3.5-turbo",
    max_tokens=1024,
)

print(response)

Observe

Now that you have tracing setup, all invocations of underlying models used by Guardrails (completions, chat completions, embeddings) will be streamed to your running Phoenix for observability and evaluation. Additionally, Guards will be present as a new span kind in Phoenix.

Resources

Example notebook
OpenInference package

⌘I

Developer Tools

MCP

LLM Providers

TypeScript

Python

Java

Platform

Sandboxes

Evaluation Integrations

Coding Agents

Guardrails AI Tracing

Install

Setup

Run Guardrails

Observe

Resources

​Install

​Setup

​Run Guardrails

​Observe

​Resources

Install

Setup

Run Guardrails

Observe

Resources