NeMo Agent Toolkit Tracing

Phoenix provides seamless observability and tracing for NVIDIA NeMo Agent Toolkit workflows. This guide walks you through setting up telemetry to view traces in the Phoenix UI.

Install

Install the Phoenix subpackage to enable tracing capabilities:

uv pip install -e '.[phoenix]'

Setup

Start Phoenix

Self-Host
Local
Container

Run Phoenix on your own infrastructure, backed by PostgreSQL so traces persist beyond a single process. This is the option to reach for once Phoenix is shared across a team or environment.The self-hosting guide covers Kubernetes, Helm, Railway, AWS CloudFormation, Google Cloud Run, Azure, and Render, plus authentication and configuration.

uvx arize-phoenix serve

No uv? pip install arize-phoenix && phoenix serve does the same thing. See Terminal setup for customization.

docker run -p 6006:6006 -p 4317:4317 arizephoenix/phoenix:latest

Images are published to Docker Hub. See Docker for volumes, PostgreSQL, and other options.

Phoenix serves its UI and OTLP HTTP on port 6006, and OTLP gRPC on port 4317. For a local instance that’s http://localhost:6006 — leave it running while you work.

Configure Your Workflow

Update your workflow configuration file to include the telemetry settings. Add the following to your workflow configuration:

general:
  telemetry:
    tracing:
      phoenix:
        _type: phoenix
        endpoint: http://localhost:6006/v1/traces
        project: my_workflow_project

This setup enables tracing through Phoenix at http://localhost:6006/v1/traces, with traces grouped into your specified project.

Run Your Workflow

From the root directory of the NeMo Agent toolkit library, install dependencies and run your workflow:

# Install the workflow and plugins
uv pip install -e examples/observability/simple_calculator_observability/

# Run the workflow with Phoenix telemetry settings
nat run --config_file examples/observability/simple_calculator_observability/configs/config-phoenix.yml --input "What is 1*2?"

As the workflow runs, trace data will show up in Phoenix.

Observe

Open your browser and navigate to http://0.0.0.0:6006 to view your workflow traces:

Locate your workflow traces under your project name in projects
Inspect execution details (latency, tokens, etc.) and run evaluations on your traces

Resources

NVIDIA NeMo Agent Toolkit Documentation

NeMo Agent Toolkit Overview

⌘I

Developer Tools

MCP

LLM Providers

TypeScript

Python

Java

Platform

Sandboxes

Evaluation Integrations

Coding Agents

NeMo Agent Toolkit Tracing

Install

Setup

Run Your Workflow

Observe

Resources

NVIDIA NeMo Agent Toolkit Documentation

NeMo Agent Toolkit Overview

​Install

​Setup

​Run Your Workflow

​Observe

​Resources

NVIDIA NeMo Agent Toolkit Documentation

NeMo Agent Toolkit Overview

Install

Setup

Run Your Workflow

Observe

Resources