Phoenix Arize Setup

Phoenix Arize Setup Skill

Capabilities

• Set up Phoenix local server
• Configure tracing instrumentation
• Design evaluation experiments
• Implement embedding visualizations
• Set up retrieval analysis
• Create custom evaluations with LLM-as-judge

Target Processes

• llm-observability-monitoring
• agent-evaluation-framework

Implementation Details

Core Features

1. Tracing: OpenTelemetry-based LLM traces
2. Evals: LLM-as-judge evaluations
3. Embeddings: Visualization and drift detection
4. Retrieval: RAG quality analysis
5. Datasets: Experiment management