Run Repeatable Agent Evaluation Suites With Trajectory And Simulator Coverage Using Strands Evals

---
name: "Run repeatable agent evaluation suites with trajectory and simulator coverage using Strands Evals"
slug: "run-repeatable-agent-evaluation-suites-with-trajectory-and-simulator-coverage-using-strands-evals"
description: "Build repeatable evaluation experiments for agents and LLM apps with output checks, trajectory scoring, simulators, and trace-based review."
github_stars: 105
verification: "security_reviewed"
source: "https://github.com/strands-agents/evals"
author: "strands-agents"
publisher_type: "organization"
category: "Code Quality & Review"
framework: "Multi-Framework"
tool_ecosystem:
  github_repo: "strands-agents/evals"
  github_stars: 105
---

# Run repeatable agent evaluation suites with trajectory and simulator coverage using Strands Evals

Build repeatable evaluation experiments for agents and LLM apps with output checks, trajectory scoring, simulators, and trace-based review.

## Prerequisites

Python 3.10+, pip, optional judge-model access

## Installation

Use the upstream install or setup path that matches your environment:
- pip install strands-agents-evals
- pip install -e .
- pip install -e ".[test]"
- pip install -e ".[test,dev]"

Requirements and caveats from upstream:
- <a href="https://python.org"><img alt="Python versions" src="https://img.shields.io/pypi/pyversions/strands-agents-evals"/></a>
- ◆ <a href="https://github.com/strands-agents/sdk-python">Python SDK</a>
- python

Basic usage or getting-started notes:
- **Multiple Evaluation Types**: Output evaluation, trajectory analysis, tool usage assessment, and interaction evaluation
- bash
- from strands import Agent

- Source: https://github.com/strands-agents/evals
- Extracted from upstream docs: https://raw.githubusercontent.com/strands-agents/evals/HEAD/README.md

## Documentation

- https://github.com/strands-agents/evals

## Source

- [Agent Skill Exchange](https://agentskillexchange.com/skills/run-repeatable-agent-evaluation-suites-with-trajectory-and-simulator-coverage-using-strands-evals/)