Benchmark Browser Agents On A Fixed Stealth And Task Suite With Browser Use Benchmark

---
name: "Benchmark browser agents on a fixed stealth and task suite with browser-use benchmark"
slug: "benchmark-browser-agents-on-a-fixed-stealth-and-task-suite-with-browser-use-benchmark"
description: "Compare browser-agent reliability on a repeatable task and anti-bot suite before choosing a stack or claiming progress."
github_stars: 71
verification: "security_reviewed"
source: "https://github.com/browser-use/benchmark"
author: "browser-use"
publisher_type: "organization"
category: "Browser Automation"
framework: "Multi-Framework"
tool_ecosystem:
  github_repo: "browser-use/benchmark"
  github_stars: 71
---

# Benchmark browser agents on a fixed stealth and task suite with browser-use benchmark

Compare browser-agent reliability on a repeatable task and anti-bot suite before choosing a stack or claiming progress.

## Prerequisites

Python, uv, benchmark repository dependencies, required API keys for the judge model and selected browser provider, target browser agent configuration

## Installation

Use the upstream install or setup path that matches your environment:
- pip install uv
- uv sync
- uv run python run_eval.py --browser <provider>

Requirements and caveats from upstream:
- python -c "

Basic usage or getting-started notes:
- **2. Set up your .env** (see [.env.example](.env.example))
- cp .env.example .env
- **4. Run the evaluation**

- Source: https://github.com/browser-use/benchmark
- Extracted from upstream docs: https://raw.githubusercontent.com/browser-use/benchmark/HEAD/README.md

## Documentation

- https://github.com/browser-use/benchmark#readme

## Source

- [Agent Skill Exchange](https://agentskillexchange.com/skills/benchmark-browser-agents-on-a-fixed-stealth-and-task-suite-with-browser-use-benchmark/)