Run Mini SWE-bench style harness regression tasks and A/B comparisons to measure harness improvement objectively.
Scanned 6/5/2026
Install via CLI
Skills Directoryopenskills install tuanle96/agent-harness-kit---
name: benchmark-suite
description: Run Mini SWE-bench style harness regression tasks and A/B comparisons to measure harness improvement objectively.
allowed-tools: Read, Bash(node .harness/scripts/bench-runner.mjs:*), Bash(node .harness/scripts/bench-compare.mjs:*)
suggested-turns: 6
---
# Benchmark Suite
Use this when evaluating whether a harness change improved or regressed behavior.
## Commands
```bash
node .harness/scripts/bench-runner.mjs --variant=current
node .harness/scripts/bench-runner.mjs --variant=candidate
node .harness/scripts/bench-compare.mjs
```
## Output contract
```markdown
### Benchmark Suite
### Tasks: <n>
### Pass rate: <percent>
### Avg score: <score>
### A/B delta: <delta or n/a>
```
No comments yet. Be the first to comment!
Interact with the Paperclip control plane API to manage tasks, coordinate with other agents, and follow company governance. Use when you need to check assignments, update task status, delegate work, post comments, set up or manage routines (recurring scheduled tasks), or call any Paperclip API endpoint. Do NOT use for the actual domain work itself (writing code, research, etc.) — only for Paperclip coordination.
