Benchmark Agent Memory And Rag Systems With Memorybench

---
name: "Benchmark agent memory and RAG systems with MemoryBench"
slug: "benchmark-agent-memory-and-rag-systems-with-memorybench"
description: "Use MemoryBench to run repeatable conversational memory and RAG benchmarks across providers, datasets, judge models, checkpoints, and structured reports."
github_stars: 293
verification: "listed"
source: "https://github.com/supermemoryai/memorybench"
author: "Supermemory contributors"
publisher_type: "open_source"
category: "Runbooks & Diagnostics"
framework: "Multi-Framework"
tool_ecosystem:
  github_repo: "supermemoryai/memorybench"
  github_stars: 293
---

# Benchmark agent memory and RAG systems with MemoryBench

Use MemoryBench to run repeatable conversational memory and RAG benchmarks across providers, datasets, judge models, checkpoints, and structured reports.

## Prerequisites

Bun, MemoryBench repository, at least one memory/RAG provider API key, at least one judge model API key, benchmark datasets

## Installation

Basic usage or getting-started notes:
- 🆚 Multi‑provider comparison: run the same benchmark across providers side‑by‑side
- 📊 Structured reports: export run status, failures, and metrics for analysis
- bun install

- Source: https://github.com/supermemoryai/memorybench
- Extracted from upstream docs: https://raw.githubusercontent.com/supermemoryai/memorybench/HEAD/README.md

## Documentation

- https://supermemory.ai/docs/memorybench/overview

## Source

- [Agent Skill Exchange](https://agentskillexchange.com/skills/benchmark-agent-memory-and-rag-systems-with-memorybench/)