Derived from arXiv:2607.16848 - Beyond Memory Leaderboards: Evaluating Scientific Memory as Budgeted Context Restoration
Scanned 9/11/2026
Install to Claude Code
npx -y skills add hiyenwong/ai_collection --skill beyond-memory-leaderboards-evaluating-scientific-m --agent claude-codeInstalls into .claude/skills of the current project.
Are you the author of Beyond Memory Leaderboards Evaluating Scientific M?
Add the live security badge to your README — it updates automatically with every re-scan.
[](https://www.skillsdirectory.com/skills/hiyenwong-beyond-memory-leaderboards-evaluating-scientific-m)More formats (shields.io, HTML) on the badges page.
# Beyond Memory Leaderboards: Evaluating Scientific Memory as Budgeted Context Restoration
Derived from arXiv:2607.16848 - Beyond Memory Leaderboards: Evaluating Scientific Memory as Budgeted Context Restoration
## Core Concept
Long-term memory is becoming a core component of LLM agents, but most memory benchmarks evaluate conversations or compact summaries, while research agents need to restore evidence from full scientific papers. We introduce two full-text scientific-memory benchmarks, Public AI Memory (PAIM; 81 papers, 66 questions) and Public Transformers (PTr; 252 papers, 98 questions). We evaluate eight memory/retrieval systems, including our own proposed Theoria, plus a no-retrieval baseline. Our results show t...
## Key Insights
- Derived from arXiv:2607.16848
- Published: 2026-07-18
- Utility Score: 1.00
- Authors: Maksim Sheverev, David Finkelstein, Sergey Nikolenko
## Activation
beyond-memory-leaderboards-evaluating-scientific-m, 2607.16848
## References
- arXiv: https://arxiv.org/abs/2607.16848
Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.
No comments yet. Be the first to comment!
Ultra-compressed communication mode. Cuts token usage ~75% by speaking like caveman while keeping full technical accuracy. Supports intensity levels: lite, full (default), ultra, wenyan-lite, wenyan-full, wenyan-ultra. Use when user says "caveman mode", "talk like caveman", "use caveman", "less tokens", "be brief", or invokes /caveman. Also auto-triggers when token efficiency is requested.
Adversarial multi-agent planning skill. Self-orchestrates 5 hostile category members (unspecified-low, unspecified-high, deep, ultrabrain, artistry) via team-mode for ruthless cross-critique debate, distills only the defensible insights, then MANDATORILY hands the distilled insight bundle to the `plan` agent for executable plan formalization. Use when planning needs maximum rigor and surfacing of weak assumptions, blind spots, and over-engineering. Triggers: 'hyperplan', 'hpp', '/hyperplan', ...
Routes multi-tool workflows through MCP servers for large datasets and pipelines. Use when Bash tool overhead is limiting throughput on data-heavy tasks.
Recovers prior coding-agent session context by running `catchup <agent> --since-compact`, which extracts a clean summary of a previous Codex, Claude Code, Antigravity, OpenCode, or Pi Agent session. Use when the user says "catch up", "what did the last session do", "get me up to speed", "I switched agents", or asks to recover/summarize a previous session before continuing. Do NOT use for the current conversation, git history, or any non-agent log.
A comprehensive mathematical reasoning skill for AI assistants — handles arithmetic to research-level problems with rigorous step-by-step reasoning, systematic verification, and transparent uncertainty handling