Use this skill to scan a tiny resource registry sample for near-duplicate text records with MinHash LSH.
Scanned 9/8/2026
Install to Claude Code
Skills Directorynpx -y skills add ma-compbio-lab/SkillFoundry --skill datasketch-resource-deduplication-starter --agent claude-codeInstalls into .claude/skills of the current project.
Are you the author of Datasketch Resource Deduplication Starter?
Add the live security badge to your README — it updates automatically with every re-scan.
[](https://www.skillsdirectory.com/skills/ma-compbio-lab-datasketch-resource-deduplication-starter)More formats (shields.io, HTML) on the badges page.
# datasketch Resource Deduplication Starter
Use this skill to scan a tiny resource registry sample for near-duplicate text records with MinHash LSH.
## What This Skill Does
- reads a toy JSONL resource list
- tokenizes title and summary text
- builds MinHash sketches with `datasketch`
- returns candidate duplicate pairs above a configurable threshold
Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.
No comments yet. Be the first to comment!
Ultra-compressed communication mode. Cuts token usage ~75% by speaking like caveman while keeping full technical accuracy. Supports intensity levels: lite, full (default), ultra, wenyan-lite, wenyan-full, wenyan-ultra. Use when user says "caveman mode", "talk like caveman", "use caveman", "less tokens", "be brief", or invokes /caveman. Also auto-triggers when token efficiency is requested.
