Challenge research design decisions, assumptions, and methodology choices with specific critical questions. Helps strengthen the paper before submission.
Scanned 9/3/2026
Install to Claude Code
npx -y skills add brycewang-stanford/Auto-Empirical-Research-Skills --skill devils-advocate --agent claude-codeInstalls into .claude/skills of the current project.
Are you the author of Devils Advocate?
Add the live security badge to your README — it updates automatically with every re-scan.
[](https://www.skillsdirectory.com/skills/brycewang-stanford-devils-advocate-auto-empirical-research-skills)More formats (shields.io, HTML) on the badges page.
---
name: devils-advocate
description: Challenge research design decisions, assumptions, and methodology choices with specific critical questions. Helps strengthen the paper before submission.
disable-model-invocation: true
argument-hint: "[topic, design choice, or methodology to challenge]"
allowed-tools: ["Read", "Grep", "Glob"]
---
## Devil's Advocate
Critically examine a research design, methodology, or assumption with 5-7 specific challenges.
### Steps
1. **Understand the target**: Read `$ARGUMENTS` and any relevant project files (CLAUDE.md, manuscript, estimation code).
2. **Generate 5-7 challenges** from these categories:
- **Identification:** Could the causal claim be undermined by [specific threat]?
- **Specification:** What if the functional form is wrong? Alternative specifications?
- **Data:** Are there sample selection issues? Measurement error concerns?
- **Methodology:** Could a different estimator give different results? Why this method?
- **Assumptions:** Which assumptions are most vulnerable? What if they're violated?
- **Robustness:** What robustness checks are missing?
- **External validity:** Does this generalize beyond the sample?
3. **For each challenge**, provide:
- The question
- Why it matters
- Suggested resolution or robustness check
- Severity (Critical / Major / Minor)
4. **Summary verdict**: Strengths, critical changes needed, and suggested improvements.
### Notes
- Be constructive, not destructive.
- Think like a skeptical referee at a top journal.
- Focus on the most impactful challenges first.
Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.
No comments yet. Be the first to comment!