Post Deploy Qa

---
name: post-deploy-qa
domain: dev
description: |
  [METHODOLOGY] Post-deploy verification (execute AVP from tech-spec
  on live environment, verify acceptance criteria from user-spec + tech-spec,
  pick up deferred criteria from pre-deploy QA report) using MCP tools
  (Telegram MCP, Playwright, curl, bash). Preloaded by post-deploy-qa agent.
---

# Post-deploy QA

## Input Requirements

Read before starting:
- `user-spec.md` — acceptance criteria
- `tech-spec.md` — Agent Verification Plan (AVP) section + technical acceptance criteria
- `decisions.md` — deviations from plan (if exists)
- Pre-deploy QA report (`logs/working/qa-report.json`) — check `deferredToPostDeploy` section for criteria that could not be verified pre-deploy
- Confirmation that deploy is complete and environment is live

If tech-spec has no AVP section — still proceed with acceptance criteria verification.

## Verification Methodology

Two verification directions (both required):

### 1. Agent Verification Plan (AVP)

Execute each step from AVP section in tech-spec:

1. Read AVP section — it lists verification steps with expected outcomes and MCP tools to use
2. For each step:
   - Use the specified MCP tool (Telegram MCP, Playwright, curl, bash, etc.)
   - Perform the described action on live environment
   - Compare result with expected outcome
   - Record: tool used, step performed, result
3. If MCP tool is unavailable — mark step as `not_verifiable`, continue with remaining steps

**Checkpoint:** All AVP steps executed or marked `not_verifiable`. Proceed to acceptance criteria.

### 2. Acceptance Criteria Verification

Verify all acceptance criteria from user-spec and tech-spec on live environment. This catches criteria that pre-deploy QA could not verify without a live system.

1. Read pre-deploy QA report (`logs/working/qa-report.json`) — check `deferredToPostDeploy` section
2. For each deferred criterion — follow the verification steps specified in the pre-deploy report
3. Also re-check all acceptance criteria from user-spec and tech-spec against live behavior
4. For each criterion:
   - **passed** — verified on live environment, evidence provided
   - **failed** — live behavior does not meet the criterion
   - **blocked** — cannot verify due to external conditions (no data, third-party service down). Provide a concrete manual verification plan for the user: what to check, when, how

A `blocked` criterion requires user follow-up before the feature can count as fully verified.

**Checkpoint:** All acceptance criteria verified, or marked `blocked` with manual verification plan.

## Severity Classification

- **critical** — verification step failed, live functionality broken, data integrity at risk
- **major** — works but with significant issues visible in production
- **minor** — cosmetic, non-functional discrepancies

## Output Format

Return findings as JSON. Reason: orchestrator parses this to decide pass/fail and log findings.

```json
{
  "status": "passed | failed",
  "summary": {
    "totalSteps": 0,
    "passed": 0,
    "failed": 0,
    "blocked": 0,
    "notVerifiable": 0,
    "criticals": 0,
    "majors": 0,
    "minors": 0
  },
  "agentVerification": [
    {
      "step": "Send /start to bot",
      "tool": "telegram_mcp",
      "status": "passed | failed | not_verifiable",
      "details": "Bot responded with welcome message"
    }
  ],
  "acceptanceCriteria": [
    {
      "id": "US-5",
      "criterion": "Titles generated with correct declensions",
      "source": "user-spec | tech-spec | deferred-from-pre-deploy",
      "status": "passed | failed | blocked",
      "evidence": "Checked live output, title 'В компании X работает...' uses correct declension",
      "manualVerificationPlan": "Only if blocked — what the user should check, when, how"
    }
  ],
  "findings": [
    {
      "severity": "critical | major | minor",
      "title": "Bot does not respond to /start",
      "expected": "Welcome message within 3 seconds",
      "actual": "No response after 10 seconds",
      "reproduction": "Steps to reproduce..."
    }
  ]
}
```

Status decision: `passed` if zero criticals, `failed` if one or more criticals.

## Playwright Integration

When Playwright MCP is available and the feature has UI components:

1. **Structured smoke tests** — for each user-facing acceptance criterion:
   - `browser_navigate` to the relevant page
   - `browser_snapshot` to capture DOM state
   - `browser_take_screenshot` for visual evidence
   - Verify key elements exist and contain expected content

2. **Interactive flow verification** — for multi-step user flows:
   - `browser_fill_form` for input fields
   - `browser_click` for buttons/links
   - `browser_wait_for` for async operations
   - Capture before/after screenshots

3. **Responsive checks** (if applicable):
   - `browser_resize` to test breakpoints (mobile: 375px, tablet: 768px, desktop: 1280px)
   - Verify layout doesn't break at each size

4. **Evidence collection**: Save screenshots to `logs/working/screenshots/` with descriptive names. Reference in the QA report JSON.

## Guidelines

- Every finding includes concrete reproduction: steps, expected vs actual, tool output.
- If all MCP tools are unavailable — report that automated verification is not possible, suggest manual steps.
- Empty findings array = clean verification.

## Final Check

Before finishing, verify:
- [ ] All AVP steps executed or marked `not_verifiable`
- [ ] All deferred criteria from pre-deploy QA report addressed
- [ ] All acceptance criteria from user-spec and tech-spec verified on live environment
- [ ] Every `blocked` criterion has a manual verification plan (what to check, when, how)
- [ ] Output JSON is valid, status reflects critical count