2509 Failure Analysis Batch 20260211 212328 Ebcc0636

# Evaluation Failure Analysis

**Generated**: 2026-02-11 21:23:34

## Summary Statistics

- **Total Failures**: 52

### Failures by Category

| Category | Count | Percentage |
|----------|-------|------------|
| skill_not_found | 52 | 100.0% |

### Failures by Domain

| Domain | Count |
|--------|-------|
| customer_success | 29 |
| product_ops | 18 |
| ai_ops | 5 |

## Action Plan (Prioritized)

### 1. Skill Not Found

**Priority**: 5/5 | **Effort**: Low | **Affected Skills**: 52

**Fix**: Verify skill directory structure and skill.json exists

**Domains**: customer_success, ai_ops, product_ops

**Skills**: cs_sentiment_analyzer, cs_health_scoring, cs_time_to_impact, cs_multi_product_adoption, cs_contract_intelligence, cs_adoption_score, cs_advocacy_identifier, cs_customer_maturity_model, cs_expansion_playbook, cs_onboarding_health (and 42 more)


## Detailed Failure List

| Skill ID | Domain | Category | Error (first 50 chars) |
|----------|--------|----------|------------------------|
| cs_sentiment_analyzer | customer_success | skill_not_found | Skill not found: cs_sentiment_analyzer |
| cs_health_scoring | customer_success | skill_not_found | Skill not found: cs_health_scoring |
| cs_time_to_impact | customer_success | skill_not_found | Skill not found: cs_time_to_impact |
| cs_multi_product_adoption | customer_success | skill_not_found | Skill not found: cs_multi_product_adoption |
| cs_contract_intelligence | customer_success | skill_not_found | Skill not found: cs_contract_intelligence |
| cs_adoption_score | customer_success | skill_not_found | Skill not found: cs_adoption_score |
| cs_advocacy_identifier | customer_success | skill_not_found | Skill not found: cs_advocacy_identifier |
| cs_customer_maturity_model | customer_success | skill_not_found | Skill not found: cs_customer_maturity_model |
| cs_expansion_playbook | customer_success | skill_not_found | Skill not found: cs_expansion_playbook |
| cs_onboarding_health | customer_success | skill_not_found | Skill not found: cs_onboarding_health |
| cs_executive_alignment | customer_success | skill_not_found | Skill not found: cs_executive_alignment |
| cs_quarterly_business_review | customer_success | skill_not_found | Skill not found: cs_quarterly_business_review |
| customer_success/feedback_collection | customer_success | skill_not_found | Skill not found: customer_success/feedback_collect |
| cs_red_flag_detector | customer_success | skill_not_found | Skill not found: cs_red_flag_detector |
| cs_churn_prediction | customer_success | skill_not_found | Skill not found: cs_churn_prediction |
| cs_stakeholder_mapper | customer_success | skill_not_found | Skill not found: cs_stakeholder_mapper |
| cs_risk_mitigation_playbook | customer_success | skill_not_found | Skill not found: cs_risk_mitigation_playbook |
| cs_playbook_selector | customer_success | skill_not_found | Skill not found: cs_playbook_selector |
| cs_escalation_manager | customer_success | skill_not_found | Skill not found: cs_escalation_manager |
| cs_product_adoption_guidance | customer_success | skill_not_found | Skill not found: cs_product_adoption_guidance |
| cs_nps_followup | customer_success | skill_not_found | Skill not found: cs_nps_followup |
| cs_outcome_tracker | customer_success | skill_not_found | Skill not found: cs_outcome_tracker |
| cs_csql_generator | customer_success | skill_not_found | Skill not found: cs_csql_generator |
| cs_renewal_orchestration | customer_success | skill_not_found | Skill not found: cs_renewal_orchestration |
| cs_success_plan_generator | customer_success | skill_not_found | Skill not found: cs_success_plan_generator |
| cs_customer_journey_orchestrator | customer_success | skill_not_found | Skill not found: cs_customer_journey_orchestrator |
| cs_value_realization | customer_success | skill_not_found | Skill not found: cs_value_realization |
| cs_vla_tracker | customer_success | skill_not_found | Skill not found: cs_vla_tracker |
| cs_product_gap_reporter | customer_success | skill_not_found | Skill not found: cs_product_gap_reporter |
| ai_ops/prompt-engineering | ai_ops | skill_not_found | Skill not found: ai_ops/prompt-engineering |
| ai_conversation_intelligence | ai_ops | skill_not_found | Skill not found: ai_conversation_intelligence |
| ai_personalization_engine | ai_ops | skill_not_found | Skill not found: ai_personalization_engine |
| ai_autonomous_outreach | ai_ops | skill_not_found | Skill not found: ai_autonomous_outreach |
| ai_predictive_lead_scoring | ai_ops | skill_not_found | Skill not found: ai_predictive_lead_scoring |
| prodops_documentation_health | product_ops | skill_not_found | Skill not found: prodops_documentation_health |
| prodops_accessibility_auditor | product_ops | skill_not_found | Skill not found: prodops_accessibility_auditor |
| prodops_experimentation | product_ops | skill_not_found | Skill not found: prodops_experimentation |
| prodops_user_interview_synthesizer | product_ops | skill_not_found | Skill not found: prodops_user_interview_synthesize |
| prodops_api_deprecation | product_ops | skill_not_found | Skill not found: prodops_api_deprecation |
| prodops_beta_program_manager | product_ops | skill_not_found | Skill not found: prodops_beta_program_manager |
| prodops_feedback_synthesis | product_ops | skill_not_found | Skill not found: prodops_feedback_synthesis |
| prodops_feature_adoption | product_ops | skill_not_found | Skill not found: prodops_feature_adoption |
| prodops_localization_manager | product_ops | skill_not_found | Skill not found: prodops_localization_manager |
| prodops_voc_aggregation | product_ops | skill_not_found | Skill not found: prodops_voc_aggregation |
| prodops_incident_analyzer | product_ops | skill_not_found | Skill not found: prodops_incident_analyzer |
| prodops_roadmap_alignment | product_ops | skill_not_found | Skill not found: prodops_roadmap_alignment |
| prodops_prioritization_engine | product_ops | skill_not_found | Skill not found: prodops_prioritization_engine |
| prodops_dogfooding_tracker | product_ops | skill_not_found | Skill not found: prodops_dogfooding_tracker |
| prodops_competitive_feature_tracker | product_ops | skill_not_found | Skill not found: prodops_competitive_feature_track |
| prodops_performance_budget | product_ops | skill_not_found | Skill not found: prodops_performance_budget |
| prodops_release_notes_generator | product_ops | skill_not_found | Skill not found: prodops_release_notes_generator |
| prodops_impact_analyzer | product_ops | skill_not_found | Skill not found: prodops_impact_analyzer |