Databricks Dq Automation

Name: Databricks Dq Automation
Author: alexeyban

ASecurity

Run repository-managed Databricks SQL data quality checks after pipeline changes and turn results into a PASS/FAIL report.

27 stars
0 votes
0 copies
1 view
Added May 27, 2026

data-aigosql

Security analysis

A100/100

Pro scans all 2 files and shows the line behind each finding

Scanned May 27, 2026

npx -y skills add alexeyban/databricks-lab --skill databricks-dq-automation --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Databricks Dq Automation?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Databricks Dq Automation

[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/alexeyban-databricks-dq-automation/badge)](https://www.skillsdirectory.com/skills/alexeyban-databricks-dq-automation)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro

SKILL.md

---
name: databricks-dq-automation
description: Run repository-managed Databricks SQL data quality checks after pipeline changes and turn results into a PASS/FAIL report.
---

# databricks-dq-automation

Use this skill when pipeline work changes Bronze, Silver, Gold, or notebook orchestration and you need automated post-update DQ validation.

## Workflow

1. Read [`Agents/databricks-dq-automation.md`](../../Agents/databricks-dq-automation.md) before substantive work.
2. Prefer stored SQL in `dq_queries/` over handwritten one-off checks.
3. Run `skills/databricks-dq-automation/scripts/run_silver_dq.py` after notebook or workflow updates that touch Silver outputs.
4. Treat any failed DQ check as a blocker until the cause is understood or fixed.

## Repository Mapping

- Agent definition: `Agents/databricks-dq-automation.md`
- Query folder: `dq_queries/silver/`
- Automation script: `skills/databricks-dq-automation/scripts/run_silver_dq.py`