534 Vastai Data Handling 2daac9ac

# vastai-data-handling

> Efficiently transfer large datasets to/from Vast.ai instances using rsync, rclone, or cloud storage integration

## Directory Structure

```
vastai-data-handling/
├── SKILL.md
└── examples/
    └── data_sync_pipeline.py
```

## File Descriptions

| File | Type | Purpose |
|------|------|---------|
| SKILL.md | Markdown | Guide for high-performance data transfer patterns and persistent storage configuration |
| examples/data_sync_pipeline.py | Python | Automated data synchronization script with integrity verification and progress tracking |

## Summary

**Category:** Operations
**Target Audience:** ML engineers managing training datasets, data engineers building GPU pipelines
**Trigger Phrases:** "vast data transfer", "upload dataset vast", "vast rsync", "vast rclone", "vast persistent storage", "vast s3 sync"

**Version:** 1.0.0
**License:** MIT
**Author:** Jeremy Longshore <jeremy@intentsolutions.io>