Huggingface Cli

# HuggingFace CLI

Execute Hugging Face Hub operations using the `hf` CLI for downloading models/datasets, uploading files, managing repositories, cache, and cloud compute.

## Prerequisites

- HuggingFace CLI installed: `pip install huggingface_hub`
- HF account and token for authenticated operations
- `hf auth login` completed

## Instructions

1. **Authentication**
   ```bash
   hf auth login                    # Interactive login
   hf auth login --token $HF_TOKEN  # Non-interactive
   hf auth whoami                   # Check current user
   ```

2. **Download models and datasets**
   ```bash
   hf download <repo_id>                           # Full repo to cache
   hf download <repo_id> --local-dir ./models      # To local directory
   hf download <repo_id> --include "*.safetensors" # Filter by pattern
   hf download <repo_id> --repo-type dataset       # Dataset
   ```

3. **Upload files**
   ```bash
   hf upload <repo_id> . .                         # Current dir to root
   hf upload <repo_id> ./models /weights           # Folder to path
   hf upload <repo_id> . . --repo-type dataset     # Dataset
   hf upload <repo_id> . . --create-pr             # Create PR
   ```

4. **Repository management**
   ```bash
   hf repo create <name>                           # Create model repo
   hf repo create <name> --repo-type dataset       # Create dataset
   hf repo create <name> --private                 # Private repo
   hf repo delete <repo_id>                        # Delete repo
   hf repo tag create <repo_id> v1.0               # Create tag
   ```

5. **Cache management**
   ```bash
   hf cache ls                      # List cached repos
   hf cache rm model/gpt2           # Remove cached repo
   hf cache prune                   # Remove detached revisions
   ```

6. **Browse Hub**
   ```bash
   hf models ls                                    # List trending models
   hf models ls --search "llama" --limit 20       # Search models
   hf datasets ls                                  # List datasets
   hf spaces ls                                    # List spaces
   ```

7. **Cloud compute (Jobs)**
   ```bash
   hf jobs run python:3.12 python script.py       # Run on CPU
   hf jobs run --flavor a10g-small <image> <cmd>  # Run on GPU
   hf jobs ps                                      # List jobs
   hf jobs logs <job_id>                          # View logs
   ```

## Error Handling

- If authentication fails, run `hf auth login` again
- For permission errors, check token scope
- For large uploads, use `hf upload-large-folder`

## Notes

- Key options: `--repo-type` (model/dataset/space), `--revision`, `--quiet`
- GPU flavors: cpu-basic, t4-small, a10g-small, a100-large, h100
- Use `--quiet` for scripts to get only paths/URLs

Source: huggingface/skills