Quantization Gptq

---
name: quantization-gptq
description: Compiling INT4/INT8 models with GPTQ algorithms.
category: model-serving
level: standard
---

# Quantization Gptq

## Overview

Compiling INT4/INT8 models with GPTQ algorithms.

## When to Use

- Standard workflow tasks related to quantization gptq.

## When NOT to Use

- Out-of-scope scenarios.

## Prompt Template

```markdown
Execute the quantization-gptq process targeting the parameters below.
Parameters: {{parameters}}
```

## Evaluation Checklist

- [ ] Task matches structural schemas.
- [ ] Output is clean and formatted.