Bomjin Code Eval Octopack

---
name: bomjin-code-eval-octopack
description: Compute bomjin/code_eval_octopack via the HuggingFace `evaluate` library. Use when the user has predictions + references and wants the canonical implementation of bomjin/code_eval_octopack.
metadata:
  skill_kind: metric
  source_lib: huggingface-evaluate
  hf_module: bomjin/code_eval_octopack
  source: library_introspection
---

# bomjin-code-eval-octopack

> Metric `bomjin/code_eval_octopack` from the HuggingFace `evaluate` library.

## When to invoke

User asks to compute `bomjin/code_eval_octopack` or wants HF evaluate's canonical version.

## Recipe

```python
import evaluate
metric = evaluate.load("bomjin/code_eval_octopack")
result = metric.compute(predictions=preds, references=refs)
print(result)
```

## Don'ts

- Don't assume your in-house `bomjin/code_eval_octopack` matches HF — version conventions vary.
- Many evaluate metrics have task-specific arguments (`average=`, `lang=`, `model_type=`); read the metric card before reporting numbers.