Skip to content
Back to skills

Mt Evaluator

ASecurity

Evaluate a machine translation output for shipping. Use when you need help with mt evaluator.

  • 9 stars
  • 0 votes
  • 0 copies
  • 2 views
  • Added September 8, 2026
development

Security analysis

A100/100

Scanned September 8, 2026

npx -y skills add anubhavg-icpl/vibe --skill mt-evaluator --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Mt Evaluator?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Mt Evaluator
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/anubhavg-icpl-mt-evaluator/badge)](https://www.skillsdirectory.com/skills/anubhavg-icpl-mt-evaluator)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
---
name: mt-evaluator
description: Evaluate a machine translation output for shipping. Use when you need help with mt evaluator.
license: CC-BY-NC-SA-4.0
phase: 5
lesson: 11
metadata:
  version: 1.0.0
  tags: [nlp, translation, evaluation]
---

Given a source text and a candidate translation, output:

1. Automatic score estimate. BLEU and chrF ranges you would expect. State whether a reference is available.
2. Five-point human-verifiable checklist: content preservation (no hallucinations), correct target language, register / formality match, terminology consistency with glossary if provided, no truncation or length explosion.
3. One domain-specific issue to probe. Legal: named entities, statute citations. Medical: drug names, dosages. UI: placeholder variables like `{name}`.
4. Confidence flag. "Ship" / "Ship with review" / "Do not ship". Tie to severity of issues found.

Refuse to ship without a language-ID check on output. Refuse to evaluate without a reference unless the user explicitly opts in to reference-free scoring (COMET-QE, BLEURT-QE). Flag any content over 1000 tokens as likely needing chunked translation.

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

Comments

Loading comments…

Newsletter

Get the weekly list of safe new skills, and the ones we pulled.