Skip to content
Back to skills

Add Scorer

ASecurity

Use when adding an evaluation scorer to Lyntai's cortex layer (a new IScorer — deterministic or an LLM judge via LlmScorerBase — for the scoring/eval loop).

  • 2 stars
  • 0 votes
  • 0 copies
  • 1 view
  • Added October 23, 2026
ai-agentsnode

Security analysis

A100/100

Scanned November 11, 2026

npx -y skills add JiarongGu/Lyntai --skill add-scorer --agent claude-code

Installs into .claude/skills of the current project.

Are you the author of Add Scorer?

Add the live security badge to your README. It updates with every re-scan.

Security grade badge for Add Scorer
[![Security: A — Skills Directory](https://www.skillsdirectory.com/api/skills/jiaronggu-add-scorer/badge)](https://www.skillsdirectory.com/skills/jiaronggu-add-scorer)

More formats (shields.io, HTML) on the badges page. Keep it an A: scan every change in CI with Pro.

Download with Pro
SKILL.md
---
name: add-scorer
description: Use when adding an evaluation scorer to Lyntai's cortex layer (a new IScorer — deterministic or an LLM judge via LlmScorerBase — for the scoring/eval loop).
---
<!-- daoris: mirror of .agents/skills/add-scorer/SKILL.md for agents that read only .claude/skills — edit that file, not this; daoris sync rewrites this one -->

# Add a scorer to Lyntai

Read `.agents/knowledge/extending-lyntai.md` (§Add a scorer). This is the cheapest extension: a class +
one registration, no new package. Built-ins live in `Lyntai.Core/Cortex/Scorers/`.

## Checklist
- [ ] Pick the kind:
  - **Deterministic** → implement `IScorer` directly; compute in code; return `ScoreResult`, or `null`
    when the scorer doesn't apply to this `ScoreContext` (the service skips nulls).
  - **LLM judge** → extend `LlmScorerBase`; supply the criterion prompt. The base runs a one-shot judge
    through the front door and parses a clamped `{score,reason}` — a prose or out-of-range reply yields
    no score (dimension skipped), so don't re-parse yourself.
- [ ] Keep it generic — no domain assumptions baked into a library scorer.
- [ ] Register into the DI collection: `builder.AddScorer<MyScorer>()`. Never add an `if`/`switch` over
      scorer ids — `ScoringService` iterates `IEnumerable<IScorer>` and isolates a throwing scorer.
- [ ] Test it: deterministic scorers get a plain unit test; a judge scorer runs against the
      `provider-stub.mjs` `SCORING TASK` path for a deterministic verdict.
- [ ] `node devtools/dev.mjs verify` green.

Attribution

Is this your skill, or is something wrong with this listing? Request removal or report an issue. Author removals are honored within 72 hours.

View all in ai-agents →

Comments

Loading comments…

Newsletter

Get the weekly list of safe new skills, and the ones we pulled.