Skill Optimizer

Optimizes AI skills for activation, clarity, and cross-model reliability. Use when creating or editing skill packs, diagnosing weak skill uptake, reducing regressions, tuning instruction salience, improving examples, shrinking context cost, or setting benchmark/release gates for skills. Trigger terms: skill optimization, activation gap, benchmark skill, with/without skill delta, regression, context budget, prompt salience.

Published by @mcollina·from mcollina/skills·0 agent reads / 30d·0 saves·

When to use

Use this skill when you need to:

  • Improve whether a skill is actually applied by models
  • Diagnose why some criteria fail across all models
  • Prevent a skill from making outputs worse
  • Refactor skill text for stronger retrieval under context pressure
  • Build repeatable benchmark loops and release gates

Optimization loop (default workflow)

  1. Measure baseline and skill-on behavior (per model, per scenario, per criterion)
  2. Find failure pattern:
    • universal failure (0% with skill)
    • model-specific weakness
    • regression (negative delta)
  3. Edit for salience:
    • add explicit triggers
    • add concrete integrated examples
    • tighten checklists and decision rules
  4. Re-run evals and compare deltas
  5. Ship with guardrails (documented gate + run history + follow-up issues)

How to use

Read individual rule files for detailed procedures and templates:

  • rules/benchmark-loop.md - End-to-end benchmark loop and scoring
  • rules/activation-design.md - Improve retrieval and instruction uptake
  • rules/context-budget.md - Reduce token cost without losing behavior
  • rules/regression-triage.md - Diagnose and fix skill-on regressions
  • rules/release-gates.md - Go/no-go criteria before shipping skill updates

Practical heuristics

  • Prefer few high-signal rules over many soft recommendations
  • Put fragile, high-value behaviors in top-level checklists
  • Include at least one integrated example per common scenario
  • Add explicit wording for what must not be omitted
  • Track gains/losses with with-skill vs without-skill comparisons

Bundled with this artifact

6 files

Reference files that ship alongside this artifact. Agents pull these in only when the task needs them.

More on the bench

SKILL0

Skill Creator

Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.

ai-prompt-engineering+1
6
SKILL0

Bash Pro

Master of defensive Bash scripting for production automation, CI/CD pipelines, and system utilities. Expert in safe, portable, and testable shell scripts.

ai-prompt-engineering+3
4
SKILL0

Documentation

Creates, structures, and reviews technical documentation following the Diátaxis framework (tutorials, how-to guides, reference, and explanation pages). Use when a user needs to write or reorganize docs, structure a tutorial vs. a how-to guide, build reference docs or API documentation, create explanation pages, choose between Diátaxis documentation types, or improve existing documentation structure. Trigger terms include: documentation structure, Diátaxis, tutorials vs how-to guides, organize docs, user guide, reference docs, technical writing.

software-engineering
4