Skill evaluation (CodeCraft)
Created by CodeCraft LLCTest and promote skills in the CodeCraft LLC agent-skills library
Product and technology names are trademarks of their respective owners, used only to identify what this skill covers. CodeCraft LLC is not affiliated with or endorsed by them.
by Jace (@jamick)v1.0.1 · updated 2026-10-03Report copyright infringement
Description
Test and promote skills in the CodeCraft LLC agent-skills library — writing realistic eval prompts per skill (task evals and trigger evals with near-miss negatives), objective assertions, running each prompt with and without the skill in fresh agent sessions, grading outputs, recording results in the standard evals/ format, comparing against baseline, human review, deciding when a skill moves from drafted to tested in TODO.md, and keeping live-model costs approved and bounded. Use whenever the user asks to test, evaluate, benchmark, or validate a CodeCraft skill, promote skills from drafted to done, check which skills have evals, or tune a skill's description for triggering.
Included with all-access
$9.00 value as a single download
AiSkillz is in preview: browse the catalogue now - skill downloads and subscriptions open soon.
All skills are included with the all-access subscription
Changelog
v1.0.1Oct 3, 2026Latest
Changed
- Added a trademark notice to the README.
v1.0.0Oct 2, 2026
Added
- First release.