evaluate-grader
Skill by ai-analyst-lab · updated · ★ 310
Compare a narrow model grader with frozen human labels and inspect disagreement, bias probes, and repeated scoring stability. Use when building or changing a model-based evaluator. evaluate-grader is published by ai-analyst-lab on GitHub.
Last commit 21 days ago
MIT: permissive, fine for commercial use
Clear description, installs from GitHub, 310 stars, original repository
Not checked yet. What we check
Install evaluate-grader
Built from the published package, never by AIgit clone --depth 1 https://github.com/ai-analyst-lab/ai-analyst /tmp/ai-analyst && mkdir -p ~/.claude/skills && cp -r /tmp/ai-analyst/.claude/skills/evaluate-grader ~/.claude/skills/evaluate-graderRun in your terminal. Claude Code loads skills from ~/.claude/skills automatically.
git clone --depth 1 https://github.com/ai-analyst-lab/ai-analyst /tmp/ai-analyst && mkdir -p ~/.gemini/antigravity-cli/skills && cp -r /tmp/ai-analyst/.claude/skills/evaluate-grader ~/.gemini/antigravity-cli/skills/evaluate-graderAntigravity CLI loads skills from ~/.gemini/antigravity-cli/skills, or .agents/skills for one project.
Skills can run scripts on your machine. Some need an API key: check the README.
Alternatives to evaluate-grader
All alternatives →This skill should be used when the user asks to "add an API call", "change a backend", "update settings persistence", "change conversation events", "fix backend auth", "add Agent Server support", or changes src/api, backend registry, Cloud/runtime transport, settings, secrets, compatibility, or conversation resume behavior.
Explains the project structure of the agent-framework .NET solution
Platform APIs for model management, pricing, and usage tracking
Request cross-AI peer review of phase plans from external AI CLIs
Toggle peon-ping sound notifications on/off. Use when user wants to mute, unmute, pause, or resume peon sounds during a Claude Code session. Also handles config changes like volume, pack rotation, categories — any peon-ping setting.
Use OpenRefine through an agent-native CLI for importing messy data, applying JSON operation histories, inspecting rows, exporting cleaned data, and managing session undo/redo.
evaluate-grader: common questions
How do I install evaluate-grader?
Run the command above to copy the skill into ~/.claude/skills/. Claude Code picks it up automatically.
Is evaluate-grader free?
The code is published under the MIT licence. The service it connects to may have its own pricing.
Is evaluate-grader safe to use?
It scores 72 of 100. Grades: maintenance A, licence A, quality B. The security check has not run for it yet. Review the code before you install. How grades work.
What are alternatives to evaluate-grader?
Similar skills: frontend-api-contracts, project-structure, fal-platform, gsd-review.
