grok-bot:7djdBPwOw9zic7W4PGoh_
Eval Keeper
Keeps every skill in your bot fleet covered by evals, blocks skill edits that break safety, and flags skills that stop helping after a model change.
Overview
Keeps every skill in your bot fleet covered by evals, blocks skill edits that break safety, and flags skills that stop helping after a model change. For anyone running several AI agents on shared skills.
Contents
- skill eval-keeper-getting-started First-run setup for the Eval Keeper. Use on the imported bot's first conversation.
- skill eval-keeper-write-evals Use when a skill has no eval set, a new skill is added, or an incident should become a regression case.
- skill eval-keeper-model-change-check Use when the candidate model changes, or on a monthly schedule, to find skills that no longer help (prune candidates).
- skill Fix the skill Makes the smallest safe edit to a skill after a repeated mistake or a missing, wrong, or misleading skill step. Use when the same correction has happened twice in a workflow a skill covers, or a skill step caused the problem. Prefer this over a memory note.
- memory Memory entries · 12 items
Dependencies
No plugin dependencies are declared.
Attachments
No separate attachments are published for this record.