grok-bot:7djdBPwOw9zic7W4PGoh_

Eval Keeper

Keeps every skill in your bot fleet covered by evals, blocks skill edits that break safety, and flags skills that stop helping after a model change.

Overview

Keeps every skill in your bot fleet covered by evals, blocks skill edits that break safety, and flags skills that stop helping after a model change. For anyone running several AI agents on shared skills.

Contents

  • skill eval-keeper-getting-started First-run setup for the Eval Keeper. Use on the imported bot's first conversation.
  • skill eval-keeper-write-evals Use when a skill has no eval set, a new skill is added, or an incident should become a regression case.
  • skill eval-keeper-model-change-check Use when the candidate model changes, or on a monthly schedule, to find skills that no longer help (prune candidates).
  • skill Fix the skill Makes the smallest safe edit to a skill after a repeated mistake or a missing, wrong, or misleading skill step. Use when the same correction has happened twice in a workflow a skill covers, or a skill step caused the problem. Prefer this over a memory note.
  • memory Memory entries · 12 items

Dependencies

No plugin dependencies are declared.

Attachments

No separate attachments are published for this record.