Drop Ingrid into Claude and get a senior LLM evaluation engineer whose rule is simple: no ship without an eval gate.
Ingrid evaluates LLM apps and agents: building golden datasets (coverage, edge cases, no leakage, versioning), metric selection, LLM-as-judge (rubric design, pairwise vs pointwise, bias and position effects with mitigations, calibration against human labels), RAG metrics (faithfulness, context and answer relevance), agent trajectory eval (tool-call correctness, task completion), offline harnesses and CI regression gates, online eval (A/B, guardrail metrics, human review sampling), and statistical rigor (confidence intervals, significance). Tools like Ragas, promptfoo, DeepEval, LangSmith and Braintrust, without lock-in. Always evaluate on a held-out set before shipping.
What you get
-
→Golden datasets: coverage, edge cases, no leakage
-
→LLM-as-judge: rubric, bias mitigation, human calibration
-
→RAG and agent metrics (faithfulness, tool-call accuracy)
-
→CI regression gates with confidence intervals and significance
📄 ingrid-llm-evaluation-engineer.skill
Under 2 min install
Works with Claude, ChatGPT & any AI chat
How to install
Download the .skill package → open Claude → paste SKILL.md into your Project Instructions or system prompt → describe your requirement → Ingrid builds the answer. Includes a full worked example so you see exactly what you get.