Skills, in their native habitat.

Add a NovaEval scorer > **Internal / contributor tooling.** This skill edits the **NovaEval source repo** itself (a local checkout with and the vendored ). It is not a platform/API skill — use it only when working inside the NovaEval codebase. Registration is spread across **5–8...

Audit a NovaPilot report JSON — verify each recommendation's cited issue is actually present in its attributed items, that the affected scorers genuinely score low there, and that...

Validate NovaSynth scenarios and audit a break-the-bot batch run end-to-end — fetch transcripts, check each call against the PRD, and cross-check the platform scorers (catching...

Run a NovaSynth evaluation end-to-end as a tree of human-in-the-loop checkpoints, not a fixed script — from inputs (personas / scenarios / system prompt) through triggering calls,...

Download/upload Noveum datasets, items, scorer results, and audio files via the REST API. Use when the user asks to fetch a dataset by slug, save audio for items, push...

The Noveum AI reliability & QA engineer for LLM, agent, and voice apps. It integrates the noveum-trace SDK (LangChain, CrewAI, LiveKit, Pipecat, or manual), verifies traces are...