The assistant that confidently invents policy
- Why it happens
- An internal support assistant answers HR and policy questions from a document set, and occasionally states a policy that does not exist.
- How we work it
- Build a retrieval evaluation set from real historical questions, measure grounding and citation accuracy, add answer refusal thresholds, surface source passages inline, log every low-confidence response for review.
- What you end up with
- A measured hallucination rate with a baseline, a refusal path instead of a fabrication, and a weekly review queue with an owner.