Weekly chat review checklist for justice and safety agencies
This checklist helps a supervisor review a week of public chats handled by an AI agent at a court, police unit, jail, probation office or fire service. It focuses on emergencies, handovers, wrong answers and missing facts.
Runs in your browser. Nothing you enter is sent anywhere or saved.
Before you start
An AI agent does not need constant watching, but in a justice or safety setting a weekly look is a sensible habit. Rules change, hours move and a new form appears, and the agent only knows what you told it. A weekly review keeps its answers true and its limits tight.
Set aside thirty minutes at the same time each week and read a sample of chats, plus every chat that was handed to a person. Tick off each point below as you go. Write down what you change, so the next reviewer can see why a rule exists.
Tick each one as you go. 0 of 10 done.
[ ] Read every chat where someone mentioned danger, a threat or an emergency. [ ] Check each handover was picked up and answered within your target time. [ ] Look for any answer that sounded like legal advice or a promise about a case. [ ] Check that nothing was said about a person in custody or on supervision. [ ] List the questions asked that the agent could not answer. [ ] Check opening hours, closures and phone numbers still match reality. [ ] Read any chat that ended in a complaint or an unhappy reply. [ ] Look at which topics came up most often. [ ] Check that personal details were not collected or repeated more than needed. [ ] Write down one change to make before the next review.
Reading the week as a team
If you can, share the main findings with the people who take handovers. A clerk may know that a certain form was replaced, or an officer may spot that a question hides a bigger worry. Their notes are often the quickest route to a better answer.
Keep a short log of changes, with a date and a reason. If anyone asks why the agent says something, you can show how it was cleared and who agreed.
Warning signs worth acting on at once
Some findings should not wait for next week.
- An emergency message that did not get the emergency number first.
- A chat that gave out details about a person in custody.
- A handover left unread for most of a day.
FAQ
How many chats should I read each week?
Read every handover and every chat that mentioned danger, then a handful of ordinary ones. If volume is low, read them all. The goal is to spot patterns, not to audit every line.
Who should do the weekly review?
A supervisor or records lead who knows your policies and can change the agent notes. Rotating the job between two people helps catch things one reviewer might miss.
What if I find a mistake?
Fix the cause by correcting the fact or tightening the rule, then check the next few chats. If someone was given a wrong answer about something serious, have a person contact them.
More free tools for courts, police, corrections and fire services
- First-reply checklist for courts, police, corrections and fire services
- Hand-over rules checklist for courts, police, corrections and fire services
- First-week checklist for courts, police, corrections and fire services
- Busy-season checklist for courts, police, corrections and fire services
- Customer privacy checklist for courts, police, corrections and fire services
- Do and don't guide for your agent: courts, police, corrections and fire services
- Greeting messages for courts, police, corrections and fire services
- After-hours replies for courts, police, corrections and fire services
- Booking and order confirmations for courts, police, corrections and fire services
- Reminder messages for courts, police, corrections and fire services
- Apology and complaint replies for courts, police, corrections and fire services
- "Let me check" replies for courts, police, corrections and fire services
- Follow-up messages for courts, police, corrections and fire services
- Review request messages for courts, police, corrections and fire services
- Price and quote replies for courts, police, corrections and fire services
- Delay and stock notices for courts, police, corrections and fire services
- Thank-you messages for courts, police, corrections and fire services
- Hand-over notes for courts, police, corrections and fire services
- Ready answers for courts, police, corrections and fire services
- Holiday and closure notices for courts, police, corrections and fire services
- Missed enquiries calculator for courts, police, corrections and fire services
- AI agent instructions builder for courts, police, corrections and fire services
- Auto-reply message writer for courts, police, corrections and fire services
- FAQ answer sheet for courts, police, corrections and fire services
- Reply speed scorecard for courts, police, corrections and fire services
- Is your business ready for an AI agent? Quiz for courts, police, corrections and fire services
- Message workload planner for courts, police, corrections and fire services
- Hours saved calculator for courts, police, corrections and fire services
- Enquiry-to-customer value estimator for courts, police, corrections and fire services
Read the guide: Answer routine questions for courts, police, corrections and fire services.