Spaces

Weekly chat review checklist for justice and safety agencies

This checklist helps a supervisor review a week of public chats handled by an AI agent at a court, police unit, jail, probation office or fire service. It focuses on emergencies, handovers, wrong answers and missing facts.

Runs in your browser. Nothing you enter is sent anywhere or saved.

Before you start

An AI agent does not need constant watching, but in a justice or safety setting a weekly look is a sensible habit. Rules change, hours move and a new form appears, and the agent only knows what you told it. A weekly review keeps its answers true and its limits tight.

Set aside thirty minutes at the same time each week and read a sample of chats, plus every chat that was handed to a person. Tick off each point below as you go. Write down what you change, so the next reviewer can see why a rule exists.

Tick each one as you go. 0 of 10 done.

[ ] Read every chat where someone mentioned danger, a threat or an emergency.
[ ] Check each handover was picked up and answered within your target time.
[ ] Look for any answer that sounded like legal advice or a promise about a case.
[ ] Check that nothing was said about a person in custody or on supervision.
[ ] List the questions asked that the agent could not answer.
[ ] Check opening hours, closures and phone numbers still match reality.
[ ] Read any chat that ended in a complaint or an unhappy reply.
[ ] Look at which topics came up most often.
[ ] Check that personal details were not collected or repeated more than needed.
[ ] Write down one change to make before the next review.

Reading the week as a team

If you can, share the main findings with the people who take handovers. A clerk may know that a certain form was replaced, or an officer may spot that a question hides a bigger worry. Their notes are often the quickest route to a better answer.

Keep a short log of changes, with a date and a reason. If anyone asks why the agent says something, you can show how it was cleared and who agreed.

Warning signs worth acting on at once

Some findings should not wait for next week.

  • An emergency message that did not get the emergency number first.
  • A chat that gave out details about a person in custody.
  • A handover left unread for most of a day.

FAQ

How many chats should I read each week?

Read every handover and every chat that mentioned danger, then a handful of ordinary ones. If volume is low, read them all. The goal is to spot patterns, not to audit every line.

Who should do the weekly review?

A supervisor or records lead who knows your policies and can change the agent notes. Rotating the job between two people helps catch things one reviewer might miss.

What if I find a mistake?

Fix the cause by correcting the fact or tightening the rule, then check the next few chats. If someone was given a wrong answer about something serious, have a person contact them.

More free tools for courts, police, corrections and fire services

Read the guide: Answer routine questions for courts, police, corrections and fire services.