Spaces

Weekly review checklist for public safety and justice agency chats

This weekly checklist shows what a justice or safety agency should look at in the chats its AI agent handled, so wrong answers, slow handovers and missing information are caught early.

Runs in your browser. Nothing you enter is sent anywhere or saved.

Before you start

An agent that answered well last month can answer badly this month, because a fee changed, a courtroom moved or a station closed its counter. Public agencies feel these slips quickly, and the people affected are often in a stressful position. A short weekly review catches them before they spread.

Set aside thirty minutes at the same time each week, with the person who owns the agent and one member of the team who takes handovers. Read a sample of chats, tick off each point below and write down what to change. Keep a simple log so you can see patterns across months.

Tick each one as you go. 0 of 10 done.

[ ] Read ten chats the agent handled alone, chosen at random.
[ ] Check that every answer matched your current published information.
[ ] Look at every chat that was handed to a person and how long it waited.
[ ] Check that emergency messages got the emergency number first.
[ ] Search for any chat where the agent seemed to give advice or predict an outcome.
[ ] Note the questions the agent could not answer and decide which to add.
[ ] Check tone in the sensitive chats from victims, families and supervised people.
[ ] Confirm that no chat asked for or shared more personal detail than needed.
[ ] Review any complaints about the agent itself and respond to them.
[ ] Write down two changes for next week and who will make them.

Keep the review small and regular

The aim is not a long report. A single page with the date, the number of chats, the number of handovers, the problems found and the fixes made is enough. Over a quarter this page shows which topics keep returning and which answers need a rewrite.

Share a short summary with the team that takes handovers. They see the chats the agent cannot, and they will often spot what you missed.

Signs that something needs changing now

If you see any of these in a weekly review, fix it the same day rather than waiting.

  • A reply with a wrong address, fee, date or opening time.
  • A handover that waited longer than your own promise.
  • Any reply that told someone what to do about their own case.
  • Repeated messages from the same person who did not get an answer.

FAQ

How long should a weekly review take?

About thirty minutes once you have a rhythm. Read a sample of chats, look at the handovers, then write down the fixes. If it takes longer, reduce the sample, do not skip the review.

Who should do the review?

The person who owns the agent, with someone from the team that takes handovers. Where wording touches the law, ask a legal reviewer to read any new or changed answer.

What if we find a serious mistake?

Fix the answer straight away, tell the person if you can, and note it in your log. If the mistake could cause real harm, pause the agent for that topic until the answer is corrected.

More free tools for courts, police and fire services

Read the guide: Answer routine public questions for justice, order and safety agencies.