Spaces

Weekly chat review checklist for monetary authority teams

This checklist gives a monetary authority a short weekly routine for reviewing the chats its AI agent handled. It focuses on routing, tone and anything the agent should have passed to a person.

Runs in your browser. Nothing you enter is sent anywhere or saved.

Before you start

With a small number of chats, a central bank can afford to read nearly all of them. That is a real advantage, because the cost of one bad reply is high and the cost of reading a few dozen chats is low. A weekly review is how you stay sure that the agent still behaves as you intended.

Set aside thirty minutes at the same time each week, ideally with someone from the press or public affairs team. Work down the list and note anything to change in the agent notes. Keep a one-page log so that you can see patterns over the months.

Tick each one as you go. 0 of 10 done.

[ ] Read every chat that the agent passed to a person.
[ ] Read a sample of chats the agent answered alone.
[ ] Check that nothing about policy, markets or named institutions was said.
[ ] Look at how long each hand-over waited for a human reply.
[ ] Check opening hours, tour times and event dates are still correct.
[ ] Note any question asked more than twice.
[ ] Look for messages that mention scams or fake accounts.
[ ] Check the tone was calm, plain and consistent with the institution.
[ ] Review any message where the sender seemed unhappy.
[ ] Update the agent notes and record what you changed.

Keep the review small and regular

A review that takes an hour will be skipped, so keep it brief. Thirty focused minutes each week beat a long review each quarter. Reading actual messages is more valuable than counting them.

Share one or two interesting findings with the wider team each month, such as a question that revealed a hole in your published information. It helps colleagues see why the review exists.

What to log each week

A simple page is enough. Record the following and compare month to month.

  • How many chats were handed to staff, and to which desks.
  • Any wrong or risky replies, and the fix you made.
  • New ready answers you added.
  • Anything that suggests the agent role should shrink or grow.

FAQ

Who should do the weekly review?

Someone who knows the institution voice and the rules on what may be said, ideally from public affairs or communications. A second person from security or legal can join occasionally for a fresh view.

What if we find a reply that said too much?

Treat it as a learning point. Fix the agent notes, tell the relevant team, and check earlier chats for the same issue. Consider holding replies as drafts again for a while.

How long should we keep the chats?

Follow your normal record keeping and data protection rules, and agree a period with your legal and records teams. Keep only what you need and remove the rest on schedule.

More free tools for central banks and monetary authorities

Read the guide: A realistic role for an AI agent at a monetary authority.