Spaces

Weekly chat review checklist for exchange member services

This checklist gives exchange teams a weekly routine for reviewing the chats their AI agent handled. It checks accuracy, hand-overs and stale notices so the agent stays trustworthy.

Runs in your browser. Nothing you enter is sent anywhere or saved.

Before you start

An exchange changes its notices all the time: fee updates, new product specifications, holiday calendars, contact changes. An agent that was right last month can be wrong this week. A short weekly review is the habit that keeps published answers and chat answers the same.

Set aside thirty minutes at the same time each week, ideally away from the open or close. Read a sample of chats, tick through the list and write down fixes. Share the notes with the desk heads so they know what changed in their area.

Tick each one as you go. 0 of 10 done.

[ ] Read a sample of chats from each audience: members, issuers, data users.
[ ] Check every date and time the agent quoted against the live calendar.
[ ] Check that every quoted notice is still the current one.
[ ] List every hand-over and note how fast a person replied.
[ ] Look for hand-overs that should have happened but did not.
[ ] Look for hand-overs that were not needed.
[ ] Collect questions the agent could not answer.
[ ] Check for any reply that sounded like an opinion on a market.
[ ] Confirm that the contact list and desk hours are current.
[ ] Write down one change for next week and who owns it.

Making the review quick

You do not need to read everything. Pick ten chats: three hand-overs, three busy-hour chats, two quiet-hour chats and two where the person wrote back unhappy. That mix shows you the most for the least time.

Keep a running note of each fix. After a month you will see patterns, such as the same fee question arriving every week, which suggests your published notice is hard to find.

After a busy event

Run an extra review after an index change, a rollover, an outage or a fee notice. These days produce the strangest questions.

  • Compare the questions with the ones you rehearsed.
  • Note which hand-overs were slow and why.
  • Update the agent's notes the same day.

FAQ

How many chats should I read each week?

Ten to twenty is plenty for most exchanges. Choose a mix of hand-overs, busy times and quiet times so you see the full range without spending hours reading.

Who should run the review?

Someone in member services who knows the published material well, joined by a desk head when a topic is theirs. Rotating the role helps the whole team learn what members ask.

What do I do when I find a wrong answer?

Fix the source note first, then check whether other chats used the same wrong fact. If a member was misled, a named person should write to them directly with the correction.

More free tools for stock and commodity exchanges

Read the guide: Answer member and listing questions at an exchange.