Spaces

A weekly review of your broker chats: what to check on Friday

This weekly checklist shows what a brokerage or desk owner should look at in the chats an AI agent handled, from hand-over speed to wrong answers. It takes about thirty minutes.

Runs in your browser. Nothing you enter is sent anywhere or saved.

Before you start

An agent that answers client messages should be read the way you would read a new hire's work in their first months. In a brokerage the cost of a bad reply is higher than in most shops, because one careless line can sound like a quote or advice. A short weekly look keeps small slips from becoming habits.

Set aside half an hour at the same time each week, such as Friday after the close. Open a sample of the week's chats and go down the list. Write down what you change, so you can see whether next week is cleaner. Pull complaint and hand-over chats first.

Tick each one as you go. 0 of 10 done.

[ ] Read every chat where the agent handed over to a person.
[ ] Check how long each hand-over waited before a person replied.
[ ] Look for any reply that mentioned a price, level or opinion.
[ ] Spot-check ten routine paperwork answers against your records.
[ ] List the questions the agent could not answer.
[ ] Check that nobody sent identity papers into an open chat.
[ ] Count the messages that arrived outside desk hours.
[ ] Review any complaint and confirm it reached the named owner.
[ ] Check that holiday and half-day hours in the guide are still right.
[ ] Write down one change to make before next week.

What to do with what you find

Most findings fall into two piles. Missing facts go into the guide, such as the form to use for a change of address. Wrong behaviour goes into the rules, such as an added line telling the agent never to confirm that an instruction has been received.

Keep a simple log of changes with a date. If a problem repeats after a fix, the wording is probably unclear, so rewrite it in plainer terms.

Signs the week went well

You do not need perfect scores. Look for these patterns.

  • Hand-overs reached the right person within your target window.
  • No reply sounded like a price, a view or advice.
  • Fewer repeat questions about the same missing paperwork step.

FAQ

How many chats should I read each week?

Read every hand-over and every complaint, then a sample of routine chats. For a small firm that may be twenty to forty chats, and it still takes under an hour.

Who should do the weekly review?

Someone who knows your procedures well, ideally the owner or head of operations. If a compliance person is on staff, have them look at any reply that came close to advice.

What if I find a reply that sounded like advice?

Treat it as a real incident. Note it, tighten the rules, and tell the person in charge of regulatory matters. Then check whether the client acted on it, and speak to them if so.

More free tools for stockbrokers and commodity brokers

Read the guide: Answer client messages at brokerages and trading desks.