A weekly review of your broker chats: what to check on Friday
This weekly checklist shows what a brokerage or desk owner should look at in the chats an AI agent handled, from hand-over speed to wrong answers. It takes about thirty minutes.
Runs in your browser. Nothing you enter is sent anywhere or saved.
Before you start
An agent that answers client messages should be read the way you would read a new hire's work in their first months. In a brokerage the cost of a bad reply is higher than in most shops, because one careless line can sound like a quote or advice. A short weekly look keeps small slips from becoming habits.
Set aside half an hour at the same time each week, such as Friday after the close. Open a sample of the week's chats and go down the list. Write down what you change, so you can see whether next week is cleaner. Pull complaint and hand-over chats first.
Tick each one as you go. 0 of 10 done.
[ ] Read every chat where the agent handed over to a person. [ ] Check how long each hand-over waited before a person replied. [ ] Look for any reply that mentioned a price, level or opinion. [ ] Spot-check ten routine paperwork answers against your records. [ ] List the questions the agent could not answer. [ ] Check that nobody sent identity papers into an open chat. [ ] Count the messages that arrived outside desk hours. [ ] Review any complaint and confirm it reached the named owner. [ ] Check that holiday and half-day hours in the guide are still right. [ ] Write down one change to make before next week.
What to do with what you find
Most findings fall into two piles. Missing facts go into the guide, such as the form to use for a change of address. Wrong behaviour goes into the rules, such as an added line telling the agent never to confirm that an instruction has been received.
Keep a simple log of changes with a date. If a problem repeats after a fix, the wording is probably unclear, so rewrite it in plainer terms.
Signs the week went well
You do not need perfect scores. Look for these patterns.
- Hand-overs reached the right person within your target window.
- No reply sounded like a price, a view or advice.
- Fewer repeat questions about the same missing paperwork step.
FAQ
How many chats should I read each week?
Read every hand-over and every complaint, then a sample of routine chats. For a small firm that may be twenty to forty chats, and it still takes under an hour.
Who should do the weekly review?
Someone who knows your procedures well, ideally the owner or head of operations. If a compliance person is on staff, have them look at any reply that came close to advice.
What if I find a reply that sounded like advice?
Treat it as a real incident. Note it, tighten the rules, and tell the person in charge of regulatory matters. Then check whether the client acted on it, and speak to them if so.
More free tools for stockbrokers and commodity brokers
- First-reply checklist for stockbrokers and commodity brokers
- Hand-over rules checklist for stockbrokers and commodity brokers
- First-week checklist for stockbrokers and commodity brokers
- Busy-season checklist for stockbrokers and commodity brokers
- Customer privacy checklist for stockbrokers and commodity brokers
- Do and don't guide for your agent: stockbrokers and commodity brokers
- Greeting messages for stockbrokers and commodity brokers
- After-hours replies for stockbrokers and commodity brokers
- Booking and order confirmations for stockbrokers and commodity brokers
- Reminder messages for stockbrokers and commodity brokers
- Apology and complaint replies for stockbrokers and commodity brokers
- "Let me check" replies for stockbrokers and commodity brokers
- Follow-up messages for stockbrokers and commodity brokers
- Review request messages for stockbrokers and commodity brokers
- Price and quote replies for stockbrokers and commodity brokers
- Delay and stock notices for stockbrokers and commodity brokers
- Thank-you messages for stockbrokers and commodity brokers
- Hand-over notes for stockbrokers and commodity brokers
- Ready answers for stockbrokers and commodity brokers
- Holiday and closure notices for stockbrokers and commodity brokers
- Missed enquiries calculator for stockbrokers and commodity brokers
- AI agent instructions builder for stockbrokers and commodity brokers
- Auto-reply message writer for stockbrokers and commodity brokers
- FAQ answer sheet for stockbrokers and commodity brokers
- Reply speed scorecard for stockbrokers and commodity brokers
- Is your business ready for an AI agent? Quiz for stockbrokers and commodity brokers
- Message workload planner for stockbrokers and commodity brokers
- Hours saved calculator for stockbrokers and commodity brokers
- Enquiry-to-customer value estimator for stockbrokers and commodity brokers
Read the guide: Answer client messages at brokerages and trading desks.