MazBot — Team Performance & QA Guide
This guide explains how to measure agent response speed and score conversation quality in MazBot. Share it with client admins, team managers, and support staff.
1. What this feature does
| Question | Where you see the answer |
|---|---|
| How fast do my agents reply? | Team Performance dashboard + each agent's Activity page |
| Are conversations handled to our standards? | QA Scores + greeting / forbidden words / sale KPIs |
Two parts
| Part | What it measures | Needs setup? |
|---|---|---|
| Response analytics | Time between customer message → agent reply | No — works from existing chat data |
| QA scoring | Greeting, forbidden words, sale closed | Yes — enable and configure rules once |
2. Who can use it
| Role | Access |
|---|---|
| Client owner (admin) | Full access — performance, QA settings, scores, export |
Staff with manage_team permission | Same as above |
| Other staff | No access to team performance pages (they can still reply in inbox) |
If you do not see Team in the sidebar, ask your account owner to grant the manage team permission.
3. Where to find it
In the client panel sidebar, open Team:
| Menu item | Purpose |
|---|---|
| Team Member | List staff, edit, view individual activity |
| Team Performance & KPIs | Compare all agents — response time + QA rollups |
| QA Settings | Configure greeting rules, forbidden words, sale detection |
Additional pages: QA Scores (per-conversation list); View Activity per agent (detailed log + KPIs).
4. Quick start (5 minutes)
Step 1 — Open Team Performance
- Go to Team → Team Performance & KPIs
- Set Date from / Date to (default: last 30 days)
- Click Apply filters
You should immediately see response time columns for each agent (no extra setup).
Step 2 — Enable QA (optional but recommended)
- Go to Team → QA Settings
- Turn on Enable QA Scoring
- Review defaults: greeting phrases, forbidden words, sale closed tags (e.g.
sale,بيع) - Click Save
Step 3 — Run first scoring batch
- On QA Settings, click Score Recent Conversations
- Go to QA Scores to review results
- Return to Team Performance — QA columns populate after scoring
5. Response time KPIs
These metrics use human agent messages only (message_by = agent). Bot and AI replies are excluded.
| KPI | Meaning |
|---|---|
| Conversations handled | Chats where this agent sent at least one reply in the selected period |
| Avg response time | Average time from each customer message to the agent's next reply |
| Median response time | Middle value — less affected by one very slow reply |
| Avg first response | Time from the first customer message to the agent's first reply |
Tips
- Median is often more fair than average for coaching.
- Use date filters for weekly/monthly reviews.
- Compare agents on Team Performance, then drill into View Activity.
Current limitations
- Counts all hours (not only business hours)
- Counts replies from any assigned agent in the thread
- Does not separate WhatsApp / Telegram / Messenger yet in the KPI view
Business-hours SLA and channel-specific reporting can be customized after you confirm requirements with MazBot support.
6. QA scoring — setup
Path: Team → QA Settings
Greeting phrases
Comma- or line-separated. The agent's first reply must contain at least one phrase.
مرحبا, أهلا, السلام, hello, hi, welcome
Forbidden words
Words agents must not use. If any appear in any agent message, the forbidden-words score is lost.
Sale closed tags
If the contact has a matching tag (case-insensitive), the conversation counts as sale closed.
sale, sold, closed, won, بيع, تم البيع, مبيع
Tag a contact: Inbox → contact sidebar → add tag after a successful sale.
Sale closed contact attribute (optional)
- Create an attribute in Contacts → Contact Attributes (e.g. Order Status)
- In QA Settings, set Sale Closed Contact Attribute
- Set Accepted Attribute Values (e.g. yes, نعم, تم, مباع)
Scoring weights
| Weight | Default | When points are awarded |
|---|---|---|
| Greeting | 25 | First agent message includes a greeting phrase |
| Forbidden words | 25 | No forbidden words found |
| Sale closed | 50 | Sale tag or attribute detected |
Maximum score = 100 (sum of earned weights).
7. QA scoring — how scores are calculated
- Loads all non-campaign messages for the contact
- Filters to messages sent by the assigned agent
- Checks greeting, forbidden words, and sale status
- Saves one row in QA Scores (updated if you score again)
Per-conversation result
| Field | Pass | Fail |
|---|---|---|
| Greeting | ✓ First reply contains phrase | ✗ Missing greeting |
| Forbidden words | ✓ None found | ✗ One or more found |
| Sale closed | ✓ Tag or attribute match | ✗ No match |
Per-agent rollups
| KPI | Formula |
|---|---|
| QA avg score | Average of all scored conversations for that agent |
| Sale conversion rate | % of scored conversations with sale closed |
| Greeting pass rate | % with greeting passed |
| Forbidden violations | Count of conversations with forbidden words |
8. Reading the dashboards
Team Performance & KPIs
One row per agent. Suggested review order: median response time → QA avg score → sale conversion rate → forbidden violations.
Individual agent — View Activity
Open from team list → ⋮ → View Activity. Shows activity log plus Response Time & QA KPIs for the filtered date range.
QA Scores
Table of every scored conversation: contact, agent, score / 100, greeting, forbidden count, sale closed, scored at. Filter by agent and date range.
9. Sale conversion tracking
MazBot does not automatically know a sale happened unless you mark it.
Recommended workflow
- Agree on tags, contact attribute, or future integration
- Train agents to mark deals when they close
- Run QA scoring (manual or nightly)
- Review Sale conversion rate on Team Performance
| Step | Action |
|---|---|
| 1 | Customer buys product in chat |
| 2 | Agent adds tag بيع to contact |
| 3 | Scoring runs (manual or nightly) |
| 4 | Conversation gets sale closed = yes (+50 points default) |
10. Running scoring (manual & automatic)
Manual
Team → QA Settings or QA Scores → Score Recent Conversations
- Scores up to 200 most recent conversations
- Safe to run multiple times — existing scores are updated
Automatic (server)
Scheduled daily at 02:45 (requires cron + php artisan migrate on deploy):
php artisan qa:score-conversations
# One client only:
php artisan qa:score-conversations --client=123 --limit=200
Only clients with QA Scoring enabled are processed. Ensure cron runs php artisan schedule:run every minute.
11. Exporting reports
Team Performance → Export CSV includes per agent: conversations handled, avg/median/first response, QA avg score, sale %, greeting %, forbidden violations. Apply date filters before export.
12. Best practices for managers
Weekly routine
- Open Team Performance (last 7 days)
- Export CSV
- Review QA Scores for low scores or violations
- Coach agents using inbox examples
| Area | Recommendation |
|---|---|
| Greeting | Add your exact welcome line to greeting phrases |
| Forbidden | Review marketing/legal banned terms monthly |
| Sale | One consistent tag name across the team |
| Targets | Example: median response < 5 min, greeting pass > 90% |
13. FAQ & troubleshooting
Response times but empty QA columns
- Enable QA Scoring in QA Settings
- Click Score Recent Conversations
- Ensure agents sent messages (
message_by = agent)
QA score is 0 or very low
| Cause | Fix |
|---|---|
| No greeting in first reply | Train agents or add more greeting phrases |
| Forbidden word detected | Check QA Scores row for words found |
| Sale not marked | Add sale tag or contact attribute |
| Wrong agent attributed | Scoring uses assignee_id — reassign if needed |
Does this use AI credits?
No. Current QA is rule-based (phrases, words, tags).
14. Settings to confirm with your team
| Topic | Question for your business |
|---|---|
| Sale definition | Tag only? Attribute? Integration with orders? |
| Business hours | Should response time count only 9 AM–6 PM? |
| QA trigger | Score when chat closed? After 24h idle? Daily only? |
| Arabic matching | Word variants needed (e.g. غالي / غاليه)? |
15. ملخص عربي
| الميزة | الوصف |
|---|---|
| سرعة الرد | متوسط ووسيط وقت رد كل موظف + أول رد |
| تقييم الجودة | درجة من 100: تحية، كلمات ممنوعة، إغلاق بيع |
أين أجدها؟ القائمة الجانبية → فريق العمل (Team) → أداء الفريق والمؤشرات / إعدادات الجودة
- افتح أداء الفريق لرؤية سرعة الرد
- فعّل تقييم الجودة من الإعدادات
- أضف الكلمات الممنوعة ووسوم البيع
- اضغط تقييم المحادثات الحديثة
- راجع درجات الجودة ونسبة إغلاق البيع
