Original Message:
Sent: 12-09-2025 18:37
From: Jose Ruiz
Subject: Feedback Wanted: Your Experience with Virtual Supervisor (AI Scoring)
Hello @Bob Hall,
Thank you for the information. We have a brand new model for our native transcription engine under limited availability. The customers that have tested it so far have very positive feedback stating that they have seen a marked transcription accuracy improvement.
As you properly conveyed, with better transcription AI Scoring can be more accurate when answering questions.
If you are interested in participating in the LA, feel free to reach out to @Liore Finkelstein directly
Regards,
------------------------------
Jose Ruiz
Genesys - Employees
Product Manager
jose.ruiz@genesys.com
Original Message:
Sent: 12-05-2025 08:56
From: Bob Hall
Subject: Feedback Wanted: Your Experience with Virtual Supervisor (AI Scoring)
Sorry for the late reply. English US is what we were using, we are in the financial services sector (Banking & Insurance), but when it came to scoring for quality that would have been irrelevant though did not improve with the addition of financial terminology that has been added. The scoring was done for the basic aspects of agent interaction. Proper greeting and closing if a specific statement was made, for example "my agent ID is 13245" the transcription service did not pick these up accurately enough to make the AI scoring reliable. Our quality team still had manually score all of the questions due to the inaccuracy of the scoring fueled by the transcription service.
We worked with Genesys professional services and solutions consultants but just couldn't get it to be accurate.
Our use case was to get the simple pieces of the scoring done by the AI that would be agnostic of line of business or customer servicing, in order to speed along the scoring and allow the quality team to still score the client specific or more difficult questions.
------------------------------
Bob Hall
.
Original Message:
Sent: 11-12-2025 13:04
From: Jose Ruiz
Subject: Feedback Wanted: Your Experience with Virtual Supervisor (AI Scoring)
Thank you for your feedback @Bob Hall. May I know what language/dialect is being used in your case for transcription?.
We have made considerable updates to the Native transcription quality for core dialects and will release a net new transcription model in the coming weeks. Feel free to send over more information on the issues you faced directly to me so we can review them in detail.
Regards,
------------------------------
Jose Ruiz
Genesys - Employees
Product Manager
jose.ruiz@genesys.com
Original Message:
Sent: 11-12-2025 08:30
From: Bob Hall
Subject: Feedback Wanted: Your Experience with Virtual Supervisor (AI Scoring)
We did a trial of both agent Copilot and supervisor Copilot. We found the AI scoring to be the weakest aspect of Supervisor copilot.
We found that the reliance on the transcription service to be the major issue. We are using the Genesys native transcription service and had Genesys teams engaged to assist with tuning for the scoring but when the transcription service can't accurately capture something like the greeting which should all be the same for each agent, it makes the automated scoring not worth it.
Ultimately at least at this point we have decided to not rely upon the AI scoring but could revisit in the future. We are also considering using a different transcription service rather than the Genesys native transcription service
------------------------------
Bob Hall
.
Original Message:
Sent: 10-30-2025 11:06
From: Jose Ruiz
Subject: Feedback Wanted: Your Experience with Virtual Supervisor (AI Scoring)
Hi everyone,
The Virtual Supervisor (AI Scoring) feature has now been available in Genesys Cloud for several months, and we'd love to hear from you!
We're looking to understand how this capability has impacted your organization - what benefits have you seen so far, and how has it influenced your quality management or performance processes?
At the same time, we'd like to know about any barriers or challenges that have limited your use or expansion of the feature.
To help you get the most out of Virtual Supervisor, we've also just launched a new AI Scoring Best Practices Guide. This resource shares recommendations and practical tips for optimizing AI scoring accuracy, aligning it with your evaluation forms, and driving better agent performance outcomes. We encourage you to review it and share your feedback or additional insights from your own experience.
Your input will help us identify opportunities to improve the experience and guide future enhancements.
Looking forward to hearing your thoughts - both the wins and the pain points!
#AIScoring(VirtualSupervisor)
------------------------------
Jose Ruiz
Genesys - Employees
Product Manager
jose.ruiz@genesys.com
------------------------------