Workforce Engagement Management

 View Only

Sign Up

  • 1.  AI Scoring Evaluation

    Posted 11-13-2025 10:56

    I looked and didn't see a prior thread - Is anyone having issues with the AI scoring working fine then suddenly it cannot score a question? The question is a simple one asking if the agent selected a wrap code or if the wrap code was the default. It worked fine for a day then stopped working and says it cannot score it now. 


    #QualityEvaluations

    ------------------------------
    Sarah Johnston
    Network Engineer
    ------------------------------


  • 2.  RE: AI Scoring Evaluation

    Posted 11-17-2025 11:30

    Hello Sarah, 

    AI Scoring evaluates interactions only from the conversation transcript, so it cannot answer an AI question about whether a wrap up code was selected or not. This would be a question that would require a manual answer. 

    It does not use metadata such as:

    • Queue or routing path
    • Timestamps or duration
    • Platform or system metrics


    ------------------------------
    Amber Sutherland
    Sr. Principal PS Consultant
    ------------------------------



  • 3.  RE: AI Scoring Evaluation

    Posted 11-18-2025 07:56

    in that case, i wonder why the AI scoring does answer that question on some days and does it correctly. What could it be mistakenly using to determine that answer, when it does score that question? I also had a transfer question that some times it answers and some times it does not, but that answer can be iffy on if the AI scores it correctly when it does score the question. Will AI be updated to do things like routing / transfers and wrap codes consistantly? That is what i'm looking for with the use of AI is procedure accuracy. We will do softskills as a seperate audit. 



    ------------------------------
    Sarah Johnston
    Network Engineer
    ------------------------------



  • 4.  RE: AI Scoring Evaluation

    Posted 10 days ago

    HI Sarah,

    Is it possible that the times when it worked, the agent selected a wrap up code that had a description? The description is how Copilot suggests wrap ups for a conversation, so I am wondering if that is when you see it working as opposed to when it doesn't.



    ------------------------------
    Dawn Zielinski
    Employee
    ------------------------------



  • 5.  RE: AI Scoring Evaluation

    Posted 9 days ago

    Hello Sarah,

    Thank you for posting your question. 

    I am the AI Scoring Product Manager. Keep in mind that AI Scoring currently ONLY takes into account the interaction transcript to answer questions. If there is enough evidence in the transcript to answer a question, it will do so, while providing an explanation on why the specific answer was selected. No metadata (e.g., routing, wrap up code, etc) is considered. 

    With that said, I can gladly review your case and guide you on how to best utilize AI Scoring and/or Evaluation Assistance to automate your evaluation process. Feel free to email me directly with specific examples and your current evaluation form so I can review ASAP.

    Regards,



    ------------------------------
    Jose Ruiz
    Genesys - Employees
    Product Manager
    jose.ruiz@genesys.com
    ------------------------------