Genesys Cloud - Developer Community!

 View Only

Sign Up

Expand all | Collapse all

Need ability to access transcription confidence level outside CX after interaction ended

  • 1.  Need ability to access transcription confidence level outside CX after interaction ended

    Posted 13 days ago

    We have a use case where we have a post-call survey with a free-form question at the end. As part of that question we need to also pass the confidence level as that is an important factor for our business customer. We have the ability to attach the transcription confidence for that question at the end of the survey, however we only recently added that. I've been looking for any way to pull a previous interaction, pull the survey data, and get that transcription confidence. I am not seeing this reported as part of the survey data in the API response or any other API for that matter.

    One option (which I would prefer not to do) would be to make an API call for each survey to get the transcription URL, then fetch the content from the URL, take the average of the confidence levels for each individual word and use that value. 

    Crossing my fingers that someone knows of a different/cleaner approach. Thanks in advance!


    #PlatformAPI

    ------------------------------
    Rich Bartolucci
    Sr. Director, Omnichannel Application Development
    Travelers Insurance
    ------------------------------


  • 2.  RE: Need ability to access transcription confidence level outside CX after interaction ended

    Posted 3 hours ago

    Hi Rich, here to see if the following sparkles more engagement from more enlightened folks. Here my two cents:

    My understanding too is this is a known limitation, transcription confidence levels for free-form survey questions are not currently exposed through the survey APIs (such as GET /api/v2/quality/conversations/{conversationId}/surveys).

    What the Platform Offers:

    In-Flow Variable Available:
    During flow execution, Genesys Cloud provides the Session.LastCollectionConfidence variable that captures the ASR (Automatic Speech Recognition) confidence for the participant's most recent utterance in an "Ask for" action. This variable is specifically for ASR confidence, not NLU confidence.

    I like your workaround requiring: 

    Using POST /api/v2/analytics/conversations/details/query to identify conversations with surveys
    Making an API call to /api/v2/speechandtextanalytics/conversations/{conversationId}/communications/{communicationId}/transcripturl to get the transcription URL
    Fetching the JSON content from that S3 URL, which contains word-level confidence scores
    Calculating the average confidence yourself

    I did a quick search and there seems to be an existing Aha! Idea DARSTA-I-415 titled "Overall transcript confidence score" (status: Future Consideration) that requests exactly this functionality - adding an overall confidence score to the transcription API response instead of requiring manual calculation from word-level confidence scores.

    In the meantime, considering you mention that you recently added the ability to attach transcription confidence at the end of the survey, what I would explore going forward would would be:

    Use the Session.LastCollectionConfidence variable after each free-form question
    Store it to Participant Data using a Set Participant Data action
    This makes the confidence value available via the Analytics API and attached to the interaction record

    For the historical data where you didn't capture this, unfortunately the only option is the workaround you described - fetching the transcript URL and calculating average confidence from the word-level data.

    API References for Your Workaround:

    POST /api/v2/analytics/conversations/details/query - Find survey interactions
    GET /api/v2/quality/conversations/{conversationId}/surveys - Get survey responses
    /api/v2/speechandtextanalytics/conversations/{conversationId}/communications/{communicationId}/transcripturl - Get transcript with word-level confidence



    ------------------------------
    Joaquin Garcia Fink
    Senior Customer Success Manager
    Genesys - Employees
    ------------------------------