Genesys Cloud - Main

 View Only

Discussion Thread View
Expand all | Collapse all

Upcoming New Feature - Dictionary Management in UI

  • 1.  Upcoming New Feature - Dictionary Management in UI

    Posted 04-19-2024 10:30

    We're very excited to announce that starting the week of May 20, 2024, we'll be rolling out Dictionary Management in the UI.

    Back in October, we released this capability through the API here:

    Voice transcription - What is dictionary management ? - Genesys Cloud Resource Center

    This feature will now be much more accessible to Genesys Cloud users with the appropriate permissions. It will be possible to add Terms, Example Phrases, and Sound Like words through the UI to improve the accuracy of transcription, especially for business or product specific terminology.

    Keep an eye out for more announcements as we get closer to release!


    #Roadmap/NewFeatures

    ------------------------------
    Leor Grebler, Principal Product Manager - Voice Transcription
    leor.grebler@genesys.com
    Genesys - Employees
    ------------------------------


  • 2.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 04-23-2024 22:15

    Leor,

    Great to hear!  Question for you.  Would this eventually be able to consume grammars like the Nuance libraries or open source ones like Kaldi?



    ------------------------------
    Robert Wakefield-Carl
    ttec Digital
    Sr. Director - Innovation Architects
    Robert.WC@ttecdigital.com
    https://www.ttecDigital.com
    https://RobertWC.Blogspot.com
    ------------------------------



  • 3.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 04-24-2024 10:36

    Hey Robert!

    Thanks! On initial release, it will support terms the same way it does today through the API. The next step will likely be capitalization support and special characters. Grammars aren't likely to be supported as the language models work a bit differently. The "Sounds like" feature helps build the equivalent.

    Curious - are you seeing much usage of grammars in newer transcription engines? 

    Thanks again,

    Leor



    ------------------------------
    Leor Grebler, Principal Product Manager - Voice Transcription
    leor.grebler@genesys.com
    Genesys - Employees
    ------------------------------



  • 4.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 04-25-2024 00:22

    Hey Leor,

    From what we see are the following:

    1. Insurance and heath benefit terms
    2. City/state slots
    3. Automotive parts
    4. Addresses
    5. Doctor names
    6. Physician specialties


    ------------------------------
    Robert Wakefield-Carl
    ttec Digital
    Sr. Director - Innovation Architects
    Robert.WC@ttecdigital.com
    https://www.ttecDigital.com
    https://RobertWC.Blogspot.com
    ------------------------------



  • 5.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 04-25-2024 10:11

    Thanks so much, Robert!

    One area we're looking at for future expansion is the ability to add recordings of examples to Dictionary Management. This could further improve accuracy in the above examples.

    Leor



    ------------------------------
    Leor Grebler, Principal Product Manager - Voice Transcription
    leor.grebler@genesys.com
    Genesys - Employees
    ------------------------------



  • 6.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 08-26-2024 11:44

    I am interested to hear more about how Dictionary entries can help with these use cases as well.



    ------------------------------
    George Ganahl GCP, GCSME, ICCE, ICHD, etc.
    Senior Principal PS Consultant
    Genesys
    ------------------------------



  • 7.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 05-20-2024 15:55

    Hi Leor,

    This is amazing!!

    The launch of this functionality is still May 20, if not, when will the launch of this one be?

    Thanks,
    Francisco Alvarez



    ------------------------------
    Francisco Alvarez
    Genesys - Employees
    ------------------------------



  • 8.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 05-22-2024 23:55

    Yes I don't see this on the release notes for this week.  What's our new ETA please Leor?  Looking forward to this one, but even more looking forward to the later recording example support.  We have similar use cases as what Robert's mentioned in the medical/healthcare industry.



    ------------------------------
    Vaun McCarthy
    ------------------------------



  • 9.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 05-27-2024 11:11

    Hello Vaun,

    We're currently on track for the week of June 17, 2024. Looking into the soundsLike question!

    Leor



    ------------------------------
    Leor Grebler, Principal Product Manager - Voice Transcription
    leor.grebler@genesys.com
    Genesys - Employees
    ------------------------------



  • 10.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 06-18-2024 01:58

    I still can't see this feature even though the release notes say it was released yesterday can you please confirm if it did get pushed out? Very excited about this feature. 



    ------------------------------
    Tanya Wood
    Telstra Corporation Ltd
    ------------------------------



  • 11.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 06-18-2024 09:23

    Hi Tanya! We're slowly rolling this out across regions. It should be fully enabled in all regions by tomorrow evening Eastern Time. 



    ------------------------------
    Leor Grebler, Principal Product Manager - Voice Transcription
    leor.grebler@genesys.com
    Genesys - Employees
    ------------------------------



  • 12.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 06-24-2024 20:27

    Hi Leor. I have been working with a client to improve recognition of some of the Australian council areas - we tend to roll words together. From tests so far it definitely has helped from recognising one specific area from about 10% to 50%. However I have found that using the new GUI you cannot set the boost value and when pulling data back through the API it defaults to "2". I have now increased the boost to "10" via the API and recognition is much higher. My question is, will the boost setting be added to the GUI? Is there a reason why it was not included in the first instance?



    ------------------------------
    Malcolm Thompson
    Ensighted Pty Ltd
    ------------------------------



  • 13.  RE: Upcoming New Feature - Dictionary Management in UI
    Best Answer

    Posted 06-25-2024 09:21

    Hi Malcolm,

    Thanks so much for the feedback. Very happy to hear the initial successes! 

    We're looking at adding the boost functionality into the UI as well - part of the conversation was trading off simplicity in the UI vs increased functionality. The default of 2 should work for most terms and being able to set everything to 10 could end up leading to a decrease in accuracy in some instances.

    Will update as we look to add more functionality to this feature.

    Leor



    ------------------------------
    Leor Grebler, Principal Product Manager - Voice Transcription
    leor.grebler@genesys.com
    Genesys - Employees
    ------------------------------



  • 14.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 08-25-2024 14:24

    Hi Leor,

    I just started working with this feature last week around tuning for some medical terminology, specifically to see how I can add medical terms so that Knowledge Articles can be surfaced via Agent Assist, and those same terms can show up correctly in the auto-generated summary. A few questions came up:

    1. When I add a term, and associated phrases, how long does it take for the transcription engine to take into account those new words? Is it immediate as the next call?
    2. What is your guidance on tuning this experience? Say I am introducing a new medical product with a unique name. How would you go about handling that term? Would you add the term, some sounds like phrases and some examples, and keep it on the default "2" boost setting? Then, as time goes on, slowly increase the boost setting to 3, then to 4, etc. to see how it affects the transcription accuracy? Curious to know your thoughts on this.  The only visibility I can think of that an Admin has is relying on agents feedback on accuracy, or just going to look at conversation transcripts 1 by 1, which could be a large manual effort.

    A couple of other thoughts I had:

    1. For any unique terms that are defined in Dictionary Management, I think it would be really interesting to be able to expose some ability for agents to select from those terms to "correct" the summary. So, in this scenario the call is completed and the summary is generated. If the transcription engine transcribes a word -- say "particle", and the dictionary Term is Partilique --, and the Admin has defined particle as a "sounds like" phrase.. It would be interesting to provide some sort of indiciation to the agent that "hey, I found another possible transcription option.." and offer of "Partililque" as the transcription correction, where the agent could select that as the proper transcription term.
    2. Even cooler, would be the ability to offer that sort of suggestion in real-time.. so that the agent could make that correct, which could then in downstream affect knowledge surfacing, etc.

    Anyways, the maintenance and tuning of this is really interesting to me. Curious to know what you're thinking up over there and what's on the vision board/roadmap. 

    Thanks,

    Peter



    ------------------------------
    Peter Stoltenberg
    TTEC Digital
    ------------------------------



  • 15.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 08-27-2024 00:25

    Hi Peter, thanks for the questions.

    1. Typically, the language model is updated within 15 minutes. Often, less.
    2. Yes, keep at the default (which is the only option in the UI) and increase by a single digit until the desired results. Over-boosting that lead to over-identifying the term. 

    We are looking at building in feedback mechanisms to the UI and elsewhere to help make it easier to report issues. Very grateful for these ideas! Will share more as we get closer to updating the roadmap.

    Leor



    ------------------------------
    Leor Grebler, Principal Product Manager - Voice Transcription
    leor.grebler@genesys.com
    Genesys - Employees
    ------------------------------



  • 16.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 08-27-2024 13:13

    Thank you, Leor!



    ------------------------------
    Peter Stoltenberg
    TTEC Digital
    ------------------------------



  • 17.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 08-26-2024 09:29

    I may have missed this when the original API was launched, but will this dictionary management also apply to the accuracy of bot flows using the native Genesys STT (ask for intent and ask for slot)?  My company's product is way too often "heard" by the bot as "goat you connect" and other awful misunderstandings, instead of "GoTo Connect".



    ------------------------------
    Paul McGurn
    Manager, Telecom & DevOps
    GoTo
    ------------------------------



  • 18.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 08-27-2024 00:20

    Currently, voice bots use an older technology that isn't the same as the existing voice transcription engine. We are looking at bringing that engine to voice bots, in which case Dictionary Management would apply.



    ------------------------------
    Leor Grebler, Principal Product Manager - Voice Transcription
    leor.grebler@genesys.com
    Genesys - Employees
    ------------------------------



  • 19.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 08-27-2024 09:09

    Interesting.  I thought the voice bots were supposed to be the bleeding edge tech, not the other way around.






  • 20.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 09-02-2024 17:57

    Yes, Bots are using the latest tech, but it is third party.  Bots are not yet using our native transcription engine, that is a roadmap item.



    ------------------------------
    Rakesh Tailor
    Vice President, Product Management
    Workforce Engagement Management (WEM)
    ------------------------------



  • 21.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 09-23-2024 10:58
    Edited by Brady Speed 09-23-2024 12:05

    It was touched on earlier in the thread, but want to confirm - do Dictionary Management terms apply to Agent Assist/CoPilot transcription and knowledge article surfacing?

    Thanks,

    Brady



    ------------------------------
    Brady
    Seattle, USA
    ------------------------------



  • 22.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 09-23-2024 16:19

    Hi Brady, 

    Thanks for the note. If the user has GC3 or WEM Add On today, what's added to Dictionary Management will affect the transcription that is consumed by Agent Assist and Copilot if Native Voice Transcription is used. We hope to be able to provide the Dictionary Management soon to those who might not have the GC3 or WEM Add On licenses soon. @Amanda Halpin for visibility.

    Leor



    ------------------------------
    Leor Grebler, Principal Product Manager - Voice Transcription
    leor.grebler@genesys.com
    Genesys - Employees
    ------------------------------



  • 23.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 09-23-2024 18:10

    Leor, 

    I think what people are really asking is how do we make the transcription/ASR/Topic Spotting the best it can be.  Other companies offer pre-trained dictionaries, the ability to feed in lots of sentences and/or words, and the ability to train dictionaries by using audio or spoken input.  The 500 entry limit is very limiting, especially in the medical field.  If you were to ask me for my top 10, here is what I would suggest:

    1. Empathy Feedback like we have for Sentiment
    2. Ability to train more than 500 dictionary words in bulk without taking 30-50 clicks per word
    3. Allow dictionaries to be trained on actual voice input of the word instead of just phonetics
    4. Allow AI Generation of phonetic pronunciation like Bing replied to this for Genesys:  juh-NEH-sis
    5. Genesys should publish pre-trained dictionaries for Medical, Insurance, Financial, and other industries
    6. Correction mechanism in transcript to train model when inaccurate
    7. Transcription Feedback loop for LM on positive or negative input from agents and/or QM Managers
    8. Speaker-based output of transcription via the API
    9. Dialect and accent detection and adjustment after the fact
    10. Translation of transcriptions (wait - that one is coming!)


    ------------------------------
    Robert Wakefield-Carl
    ttec Digital
    Sr. Director - Innovation Architects
    Robert.WC@ttecdigital.com
    https://www.ttecDigital.com
    https://RobertWC.Blogspot.com
    ------------------------------



  • 24.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 09-25-2024 22:08

    Robert,

    Always appreciate your valuable input. Thanks for taking the time. Cheers!

    Brady



    ------------------------------
    Brady
    Seattle, USA
    ------------------------------



  • 25.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 09-30-2024 17:36

    Hi Robert, always helpful feedback! Thank you!

    This feedback aligns with other feedback that we've received. We are looking at nearly all of these. They're great. Hopefully, you hear more updates soon rather than me just being cheerful about your comments.

    Very grateful,

    Leor



    ------------------------------
    Leor Grebler, Principal Product Manager - Voice Transcription
    leor.grebler@genesys.com
    Genesys - Employees
    ------------------------------



  • 26.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 09-25-2024 22:14
    Edited by Brady Speed 09-25-2024 22:15

    Thanks for the info!

    Follow up question - how is "confidence" derived as seen in the transcript URL result for the below API?

     api/v2/speechandtextanalytics/conversations/{conversationId}/communications/{communicationId}/transcripturl

    "words": [
                {
                  "word": "and",
                  "confidence": 0.971,
                  "startTimeMs": 1726155205633,
                  "duration": {
                    "milliseconds": 40
                  }
                }



    ------------------------------
    Brady
    Seattle, USA
    ------------------------------



  • 27.  RE: Upcoming New Feature - Dictionary Management in UI

    Posted 09-25-2024 22:25

    Quoting from one of the engines behind Genesys ASR:

    The confidence value is an estimate between 0.0 and 1.0. It's calculated by aggregating the "likelihood" values assigned to each word in the audio. A higher number indicates an estimated greater likelihood that the individual words were recognized correctly. This field is typically provided only for the top hypothesis, and only for results where is_final=true. For example, you may use the confidence value to decide whether to show alternative results to the user or ask for confirmation from the user.

    Be aware, however, that the model determines the "best", top-ranked result based on more signals than the confidence score alone (such as sentence context). Because of this there are occasional cases where the top result doesn't have the highest confidence score. If you haven't requested multiple alternative results, the single "best" result returned may have a lower confidence value than anticipated. This can occur, for example, in cases where rare words are being used. A word that's rarely used can be assigned a low "likelihood" value even if it's recognized correctly. If the model determines the rare word to be the most likely option based on context, that result is returned at the top even if the result's confidence value is lower than alternative options.



    ------------------------------
    Robert Wakefield-Carl
    ttec Digital
    Sr. Director - Innovation Architects
    Robert.WC@ttecdigital.com
    https://www.ttecDigital.com
    https://RobertWC.Blogspot.com
    ------------------------------



Need Help finding something?

Check out the Genesys Knowledge Network - your all-in-one access point for Genesys resources