Genesys Cloud - Main

 View Only

Sign Up

Expand all | Collapse all

Telephony-0010 and Telephony-0011 Events recently started

  Thread closed by the administrator, not accepting new replies.
  • 1.  Telephony-0010 and Telephony-0011 Events recently started

    Posted 09-29-2025 10:37
    No replies, thread closed.

    Good morning all,

    Curious if anyone else has ran into this issue.

    We are a FedRAMP customer and starting last week (09/25/25 to be exact) our Edges (vendor managed) were updated to version 1.0.0.26833 after midnight on 09/25. Starting at around 6:20AM EST, we began receiving Telephony-0010 and Telephony-0011 events for the very first time (we've been on the platform for around 18 months and cannot recall receiving these two specific events until 09/25). We also have a trigger setup to email us when operational events occur. We cannot find an email for previous 6 months of these events occurring.

    We can recreate the 0011 event by running webRTC diagnostics and this occurs whether we're on our corporate network or using a personal machine from our home network. Several of our folks have recreated this. We highly suspect the Edge update to 1.0.0.26833 or something w last weeks platform release has changed something which is now leading to us seeing / receiving these two specific events. Has anyone here ran into the same issue or something similar? 

    You can also spot check these from the Operational Console. Seems odd to us that multiple users can recreate off or on network and these first began happening last week. Seems logical to think something changed somewhere.

    We have an open ticket w support, thought we'd check here as well.

    Telephony-0011 is a DTLS Peer Disconnect event 

    Telephony-0010 is a WebRTC ICE Idle Detected

    Thanks as always!


    #PlatformAdministration
    #SIP/VoIP
    #SystemAdministration
    #Telephony

    ------------------------------
    Shane Jenkins
    ------------------------------


  • 2.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 09-29-2025 11:56
    No replies, thread closed.

    Hi Shane,

    That's an interesting one.  Hopefully others in the community can comment if they are seeing similar.  If not, please let us know of any resolution provided by Genesys Product Support as it may help others in the future.



    ------------------------------
    Sam Jillard
    Online Community Manager/Moderator
    Genesys - Employees
    ------------------------------



  • 3.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 09-30-2025 01:42
    No replies, thread closed.

    Hi Shane,

    We have an implementation for a customer that was using the trigger ...user.end to check the conversation.details api for the sip response 480 (IceIdle) on the interact session. We would then be able to perform our own logging to datatable in order to potentially respond back to the customer in a post flow, and to check on agent behavior/network stability, as this event was also signaled if an agent performed a browser refresh while on a call (call avoidance).

    This all changed on 26th August for us with the same edge update. (Case #0003863445), and the same  observations as you had above for the operational log. Genesys confirmed these changes.

    Unfortunately the event model also changed to report the 480 sip response. The customer segment now shows the 480 sip response in the interact session, which is now immediately disconnected also (previously the customer was still active). The disconnectType for the trigger changed from 'ENDPOINT' to 'ERROR' on the agent side, with an iceIdle WebRtc error code.

    hope that helps,



    ------------------------------
    Kevin Young
    TTEC Digital, LLC
    kevin.young@ttecdigital.com
    ------------------------------



  • 4.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 09-30-2025 10:01
    No replies, thread closed.

    Hi Kevin / all,

    Really appreciate the information and good to know we aren't totally alone in this. We felt pretty strongly that the Edge update led to these new events / errors being reported. We're now getting them hundreds per day and previously we were getting zero of these specific errors. Kind of crazy that we can also recreate at least one of the "errors" on demand by simply running WebRTC phone diagnostics.

    Kevin, did you get any indication that Genesys would address this or correct this issue?

    Seems like that Edge version introduced or significantly changed how the Edge processes these events. To your point, we also have a trigger and thus are getting email notifications each time these events are generated and we also noticed the disconnect type being ERROR now vs. ENDPOINT for some of them. Just curious if you got a sense this is something Genesys can/will address? 

    I'll reach back out to support via our open ticket and ask for additional information and if there are next steps as well. I'll update here if I learn anything more/new.

    Thanks again all!



    ------------------------------
    Shane Jenkins
    ------------------------------



  • 5.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-01-2025 01:45
    No replies, thread closed.

    Hi Shane,

    Case with Genesys just provided the confirmation that the operational console events and the session model changes were intended. For me it seems that all of the operational console events relate correctly to the agent disconnects that we were seeing before, mainly due to home working issues / network drops etc.. in similar numbers that I previously saw, spread over the 3 console events, 10,11 & 12. 

    personally I see this as a positive change, just would have been nice to know it was coming!



    ------------------------------
    Kevin Young
    TTEC Digital, LLC
    kevin.young@ttecdigital.com
    ------------------------------



  • 6.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-09-2025 12:18
    No replies, thread closed.

    Shane,

    Do you receive any errors when running WebRTC phone diagnostics, or does it run successfully and you get a TELEPHONY-0011 event?

    Thanks,

    Chad



    ------------------------------
    Chad Markle
    Senior Director of IT Unified Communications
    ------------------------------



  • 7.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-09-2025 12:37
    Edited by Shane Jenkins 10-09-2025 12:38
    No replies, thread closed.

    Hi Chad,

    Just tested this on our VPN and off the VPN.

    Both scenarios seemed to behave the same. We do get an error as shown in screenshot below, but if we wait it out for 15-20 seconds, we eventually get Test Results and they are positive. We first thought this was something to do w our VPN (Zscaler), but this behavior also occurs off network from our home network. We've had several individuals test this from their home network w same results. We do have supposedly ALL RTP traffic bypassing Zscaler when on network, but again this seems to occur even when not on the VPN.

    This also generates the Telephony-0011 event when this occurs.

    Are you able to replicate this at all? 



    ------------------------------
    Shane Jenkins
    ------------------------------



  • 8.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-09-2025 13:28
    No replies, thread closed.

    We use ZScaler as well and have RTP traffic bypassing it.

    I've tried running Diagnostics several times on and off VPN, but I could only get that error message you are getting immediately after disconnecting from the VPN.  If you run the Standalone WebRTC Diagnostics app, do you get that error as well?



    ------------------------------
    Chad Markle
    Senior Director of IT Unified Communications
    ------------------------------



  • 9.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-09-2025 13:49
    No replies, thread closed.

    Just tested using the Troubleshooter URL and received same behavior (both off and on VPN, from different machines as well)

    Call Quality attempts to check, then goes to "Checking -> Never Ran", but I can see it dialing *86 in background. Then after waiting 10-15 seconds, it then shows "Excellent" for Call Quality. I tried this multiple times in a row and each time had same behavior.

    You can see the 'Never Ran' below, but if we wait 10-20 seconds, that changes to Excellent as shown in screenshot 2.

    Now Call Quality is "Excellent" after waiting 10-20 seconds while *86 and diagnostics completes


    ------------------------------
    Shane Jenkins
    ------------------------------



  • 10.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 09-30-2025 03:51
    No replies, thread closed.

    Hello, 


    Same here, we've been experiencing these errors throughout the day for several weeks now.
    In our case, we are not a FedRAMP customer, but this issue is also bothering us quite a bit.

    Best regards. 



    ------------------------------
    Adrian Rodriguez
    ------------------------------



  • 11.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 09-30-2025 04:34
    No replies, thread closed.

    Hello,

    we have an org on Tokyo with the same edge software version of 1.0.0.26833 and we notice an increase of reported issue as well where agent experiencing Call error: WebRTC endpoint disconnect, reason-iceIdleDetection, there are also reported error which is: Failed to rejoin call leg.



    ------------------------------
    Ernest John Nuque
    Voice Network Engineer
    ------------------------------



  • 12.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 09-30-2025 13:15
    No replies, thread closed.

    We are a FedRAMP org and have also seen telephony 0010, 0011, and 0012 errors for the first time starting on 9/25/25.

    Has anyone received any more information about this? 

    I'd like to know before we have to open a support case to find out if this is simply a matter of something that has always been occurring but wasn't reported in the ops console versus something new that is happening.



    ------------------------------
    Judy Kerbel
    ------------------------------



  • 13.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-01-2025 03:48
    No replies, thread closed.

    We also seem to have increased reports of WebRTC endpoint disconnect, reason-iceIdleDetection and Failed to rejoin call leg.

    Similar to @Judy Kerbel, unsure whether this behaviour always occurred but now is displayed slightly differently in Genesys, therefor have not raised a case with Genesys (yet).

    High proportion of our staff work from home.

    Our Org is in EU2 running on Edge version 1.0.0.26833.



    ------------------------------
    Dan Wong
    EUC Engineer
    ------------------------------



  • 14.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-01-2025 05:42
    No replies, thread closed.

    We've also gotten report on this issue happening lately while agents have the call on hold.

    Haven't gotten anywhere with support who basically just says it's a customer network issue, but seems there's a new Edge firmware release that should be deployed this week. Hoping that will solve the issue.

    Looking at some client traces it seems that the STUN request gets "Destination unreachable" after a while from the Media server but need to find out if it is the same at the customer firewall.



    ------------------------------
    Jan Heinonen
    Contact Center Specialist
    GlobalConnect AB
    ------------------------------



  • 15.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-01-2025 06:25
    No replies, thread closed.

    Yes, I reported an increase in these 2 events on 10th September. Genesys investigated and have currently determined the issue is on our side, so the incident is with our network team for investigation.



    ------------------------------
    Duncan Lynch
    Solutions Specialist
    ------------------------------



  • 16.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-01-2025 08:19
    No replies, thread closed.

    Hello Duncan,
    what issue in the network they found in particular?



    ------------------------------
    Ernest John Nuque
    Voice Network Engineer
    ------------------------------



  • 17.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-01-2025 09:07
    No replies, thread closed.

    Hi Ernest,

    A brief anonymized summary of what was observed..

    On receiving an inbound call, media negotiation was set up between:
     
    Remote endpoint (our agent): Public IP A
    Media server: IP B
     
    However, instead of receiving media from the expected remote IP (IP A), they observed:
     
    Connectivity checks (STUN packets) and RTP packets from an IP address (IP C), which was not part of the ICE negotiation.
     
    This kept happening for approximately 10 seconds, during which:
     
    No RTP packets or connectivity check responses were received from the expected remote IP (IP A).
    RTP packets were received from the unexpected IP (IP C) and discarded.


    ------------------------------
    Duncan Lynch
    Solutions Specialist
    ------------------------------



  • 18.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-01-2025 10:43
    No replies, thread closed.

    Thanks for sharing!

    Did you find this on all interactions or did it only occur on a certain proportion? 

    Was there any particular duration these interaction would eventually "Error" and disconnect?

    "This kept happening for approximately 10 seconds..."

    Would i be right in staying you saw this in the PCAPs, with multiple Requests / Status every 10 seconds?



    ------------------------------
    Dan Wong
    EUC Engineer
    ------------------------------



  • 19.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-03-2025 10:37
    No replies, thread closed.

    10 seconds matches a recently-discovered issue when Group Policy gets applied to a Windows machine (I think mainly Windows 11) that results in sending sending an LLDP Shutdown message:

    "...an LLDP packet which states 'Shutdown LLDP'. This packet causes the NIC on the machine to essentially be reset, and since Genesys Cloud does not currently have any ability to reestablish ICE connectivity after it has been lost the call will simply disconnect."

    There is a fix currently in Limited Availability status which will allow for "...graceful media stream recovery for WebRTC calls"

    So, when you communicate with Support you might ask about the steps you can take in Group Policy to avoid that particular issue.

    To test the effect,

    1. On an affected user/machine, perform an outbound WebRTC call from Genesys Cloud.

    2. Open cmd.exe as administrator on the machine

    3. Run the command 'gpupdate /force'

    If the client is affected by this issue, you will see the call disconnect about ten seconds later. If you do not see the call disconnect after running the command above, you likely have another bit of software which is triggering the LLDP shutdown.



    ------------------------------
    George Ganahl GCCX-AI, GCP, GCSME
    Technical Adoption Champion
    Genesys
    2024 Community Member of the Year
    ------------------------------



  • 20.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-07-2025 13:39
    No replies, thread closed.

    Hi George,

    Can you please provide a link of the documentation regarding the Group Policy? Where is this information posted?

    Thank you.



    ------------------------------
    Ninette Elashry
    Senior Application Specialist
    ------------------------------



  • 21.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-07-2025 14:12
    No replies, thread closed.

    That is internal info I dug up. I don't know of it being posted anywhere else. Something our folks discovered while working with Microsoft Support



    ------------------------------
    George Ganahl GCCX-AI, GCP, GCSME
    Technical Adoption Champion
    Genesys
    2024 Community Member of the Year
    ------------------------------



  • 22.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-07-2025 15:30
    No replies, thread closed.

    Hello George,

    Thank you for the information. I believe the following points remain unclear:

    • Was there an Edge update that introduced a change in how the IceIdle error is reported?

    • Prior to this change, did the IceIdle error result in call disconnects/dropped calls, or was it only visible in the logs?

    Thank you for clarifying.



    ------------------------------
    Ninette Elashry
    Senior Application Specialist
    ------------------------------



  • 23.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-08-2025 03:25
    Edited by Adrian Rodriguez 10-08-2025 03:25
    No replies, thread closed.

    Hi, All

    We reported this kind of issues, and this is the response of Genesys Support.

    Since Edge release: 1.0.0.26833, Organizations will now be able to see the WebRTC disconnect errors logged in the Console. Events such as the Telephony-0010 and 0011.

    • This logging was previously not being included or displayed in the Console due to the manner in which Genesys handled WebRTC station sessions during interactions. Since the session handling has been updated with the modern WebRTC feature, this now allows the details for the WebRTC disconnect's Analytics data to be logged and available to you.
    • Please keep in mind that the presenting of the errors now do not mean that you are now experiencing "new" issues/errors, but this is more to provide more details regarding what occurred and identifying the disconnect reason.
    • Previously you would need to raise these disconnect issue with Support in order for us to identify what caused the disconnect. Now as an Admin in the Organization, you will have more details with those Telephony Events.

    I hope this will be useful :)

    BR 



    ------------------------------
    Adrian Rodriguez
    ------------------------------



  • 24.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-08-2025 06:51
    No replies, thread closed.

    Hi all,

    for us also the number of events increase since some weeks and we've also reported back a number of increasing call drops.

    Regards,
    Christian



    ------------------------------
    Christian Rosenberger
    System Architekt Customer Interaction Art
    ------------------------------



  • 25.  RE: Telephony-0010 and Telephony-0011 Events recently started

    Posted 10-08-2025 07:52
    No replies, thread closed.

    Thanks, Adrian!



    ------------------------------
    George Ganahl GCCX-AI, GCP, GCSME
    Technical Adoption Champion
    Genesys
    2024 Community Member of the Year
    ------------------------------