agilio | 2022-04-08 20:05:48 UTC | #1
If I write a service that uses Auth Token A to perform it's actions and this hypothetical service generates a 429 Rate Limit response. Is that limit and Retry-After applicable to only the Auth Token A that generated it or would it apply to any Auth Token or Client that tries to call that same API? Trying to determine the effect a 429 will have on the whole Org or if it's scope is limited to the Offending Auth.
Thanks
tim.smith | 2022-04-08 20:39:22 UTC | #2
The most correct answer is that it depends.
429 with a retry-after header are usually caused by the API's main rate limiter (300 RPM), which is applied on a per-token basis. However, other rate limiters may or may not specify a retry-after header. Some definitely do so you can't make an assumption about the nature of the limit based on the presence of the header. They also can/do have a different scope (per user id, per org, per region, per something else) so some 429s can have a wider impact than just the token used with the request.
The bottom line is that a well-behaved app will follow the documented best practices for handling and retrying rate limits. https://developer.genesys.cloud/platform/api/rate-limits
agilio | 2022-04-08 22:30:04 UTC | #3
Thanks Tim we have a client trying to understand the effects a 429 would have on their production Org. Based on everything I've read, understand and you've confirmed there is no one answer to that question.
agilio | 2022-04-11 17:21:18 UTC | #4
Will Event Bridge have insight into when rate limiting is incurring? The customer needs to know if / when they are in a Rate Limiting situation. They understand and plan to build good code but they contend that they need to know when it's happening and how long till it will be cleared. For example if the region or the Org is in a rate limiting event they want to trigger alerts.
John_Carnell | 2022-04-11 17:41:26 UTC | #5
Hi Agilo,
The AWS EventBridge does not publish when rate-limiting is incurring. That does not sound like a a bad idea. I would recommend you open an idea in our ideas portal on it. The link for our ideas portal can be found here. In the mean time you can query our Usage API to get information on rate-limiting. Be aware that the usage data can be 24 hours old. Information about the usage api can be found here. I wrote a blog post about the usage API here that might be useful.
Thanks, John Carnell Manager, Developer Engagement
agilio | 2022-04-11 17:38:29 UTC | #6
Thanks John,
The customers requirements are if for any reason the Org/Platform is in rate limiting they want to know the scope of it.(What entity Auth, user etc caused it) and what is the expected recovery time so they can trigger appropriate alerts. Would you be willing to jump on a call with me and the client to discuss they feel strongly that this should be part of the platform.
John_Carnell | 2022-04-11 18:30:31 UTC | #7
Hi Agilo,
Our philosophy has always been that we are a platform so how customers want information like 429's can be wildly different. What we have always recommended in the past is that if a customer wants to be alerted on a 429, they need to capture that information at the time of the API invocation and notify whatever alerting/monitoring tool they are using to enforce the policy of their choice.
Any request for face-to-face discussions needs to be initiated by the TAM/CSM and then go through our product management team.
Thanks, John Carnell Manager, Developer Engagement
agilio | 2022-04-11 20:11:50 UTC | #8
Thanks John I'll discuss with the Client. Plus I'll make the idea about the event bridge as we hope developers build good code but we know in the real world mistakes happen. Being able to receive an event when a 429 is triggered would be a nice proactive feature.
Becky_Powell | 2022-04-12 11:57:20 UTC | #9
Hi there, can you share the idea number with me once you've created it? I am open to exploring this as a feature enhancement. Thank you!
-Becky Powell Director, Product Management
agilio | 2022-04-12 14:57:01 UTC | #10
https://genesyscloud.ideas.aha.io/ideas/SUPPT-I-18
Becky_Powell | 2022-04-12 18:15:04 UTC | #11
Thank you very much!
system | 2022-05-13 18:15:17 UTC | #12
This topic was automatically closed 31 days after the last reply. New replies are no longer allowed.
This post was migrated from the old Developer Forum.
ref: 14252