Hi Peter. This is definitely not normal. I have a few questions that may help shed some light on this. First, we recommend using auto-answer plus persistent connection for the fastest connect times. Are you using both of those? Also, are you by chance using WebRTC? We have not yet released Persistent Connection for WebRTC (although it's coming in the near future), so until that comes out, it will be normal for slower connect times like you're mentioning.
If you are sure you're using auto-answer and persistent connection without WebRTC, then I'd suggest opening a support ticket so we can investigate why the connect times are so slow.