Hi Pranav,
You can get this information from Agent Statuses, although you would have to do some manual manipulation to find the agents specific to the queue, as the view isn't currently sortable by queue.
There is an idea on the Product Ideas Lab of which the use case seems similar to what you require, so I would recommend voting on the idea and add your use case.
------------------------------
Sam Jillard
Online Community Manager/Moderator
Genesys - Employees
------------------------------