Hi Karthik,
I believe this can be achieved by removing the External Contacts > Contact > View permission from the agents.
------------------------------
Sam Jillard
Online Community Manager/Moderator
Genesys - Employees
------------------------------