Roster IQ packet taking time to process

Roster IQ packet taking time to process.
Total time from request interception to delivery of packet takes approximately 5 secs.

As debugged, majority time is consumed by org.jivesoftware.openfire.handler.IQRosterHandler.java class file where the XMPP packet of IQ is taking time.

Can anyone help us with the problem here?