Better Compatibility with authinfo.gpg?

I use authinfo.gpg, a GPG encrypted authinfo file, to manage my passwords in Emacs.
Thou I've configured gpg-agent to cache the main password, running Magithub before the first time the password is entered would cause connection to GitHub API timeout.

If it is possible to make Magithub waiting GPG's password prompt before connect to GtHub API or it is actually a upstream issue of ghub?