No fuse box should get very hot....if it is, the fuse has too low a rating and could blow at any time, or there is an electrical fault somewhere, maybe in the form of a loose connection which is inducing some resistance. A degree of warmth is acceptable however.
John
July 2009