Any person required to pay special (occupational) tax under section
5801 shall be relieved from payment of that tax if he establishes to the satisfaction of the Secretary that his business is conducted exclusively with, or on behalf of, the United States or any department, independent establishment, or agency thereof. The Secretary may relieve any person manufacturing firearms for, or on behalf of, the United States from compliance with any provision of this chapter in the conduct of such business.