The Capitol Police Board shall select and regulate the pattern for a uniform for the Capitol police and watchmen, and furnish each member of the force with the necessary belts and arms, payable from appropriations to the Capitol Police upon certification of payment by the Chief of the Capitol Police. Such arms so furnished or other arms as authorized by the Capitol Police Board shall be carried by each officer and member of the Capitol Police, while in the Capitol Buildings (as defined in section
5101 of title
40), and while within or outside of the boundaries of the United States Capitol Grounds (as defined in section
5102 of title
40), in such manner and at such times as the Capitol Police Board may, by regulations, prescribe.