The oath of office shall be administered by the President of the Senate to each Senator who shall be elected, previous to his taking his seat.