James F. Byrnes #81 (1882-1972) Byrnes was variously a member of the House of Representatives, a U.S. Senator, a Justice of the U.S. Supreme Court, Director of the Office of Economic stabilization, Director of War Mobilization, Secretary of State and Governor of the State of South Carolina. He was everything. For a Supreme Court justice Byrnes tenure with the court is the shortest span of any Justice at any time for any reason