Patrick O'Donovan, Minister for the Office of Public Works