Taillon became premier when Boucher de Boucherville resigned.
He resigned in 1896 and moved into federal politics to serve as Postmaster-General in the very short-lived federal Conservative government of Charles Tupper, from May to July 1896.
He failed to gain a federal seat in the 1896 federal election, and likewise failed to secure a seat in the 1900 federal election, ending his political career.