Where does “pardon my French” come from?

pardon my French (English): To excuse the speaker's frankness of expression or profanity