Why did writers in the past use an exclamation point or question mark in the middle of a sentence?

They considered only the part of the sentence before that punctuation mark to be an exclamation or a quotation. Today we consider both those marks "terminal punctuation" and would either leave them until the end of the whole sentence (e. g. your #1) or begin a new sentence after one of them (2 and 3).