I can only easily recall a single interview where I made a determination of "well ... THIS interview is over." Unless you do something REALLY egregious, it's unlikely that the interviewer will halt the interview and ask you to leave.