Our guy let us in on the specific reason his date didn't want to take things to move forward