keep in step (with someone or something) Literally, to follow or maintain the proper rhythm of someone or something else while walking.