Respectfulness is an expression of dignity and is unrelated to whether the other person feels the disrespect. Respect is a בין אדם לעצמו not a בין אדם לחבירו
Sources