'Man with pride' means that the man and pride are near each other, while 'man of pride' means that pride possesses the man.