I Am My Brother's Creeper

It would seem at first glance that Yosef turns vengeful as he creeps his brothers out. He imprisons them, entraps them and taunts them. But was he not aware of the pain he was also causing his beloved father?