The source for changing special clothing for Shabbat is from the clothing of the kohanim, the law that a talmid chacham should have clean clothes