Sandpaper isn't made of ordinary sand, it's made of abrasive minerals like aluminum oxide or garnet that are glued onto a paper backing.
See All 1944 Episodes of "A Moment of Science"