Oppenheimer was born in New York City on April 22, 1904. He was the son of an immigrant German textile merchant.