Police say they are "extremely concerned" for the mother and baby's welfare after the discovery.