The danger of habitat specialization