If your supplier provided an invalid ABN on the tax invoice, or is not registered for GST but they have charged it, and you pay it to that supplier, then the ATO position is that you are not allowed to claim back that GST from the ATO. You will be considered to not have received a Valid Tax Invoice.