The veteran fundraiser's family is appealing against an order to demolish the building.