Defects, Duality and Topology