You should be worried more about asset seizures, than gold confiscation. Peter Schiff gives pretty insight into this.