The tongue is covered with bacteria, and when pierced, that bacteria can get in the bloodstream and underlying tongue tissues. This can cause serious infections. Unfortunately, tongue jewelry wearers may not be aware of a problem since the symptoms of infection, such as swelling, are similar to the after-effects of theĀ tonguepiercing.