Pastors are sworn to hold personal information in confidence.  You should feel totally comfortable in confessing personal realities to your pastor knowing that his job is to advise and to pronounce the forgiveness of your sins in Jesus name.  If pastors break this oath they can and should be removed from office.