Psalm 105:3, "Glory in his holy name; let the hearts of those who seek the Lord rejoice!"
To worship the Lord and seek his kingdom and righteousness is the sure way to happiness, for there is no other. True seekers throw their hearts into the engagement, hence their hearts receive joy; according to the text they have a permit to rejoice and they have the promise that they shall do so.