Training in meditation is training in developing single-pointedness of attention.  

It does initially require a little effort to keep returning the attention back to the physical sensation of the breath. 

The quality of this attention is not too tight, not too loose; it is relaxed yet focussed. 

With familiarity, you'll be able to maintain this attention without too much effort.