A survey of dairy farmers has found nearly a third are feeling less positive than they were 12 months ago.