The Gemara finds another דין of רב נחמן which follows his logic here