V/Line passengers on a train to Gippsland have said they could not get off during a three-hour breakdown outside Richmond Station on Tuesday afternoon.