Describing the written through understanding the spoken