The historic district near the railroad depot houses some architectural gems.