The top five banks have combined construction loans of more than $71 billion.