Is it better to pay out your home mortgage first or keep the mortgage and buy more property?

Should I invest in a dual occupancy, two different apartments or two different homes? 

How fast are portfolios typically grown/5-10 year plans?