Bridgeport officials want to expand the city’s downtown with new luxury and affordable housing developments.