Minister tells Inside Politics that population growth is too high, putting services under pressure