Can’t speak to what is available in NZ, but one of my enterprise servers (the r420) came from Amazon for about 300US

HomeProd also came from Amazon, 2x HP EliteDesk 800 g3, currently sitting about 130US/ea (plus whatever another 8gb ramstick cost, plus $100 that 1TB nvme used to cost)