I grew up in Sydney, as did both my parents, and I've never heard the expression "Sydney or the bush".

I'd guess it would mean that Sydney is the centre of the known world and all elsewhere is uncivilized and not worthy of consideration.