I would suggest that the word 'posh' indicates someone who, through birth and inherited wealth, has been and remains insulated from any concerns regarding maintenance of living standards and who is welcome in the sort of elite groups which develop in any society and which are in this society based upon class structures. To be posh in that sense could make it hard to empathise with the lot of the ordinary person.