"downside is a minority of the clientele,filthy dirty"


You definitely get some scumbags who can be abusive to staff and generally a bit scary, but as to "filthy, dirty" in particular it's also worth realising that some of those people may be vulnerable people who may for example have difficulty keeping themselves sober and generally together and/or are living rough and without access to soap and clean clothes.