One is supposed to work out the rhyming slang from the context even when hearing it for the first time.
e.g. A guy is fidgeting on a church pew and he says "These pews are 'ard, me farmers ain't 'arf givin' me gyp" You are supposed to know what he is talking about even if you grew up using the term Chalfonts.