That is sounding VERY like an inspection chamber - not necessarly to a foul sewer, but to a culverted stream - later abandoned and subsequently filled with rubbish. Are you on a line that might once have had a stream?

If you'd like to join and PM me the exact location it might help me - I'm fairly local, in Lower Stoke, formerly of Higham.