Although not rural, my parents' Brooklyn apartment didn't have hot water, you had to heat it on the stove. A lot of the old brownstone apartments were once single family homes, later turned into multi-family apartments. Toilets were usually placed in closets, and some friends down the street had their bathtub in the kitchen, which was, and still is, common in old New York City apartments.