The word tow in the sense of fiber goes back to the 14th century. "The original sense may have been textile fibre generally. OED.
Newspapers used the word in price quotations for raw materials used in making cloth throughout the 19th century. An article in 1822 spoke of "tow-cloth" being made for family use. This was cheap, poor quality cloth.