I live over the hill from greenfield, and have been involved in textiles for most of my working life. Shifters are people who move the cloth rolls, so shifting in this context would be moving the cloth up and down to the looms which were on the top floors to catch the most light. Tarrying locally means waiting around without work.