As I recall, Tevye's horse was out of commission, so he had to pull the wagon himself, something he didn't usually do. Perhaps the rope was the horse's primitive harness.