" Can smoke affect your voice like that?"

If the poisons and gunk coming off the lit end of a cigarette were present down a mine shaft or in a foundry, in even half the quanties, no bugger in the civilized world would be allowed to work there.

So yes, 2nd hand smoke CAN affect your voice like that