I once bought some stuff online that claimed to stop animals from messing on your yard. It was expensive, and when I read the label, it turned out to be non bentonite 'cat litter' mixed with thyme and peppermint.

The stuff I bought worked, but I have NO idea if home made stuff would work, or how long it would last.