I found that there is an "Assumed Right of Access" to the front door of premises.

I wrote to the TV Licensing (email) withdrawing that right.

Never heard from them again.

It may not be legally correct or even true but it worked for me.

Best regards

Dave