This guy was publicly committing felonies.

Not from olddude's description he wasn't. Taking pictures that are in no way indecent in a public place is not a crime of any sort, no matter who the subject is. It might be creepy and suggest he's done other things the police might be interested in, but that's all.