Sometimes milk gives babykitties litterbox woes..if you're giving him milk, I'd suggest giving him a break for a little while.

..checking in with another vet seems like a very good idea. Even if the first vet was accurate, it'll do you good to have some reassurance.