"Not as such" – I'd take that to mean the speaker had no idea where Mr. J was.

I used to work for a man who had a bad habit of disappearing, usually on a sales call, without telling anyone where he was going or for how long. It's not that he was trying to pull a fast one--he was a hard worker. He just couldn't get it through his skull that it was embarrassing for us when people would call and ask for him and we had no idea what to tell them.

He was the owner of the company, by the way.