Don, there are numerous court rulings starting in the 1800's that agree with your interpretation, and say exactly why -- namely that privacy is the end product of several amendments.

The courts continue to uphold "privacy" as an essential component to the guarentee of liberty in the 14th Amendment -- the question is simply, how much liberty, and in relation to what activities.

And an article on the subject from those fine folks at FindLaw.