Like Ebbie, I do follow some of it... and like gillymor, I am awed by the downhill skiing.
I am impressed by any display of physical/artistic abilities... but not a bit concerned with medal count or who makes money.

Some events, like Biathlon, seem outdated and almost silly, and some, like luge, skeleton and bobsledding and halfpipe snowboarding seem to serve no purpose except to take useless chances doing something unnecessary. However, the sheer daring involved is, to me, worth a brief look.
I do like the events where it is obvious who was first or fastest... like cross-country skiing or speed skating, but I get upset at the events which involve 'style' points by biased judges.

   In the USA, NBC has 3 channels devoted to the games, and one is just reviews and interviews which allow a quick glance at the latest results.
Finally, I DO NOT care for ice hockey, as even amateur games involve violence.... and curling, while genteel and open, is not something I can comprehend. It would take me years I do not have to follow the strategy.

As to TV in general.... with 70-80 channels available to me, there ARE worthwhile tidbits once one gets used to how to dodge the crap. It is perfectly possible to enjoy certain things without it eating up one's life.