Yup, I know exactly what you mean. Timing details like that have always been a problem for me.
Don't give up hope though. a friend once told me that "if you can hear that it's wrong, then you can get it right with practice".
Me, I'm still practicing.