No, you're fine! I actually just watched random episodes when I first started. Just be sure to watch the two-parters and obvious sequels in the right order.
And... I have a confession to make. I skipped Nine. Well, sort of. I watched the first few Nine episodes, skipped to his regeneration into Ten, and then stopped watching altogether.
Then, around six months or so later, for reasons totally unrelated to a girl (), I got back into it and just watched them all out of order, until Season 7 was made available on the interwebs and I watched that one straight through (Also Season 8, but that's just because I had to).