Keep going. It get's much much better. Each season is better than the last, but Season 2 is where the feel of the show stablises and softens; it'll always be jarring when you go back to season 1 after you pass it. Season 3 is definitely where it starts to hit it's stride.
It's largely an episodic show; you could skip to season 3 and go back to the season 1 & 2 later without missing much. A few recurring characters and themese like do Q make more sense if you watch from the start though.
If you're really wavering definitely skip to season 3.
This advice here is it, OP. I've watched the whole series close to 10 times by now, and sometimes even I skip season 1. However, it does add some good context, and flashbacks in later seasons will make sense and give you a better feeling of attachment to the events if you've seen them.