Its not as good as a show as people make it out to be
It's BETTER. =D
It's all good, I don't expect it to be a show for everyone. My brother got me into IT Crowd and The Mighty Boosh, so I thought TBBT would be right up his ally. He had the same feeling as you guys.
As for anyone who, as Vintage says, "watched an episode or two at some point", I'd say try the newest episodes. The first couple seasons feel very awkward because, well, the cast plays as awkward nerds who play games. But as the show continues, they are much better.