No, there's actually a lot more of us than them. The combination of gerrymandering and 2 senators per state gives them far more representation than they should have, then add in non-conservative voters being much less likely to vote and they end up with minority rule. But it's not inevitable - if everyone else voted in the same percentages as they do, they wouldn't have a majority in Congress or be in the White House ever again.