That's interesting. Can you provide some references to look into? Rothbard and the Austrian School clearly had a lot of influence on Ron Paul and his followers. A lot of those ideas definitely are a part of the current Libertarian party.
Legal discrimination is actually anti-Capitalist as it is regulation of both the labor and the buyer market. If you're a business you want to be able to sell to the largest market possible while at the same time want to have more freedom in who you can hire.
Regardless of my own criticisms of libertarianism which have been already hashed and rehashed here, OP poses a legitimate question and the US likely has millions and millions of self-identified libertarians who could form a powerful political party. but - The style of voting in this country (winner takes all, in most cases) leads to a two party system, and the two parties have entrenched themselves and created laws and rules to prevent third parties from playing spoiler in elections. If we waved a magic wand, changed all voting to Ranked Choice Voting, we'd see numerous outside parties suddenly jump in power and the libertarians IMO would lead the pack of outsiders. - the republican party has co-opted the messaging of personal responsibility and personal freedom and small government; most people vote with their wallets and most libertarians vote republican. (it must be said that it is the height of absurdity that libertarians and evangelists share a political party; search "Ayn Rand Christianity" and see what she had to say about it. One quote: "Christianity is the perfect cradle for Communism." She despised it.)