Estonia, Hong Kong, Ireland, New Zealand, and the Netherlands are all good choices. Look up their policies and see which ones fit you best. (Like social freedom but don't mind too little economic freedom? Choose the Netherlands. Like economic freedom better? Choose Hong Kong.) Also, keep in mind that Canada has VERY different laws in each province, so you might find one that's right for you (Alberta maybe?) even if the others don't fit your fancy.
Switzerland has pretty high taxes as far as I can remember, but they are badass enough to put a big circular hole in the middle of the European Union.

Also, it seems that most of the benefit of the privacy of Swiss bank accounts are only available to non-Swiss citizens who bank there, so you may be better off living somewhere else but keeping your money in Switzerland.
All of this advice is pretty half-assed, I know, because there ISN'T a libertarian country anywhere in the world. To go to a real libertarian country, you'd have to hop in a time machine and go back to 19th-century America.
You might also want to look at the following indexes which rank countries:
Economic Freedom Index
http://www.heritage.org/Index/
Freedom House Index
http://www.freedomhouse.org/template.cfm?page=363&year=2008
State of World Liberty Index
http://www.stateofworldliberty.org/