Look, there is no such thing as "smoker's rights" and "non-smoker's rights". That's collectivism. Whether or not one should be permitted to smoke within a building, a car, on the lawn, etc., is a decision that should be reserved to the property owner, not government. If we argue that the government can come in and make you walk 25 feet away from your business establishment, that you paid for and worked for, to smoke a cigarette or a cigar, we are arguing that the property owner no longer has control or ownership of his property, and that government can arbitrarily usurp those property rights, interfere and force people to alter their behavior with regard to a legal substance.
Whether you like smoking or not, or whether you think it's dangerous and a health hazard, you do not, either as an individual or as a government body, have the authority to usurp the property owner's rights to allow or disallow such behavior.
If it is your house, your business, or your car, and you don't like smoke, you're free to pass all the rules and regulations you wish regarding other people's behavior on your property. But when it comes to other people's homes, businesses, vehicles or front lawns, you have no right to demand anything of anyone. You can request that they stop a behavior that you disapprove of, but you can't force them. And to seek government intervention to force people to stop engaging in an activity because you don't like it or because you think it's a health hazard, is to negate that property owner's rights.
If someone is smoking and you don't like it, and you aren't in a position of property ownership/control, no one is forcing you to remain. You can leave, go outside, ask them to stop (you'll find that many people are considerate and obliging), or wear a gas mask.
On a final note, I do find it odd that the number of smokers is dramatically decreasing, and therefore so is the amount of "second hand smoke". Yet, cancer in all forms is on the rise.
And regarding "smoking nazis", Adolph Hitler engaged in an anti-smoking campaign that would make modern-day liberals proud.
It comes down to property ownership and control.
Edit: Businesses, such as restaurants, department stores, bars, flowershops, etc., are PRIVATE property, not public property. The public has permission from the property owner to enter into those establishments, but the public doesn't have a "right" to enter. Even to the point that if I, as a business owner, ask you to leave and you refuse to do so, I can call the police and have them enforce my property ownership rights.