Smoking irritates peoples mucous membranes, meaning eyes water and hurt, throats get dry and scratchy, and people may not want their sense of smell messed with when they are eating (same reason you generally don't get scented candles at restaurants).
And oh yeah, second hand smoke causes cancer.
Just like with the leafblowers, people aren't telling people NEVER to smoke, just proscribing some limits (time in the case of leafblowers, location in the case of smoking) to keep smoking from infringing on the rights of other people.
I understand your point (and I think that is a first! WHOO-HOO! points for me!) but environmental pollution whether it's noise, olfactory, or other is still something people should not HAVE to deal with.
I don't think people are condemning smokers as 'bad people', though I do think the idea of the 'right' to smoke everywhere is being challenged as unrealistic. Unlike leafblowing, smoking is not a necessary evil nor does it serve a utilitarian purpose. It's a vice, pure and simple. In a structured society, people are only allowed to indulge in vices to a point.