Nobody I regularly interact with in daily life has any such fear because they've all seen the obvious improvements in my health. I don't cough, I don't wheeze when I laugh, etc, etc. Although none of them are smokers or vapers, they all KNOW it's at least an order of magnitude better than smoking. Oh, and it doesn't smell bad either.
The folks you interact with obviously are not idiots, which makes a difference as we know. Pity those folks are becoming less common throughout the world.