Free speech hurts someone all the time, but it liberates (i…

Free speech hurts someone all the time, but it liberates (in my opinion) 99.99%+ of all the people freely having access to it.

Why limit free speech in order to fix the -0.01% with regulations, rules & even laws that makes people concerned to speak?