No, that's exactly what I mean. "Harassment" is far too broad a category of things to prohibit, since it includes both physical attacks -- which it cannot be argued should be allowed by the First Amendment -- and verbal attacks, for which such an argument could be made.

I am suggesting passing a law prohibiting physical violence alone, and only then attempting to pass a law limiting what people are allowed to say.