Fights are not always avoidable. If you believe that, I've got this big bridge in brooklyn that you'll love.
That being said, they are serious business. And if this guy really floundered you by putting his hand on your shoulder (???) then I suggest you find another line of work, because this one clearly isn't working for you.