You aren't punishing the dead person by not going. Just punishing what friends and family he or she had, out of spite. Making enemies. I mean when you say "horrible person" you're not talking about Adolf Hitler or Pol Pot, you're just talking about someone you thought (rightly or wrongly) an asshole.

Now you've made yourself the asshole to other people. Not a great life strategy.