But I also don't feel a need to say what someone else is and isn't allowed to do, so long as anothers rights are not infringed.

I would say that all of these dead people have had their rights infringed.
Which is the greater right? The one to own high end weaponry.. or the one to live your life in the pursuit of happiness, et al...