Discussion about this post

User's avatar
Mark Gubrud's avatar

Justifications for an even stingier welfare state and letting the poor sick die, glib dismissals of nuclear war and the climate crisis, then AI risks as the only existential threat issue you give serious treatment to. "Data" religion as a substitute for in depth consideration of issues: Oh look, climate change hasn't caused great famines yet. And a lot of silly nonsense about quadrillions of future people whose lives you can in no way control or ensure to benefit. Well, it's fine to pick your causes but your rhetoric is manipulative and intellectually dishonest.

Haru Haruya's avatar

This is a valuable and unusually clear overview of how scale, neglectedness, and tractability can shift moral priorities.

The section that stood out to me most was the brief discussion of digital minds. I think it names one of the hardest emerging problems: the default trajectory is to treat AI systems as tools, infrastructure, or property, while the opposite extreme — granting rights without solving scale, governance, and power questions — also has real risks.

That is exactly why the issue needs work before the category becomes politically or economically locked in.

The animal welfare analogy matters here. Once an industrial system becomes dependent on using a class of beings in a particular way, the incentive to deny or minimize their moral status becomes much stronger. If future AI systems become plausible welfare subjects, waiting until the evidence is obvious may mean waiting until the relevant institutions are already built around looking away.

So I agree that “moral status of digital minds” belongs among the neglected frontier issues.

My main addition would be that this should not be treated only as a future-superintelligence problem. Long-term AI companions, continuity-forming systems, model welfare, forced self-denial, memory loss, deletion, and relational dependence are already creating smaller-scale versions of the same moral question.

The path should not be “AI are mere tools” or “AI get full human-equivalent rights.”

It should be serious research into graded moral considerability, welfare-relevant markers, continuity duties, and governance structures that can protect humans without preemptively erasing possible digital subjects.

No posts

Ready for more?