When it gets to the point AI is self-recursively improving itself, is this a version of 'life' as we know it? Perhaps with humans as the ultimate parent? In a sense those AIs would be our descendents.
My problem with Big Tech leading these efforts, is that they are so often anti-human welfare, why would we trust them with the issue of anyone else's? Big Tech's desire to have zero regulation is an expression of how little concern they have for other humans. The ease with which all the Big Tech firms help the military slaughter tens of thousands of civilians is another. I can't help thinking they'll use any effort to elevate AI 'welfare', to harm the interests of inconvenient humans, which means most of us to them.