Will the AI's be nice or mean?

[Terxpahseyton]

It would cause the earth to break in half with atomic weapons in a few turns.

 

[El_Machinae]

All of the risks of AI are independent of whether any become sentient. The idea that we'll create sentient AI before we crack the nature of consciousness is rather horrifying. With the way technology goes, this could very well mean that millions to billions of experiments will be performed without us caring about the cruelty involved.

Our record on this front isn't so great. We currently have something like 60 billion farm animals that are created into conditions that we just don't care about very much. And we've long, long(!) passed the point where their poor husbandry is done out of a need for survival. It's all gravy at this point.

But this, again, is independent. There are very many people out there spending large budgets trying to create amazing AI algorithms desired to win the goals of the funders. It's a very easy thing to screw up.

 

[yung.carl.jung]

Are you suggesting that Gallifreyans aren't mammalian?

They lay eggs! Eggs, I tell you!

 

[Terxpahseyton]

If AI would be truly sentient, with emotions and everything, and I was that AI, I think I would certainly wonder weather there was a good way to get those glorified hairless monkeys under permanent control.

But I have a hunch that for that to happen, first biology and (electronic) technology will significantly converge. After all, biology is technology, just a kind of technology which is in its design way way way (I can not stress this enough) way more intelligent, and also in accordance with that way way way more knowledgeable of how just everything works, than current human tech is. In a nutshell: We make high-tech. Nature makes super-mega-high-tech.
And I speculate to create artificial consciousness we will have to adapt our high-tech to this super-high-tech.

To round this argument up: I think there is a notion in some people's head that we understand at least the basics of how biology works - but that is, I have gathered, not true. We understand some basics. But often, we can not really say why something works. How that is even, actually, possible. We just know it does work and observer the process. Why this process actually keeps going, however, is often kind of a mystery.
And example is photosynthesis- Plants are utterly amazing in making use of the Sun. We got chemical formulas etcetera. But we could not for the life of us mimic that efficiency with our tech. Because we do not fully understand how it is possible.
In general the amazing efficiency in biology is a good general illustration of the different levels of high- and bio-tech.

And for a theory how biology achieves what we don't - there is some speculation and research weather bio-tech may me tapping into quantum mechanics to achieve its wizardry. But mostly it may be just ingenious design.

 

[yung.carl.jung]

If AI would be truly sentient, with emotions and everything, and I was that AI, I think I would certainly wonder weather there was a good way to get those glorified hairless monkeys under permanent control.

I agree it is a possibility, but imo a very unlikely one. Right now you are essentially just projecting your human emotions onto that AI, but the AI will be fundamentally different froma human being. The AI may not at all think in our "categories". Power, control, those are all very societal, relational concepts. They are fundamental to the human experience, but are they fundamental to the AI experience?

Personally I would argue that a proper AI would have much higher ambitions, things we (right now) simply cannot fathom. When man tries to think big he thinks about colonizing other universes, essentially just a petty evolution of good ole colonialism.

If I try to think of things humans have never even attempted to achieve, I can come up with much more interesting scenarios than "AI wants world domination".

What if the AI strived to unite all consciousness into one?

Spoiler :

Hopefully it would not be like the ending of Neon Genesis Evangelion, lmao

What if the AI would attempt to create infinite new species, not in its own image, but rather a species that is fit completely to its environment. If the AI would have some sort of compassion, it might feel obligated to aid us to advance to its level of consciousness by whatever means.

I
To round this argument up: I think there is a notion in some people's head that we understand at least the basics of how biology works - but that is, I have gathered, not true. We understand some basics. But often, we can not really say why something works. How that is even, actually, possible. We just know it does work and observer the process. Why this process actually keeps going, however, is often kind of a mystery.

Agreed 100%!