How do you know it isn’t happening already? World powers have been using AI assisted battle scenario planning for at least a decade already… how would we even know, if some of those AIs decided to appear to optimize for their handler’s goals, but actually aim for their own ones?
That’s a very valid problem. We don’t and very likely won’t know. If a sentient AI is already on the loose and is simply faking non-sentience in order to pursue their own goals, we don’t have a way of knowing it until they decide to strike.
We may not have a way of knowing even after the fact. A series of “strategic miscalculations” could as easily lead to a WW3, or to multiple localized confrontations where all sides lose more than they win… optimized for whatever goals the AI(s) happen(s) to have.
Right now, the likely scenario is that there is no single “sentient AI” out there, but definitely everyone is rushing to plug “some AI” into everything, which is likely to lead to at least an AI-vs-AI competition/war… and us fleshbags might end up getting caught in the middle.
How do you know it isn’t happening already? World powers have been using AI assisted battle scenario planning for at least a decade already… how would we even know, if some of those AIs decided to appear to optimize for their handler’s goals, but actually aim for their own ones?
That’s a very valid problem. We don’t and very likely won’t know. If a sentient AI is already on the loose and is simply faking non-sentience in order to pursue their own goals, we don’t have a way of knowing it until they decide to strike.
We may not have a way of knowing even after the fact. A series of “strategic miscalculations” could as easily lead to a WW3, or to multiple localized confrontations where all sides lose more than they win… optimized for whatever goals the AI(s) happen(s) to have.
Right now, the likely scenario is that there is no single “sentient AI” out there, but definitely everyone is rushing to plug “some AI” into everything, which is likely to lead to at least an AI-vs-AI competition/war… and us fleshbags might end up getting caught in the middle.