He continued, “If I’m designing AI, I’m going to design a computer whose first job is to design another computer that’s cleverer than the first one.
And when they get together, then you’re in trouble, because then it can take over the whole electrical-monetary system in the world and switch it off. That’s your first disaster.
It’s a technical hydrogen bomb. Think about what that would mean.”