You guys know what field programmable gate arrays are? nearly 20 years ago now, a system was set up to design a circuit that was able to distinguish between two different input tones using the smallest number of components. The test system could reprogram the FPGAs in multiple connections and lay outs while trying to come up with the smallest circuit that could still do the job. When the system was finished, the people running the test discovered they could not understand how the final "winning" circuit worked. in fact, some of the component FPGAs were not even connected to the rest. When I saw this I was, not alarmed, probably a better word is concerned, because, even with no AI input, we were using machines to design other machines that we could not understand how they worked.
AI will accelerate this process. And if it does become self aware we have no common frame of reference or experience. I fail to see how AI would not see humanity as an extraneous distraction at best and a nuisance or threat at worst. lol, seen the movie Colossus?
