Press ESC to close

AI doom, AI boom and the possible destruction of humanity

According to researchers, systems like AutoGPT nowadays have a significant impact. Humans frequently find themselves in never-ending loops. A single system was given all the resources it would need to clone itself. It was unable to complete the task. Such restrictions can be eliminated in the future.

In addition to other societal-scale concerns like pandemics and nuclear weapons, reducing the possibility of annihilation from AI should be a global priority.

Center for AI Safety (CAIS) issued this statement this week in response to widespread concerns about runaway superintelligence potentially causing the end of the world. The CAIS statement reflects the top issues raised in the AI sector during the last two months: In particular, if AI technology is not carefully regulated on a worldwide basis, existential risks may materialize over the next decade or two.

Center for AI Safety issues a dire warning about extinction as well as other grave issues, including the deterioration of human reasoning and the dangers of AI-generated false information influencing public opinion. An impressive list of academic experts and technological giants, including executives from several companies and MIT specialists, have signed the statement. 

Doom predictions

There’s a fairly popular misconception within the AI field that there are just a few doomers, as per an interview by the executive director of CAIS. Nonetheless, a lot of people would quietly express their worries about these issues.

There is a fair amount of doom and gloom conversation right now, as the word “doomers” occurs in this line.

The term “P (doom)” has gained popularity in the AI community to denote the likelihood of such spooky events. P (doom) is an effort to put a monetary value on the likelihood that super-intelligent AI, in particular, will seriously hurt or even wipe out humanity in a doomsday scenario.

Understanding the benefits of AI

The idea of P (doom) emphasizes the possible dangers of AI, but it may unintentionally obscure a key point in the discussion: the beneficial effects AI may have on reducing existential concerns.

To provide a more balanced discussion, we should also take into account a different option that I refer to as “P (solution)” or “P (sol),” i.e., the likelihood that AI will be used to counteract these dangers. Experts estimate my P (doom) to be about 5%, while my P (sol) is closer to 80%, to give you an idea of where I’m coming from. This represents my view that, while we shouldn’t ignore the hazards, the potential advantages of AI may be significant enough to overcome them.

The issue with alignment

Many doomers believe that the problem of alignment—in which a superintelligent AI’s goals are at odds with moral principles or social goals—is the main cause for concern. ChatGPT may make the topic appear fresh, although this issue has been around for about 65 years. Cybernetics pioneer and AI pioneer Norbert Weiner is said to have written an essay in 1960 in which he stated his fears about a day when “machines learn” and “create unexpected methods that will amaze their developers.” In the present crisis, alignment issues are the key discussion points. The issue is that an AI system may act in a damaging way even if no one intended it to. Leading AI companies are constantly tackling this issue.

A fundamental dilemma

Does AI predict doom or a bright future? It’s an unsolvable dilemma. AI is either viewed as a threat to mankind or as its savior. There is little doubt that careful growth and constant supervision are required in AI. Whatever the opinions, it’s a good idea to have laws to avert a terrible situation. The fate of mankind is in a vulnerable position.