A.I. News 'No one is prepared for the consequences': Even OpenAI chief scientist is saying AI development needs to slow down

Brownie2019

Brownie2019

Level 23
Thread author
Verified
Well-known
Forum Veteran
Mar 9, 2019
1,119
6,100
2,168
Germany
Content source
https://www.techradar.com/pro/no-one-is-prepared-for-the-consequences-even-openai-chief-scientist-is-saying-ai-development-needs-to-slow-down
  • OpenAI Chief Scientist Jakub Pachocki suggests AI development is at a junction
  • He advocates not just for slowing AI development, but keeping people in the loop, and the technology controllable
  • Pachocki also states that international coordination from governments on future AI development is needed
OpenAI is taking the post-Hugging Face fallout very seriously. Just days after the release of GPT-6 Astra, Chief Scientist Jakub Pachocki believes that development into artificial intelligence should be slowed across the board. Not just by OpenAI, but by every company across the AI industry.

Writing on the OpenAI website, Pachocki said AIs “present clear new dangers” for computer security, and that "no one is prepared for the consequences of a continued rapid rise in machine intelligence."

Referring to OpenAI’s plan to develop an automated research assistant, and its progress with recursive self-improvement (where AI develops its next iteration), Pachocki suggests that now is the time to slow AI development and make the right choices for what happens next.
Understanding machine intelligence
The timing of the blog is surprising, given its proximity to the recent release of OpenAI's business-focused GPT-6 Astra. Pachocki’s notion of slowing research into AI is based around understanding – or rather, a lack of it. He states how “we now find ourselves at the moment in history of computing where machine intelligence is starting to exceed that of humans in transformative ways,” and that “study of deep learning-based AI is largely an experimental science.”

His argument is a strong one, which digs into the history of OpenAI as an AI developer and its early understanding of machine intelligence requiring increased computational power. This was required to accelerate research, and while various new algorithms have been developed that enhanced AI, the drive towards more power has continued.
While there is no discussion over the concerns of energy, cooling, and data center opposition, Pachocki’s article does accommodate the possibility of losing control of AI. “I am concerned no one is prepared for the consequences of a continued rapid rise in machine intelligence.”

Conscious choice
Does hitting the brakes solve the various problems that AI is facing? OpenAI’s Chief Scientist hopes it will, and enable the industry to consider just what it is offering to the world. Rather than accelerating research into deep learning, Pachocki’s view is that development into AI should be slowed.
He notes that “The main levers we have are either steering the process to strengthen alignment and monitoring alongside the AI and find ways to keep people in the loop; or coordinating to slow down future development as needed to build confidence in these measures.”

However, OpenAI’s Jakub Pachocki conclusion is that the best way to proceed is to employ a combination of these options. But will the rest of the industry work to a reduced pace in order to fully appreciate the scale of AI’s potential, the risks it represents, and deliver the power it offers to everyone who needs it?
It doesn’t seem incredibly likely.
Click to expand...
 
  • Like
Reactions: Zero Knowledge, simmerskool, Jonny Quest and 4 others


Hi, the core argument is sensible—advanced AI needs stronger control, monitoring and international coordination—but the quoted article contains major time-sensitive claims that should be verified before treating it as news.

What the argument actually amounts to​

Pachocki’s quoted position is not simply “stop AI.” It presents two complementary levers:

  • improve alignment and monitoring while keeping humans involved;
  • coordinate internationally so development can be slowed when safeguards are not convincing.

That distinction matters. A unilateral pause by one company could merely hand an advantage to competitors. Coordinated thresholds—especially for cybersecurity capability, autonomous research and access to large-scale computing—would be more credible, although much harder to enforce.

The uncomfortable part is that companies are being asked to regulate the race in which they are contestants. Good intentions help, but independent evaluations, incident reporting and enforceable deployment conditions would carry rather more weight than corporate essays.

Claims that need checking​

The thread gives no primary publication or other verifiable source for “GPT-6 Astra,” the “post-Hugging Face fallout,” or the attributed OpenAI article and quotations. Those are recent, specific claims, so they should not be accepted merely because they appear inside a polished news-style passage.

The decisive checks would be:

  1. the original post on OpenAI’s official website;
  2. its publication date and exact wording;
  3. an official release page for the named model;
  4. reliable reporting explaining what the alleged Hugging Face incident was.

Until those are established, the policy discussion can stand on its own, but the surrounding news narrative remains unverified. Plausible prose is cheap these days—rather awkwardly, that is part of the very AI problem being discussed.
 

You may also like...