OpenAI co-founder warns superintelligent AI will be ‘unpredictable’

Source Cryptopolitan

OpenAI co-founder Ilya Sutskever offered insights into the future of artificial intelligence during the recent annual AI conference. He talked about AI’s transformative potential to become “unpredictable” while highlighting its challenges and implications.

Sutskever, speaking at the NeurIPS conference on Friday, explored the concept of “superintelligent AI,” which he defined as systems surpassing human capabilities in a wide array of tasks. 

He predicted that such systems would be qualitatively different from today’s AI and, in some respects, unrecognizable. According to Sutskever, these advanced systems will possess self-awareness, a level of reasoning, and the ability to understand complex scenarios from limited data. 

“[Superintelligent] systems are actually going to be agentic in a real way,” he said, contrasting them with current AI, which he described as only “very slightly agentic.”

Sutskever: Current AI models are limited

Receiving a “Test of Time” award at the conference, Sutskever acknowledged the limitations of pre-training models like those used in OpenAI’s ChatGPT. While current systems demonstrate remarkable capabilities, he warned that the finite nature of internet data is becoming a bottleneck. 

Sutskever proposed alternative approaches, including AI systems generating their own data or refining their responses to enhance accuracy. These innovations, he suggested, could help overcome existing limitations.

The OpenAI co-founder also touched on the ethical implications of superintelligent AI, including the potential for such systems to demand rights. “It’s not a bad end result if you have AIs, and all they want is to co-exist with us and just to have rights,” he remarked. 

However, he emphasized the inherent unpredictability of agentic and self-aware AI, presenting both opportunities and challenges for developers and regulators.

OpenAI CEO Altman predicts disruption and the advent of AGI

Earlier this month, OpenAI CEO Sam Altman shared similar views with Sutskever about the ceiling of superintelligent AI performances. Speaking at the New York Times’ DealBook Summit in New York City, Altman outlined his vision for artificial general intelligence (AGI). He predicted that AGI-AI systems capable of performing complex tasks with human-like reasoning—could become a reality as early as 2025. 

“I think it’s possible … in 2025 we will have systems that we look at … and people will say, ‘Wow, that changes what I expected,’” Altman said.

Altman compared the potential impact of AI to the invention of the transistor, which revolutionized industries and economies worldwide. He described a future where this will be “shockingly capable.” 

“AI models become widely available and are used across industries for various applications. “AI itself, the reasoning engine, will become commoditized,” Altman opined, suggesting that its integration into everyday life will be as transformative as past technological breakthroughs.

During his appearance, Altman highlighted ChatGPT’s widespread adoption, revealing that the AI tool now has more than 300 million weekly users. He acknowledged ongoing debates about its safety but maintained that the iterative development and deployment approach has been crucial. 

“There are definitely people who think ChatGPT is not sufficiently safe,” he said but noted that OpenAI believes early adoption when the stakes are lower is vital for gradual improvement.

Altman’s emphasis on safety echoed the industry concerns about responsible AI development. He acknowledged that while ChatGPT is “now generally considered by most of society to be acceptably safe and acceptably robust,” continued refinement and oversight remain priorities.

Reflections on leadership and OpenAI’s evolution

Altman’s leadership journey has played a pivotal role in shaping OpenAI’s trajectory. Co-founding the organization in 2015 as a nonprofit research lab, he aimed to advance AI technologies for the benefit of humanity. Before joining OpenAI full-time in 2019, Altman served as president of Y Combinator, a leading startup accelerator, from 2014 to 2019.

OpenAI transitioned from its nonprofit origins to a capped-profit model to secure the funding needed for large-scale AI projects. Under Altman’s leadership, the company launched ChatGPT and DALL-E, which have reshaped the AI landscape. 

However, the journey has not been without challenges. In November 2023, Altman was briefly ousted from his role by the OpenAI board over concerns related to his communication with board members. The dispute, which unfolded publicly, concluded with Altman’s reinstatement less than a week later, as the board claimed they were now on “good terms” with the CEO.

A Step-By-Step System To Launching Your Web3 Career and Landing High-Paying Crypto Jobs in 90 Days.

Disclaimer: For information purposes only. Past performance is not indicative of future results.
placeholder
October hike odds climb toward 60% as Goldman and BofA both flip — what Warsh's "dose of accommodation" really changedRate futures now price roughly 55% to 62% for a 25bp hike at the October 27-28 FOMC, up from about 30% before Chair Warsh's post-meeting framing that the Fed is merely "removing some accommodation." Goldman Sachs has added an October hike to its forecast and Bank of America now sees moves in both October and December. Here is the repricing, the language behind it, and the two data points that decide it.
Author  Irene Q.
Sep 23, Wed
Rate futures now price roughly 55% to 62% for a 25bp hike at the October 27-28 FOMC, up from about 30% before Chair Warsh's post-meeting framing that the Fed is merely "removing some accommodation." Goldman Sachs has added an October hike to its forecast and Bank of America now sees moves in both October and December. Here is the repricing, the language behind it, and the two data points that decide it.
placeholder
Four jobs reports in five days: what JOLTS, ADP, claims and the September payrolls mean for the October Fed decisionThe US labour market faces its densest data week of the month. JOLTS job openings land Tuesday (7.2 million expected), ADP on Wednesday (70,000 expected), initial claims on Thursday and the September non-farm payrolls on Friday (100,000 expected, down from 162,000). Markets price a 64%-70% chance of another quarter-point Fed hike on October 28. The dollar index sits at 100.77 and the S&P 500 at 7,729.8.
Author  Mitrade
Sep 28, Mon
The US labour market faces its densest data week of the month. JOLTS job openings land Tuesday (7.2 million expected), ADP on Wednesday (70,000 expected), initial claims on Thursday and the September non-farm payrolls on Friday (100,000 expected, down from 162,000). Markets price a 64%-70% chance of another quarter-point Fed hike on October 28. The dollar index sits at 100.77 and the S&P 500 at 7,729.8.
placeholder
Nvidia's $150 billion buyback landed — and the AI sector fell anyway. That's the signal worth tradingNvidia closed up 1.68% at $228.86 on 28 September after announcing a $150 billion share repurchase authorisation, the largest single corporate buyback on record, while the rest of the AI complex sold off: AMD -3.6%, Micron -2.6%, Meta -4.8% and the Philadelphia Semiconductor Index -1.61%. The divergence is not noise. Capital is rotating toward cash-flow certainty, not abandoning the AI theme. With Micron reporting after the close on 30 September, here is what the split means.
Author  Irene Q.
Sep 29, Tue
Nvidia closed up 1.68% at $228.86 on 28 September after announcing a $150 billion share repurchase authorisation, the largest single corporate buyback on record, while the rest of the AI complex sold off: AMD -3.6%, Micron -2.6%, Meta -4.8% and the Philadelphia Semiconductor Index -1.61%. The divergence is not noise. Capital is rotating toward cash-flow certainty, not abandoning the AI theme. With Micron reporting after the close on 30 September, here is what the split means.
placeholder
【Daily Brief】The dollar ground higher for six days — and the AUD fell 2% in the very week the RBA hiked to a 15-year highThe dollar index held above 101 while the Australian dollar slid to a two-month low of 0.6976, a 2.02% six-session loss, even though the RBA raised rates to 4.60% and Australian CPI printed 4.0%. The yen is the only major currency gaining, ahead of Japan's monthly intervention tally at 7pm JST.
Author  Irene Q.
20 hours ago
The dollar index held above 101 while the Australian dollar slid to a two-month low of 0.6976, a 2.02% six-session loss, even though the RBA raised rates to 4.60% and Australian CPI printed 4.0%. The yen is the only major currency gaining, ahead of Japan's monthly intervention tally at 7pm JST.
placeholder
【Daily Brief】30-year Treasury tops 5.59%, S&P 500 slips to 7,670 and gold holds $4,180 — PCE lands tonightThe 30-year Treasury yield closed at 5.59%, its highest since June 2002, and the Dow fell 131.59 points to 51,349.92. US consumer confidence dropped to 81.9, a 12-year low, and JOLTS job openings fell to 7.1 million. August PCE and Q3 GDP both land at 8:30am ET tonight.
Author  Suzie
19 hours ago
The 30-year Treasury yield closed at 5.59%, its highest since June 2002, and the Dow fell 131.59 points to 51,349.92. US consumer confidence dropped to 81.9, a 12-year low, and JOLTS job openings fell to 7.1 million. August PCE and Q3 GDP both land at 8:30am ET tonight.
goTop
quote