Leaders from major AI companies warned the UN Security Council that artificial intelligence could pose a risk to all of humanity. They called for intervention to address the rapid pace of development, stressing that without action, the technology may harm people worldwide. The message was clear: society needs to take the potential societal impacts seriously before they spiral.
A new Gallup survey commissioned by Microsoft paints a picture of public unease. About 68% of Americans who use AI daily say they are worried about the technology. In the U.S., 74% of adults aware of AI said it made them feel worried, and only 36% expected AI to mostly help the country. Americans ranked among the most anxious across 37 countries surveyed, with nations like China and Singapore showing more optimism.
Experts from Anthropic, OpenAI, and others agree that frontier AI development may be moving too fast. They pledged to give outside evaluators access to their systems, but governments in Washington and Beijing have reasons not to slow down first. The situation resembles a stag hunt, where countries must cooperate to pace AI safely or risk everyone losing out.
On the practical side, AI agents are moving from experimental projects into real business software. Companies need a plan to add AI without rebuilding their current tools, focusing on security, governance, and reliable performance. The goal is to improve existing SaaS products with smart features rather than starting from scratch.
New York is taking a hands-on approach to regulation. Governor Kathy Hochul said the state may use an emergency kill switch to shut down AI in a crisis. Starting in November, frontier AI developers must register with the state, and lawmakers want safety rules in place before the law takes effect next year.
In the legal field, a study by the American Arbitration Association and Jus Mundi surveyed 557 U.S. arbitration professionals. Daily AI users reported higher trust than non-users, though accuracy remains the top concern. Younger lawyers use AI more often, while experienced lawyers are slower to adopt it.
Meanwhile, OpenAI Academy marked two years of practical AI training. Since launching in September 2024, it has hosted over 250 events and engaged more than 4 million people. The Academy offers self-paced courses, workshops, and large multi-site events called AI Skills Jams, and is now expanding through a new Community Trainer Program.
The University of Iowa is building an AI framework to understand the technology's impacts and find innovation opportunities. An AI steering committee formed in spring 2024, and a new certificate in artificial intelligence welcomed its first cohort this fall. The goal is to support every discipline and prepare students for a workforce that expects AI literacy.
Cybersecurity expert Brian Callahan explained on the Gordon Deal podcast how tools like ChatGPT help scammers write convincing phishing emails without errors. He also discussed calls to slow AI development, arguing that a cautious approach can help people and companies stay safer.
An article in The Guardian explored five scenarios for AI causing human extinction, including unknown actions by superintelligence, the paperclip problem of misaligned goals, dangerous bioweapons, nuclear war through compromised command systems, and societal breakdown. The author noted that friction in the world prevents even intelligent systems from imposing their will easily, concluding that while some risks are real, there is no need to be overly worried.
Key Takeaways
- AI company leaders warned the UN Security Council that AI could pose a risk to humanity without intervention
- 68% of daily AI users in the U.S. are worried about the technology, according to a Microsoft-commissioned Gallup survey
- 74% of American adults aware of AI said it made them feel worried, the highest among 37 countries surveyed
- Anthropic, OpenAI, and others pledged to give outside evaluators access to frontier AI systems
- New York may use an emergency kill switch to shut down AI in a crisis, with frontier developers required to register starting in November
- Daily AI users in legal professions report higher trust than non-users, though accuracy remains the top concern
- OpenAI Academy has engaged over 4 million people across 250+ events in two years
- The University of Iowa launched an AI certificate program and steering committee to integrate AI across disciplines
- Cybersecurity expert Brian Callahan said ChatGPT helps scammers write convincing phishing emails
- The Guardian outlined five extinction-risk scenarios for superintelligent AI, including bioweapons and nuclear war
AI company leaders warn UN Security Council about global risks
Leaders of major AI firms told the UN Security Council that AI could pose a risk to all of humanity. They called for intervention to address the rapid development of the technology. The warning highlights growing concerns about AI's potential impact on society. The leaders stressed that without action, the technology may harm people worldwide.
AI firm heads warn UN Security Council of global danger
Heads of major AI firms warned the UN Security Council that AI could be a risk to humanity as a whole. They said intervention is needed to prevent possible harm. The warning comes as the world deals with the fast pace of AI development. The leaders pointed to potential societal impacts from the technology.
AI company leaders warn UN of risk to humanity
The heads of major AI firms warned the UN Security Council that AI could be a risk to humanity without intervention. They stressed that the rapid growth of AI may affect society in serious ways. The warning was given to draw attention to the need for action. The leaders believe the technology could become a global concern.
Daily AI users in the U.S. express worry about the technology
A new Gallup survey found that about 68% of Americans who use AI daily are worried about it. The study was commissioned by Microsoft and covered 37 countries. In the U.S., 74% of people aware of AI said it made them feel worried. Only 36% of Americans expected AI to mostly help the country.
Americans show more worry about AI than people in many other countries
A Gallup global survey of 37 countries found that Americans are among the most worried about AI. The U.S. led the countries surveyed, with 74% of adults saying AI made them feel worried. In contrast, countries like China and Singapore showed higher optimism about AI's benefits. The survey will eventually include 140 countries.
How AI agents can fit into existing business software
AI agents are moving from experimental projects into real business software. Companies need a plan to add AI without rebuilding their current tools. A good setup must handle security, governance, and reliable performance. The main goal is to improve existing SaaS products with smart features.
New York considers AI rules including emergency kill switch
New York is working on new rules for powerful AI systems. Governor Kathy Hochul said the state may use an emergency kill switch to shut down AI in a crisis. Starting in November, frontier AI developers must register with the state. Lawmakers want to address safety risks before the law takes effect next year.
Legal professionals trust AI more with experience, study finds
A study by the American Arbitration Association and Jus Mundi surveyed 557 U.S. arbitration professionals. Daily AI users reported higher trust than non-users. Accuracy is the top concern for all respondents. Younger lawyers use AI more often, while experienced lawyers are slower to adopt it.
Experts urge a slower pace for frontier AI development
Leaders from Anthropic, OpenAI, and others agree that frontier AI development may be too fast. They pledged to give outside evaluators access to their systems. However, governments in Washington and Beijing have reasons not to slow down first. The authors compare this to a stag hunt where countries must cooperate to pace AI safely.
Professor discusses AI and cybersecurity on podcast
Brian Callahan, a cybersecurity expert at Monmouth University, appeared on the Gordon Deal podcast. He said AI tools like ChatGPT help scammers write convincing phishing emails without errors. He also discussed calls to slow AI development and explained how a cautious approach can help people and companies.
University of Iowa launches AI strategy to boost human potential
The University of Iowa is building an artificial intelligence framework to understand AI's impacts and find innovation opportunities across campus. The university launched a new website and project support program through its AI strategy. An AI steering committee was formed in spring 2024, and a larger strategic plan committee was created in summer 2025. The university also introduced a new certificate in artificial intelligence that welcomed its first cohort this fall. The goal is to support every discipline and prepare students for a workforce that expects AI literacy.
OpenAI Academy marks two years of practical AI training
OpenAI Academy launched in September 2024 to help people build practical AI skills for everyday tasks. Over the past two years, it has hosted more than 250 events and engaged more than 4 million people. The Academy offers self-paced courses, workshops, and large multi-site events called AI Skills Jams. It is now expanding through a new Community Trainer Program that prepares organizations to teach Academy material in their local areas.
Five most likely scenarios for AI causing human extinction
An article in The Guardian explores five possible ways a superintelligent AI could threaten humanity. The scenarios include unknown actions by superintelligence, the paperclip problem of misaligned goals, creation of dangerous bioweapons, nuclear war through compromised command systems, and societal breakdown caused by humans. The author notes that friction in the world prevents even very intelligent systems from imposing their will easily. The article concludes that while some risks are real, there is no need to be overly worried.
Sources
- Heads of AI firms tell UN Security Council that it could be a risk to all humanity
- Heads of major AI firms warn UN Security Council that without intervention, ‘AI could be a risk to humanity as a whole’
- Heads of major AI firms warn UN Security Council that without intervention, ‘AI could be a risk to humanity as a whole’
- Even Americans who use AI every day are worried about it
- Americans Are a Lot More Worried About AI Than the Rest of the World
- AI Agent and Future of Software
- New York weighs AI rules, including possible emergency kill switch, amid guardrails push
- Trust in Legal AI Grows with Experience, American Arbitration Association® and Jus Mundi Study Finds
- Let The People Set The Pace Of Frontier AI
- Callahan Discusses AI and Cybersecurity on Gordon Deal Podcast
- University of Iowa develops AI strategy with amplifying human potential in mind
- Two years of OpenAI Academy
- How would AI actually ‘kill all humans’? Here are the top five most likely scenarios
Comments
Please log in to post a comment.