Global leaders and AI executives are clashing over how to regulate artificial intelligence as it advances faster than governments can keep up. At the UN General Assembly in New York City, CEOs from OpenAI, Anthropic, and Hugging Face addressed the UN Security Council, urging international cooperation on AI guardrails. Anthropic CEO Dario Amodei warned that poorly managed AI could threaten humanity, while OpenAI's Sam Altman said decisions cannot be left to labs in San Francisco alone. This came just days after President Trump rejected any global control scheme on AI during his assembly speech.
Twenty-two countries led by Finland and Norway signed a declaration on AI security, but the US and China stayed out. UN Secretary-General Guterres emphasized that nations with the greatest AI capabilities carry the greatest responsibilities. Meanwhile, US lawmakers introduced a bill that would ban artificial superintelligence and create a federal agency to monitor AI systems. Representative Greg Casar said the AI arms race is not a race you win, while Trump dismissed global cooperation during Chinese President Xi Jinping's visit.
On the industry side, Nvidia CEO Jensen Huang said AI labs that cannot contain their models should shut down, comparing unsafe AI to an untested robotaxi that should never be deployed. Philosopher Nick Bostrom took a different view, arguing superintelligence could still be worth pursuing even with a very high catastrophe risk, as long as it stays below about 97%. Amandeep Singh Gill, the UN Special Envoy for Digital and Emerging Technologies, called the current moment an extraordinary opportunity to set global AI standards.
Beyond policy debates, AI is already making real-world impacts. In healthcare, it speeds up drug discovery, helps doctors read CT scans and MRIs, and improves surgical robots. At the University of Florida, President Stuart Bell highlighted an AI initiative for elementary literacy and personalized medicine using mRNA vaccines. On the security front, Proofpoint launched new agentic security systems built on knowledge graphs, with its annual recurring revenue nearing $2.5 billion and growing nearly 20 percent. A Henderson, Tennessee student faces charges for using AI to generate explicit images of classmates, reflecting a growing problem as the National Center for Missing and Exploited Children reported over 180,000 AI-related child exploitation cases in 2025.
Key Takeaways
- OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei warned the UN Security Council that AI must remain under human control and needs global oversight.
- President Trump rejected any global AI governance framework during his UN General Assembly speech, while 22 countries led by Finland and Norway signed an AI security declaration without the US or China.
- US lawmakers introduced a bill to ban artificial superintelligence and create a cabinet-level federal agency to monitor AI systems.
- Nvidia CEO Jensen Huang said AI labs that cannot contain their models should shut down and should spend more on testing than building.
- Philosopher Nick Bostrom argued superintelligence could be worth pursuing even with up to a 97% extinction risk, citing potential medical breakthroughs.
- UN Special Envoy Amandeep Singh Gill called the current moment an extraordinary opportunity to set global AI standards.
- AI is already helping healthcare through faster drug discovery, improved diagnostics, and surgical robots, though it remains a research tool rather than a full clinical solution.
- Proofpoint launched intent-based agentic security models across Flash, Extended-Thinking, and Deep-Thinking tiers, with annual recurring revenue nearing $2.5 billion.
- A South Middle School student in Henderson, Tennessee faces charges for using AI to create explicit images of classmates, as the NCMEC reported over 180,000 AI-related child exploitation cases in 2025.
- University of Florida President Stuart Bell highlighted AI initiatives for elementary literacy and personalized medicine using mRNA vaccines.
World pursues AI security without US participation
Global governments are pushing for AI protections at the UN General Assembly but face challenges without US involvement. President Trump rejected any global control scheme on AI during his assembly speech. Twenty-two countries led by Finland and Norway signed a declaration on AI security, but the US and China did not join. UN Secretary-General Guterres stated that countries with the greatest AI capabilities have the greatest responsibilities to humanity.
AI CEOs urge UN Security Council for global regulation
Leaders of major AI companies told the UN Security Council that the industry needs global oversight to prevent worldwide dangers. Anthropic CEO Dario Amodei warned that poorly managed AI could threaten humanity as a whole. OpenAI CEO Sam Altman said important AI decisions cannot be made by labs in San Francisco alone. The meeting was convened by France during the UN General Assembly gathering in New York City.
OpenAI and Anthropic CEOs warn of AI catastrophe risks
OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei warned the UN Security Council that AI must remain under human control. They urged countries to cooperate as the technology continues advancing rapidly. The meeting coincided with the UN General Assembly and featured executives from OpenAI, Anthropic and Hugging Face. Earlier this month Amodei published an essay urging the industry to slow frontier AI development, which drew support from Altman and Elon Musk.
Lawmakers seek ban on artificial superintelligence development
Some US lawmakers want restrictions on AI development to prevent models from going rogue. The Alliance for Secure AI said Representatives Greg Casar and Senator Bernie Sanders introduced a bill that would ban artificial superintelligence. The bill defines it as AI models with cognitive capabilities surpassing humans that could destroy humanity. It would also create a cabinet-level federal agency to monitor AI systems and pursue international agreements. Trump has dismissed global cooperation on AI during Chinese President Xi Jinping's visit.
Texas lawmakers introduce bill to restrict superintelligence
A new bill seeks to restrict the development of artificial superintelligence in the United States. The legislation would ban AI models with cognitive capabilities surpassing humans that have the ability to destroy humanity. Representative Greg Casar said the AI arms race is not a race you win. The bill would also create a federal agency to monitor AI and pursue international agreements. President Trump stated he will not stifle growth of the technology during his UN General Assembly address.
AI Executives Address UN Security Council on Rising Risks
Top AI company leaders met with the United Nations Security Council to warn about advanced AI systems that could outpace human control. Researchers and policymakers say AI is advancing faster than governments can write rules. President Donald Trump rejected a global AI governance framework the day before at the U.N. General Assembly.
Nvidia CEO Says Unsafe AI Labs Should Close
Jensen Huang said AI labs that cannot contain their models should shut down. He spoke on The Ezra Klein Show and rejected doomsday predictions as unscientific. Huang said labs should spend more on testing and less on building, and he compared unsafe AI to an untested robotaxi that should never be deployed.
Philosopher Says AI May Be Worth a 97% Extinction Risk
Philosopher Nick Bostrom said superintelligence could still be worth pursuing even with a very high risk of catastrophe. He noted that about 170,000 people die daily from disease and aging, and AI could speed up medical breakthroughs. He calculated that AI development makes sense as long as the extinction risk stays below about 97%.
UN Tech Envoy Sees Window for Global AI Standards
Amandeep Singh Gill, the UN Special Envoy for Digital and Emerging Technologies, discussed the importance of regulating artificial intelligence. He called the current moment an extraordinary opportunity to set global AI standards. He spoke as tech CEOs urged international cooperation on AI guardrails.
Henderson Student Charged Over AI-Generated Explicit Images
A South Middle School student in Henderson faces charges for using AI to create explicit images of classmates. Police said the student placed other juveniles' faces on different bodies and showed the images to other students. The National Center for Missing and Exploited Children reported over 180,000 AI-related child exploitation cases in 2025.
AI is making a real difference in healthcare
Artificial intelligence is already helping healthcare in drug development and diagnostics. AI speeds up drug discovery and helps doctors spot problems in CT scans and MRIs. Surgical robots are also improving through better perception and decision-making. Experts say precision oncology and life science tools are promising areas for investors. Still, AI remains a research tool rather than a full clinical solution.
UF President Bell discusses NIL and AI at breakfast
University of Florida President Stuart Bell spoke about NIL, AI, and his move to Gainesville. He called for better guidance to protect student-athletes in the NIL era. Bell highlighted an AI initiative for elementary literacy and personalized medicine using mRNA vaccines. He also noted that only two of UF's 21 Division I sports fund the other 19 programs.
Proofpoint focuses on AI agent security at 2026 event
Proofpoint introduced new agentic security systems built on knowledge graphs that track intent. The company launched intent-based models in its Nexus detection suite across Flash, Extended-Thinking, and Deep-Thinking tiers. Anthropic urged enterprises to engineer for trust before scaling AI agents. Proofpoint's annual recurring revenue nears $2.5 billion and is growing nearly 20 percent.
Sources
- The world wants to secure AI. It may have to try without the US.
- AI corporate leaders tell UN the industry needs global regulation
- Anthropic, OpenAI CEOs warn AI could threaten humanity without safeguards
- Bill seeks to restrict development of artificial superintelligence
- Bill seeks to restrict development of artificial superintelligence
- AI Leaders Brief United Nations Amid Rising Alarm Over Powerful Technology
- Jensen Huang warned that AI labs unable to contain their models should shut down
- Even at 97% extinction risk, philosopher says AI could be worth it
- UN Tech Envoy: ‘Extraordinary window of opportunity’ to set global AI standards
- Henderson Student Charged for AI-Generated Explicit Images
- Artificial Intelligence Having a Real Impact on Healthcare
- At breakfast, Bell talks NIL, AI and life as UF's new president
- Proofpoint Protect 2026: 8 insights on AI agent security
Comments
Please log in to post a comment.