OpenAI CEO Sam Altman is set to address an open UN Security Council meeting next week in New York, focusing on AI safety and international coordination. France convened the session, which will also highlight risks of losing control over advanced AI models. Representatives from Anthropic may also attend, though their participation has not been confirmed.
Meanwhile, former US Representative Patrick Murphy urges Washington to act on AI risks before powerful systems outrun government oversight. He points to an Anthropic employee who resigned over warnings that AI could lead to millions of deaths in a nuclear conflict. Murphy calls for enforcement of the FRONTIER Act, which covers risk management, audits, transparency, and incident reporting.
In corporate news, Manulife reports C$300 million in AI-driven value achieved by 2025, with a target of C$1 billion in cumulative value by 2027. The insurance company uses AI across underwriting, operations, distribution, wealth management, and fraud prevention, emphasizing responsible AI from design through deployment.
On the regulatory front, OpenAI's Sam Altman and Anthropic's Dario Amodei have both called for government regulation of AI. Critics argue this benefits large companies that can navigate complex rules while smaller firms struggle. Experts also warn that slowing innovation could hand an advantage to China in the global AI race.
Snowflake is hiring more junior engineers than ever, with this group making up 70% to 80% of current hiring. The company says coding agents make workers faster, but the real challenge lies in knowing what to build. In a separate development, the US military used a false AI-generated intelligence report about a Chinese ship during the Iran conflict, raising concerns about AI in life-or-death decisions.
Key Takeaways
- <ul><li>OpenAI CEO Sam Altman will address the UN Security Council on AI safety and international coordination next week in New York</li><li>France convened the meeting, which highlights risks of losing control over advanced AI models</li><li>Anthropic may also participate in the UN session, though attendance is unconfirmed</li><li>Patrick Murphy urges enforcement of the FRONTIER Act for AI risk management, audits, and transparency within six to twelve months</li><li>Manulife has achieved C$300 million in AI-driven value by 2025 and targets C$1 billion cumulatively by 2027</li><li>OpenAI's Sam Altman and Anthropic's Dario Amodei call for government AI regulation, drawing criticism that it favors large companies</li><li>Snowflake hires junior engineers for 70% to 80% of new positions, saying AI tools make them faster rather than replacing them</li><li>The US military used a fabricated AI-generated intelligence report about a Chinese ship during the Iran conflict</li><li>A new report urges the US to accelerate AI safety research rather than simply slowing development</li><li>Optiv warns that AI governance must not slow cyber defenses, noting attackers use tools like Anthropic's Claude Mythos immediately</li></ul>
OpenAI CEO Sam Altman to address UN Security Council on AI safety
OpenAI CEO Sam Altman will personally brief an open UN Security Council meeting next week in New York. He will discuss AI safety measures, international coordination, and shared safety standards. The meeting was convened by France, which holds the presidency of the Security Council in September. France's Minister for Europe and Foreign Affairs Jean-Noël Barrot will chair the meeting. The UN Security Council first considered AI risks in 2023.
Sam Altman to address UN Security Council on AI risks and global safety
OpenAI CEO Sam Altman will personally address an open UN Security Council meeting next week dedicated to artificial intelligence and international security. The meeting is scheduled for Wednesday during the annual gathering of world leaders in New York. Altman is expected to speak about the need for international coordination in AI and shared safety standards. Representatives of Anthropic may also participate, though their attendance has not been confirmed. France convened the meeting and highlights the risks of losing control over advanced AI models.
Patrick Murphy urges Washington to act on AI risks before it is too late
Patrick Murphy, a former US Representative, argues that Washington must establish guardrails for artificial intelligence before powerful systems outrun government oversight. He references Anthropic employee Jacob Coxon, who resigned over warnings that AI could lead to millions of deaths in a nuclear war. Murphy calls for enforcement of the FRONTIER Act, introduced by Reps. Jay Obernolte and Lori Trahan, which covers risk management, audits, transparency, and incident reporting. He urges real penalties and a deadline of six to 12 months for major labs to build a verifiable safety framework.
Manulife uses data and AI to transform life insurance business
Manulife is undergoing a major data and AI transformation led by Global Chief AI Officer Jodie Wallis. The company has achieved C$300 million in AI-driven value by 2025 and targets C$1 billion in cumulative value by 2027 through efficiencies, revenue growth, and fraud prevention. AI is actively used in underwriting, operations, distribution, wealth management, and developer productivity. Manulife emphasizes responsible AI embedded from design to deployment and fosters an AI-driven culture through training and leadership engagement.
Anthropic establishes biological lab amid fears over advanced AI development
Anthropic, founded by former Google researcher Dario Amodei, has established a biological lab focused on developing a new type of artificial intelligence. The lab has sparked both excitement and concern among experts. Some worry it could lead to superintelligent machines that threaten humanity, while others believe it could lead to breakthroughs in medicine and energy. The lab's work is still in its early stages, and the public continues to watch closely as AI development fears grow.
US military faces danger after AI creates false intelligence report
The US military had a close call when AI generated a false intelligence report about a Chinese ship during the Iran war. The information was completely made up, but military officials used it to make decisions. Experts say this shows the risks of letting AI make life-or-death choices. The incident is still under investigation and raises concerns about AI use in the military.
Snowflake hires more junior engineers despite AI fears
Many people believed AI would replace junior engineers, but Snowflake is hiring more of them than ever. Junior engineers make up 70% to 80% of the company's current hiring. Snowflake says that coding agents make workers faster, but the hard part is knowing what to build and solving the right problems. The company believes junior engineers bring valuable skills from day one.
AI leaders call for regulation but critics warn it helps big companies
Several top AI leaders, including OpenAI CEO Sam Altman and Anthropic CEO Dario Amodei, have called for government regulation of AI. Critics say this is a strategy to make it harder for smaller companies to compete. Regulation creates complex rules that big companies can handle but small companies cannot. Experts warn that slowing AI innovation could give China an advantage in the global AI race.
Optiv CISO says AI governance must not slow cyber defense
Rob Gregory, Optiv's chief security officer, says companies need AI governance but should not let it slow down their cyber defenses. He says hackers use the newest AI tools right away without any rules, while businesses must go through approval processes. Attackers can immediately use tools like Anthropic's Claude Mythos model. Gregory says defenses must adapt as fast as threats, or traditional security will fall behind.
US should speed up AI safety research, not just slow AI down
A new report says the US should focus on speeding up AI safety research instead of just trying to slow AI development. Safety research gets a tiny share of the trillions spent on AI, even though risks are growing. The report suggests using the existing National AI Initiative to fund more alignment research. It also calls for flexible governance and more diverse approaches to solve the AI alignment problem.
Sources
- OpenAI’s Sam Altman to brief UN Security Council next week: Reuters exclusive
- Sam Altman Will Address UN Security Council on AI Risks and Global Safety
- Patrick Murphy: Could AI kill us all? Washington needs to act
- How Data And AI Are Transforming The Life Insurance Business At Manulife
- Anthropic Establishes Biological Lab as Public Grapples with Apocalyptic AI-Development Fears
- Exclusive: US military had close call after using AI for false intelligence report, sources say
- Everyone thought AI would replace junior engineers. We’re hiring more of them
- Big AI is begging to be regulated. That should worry you.
- AI Governance Is Key—But Don’t Let It Slow Down Cyber Defense: Optiv CISO
- Washington Wants To Win The AI Race—Is It Accelerating AI Safety?
Comments
Please log in to post a comment.