Anthropic's Coxon Warns of AI Risk as Company Raises $65B

AI researcher Jacob Coxon resigned from Anthropic after four months, citing fears that both Anthropic and OpenAI are racing to build self-improving systems that could become uncontrollable. Coxon, who previously worked at OpenAI for three years, warned on social media that these technologies pose an existential risk, potentially leading to superhuman systems capable of hacking anything. He stated the companies are prioritizing speed over safety, a move he believes gambles with human lives.

Following his departure, Coxon forfeited his unvested equity to emphasize his stance. His post on X garnered over 100 million views, drawing support from figures like Evan Hubinger, who estimates a greater than 10% chance of AI killing all humans within the next decade. Meanwhile, Anthropic remains highly valued at $965 billion, having recently raised $65 billion from investors including Sequoia Capital and Altimeter Capital.

Concerns about AI safety extend beyond major tech firms. In Florida, Attorney General James Uthmeier is investigating AI platforms for practicing medicine without a license, fearing inaccurate health advice could harm patients. Despite this, about one-third of Americans currently use conversational AI for medical information or self-diagnosis, according to the Pew Research Center.

Other sectors are also integrating AI rapidly. Davidson schools are testing AI systems designed to detect weapons in hallways, marking an early step in using such technology for security. Simultaneously, Apple is preparing to launch iOS 27, which features a completely redesigned Siri with a more conversational tone and improved natural language processing to enhance user interactions.

Looking at the broader economic impact, Anthropic created a tool modeling how AI adoption could reshape the economy by 2030. In an extreme scenario where AI performs nearly one-third of all tasks, output could increase by 32%, but unemployment might rise toward 12% with white-collar jobs dropping by over 20%. Conversely, the Bank of Korea warns that global AI investment growth will peak this year before slowing, citing risks like uncertain profits and heavy reliance on outside funding.

Corporate strategies continue to evolve to manage these shifts. Splunk is updating its platform to help organizations turn machine data into actions and defend against threats at machine speed, integrating with Cisco solutions to secure AI interactions. In the logistics sector, JD.com announced a five-year plan to acquire 3 million robots, 1 million autonomous vehicles, and 100,000 delivery drones, utilizing Meta Brain 3.0 to calculate optimal routes for millions of parcels in seconds.

Key Takeaways

  • Jacob Coxon resigned from Anthropic after four months, warning that both Anthropic and OpenAI are prioritizing speed over safety in developing self-improving AI.
  • Coxon forfeited his unvested equity and posted on X, which received over 100 million views, highlighting fears of existential risk from superhuman AI systems.
  • Anthropic is valued at $965 billion and recently raised $65 billion from investors like Sequoia Capital and Altimeter Capital despite safety concerns.
  • Florida Attorney General James Uthmeier is investigating AI platforms for practicing medicine without a license due to risks of inaccurate health advice.
  • About one-third of Americans use conversational AI for medical information or self-diagnosis, according to the Pew Research Center.
  • Davidson schools are testing AI systems designed to detect weapons in hallways as an early step in using AI for security.
  • Apple is launching iOS 27 with a redesigned Siri featuring a more conversational tone and improved natural language processing.
  • Anthropic's economic modeling suggests an extreme AI adoption scenario could increase output by 32% while pushing unemployment toward 12% by 2030.
  • The Bank of Korea predicts global AI investment growth will peak this year before slowing, comparing Nvidia's credit practices to the 1990s dot-com bubble.
  • JD.com plans to acquire 3 million robots, 1 million autonomous vehicles, and 100,000 delivery drones over five years, using Meta Brain 3.0 for logistics optimization.

Anthropic researcher quits over AI safety fears

Jacob Coxon resigned from Anthropic after working there for four months and previously at OpenAI for three years. He warned that both companies are racing to create self-improving AI systems that could become too powerful for humans to control. Coxon stated on social media that these technologies pose an existential risk to humanity and could lead to superhuman systems capable of hacking anything. He believes the companies are gambling with lives by prioritizing speed over safety in their pursuit of superintelligence.

AI researcher resigns warning of global danger

Jacob Coxon left his job at Anthropic because he fears artificial intelligence is moving too fast and endangering everyone. He explained that he worked on pre-training models at both OpenAI and Anthropic over the last three years and found neither company acting responsibly. Coxon warned that soon AI systems will be able to hack any system, revolutionize fields overnight, and acquire real power and resources. He believes many executives hide their true fears in public to appear reasonable while privately acknowledging the threat to civilization.

Anthropic researcher forfeits equity to quit and warn

Jacob Coxon resigned from Anthropic and gave up his unvested equity because he believes the company is gambling with human lives. He spent three years researching AI models at OpenAI and Anthropic before leaving, accusing both firms of moving too aggressively toward self-improving superintelligence. His post on X received over 100 million views and drew support from Evan Hubinger, who estimates the chance of AI killing all humans within the next decade is above 10%. Anthropic is currently valued at $965 billion and recently raised $65 billion from investors like Sequoia Capital and Altimeter Capital.

Davidson schools test AI weapons detection systems

Davidson schools are currently testing artificial intelligence systems designed to detect weapons in hallways. A video of the test showed the AI system drawing rectangles around humans and around a gun carried by an officer. This marks an early step in using AI technology for security purposes within the school district.

Florida investigates AI doctors for unlicensed practice

Florida Attorney General James Uthmeier asked the Board of Medicine to investigate AI platforms for practicing medicine without a license. Officials worry that inaccurate health advice from these tools could harm patients who trust them too much. Commissioner Mark Glass warned that automated guidance might suggest dangerous drug combinations that counteract existing prescriptions. Despite these risks, about one-third of Americans use conversational AI for medical information or self-diagnosis according to Pew Research Center.

Bank of Korea warns AI investment growth will peak this year

The Bank of Korea released a report stating that global AI investment growth will reach its highest point this year before slowing down next year. Bank of America predicts growth will drop from 79% this year to 38% next year, while Bloomberg Intelligence forecasts a fall from 95% to 39%. The bank identified three main risks: uncertain profits for AI companies, heavy reliance on outside funding, and financial dangers from vendor financing. The report compared Nvidia's credit practices to the 1990s dot-com bubble, warning that credit losses could happen all at once if financial conditions worsen.

Anthropic models how AI could reshape the economy by 2030

Anthropic created a new tool to show how different levels of AI adoption could change the economy, GDP, and unemployment rates by 2030. In a modest scenario where AI handles 4% of tasks, the economy grows by 1.6% with little change to jobs. A substantial scenario where AI takes 12% of tasks would boost GDP by 8.3% but raise unemployment to 4.6%. The extreme scenario, where AI performs nearly one-third of all tasks, could increase output by 32% while pushing unemployment toward 12% and dropping white-collar jobs by over 20%.

Splunk helps organizations manage data and security in the AI era

Splunk is updating its platform to help companies handle the challenges and opportunities of artificial intelligence. The company focuses on three main goals: turning machine data into actions, defending against threats at machine speed, and optimizing AI costs. Splunk integrates with Cisco solutions to break down data silos and provides tools to secure and govern AI interactions. This approach allows security teams to use AI agents effectively while maintaining trust and control over their digital systems.

Apple introduces new conversational features for Siri in iOS 27

Apple is preparing to launch iOS 27 with a completely redesigned version of its Siri virtual assistant. The new interface will use a more conversational tone and improved natural language processing to make interactions feel more natural. These updates are designed to make the assistant more useful and intuitive for iPhone users. While specific new features were not fully detailed, the focus is on enhancing how users talk to and interact with the AI.

JD.com plans to deploy 3 million robots and drones for logistics

JD.com announced a five-year plan to acquire 3 million robots, 1 million autonomous vehicles, and 100,000 delivery drones for its logistics network. The company launched this Physical AI Acceleration Plan at JDDiscovery 2026 in Beijing and unveiled its new industrial Wolf Robot series. JD Logistics already operates a vast network of over 36 million square meters of warehouses and uses Meta Brain 3.0 to calculate optimal routes for millions of parcels in seconds. The company is also expanding night-time autonomous delivery routes and drone networks in rural areas like Zizhong, Sichuan province.

Sources

NOTE:

This news brief was generated using AI technology (including, but not limited to, Google Gemini API, Llama, Grok, and Mistral) from aggregated news articles, with minimal to no human editing/review. It is provided for informational purposes only and may contain inaccuracies or biases. This is not financial, investment, or professional advice. If you have any questions or concerns, please verify all information with the linked original articles in the Sources section below.

AI Safety Existential Risk Superintelligence AI Race Anthropic OpenAI AI Ethics AI Regulation AI Weapons Detection AI in Education AI in Healthcare AI Investment AI Economy AI by 2030 AI Security AI Governance AI Conversational Features AI Robots AI Drones AI Logistics

Comments

Loading...