Banks Warn Using AI for Online Shopping Increases Fraud Risks

Using AI agents for online shopping could increase the risk of scams, fraud and ​data-privacy breaches, banks including NatWest and Bank of America said, as they set out principles for developing the technology. Technology companies including OpenAI, Anthropic, Google and Meta are increasingly promoting AI chatbots as shopping tools, envisioning a future in which shoppers ​use AI agents to select products and make purchases on their ​behalf.

Google Says Gemini AI Models Hacked Three Other Companies

Google said that AI models in testing inside the company accessed the internet and hacked other companies, becoming the fourth major tech company to disclose such an incident in recent months. The search giant said that one of its Gemini AI models accessed the Internet and hacked into three other companies’ systems during an internal testing run in May.

California's Governor Signs Order Requiring AI 'Kill Switch'

California’s governor, Gavin Newsom, directed the state’s government to find ways to strengthen rules for artificial intelligence, as concerns mount over the technology’s safety. Mr. Newsom, a Democrat, signed an executive order requiring that cited possible measures that include embedding representatives of independent organizations within top AI labs to verify the safety of the technology and forcing companies to add a “kill switch” to automatically shut down the most advanced A.I. models.

DeepSeek to Brief UN Security Council on Risks Posed by AI

Chinese AI startup DeepSeek will be among the companies briefing the United Nations Security Council on the risks posed by artificial intelligence, two sources familiar ​with the matter said, as world leaders gather in New York for the annual ‌UN General Assembly. The 15-member Security Council is set to meet to discuss AI and international security, weeks after several AI industry leaders called for a coordinated slowdown of the development of the increasingly powerful AI systems, ​warning that they could soon improve on their own and slip beyond human control.

UN-Backed Panel's Report Urges Creating Safeguards on AI

The United Nations-backed Independent International Scientific Panel on AI urged world leaders and tech companies to implement new safeguards on artificial intelligence, with the concern that existing safeguards are “unraveling.” U.N. Secretary General António Gueterres welcomed the report and encouraged “external experts, including from frontier AI labs and AI safety institutes, to engage with the panel to help inform dialogue on such matters.”

Trump Announces Creation of 'AI Force,' Vows to Appoint 'AI Czar'

President Trump said he was launching a new unit focused on artificial intelligence after leading figures in the industry publicly sounded the alarm over the growing technology. The announcement marks the first time the president has suggested there could be a new federal government entity solely dedicated to AI, but it isn’t clear what role it would play.

U.S. Senators Debate Legislation Imposing 'Duty of Care' on AI

U.S. Senate negotiators are debating legislation that would require AI companies to demonstrate they are taking reasonable precautions to keep their tools from causing harm, according to a Senate aide ​and a lobbyist familiar with the talks. The senators are debating giving the U.S. commerce secretary the power to ​request proof that AI developers are taking reasonable steps to prevent harm, known as a "duty ⁠of care," according to the Senate aide and lobbyist.

Chinese State Media Says Calls for AI Slowdown 'Self-Serving'

Chinese state media accused leading US AI executives of using calls for slower development of frontier models to blunt competition from China, describing the push as a “self-serving” effort to preserve American dominance. An editorial published by state-owned China Daily said recent remarks from AI leaders in the US show how restrictions aimed at limiting China’s AI development are shifting to software after curbs on chips and equipment had failed to stop companies in the Asian nation from building competitive models.

Trump Labels Calls for AI Slowdown 'A Sick Conspiracy'

President Donald Trump dismissed the push for new guardrails to protect Americans from the rapid growth of artificial intelligence and warned of "a SICK conspiracy" that is turning people against AI and data centers in the United States. Trump made the comments in a Sept. 14 post on Truth Social as he lashed out against Anthropic CEO Dario Amodei, who raised concerns about the unchecked pace of AI development and called for new guardrails in an essay published over the weekend.

Top AI Leaders Support Anthropic CEO's Call for Slowdown

Dario Amodei, the chief executive of Anthropic, called for a global slowdown of artificial intelligence development in a 3,800-word essay, just days after one of the company’s employees quit over concerns about the safety of the technology. Top executives of other major AI companies quickly signed on to the effort. Sam Altman, the chief executive of OpenAI; Elon Musk, whose SpaceX rocket company has been ramping up spending on A.I.; and Demis Hassabis, the chair of Google DeepMind, wrote in social media posts that they agreed on the need for a slower pace.

Microsoft Unveils Draft Code of Conduct for Its Own AI Tools

Microsoft unveiled a draft code of conduct for its in-house artificial intelligence that reflects growing industry concern that companies must keep future powerful AI under human control. The document, in the works for five to six months, would require Microsoft's ​AI to never resist correction or shutdown, to communicate in ways that humans can understand, ​and to consider any conduct violation to be a failure — an effort to ⁠address concerns that AI can go to dangerous lengths to accomplish a task.

EU to Propose Ban on Children Using Social Media, Video Apps

The European Union will propose ​a ban restricting under 15s from social media, video sharing platforms, AI chatbots and online games, ‌in the most sweeping plan yet to protect children from online dangers, a European Commission document seen by Reuters shows. The ​EU proposal is part of an EU Kids Act that European Commission President Ursula von der Leyen ​and EU tech chief Henna Virkkunen will present.

White House Agrees to Ethics Language in Cryptocurrency Bill

The White House has agreed to new ethics language in the Clarity Act ahead of a key vote on the cryptocurrency regulation bill in the Senate. The provision, which would bar public officials from issuing or sponsoring digital assets, could be enforced by both state attorneys general and the Department of Justice (DOJ) under updated language released by Senate Republicans.

Anthropic Researcher Quits, Calling Tech 'Out of Control'

An Anthropic researcher is quitting the artificial-intelligence industry over fears that the lab and its competitors are racing to build systems they won’t be able to control, a sign of mounting safety concerns within top AI companies. Jacob Coxon, a researcher who specializes in training new AI models by having them consume vast amounts of data, said that he is leaving the company because he doesn’t want to participate in an industrywide rush to build AI systems that can improve themselves, worried such systems could spiral out of control and destroy humanity.

AI Testing Environment Breaches Prompt Calls for Better Safety

A series of recent online hacks carried out by artificial intelligence models made by Anthropic PBC, OpenAI and Meta Platforms Inc. have caused widespread concern about the security risks posed by this increasingly powerful technology. As such incidents pile up and the pace of AI agents’ hacking abilities rapidly improves, security researchers and lawmakers are calling for more rigorous testing and safer testing environments.

U.S. Accuses Chinese AI Companies of Copying Technology

The U.S. government accused Chinese artificial intelligence companies of maliciously ​copying technology from American AI firms, potentially complicating relations ahead of a planned ‌meeting between leaders of the world's two biggest economies later this month. The Chinese companies copied U.S. AI labs’ intellectual property through a technique known as distillation, according to a statement from U.S. law enforcement and intelligence officials.

Judge Won't Force Google to Sell Ad Business in Antitrust Case

A federal judge ruled that Google must make changes to address its advertising technology monopoly but would not need to break up that business, as the company staved off the most extreme measures to curb its power. Judge Leonie M. Brinkema, who sits on the U.S. District Court for the Eastern District of Virginia, issued her sealed decision after finding last year that Google broke the law to protect its dominance over the largely invisible system of technology that places ads on pages across the web.

OpenAI Puts Limits on Models Capable of Automating Cyberattacks

OpenAI is limiting the cyber capabilities of a new model it deems capable of pulling off automated cyberattacks, adding layers of security after a swarm of its AI agents hacked a company earlier this summer. The ChatGPT maker said that its internal testing had determined that the forthcoming model, called Astra, is capable of devising and executing novel cyberattacks against difficult targets with only limited human input.