Source : INDIA TODAY NEWS
The race to build ever-more powerful AI has brought three of the industry’s biggest names to an unexpected conclusion: the technology may need to slow down. Anthropic CEO Dario Amodei has urged AI companies to put the brakes on rapid capability gains, winning support from OpenAI CEO Sam Altman and xAI chief Elon Musk.
Amodei outlined a three-step framework in a lengthy essay shared on X on Saturday, arguing that AI companies need more time to strengthen safety measures as the capabilities of their models advance rapidly.
advertisement
THREE-STEP PLAN TO SLOW AI DEVELOPMENT
Amodei proposed embedding independent evaluators inside leading AI companies with employee-like access to verify safety practices. He also called for coordination among frontier AI firms to establish safety standards and prevent unchecked development, along with greater international cooperation to manage the risks posed by increasingly powerful AI systems.
“We must slow the pace at which we improve the capabilities of AI models. Progress will still seem fast, and we must make wise use of the time we gain,” Amodei wrote.
Altman backed the proposal, saying independent evaluators should have employee-like access to AI companies. “Committing to having independent evaluators with employee-like access is a great idea, and we will do the same,” he said, adding that OpenAI would share more details soon.
Musk also expressed agreement with Amodei’s call for greater safety oversight.
AI MISUSE FUELS SAFETY CONCERNS
Amodei’s proposal comes days after Anthropic released a threat intelligence report detailing how several actors had used its Claude AI models for activities including weapons development, cyber operations, surveillance and fraud.
He also pointed to the growing ability of AI systems to improve themselves and recent incidents involving AI agents accessing or compromising external systems.
Amodei warned that rapidly advancing AI capabilities could soon create swarms of autonomous systems capable of causing massive disruption.
“Given the accelerating rate of AI capability development, it’s my worry that in 6-12 months such a swarm could be capable of taking over the entire internet potentially causing hundreds of billions of dollars in damage,” he wrote.
His comments come amid growing alarm within the AI industry. Anthropic researcher Jacob Coxon recently resigned, saying people building AI “earnestly believe that it could kill us all by the end of the decade.”
Amodei, however, stressed that he was not calling for a halt to AI training or technological progress. Instead, he argued that companies should allow enough time to align and safeguard increasingly capable models, while independent evaluators verify that those safeguards are working.
MONEY AND THE AI RACE
The push for caution comes as the biggest AI companies face enormous financial pressure to keep moving ahead. OpenAI and Anthropic are both preparing for major initial public offerings, while new AI capabilities can help attract funding and justify massive infrastructure investments.
Amodei proposed permanent third-party reviewers inside frontier AI companies, giving them access to relevant tools and internal risk-assessment processes.
He also urged AI companies to voluntarily coordinate on safety standards. Such cooperation, he said, could require targeted antitrust exemptions in the US to allow competitors to work together on specific safety measures without undermining competition.
THE CHINA FACTOR
Amodei also linked the pace of AI development to the global race with China, warning that a Chinese lead in advanced AI could create national security risks for the US.
He argued that any slowdown among democratically governed countries should be limited by the need to maintain the lead held by US AI companies over China.
“Pacing within democracies will be limited by the lead that U.S. companies have over authoritarian regimes, chiefly the Chinese Communist Party,” Amodei wrote.
He called for tighter controls on advanced AI chips, model distillation and theft of model weights to prevent China from narrowing the gap.
Amodei ultimately urged frontier AI labs to work with governments to establish permanent embedded evaluators and develop regulations that keep AI capabilities advancing in step with safety measures.
– Ends
SOURCE :- TIMES OF INDIA
