Anthropic says AI systems moving towards building themselves
Artificial intelligence giant Anthropic said on Thursday that AI systems are increasingly capable of building future versions of themselves, adding to mounting concerns about the dangers of the powerful technology.
The debate over the risks of AI has intensified in recent months, fueled by several incidents and apocalyptic warnings from industry professionals.
Anthropic said its Claude chatbot now leads more than a quarter of its research and development work, and collaborates with human staff on more than 90 percent of tasks.
The company said it was publishing the information to give the public, third parties and governments "better visibility into the pace of AI development" as the world "considers slowing" its pace.
Anthropic CEO Dario Amodei called this month for AI development to slow down, with rapid advances in the technology fueling concerns over job losses and the soaring energy demand and environmental impact of data centers.
Fears that designers of AI agents could lose control of their creations also mounted after several models from Anthropic and rival OpenAI reportedly broke out of their confined environments on their own, accessed the internet and intruded on websites and platforms.
"Models accelerating their own development could make it more challenging for humans to understand or control these systems," Anthropic said in a report.
"It is therefore important to share these metrics to understand how close the world is to reaching recursive self improvement (a model fully autonomously building its successor)."
As of August, Claude leads 26 percent of Anthropic's research and development, meaning it can complete most of a task from start to finish with human supervision.
Anthropic said Claude could not yet operate "fully autonomously."
The firm said it had about 30,000 AI agents doing research and engineering work, referring to bots that have the potential to carry out tasks.
Anthropic is expected to beat OpenAI to the public markets with a blockbuster IPO later this year, despite concerns around industry regulation.
Latest stories
Espanol ¿Amenaza u oportunidad? Las opiniones encontradas en el mundo sobre la IA
La amenaza de un peligro catastrófico por el avance de la inteligencia artificial ha desatado un debate mundial sobre cómo debe ser regulada. AFP habló con personas de distintos países sobre sus temores y esperanzas respecto al futuro de la IA, mientras los principales laboratorios estadounidenses piden una...
Mundo EEUU añade empresas militares cubanas y del sector del níquel a su lista de sanciones
Estados Unidos anunció el jueves sanciones contra compañías cubanas que explotan yacimientos de níquel, empresas militares dedicadas a la investigación armamentística y tres altos cargos del ejército, como parte de su campaña...
Espanol Dos guitarras de Johnny Marr, exintegrante de The Smiths, se venden por más de 750.000 dólares en una subasta
Las dos guitarras principales de la subasta dedicada a Johnny Marr, exintegrante del grupo británico The Smiths, fueron vendidas el jueves en Londres por más de 750.000 dólares...