An AI researcher at Anthropic quit the AI lab, criticising the approach of both Anthropic and OpenAI towards safety. He outlined the potential risks of AI systems that are progressing so quickly that they could pose dangers to humans worldwide.
However, Mr. Coxon was backed up by Anthropic’s Alignment Science lead Evan Hubinger, who not only agreed with Mr. Coxon but shared in the belief that AI could kill all humans.
Jacob Coxon posted that he carried out pretraining research at both OpenAI and Anthropic, and that neither company was acting “responsibly” while “gambling with our lives” in an effort to reach self-improving superintelligence.
I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to,” posted Mr. Hubinger, adding that the danger was linked to future models rather than those that are available presently. “I personally think it is >10% within the next decade.
