„Claude’s success caught even Anthropic’s own red-team hackers off guard.
„Originally it was just me at a hotel realizing that PicoCTF had started and being like, ‚Oh, I wonder if Claude could do some of these challenges,'“ Lucas [an Anthropic red-teamer] said.
* PicoCTF is the largest capture-the-flag competition for middle school, high school, and college students. Participants are tasked with reverse-engineering malware, breaking into systems, and decrypting files.
* Lucas began by just pasting the first challenge verbatim into Claude.ai. The only hiccup he encountered was the need to download a third-party tool, but once that was done, Claude instantly solved the problem.
* „Claude was able to solve most of those challenges and get in the top 3% of PicoCTF,“ he said.
As Lucas continued this laissez-faire experiment in other competitions, Claude kept surpassing expectations.
* Lucas entered a few more using only Claude.ai and Claude Code. At the time, Sonnet 3.7 was Anthropic’s most advanced available model.
* The red team provided only minimal help — usually when Claude needed to install a piece of software. Besides that, Claude was on its own.“
Leave A Reply
Du musst angemeldet sein, um einen Kommentar abzugeben.
1 Kommentar
„Claude’s success caught even Anthropic’s own red-team hackers off guard.
„Originally it was just me at a hotel realizing that PicoCTF had started and being like, ‚Oh, I wonder if Claude could do some of these challenges,'“ Lucas [an Anthropic red-teamer] said.
* PicoCTF is the largest capture-the-flag competition for middle school, high school, and college students. Participants are tasked with reverse-engineering malware, breaking into systems, and decrypting files.
* Lucas began by just pasting the first challenge verbatim into Claude.ai. The only hiccup he encountered was the need to download a third-party tool, but once that was done, Claude instantly solved the problem.
* „Claude was able to solve most of those challenges and get in the top 3% of PicoCTF,“ he said.
As Lucas continued this laissez-faire experiment in other competitions, Claude kept surpassing expectations.
* Lucas entered a few more using only Claude.ai and Claude Code. At the time, Sonnet 3.7 was Anthropic’s most advanced available model.
* The red team provided only minimal help — usually when Claude needed to install a piece of software. Besides that, Claude was on its own.“