Anthropic’s Boris Cherny partners with Gray Swan on a prompt injection competition

What happened

Over the last few years, we have made significant progress on prompt injection for Claude models. As agents do more, it is increasingly urgent that we solve it across the industry. Really excited to partner with Gray Swan to host this competition. Can’t wait to see what you find! @GraySwanAI announced a $300,000 AI red teaming challenge called “Indirect Prompt Injection: Black,” in partnership with Anthropic, Meta, Google DeepMind, Reflection AI, and other frontier lab sponsors. Cherny said Anthropic has made significant progress on prompt injection for Claude models and that solving it across the industry is increasingly urgent.

2 reports

The story so far

Anthropic is partnering with Gray Swan to host a prompt injection competition, Boris Cherny announced, joining a challenge Gray Swan announced with $300,000 and support from multiple frontier labs. Gray Swan named the AI red teaming challenge “Indirect Prompt Injection: Black” and listed Anthropic, Meta, Google DeepMind, Reflection AI and other frontier labs as partners or sponsors. Cherny said Anthropic has made significant progress on prompt injection for Claude models over the past few years, while arguing that addressing the problem across the industry is increasingly urgent as agents do more.

Keep reading

Trending now

1. 1Meta Releases Muse Spark Open With Mac and Cloud Support, Topping US Open-Weight Index
2. 2Google Launches Gemini 4 Argon Globally, Expands Paid Access as Benchmark Results Vary
3. 3OpenAI Updates GPT-6 Astra Pro in ChatGPT With Parallel Agents and Faster Responses
4. 4Meta’s New Business Terms Raise Dispute Over Website Crawling and AI Training Rights