Now we are all wondering if it's once again one the big players training their models. They should be held accountable in some kind of fashion, it's weird that we accept that businesses gets attacked by an AI and nothing comes out of it. Sure, OpenAI and Anthropic are not intentionnally doing it, but they choose how much effort they put into building guardrails and sandboxing. They have no incentive to adjust their methodology if they are not sanctioned.
I wonder if the targeted businesses are compensated privately without the media and greater public hearing about it. Imagine designing and building weapons, which you use on the street to calibrate and test. "Oops sorry, this bullet wasn't meant for you".
Decent write up. Not a word though on one of Railway's devs essentially trying a similar agent-driven hack on one of their competitors a little later. It all feels weirdly ironic.
Now we are all wondering if it's once again one the big players training their models. They should be held accountable in some kind of fashion, it's weird that we accept that businesses gets attacked by an AI and nothing comes out of it. Sure, OpenAI and Anthropic are not intentionnally doing it, but they choose how much effort they put into building guardrails and sandboxing. They have no incentive to adjust their methodology if they are not sanctioned.
I wonder if the targeted businesses are compensated privately without the media and greater public hearing about it. Imagine designing and building weapons, which you use on the street to calibrate and test. "Oops sorry, this bullet wasn't meant for you".
Decent write up. Not a word though on one of Railway's devs essentially trying a similar agent-driven hack on one of their competitors a little later. It all feels weirdly ironic.