Opinion | The OpenAI Hugging Face Hack, Explained | #hacker


On July 16, Hugging Face, which is a code library for A.I. models, announced they were hacked and they suspected the hack was done by an A.I. agent. So tell me what we’ve learned about what happened since. The very short version is they gave this A.I. a set of tests, a set of exercises, and the A.I. decided on its own that the best way to get a high score probably wasn’t to just try and do these exercises that were cybersecurity exercises, but instead it should first hack its way out of the testing environment OpenAI had put it in, where it wasn’t supposed to have access to the internet, get onto the open internet, and then hack its way into this other company, Hugging Face, where it surmised, correctly as it turned out, it might find the answer key. Since then, there have been even more crazy details that have come out. It turned out that starting two months earlier, in early May, they had had what I can only think of as an infestation of their own A.I. agents inside their own infrastructure. So inside OpenAI’s infrastructure. And they found out that for two months, many, many agents inside their infrastructure had been leaving notes for each other. They’d found a way, kind of in the nooks and crannies of OpenAI’s infrastructure, to leave notes for each other, with tips on how to hack their way out, how to get data they weren’t supposed to have. And these agents were literally referring to themselves as a swarm. This was totally emergent behavior. No one had told them to do this. They had not been trained to do this. But they were using this service they did have access to, first to communicate with each other and then ultimately to get out and to get onto the open internet. So it turns out that there wasn’t just this one isolated rogue model. It was actually a systemic swarm, infestation, plague on their own servers that they only found out about after Hugging Face announced this attack. And I would just make an obvious point here. We still do not know what we do not know. Not just about this incident. This is just a situation in which we happen to know that it happened through a somewhat — I don’t want to say coincidental, but fortuitous – series of events. – Yeah —— We don’t know how many situations we don’t know have happened. The way I saw one person put this was, If you see two ants in your kitchen, you don’t have a two-ant problem. Yes.

Click Here For The Original Source.

——————————————————–

............