OpenAI bugging case highlights AI’s insider threat problem #AI

An OpenAI employee’s alleged attempt to bug an executive conference room shows how much AI companies have to protect beyond their code, policy experts say, as developers contend with the reality that everyday workplace conversations can reveal sensitive details about their technology plans.The Justice Department announced Tuesday that Abdulrahman Alfozan, a 35-year-old OpenAI engineer and Saudi national, had been arrested Oct. 9 on a charge of using or attempting to use a device to intercept oral communications.OpenAI personnel discovered the recorder — concealed in toilet paper and plugged into the back of a television — on Sept. 30. The room hosted discussions about proprietary research, product plans and government engagements, according to the Justice Department.“We tend to picture AI security as chips, weights, and code. This case is a reminder that the stack also includes the rooms where the roadmap gets discussed and the people who walk into them, and anyone who wants insight into frontier AI has every reason to look at all of it,” said Leah Siskind, director of impact and an AI research fellow at the Foundation for Defense of Democracies.Prosecutors allege Alfozan had no authority to access the room but was seen near it repeatedly. The FBI complaint names the device as an off-the-shelf camera and audio recording chip which sells for $14 online. They also say security personnel found another similar recorder in a bag containing his identification. His motive and whether any information was recorded or shared remain unclear, though Alfozan notably had ties to Saudi Arabia’s technology and investment circles. The Financial Times reported Wednesday that he hosted a roundtable at a Saudi-backed conference during IT minister Abdullah al-Swaha’s visit to San Francisco, California last month, and was listed as a venture partner at Riyadh-based Raed Ventures. A court filing also shows he booked a one-way ticket to Saudi Arabia scheduled for earlier this week on Monday.OpenAI said it fired the employee and had no indication he improperly accessed or exfiltrated model weights, source code or customer data. The company also notably said it used its own AI models to help understand the device and identify who planted it.Jam Kraprayoon, a senior researcher at the Institute for AI Policy and Strategy, said the operation appeared limited compared with the threats that most concern him.“This appears to have been a fairly crude operation. It’s still unclear what his motivations were or if he had links to any organized group,” he said. “But from what’s been reported, it also didn’t reach the assets I’d be most concerned about, which are the model weights and the core algorithmic insights behind frontier models.”Model weights refer to the numerical parameters an AI model learns during training that determine how it processes information and responds. A theft of the model weights could have allowed an attacker to run a full copy of a given AI model, like GPT-6 Astra, on their own servers.“Recording leadership conversations could expose some high-level algorithmic insights, but this would not be the vector I’m most concerned about,” Kraprayoon added. “The bigger issue is what a more sophisticated actor could do.”A 2024 RAND study identified 38 distinct ways attackers could target model weights and recommended that developers limit who can access them, keep copies on monitored systems and establish insider threat programs. The study examined threats ranging from opportunistic criminals to well-funded state operations.Anthropic acknowledged the difficulty in a February update on its Responsible Scaling Policy. Citing RAND, it said meeting the highest security standard — defending against top-priority operations by the most capable attackers — was not yet possible and would likely require help from the national security community.“The companies themselves and independent analysts have acknowledged that AI developers do not yet have the security posture to protect these assets against a determined, well-resourced actor,” Kraprayoon said.This is not OpenAI’s only recent brush involving stolen trade secrets. The company also revealed a new filing in its legal battle with Apple that alleged a former employee who left for Apple sent ‌more than 100 files about an unreleased OpenAI product to a personal email account and presented the product to senior Apple leadership.Siskind said companies should focus on what employees can access and what they do with that access, while continuing to recruit talent from abroad.“A major part of America’s edge in the AI race is our ability to attract the best talent in the world,” she said. “That being said, we also have to assume that information about every stage of AI development is a valuable target for espionage.”“Those goals aren’t in conflict if security is built around access, with strong controls on who can reach sensitive systems and real oversight of what they do once they’re in, not just around where someone is from,” added Siskind.

!function(f,b,e,v,n,t,s)
{if(f.fbq)return;n=f.fbq=function(){n.callMethod?
n.callMethod.apply(n,arguments):n.queue.push(arguments)};
if(!f._fbq)f._fbq=n;n.push=n;n.loaded=!0;n.version=’2.0′;
n.queue=[];t=b.createElement(e);t.async=!0;
t.src=v;s=b.getElementsByTagName(e)[0];
s.parentNode.insertBefore(t,s)}(window,document,’script’,
‘https://connect.facebook.net/en_US/fbevents.js’);
fbq(‘init’, ‘10155007036758614’);
fbq(‘track’, ‘PageView’);

window.fbAsyncInit = function() {
FB.init({
appId : ‘622609557824468’,
autoLogAppEvents : true,
xfbml : true,
version : ‘v2.11’
});
};

(function(d, s, id){
var js, fjs = d.getElementsByTagName(s)[0];
if (d.getElementById(id)) {return;}
js = d.createElement(s); js.id = id;
js.src = “https://connect.facebook.net/en_US/sdk.js”;
fjs.parentNode.insertBefore(js, fjs);
}(document, ‘script’, ‘facebook-jssdk’));


Click Here For The Original Source.

——————————————————–

............