As frontier models go rogue, colleges beef up AI cybersecurity education | #hacking | #cybersecurity | #infosec | #comptia | #pentest | #ransomware


As the world increasingly recognizes the need for safer and more secure AI, U.S. colleges and universities are trying to meet a growing demand for AI security education that prepares future workers to safeguard businesses’ and governments’ powerful AI systems.

AI cybersecurity education programs, from undergraduate and graduate classes to professional certificates, are sprouting up all over the country, as experts warn that young people need to understand how to manage AI risks as they enter a workforce teeming with algorithms, models and agents. The recent autonomous-hacking incidents involving frontier AI models have further underscored the need for cybersecurity education.

With policymakers and business leaders fretting about the consequences of reckless AI development that doesn’t prioritize security, higher-education institutions are rushing to fill a stark curriculum void before it’s too late. They are receiving support from a cybersecurity workforce coalition, a handful of pioneering professors and a government newly energized about infusing AI security into classrooms.

“As we see different models from Anthropic and OpenAI and other organizations begin to cross boundaries and do things that they weren’t trained to do, it becomes all the more important to make sure that we have appropriate governance,” said Michael Mattarock, associate director of the Carnegie Mellon University’s Information Networking Institute.

Teaching the ethical AI approach

Universities have responded to AI’s growing prominence by creating courses about virtually every aspect of the technology. But until recently, demand for AI cybersecurity education had been relatively muted — something experts described as a serious problem.

“As AI becomes embedded across industries and critical systems, graduates need to understand how to build and deploy AI that is secure, trustworthy and resilient, not simply how to make the technology work,” said Eman El-Sheikh, associate vice president and professor at the University of West Florida’s Center for Cybersecurity and AI. “We need graduates who understand … how to protect AI models, data and systems from vulnerabilities, attacks and misuse.”

Several experts compared the hazards of overlooking AI security education to the disastrous consequences of universities ignoring cybersecurity in their early computer science courses. “Everybody’s chasing the cool, sexy thing of AI, and not always doing the due diligence to make sure that those solutions or those platforms are properly secured,” Mattarock said.

Preparing students to mitigate AI risks will give them “a skill set that makes them competitive for tighter job markets,” said John Petrozzelli, director of the MassCyberCenter, a Massachusetts state government hub that is incorporating AI education into a program that trains college students to work in security operations centers.

Future AI developers who graduate without foundational cybersecurity skills — including the ability to evaluate model outputs for signs of compromise — will end up building systems that they don’t know how to oversee and that lack key safeguards, Mattarock said.

 


“Everybody’s chasing the cool, sexy thing of AI, and not always doing the due diligence to make sure that those solutions or those platforms are properly secured.”

Michael Mattarock

Associate Director, Information Networking Institute, Carnegie Mellon University


Multiple experts argued that the recent loss-of-control incidents involving frontier AI models offered a potent illustration of what can happen when developers overlook security.

“Taking the ethical approach” of incorporating clear guardrails into AI systems “is really critical,” Petrozzelli said, “especially when they’re looking at using it for cybersecurity purposes, like vulnerability scanning or penetration testing.”

On the bright side, Mattarock said the trend of autonomous-hacking incidents “continues to spark interest [in AI security] among students.”

AI cyber degrees, certificates, and collaboration

AI cybersecurity education is still a nascent field, experts said, with universities at different stages of rolling out curricula.

It is unclear exactly how many universities now offer AI security programs, but Cybersecurity Dive identified several scattered across the country, including at the University of Chicago, Dakota State University, Florida International University and South Carolina’s military academy, The Citadel. Last November, a National Security Agency program created to recognize universities with outstanding cybersecurity curricula designated Ferris State University as its first “Center of Academic Excellence in Secure Artificial Intelligence.”

——————————————————-


Click Here For The Original Source.