Security Concerns and Regulatory Limits
While the four executives gave evidence to the committee on AI safety, Britain’s security service director issued a warning about the dangers of AI. MI5 director Ken McCallum used his annual threat update to warn of bioweapon misuse as a significant threat from AI. “Not yet realized, but the misuse case to which I’d attach greatest weight, is AI’s potential to change the stakes on existing or even new bioweapons,” McCallum said.
Committee chair Liam Byrne told WIRED that the fact that the head of MI5 is warning about “incredibly dangerous capability uplifts for bioterrorists” while the Cabinet Office admits the regulatory regime is voluntary “tells you everything you need to know.”
Civil servants conceded to the committee how little the current system compels. Britain’s AI Security Institute (AISI) tests frontier models before release, but only when companies choose to hand them over. Henry de Zoete, director of AISI, acknowledged that the institute was entirely reliant on the cooperation of the companies and foreign governments in order to gain access. Cat Little, the top civil servant at the Cabinet Office, which houses AISI, confirmed that the regime is currently voluntary. “At the moment, yes, it is,” she said.
De Zoete acknowledged AISI had no ability to prevent a company from releasing a model judged to be too dangerous. “What we’re not doing is kite marking,” de Zoete said, using the British term for a safety certification. “We’re not saying yes or no to any sort of model.”