However this work has largely happened in private,” AI Village founder Sven Cattell said in a statement. “Traditionally, companies have solved this problem with specialized red teams.

But in the rush to launch these models, many AI experts are concerned that companies are moving too quickly to ship new products to market without properly addressing the safety and security concerns.Īdvances in machine learning have historically occurred in academic communities and open research teams, but AI companies are increasingly closing off their models to the public, making it more difficult for independent researchers to examine potential shortcomings. Rapid advances in machine learning in recent years have resulted in a slew of product launches featuring generative AI tools. Air Force has held capture-the-flag contests there for hackers to test the security of satellite systems and the Pentagon’s Defense Advanced Program Research Agency brought a new technology to the conference that could be used for more secure voting. This won’t be the first time Washington has looked to the ethical hacking community at DEF CON to help find weaknesses in critical and emerging technologies. The announcement Thursday came ahead of a meeting at the White House later in the day between Vice President Kamala Harris, senior administration officials and the CEOs of Anthropic, Google, Microsoft and OpenAI. “That’s what we’re now working to adapt for large language models.” “Red-teaming has been really helpful and very successful in cybersecurity for identifying vulnerabilities,” the official said.

The event hosted at the AI Village is expected to draw thousands of security researchers.Ī senior administration official speaking to reporters on condition of anonymity ahead of the announcement said the red-teaming event is the first public assessment of large language models. committed on Thursday to open their models to red-teaming at this year’s DEF CON hacking conference as part of a White House initiative to address the security risks posed by the rapidly advancing technology.Īttendees at the premier hacking conference held annually in Las Vegas in August will be able to attack models from Anthropic, Google, Hugging Face, Microsoft, NVIDIA, OpenAI and Stability AI in an attempt to find vulnerabilities. A group of leading artificial intelligence companies in the U.S.

Defcon convention las vegas