The rise of large language models (LLMs) and artificial intelligence (AI) has led to increasing concerns over the safety and robustness of such models. This presentation by Dr Damian Ruck, Chief Researcher at Advai, highlighted the critical work that AI safety companies are doing to ensure the safe and responsible deployment of AI tools.
As many Compass students and researchers work in the field of generative modelling, this presentation served as an enriching discussion, bridging the gap between theoretical research developments and practical applied concerns. Dr Ruck’s experience and insights into the challenges and future directions of AI safety were particularly valuable.
The rapid advancement of AI underscores the importance of having experts like Dr Ruck share their perspectives on the field. This presentation provided a unique opportunity for our research community to engage with the critical issues surrounding AI safety and security, and to consider their implications for our own research efforts and direction.
- Sherman Khoo, Compass CDT student, Cohort 5
Title: Introducing Advai: Advancing AI Safety and Security
Speaker: Damian Ruck, Chief Researcher, Advai
Advai, a leading company in the field of Safe and Secure AI, specialises in testing, evaluation, and assistance of AI systems. It conducts research for a range of organizations, with the sole purpose of identifying AI failure modes and ensuring robust performance. Advai collaborates with prominent AI companies, financial services, insurance providers, the National Cyber Security Centre (NCSC), the AI Task Force, and venture capitalists.
Advai’s research team plays a crucial role in the company’s success by providing expertise and original research to support consultancy work. The team develops tools and metrics for Advai’s products and undertakes research contracts for the MoD and other organizations. Their work revolves around three broad areas: adversarial red teaming; tools for testing, evaluation and assurance; and tools for building more robust AI systems.
Looking ahead, Advai’s research team is exploring innovative solutions such as assurance agents, which involve the use of AI agents to semi-automate testing and evaluation processes. They are also investigating the adaptation of traditional system safety processes to AI systems, moving towards formal verification of AI systems, ensuring their reliability and security.
By addressing the critical challenges in AI safety and robustness, Advai is paving the way for the development and deployment of trustworthy AI systems across various industries. Their ongoing research and collaborations with key stakeholders, position Advai at the forefront of shaping the future of Safe and Secure AI.
Damian Ruck attained a PhD at the University of Bristol, before spending several years in U.S. universities publishing Computational Social Science research in top academic journals. He has since taken up the role of Chief Researcher at Advai, an Adversarial Machine Learning startup, applying Data Science skills to building Robust and Secure AI.
Schedule:
- 2.00 – 3.00pm Introducing Advai: Advancing AI Safety and Security
- 3.00 – 4.00pm Networking session
Location: Room 2.04, Fry Building