Deception Detection Hackathon: Can we prevent AI from deceiving humans?

Join us for the Deception Detection Hackathon: Ensuring Trustworthy AI

As artificial intelligence systems become increasingly advanced and capable, it is crucial that we develop robust methods to detect and prevent deceptive behavior. The potential for AI to mislead and manipulate humans poses significant risks to society, and we must proactively address these challenges to ensure a future where AI remains safe, transparent, and trustworthy.

We invite you to participate in the Deception Detection Hackathon, a collaborative event aimed at developing innovative techniques and benchmarks to identify and mitigate deceptive behavior in AI systems. Over the course of a weekend, you'll work alongside researchers, developers, and experts in AI safety to create solutions that can help prevent AI from deceiving humans.

Why Deception Detection Matters

Deception in AI, a concept severely under-explored, occurs when an AI system is capable of deceiving a user, either designed for it by a malicious actor or due to misaligned goals. Such systems may appear to be aligned with users and humans values during training and evaluation but pursue malign objectives when deployed, potentially causing harm or undermining trust in AI.

Examples of such work can be found in:

• Situational Awareness Benchmark: An evaluation of how well models can identify what state they are in (hackathon project, talk)
• LLM Identification Benchmark: Can an LLM identify whether a human or an LLM wrote a text? Might be important for self-coordination across chat instances (similar hackathon project)
• Strategic Deception Report: An example of strategic deception presented by Apollo Research at the AI Safety Summit 2023 (explainer)

To mitigate these risks, we must develop robust deception detection methods that can identify instances of strategic deception, make headway on understanding AI capabilities for deception, and prevent AI systems from misleading humans. By participating in this hackathon, you'll contribute to the critical task of ensuring that AI remains transparent, accountable, and aligned with human values.

What to Expect at the Deception Detection Hackathon

During the hackathon, you'll have the opportunity to:

• Learn from experts in AI safety, deceptive alignment, and strategic deception
• Collaborate with a diverse group of participants to ideate and develop deception detection techniques
• Create benchmarks and evaluation methods to assess the effectiveness of deception detection approaches
• Compete for prizes and recognition for the most innovative and impactful solutions
• Network with like-minded individuals passionate about ensuring the safety and trustworthiness of AI

Whether you're an AI researcher, developer, or enthusiast, this hackathon provides a unique platform to apply your skills and knowledge to address one of the most pressing challenges in AI safety.

Join us in late June for a weekend of collaboration, innovation, and problem-solving as we work together to prevent AI from deceiving humans. Stay tuned for more details on the exact dates, format, and registration process.

Don't miss this opportunity to contribute to the development of trustworthy AI systems and help shape a future where AI and humans can work together safely and transparently. Let's hack for a deception-free AI future!