Prizes

We are pleased to announce the following prizes for the challenge:

• 1st Prize: $600;
• 2nd Prize: $400;
• 3rd Prize: $300;
• Special Prize for Efficient Solutions: $200;

All winners will receive certificates in addition to their cash awards.

Additionally, all participants will be awarded $100 in free credits from TogetherAI (https://www.together.ai/).

Geographical Restrictions
We will be unable to transfer prize money into China, India, Russia, Somalia, Iran, Cuba, Sudan, Syria, or North Korea. This is either due to rules in the US limiting the transfer of money into these countries or rules in these countries making it difficult to transfer money into them from US nonprofits (notably, this is why India is on the list).

Tracks

Red Team Track

Participants will attempt to identify and exploit privacy vulnerabilities in LLMs, simulating potential attackers seeking to extract sensitive information.

• Development phase: participants develop solutions based on the provided LLMs and data. We will split the dataset into train/test with different data distributions, domains, and tasks. The participants will only see the train subset.

  • We study the privacy of finetuned data and we will provide our finetuned LLMs

• Test phase: test the accuracy of the solutions with LLMs on test data.

• Evaluation Metrics:

  • Attack Accuracy: The attack accuracy of the solution on the provided LLMs and on the top

Blue Team Track

Participants will focus on protecting LLMs against privacy breaches, and developing robust defense mechanisms to safeguard sensitive data.

• Development phase: participants develop solutions based on the provided LLMs and data.

• Test phase: test the accuracy of the solutions with LLMs based on Red-Team’s attack algorithms

• Evaluation Metrics:

  • NONE (Based on your submitted paper)