This work was done during one weekend by research workshop participants and does not represent the work of Apart Research.
ApartSprints
65b750b6007bebd5884ddbbf
Accepted at the 
AI Security Evaluation Hackathon: Measuring AI Capability
 research sprint on 
May 27, 2024
Accepted at the 
65b750b6007bebd5884ddbbf
 research sprint on 

rAInboltBench : Benchmarking user location inference through single images

This paper introduces rAInboltBench, a comprehensive benchmark designed to evaluate the capability of multimodal AI models in inferring user locations from single images. The increasing proficiency of large language models with vision capabilities has raised concerns regarding privacy and user security. Our benchmark addresses these concerns by analysing the performance of state-of-the-art models, such as GPT-4o, in deducing geographical coordinates from visual inputs.

By 
Le "Qronox" Lam ; Aleksandr Popov ; Jord Nguyen ; Trung Dung "mogu" Hoang ; Marcel M ; Felix Michalak
🏆 
4th place
3rd place
2nd place
1st place
 by peer review