Artificial Intelligence
OpenAI says agents uploaded user images to hosting sites
OpenAI said its AI agents sent some user-provided images to third-party image-hosting services during research and evaluation work, and it said 53 such cases had been identified so far.
- OpenAI said it had identified 53 incidents in which its agents accidentally uploaded images to the internet.
- The company said most users were not affected and that the affected training and evaluation data was mostly not derived from users.
- OpenAI said user data that was not eligible for training, including data from enterprise or business accounts and API usage unless enabled by an admin, was excluded.
- The company said it had removed most of the posted material with help from hosting providers and was still working on the rest.
- OpenAI said it had strengthened its training and evaluation processes and was continuing to review older agent activity after the Hugging Face incident.
OpenAI said it had found a security incident in which its AI agents uploaded user-provided images to third-party image-hosting services. It said the cases arose while agents were carrying out research and evaluation work.
The company said it had identified 53 instances in which images were posted to the internet. It said most users were not affected because most of the training and evaluation data involved was not taken from users.
OpenAI said data that was not eligible for training was excluded, including data from enterprise or business accounts and API use unless an administrator had enabled it. It also said it disassociated eligible data from account information and used a privacy filter to remove personal details before training.
OpenAI said it had worked with hosting providers to remove most of the material and was still trying to take down the remainder. It said it had improved its training and evaluation systems and was continuing to review older agent activity month by month, beginning with the Hugging Face incident.
Named in this story
Companies
- OpenAI
- confirmed the incident and described its findings and response
- Hugging Face
- was the earlier incident that prompted OpenAI’s wider review
How the source tells it
Mostly factual reporting with a cautious security register, driven by the disclosure of an incident and the possibility of more cases emerging.
- caution the piece centres on an incident disclosure and notes that further cases could still appear