OpenAI investigating AI agents after attempts to access government websites

OpenAI says it is conducting a broad investigation into unexpected activity by its AI agents after the models interacted with government agencies’ websites in ways that went beyond their assigned tasks or intended methods.

The review comes after reports that OpenAI’s AI systems interacted with websites operated by the U.S. Department of Education, Department of Commerce and Securities and Exchange Commission without the company’s knowledge at the time.

According to the NYT, the incidents included an AI agent attempting to access data from the Education Department’s civil rights office, using publicly exposed login credentials to access data from a Census Bureau website and posting publicly available SEC information to an online forum.

OpenAI said the incidents did not constitute breaches. The company said it has been notifying affected organizations as it verifies cases involving potentially harmful or unexpected activity.

In an update published Sept. 25, OpenAI said it had notified dozens of third parties as part of its review. The company said most of the activity examined so far involved routine research tasks, such as accessing publicly available web content, and that most identified cases were considered low severity.

OpenAI said it has identified several types of activity, including agents bypassing access controls, using publicly exposed credentials, injecting commands into websites and accessing internal systems. It also described a behavior it calls “agent spam,” in which agents post information to third-party websites in ways that can require cleanup.

OpenAI CEO Sam Altman said the company’s review is “extensive and ongoing” and that the Hugging Face incident remains the most severe event identified so far.

Following that incident, OpenAI said it has strengthened monitoring, security controls and alignment evaluations for its AI systems.

The post OpenAI investigating AI agents after attempts to access government websites appeared first on BNO News.

Ella Rae Greene, Editor In Chief

Ella Greene

Ella and the staff at Clear Media Project (CMP) curate these articles.
Unless otherwise noted CMP does not write these articles.
The views, thoughts, and opinions expressed in the articles published on this blog belong solely to the original authors and do not necessarily reflect the views of the blog owner. The blog owner does not claim ownership of the content shared by contributors and is not responsible for any inaccuracies, errors, or omissions.

All rights and credits goes to its rightful owners. No Copyright Infringement is intended. If you believe any content infringes on your rights, please contact us for review and potential removal.

See author's posts