Police Response and Concerns
The Philadelphia Police Department criticized the delay in notification. "The two-month delay in detecting and reporting the incident to the City is unacceptable," the department said in a statement. Police emphasized that while their safeguards prevented the tip from impacting investigations, the incident highlights risks associated with AI systems interacting with public infrastructure.
"Those PPD safeguards limited the impact of this incident. They do not diminish the seriousness of an AI system presenting fabricated information as though it came from a person with knowledge of a homicide," the PPD stated. "Unsolved cases involve real victims, grieving families and investigators working to secure answers."
Venkat Margapuri, a computing sciences assistant professor at Villanova University, noted that the AI was "actively submitting information to a different website on behalf of a user," which he classified as a "high-risk action."