AIAAIC Alert #32
The weekly update on incidents and issues driven by AI, algorithms and automation.
Keep up with AIAAIC via our website | X/Twitter | LinkedIn
In the crosshairs
New incidents and issues added to the AIAAIC Repository
Image: Department of Work and Pensions
DWP algorithm wrongly flags 200,000 people for possible fraud
AI robocall service is caught lying and pretending to be human
Visit the AIAAIC Repository for details of these and 1,550+ other AI, algorithmic and automation-driven incidents and controversies
Report an incident or controversy.
Allegheny County child neglect screening
Featured system or dataset
Image: Allegheny County Department of Human Services
The Allegheny Family Screening Tool (AFST) is a risk modelling tool used by Allegheny County, Pennsylvania, that aims to improve child safety by predicting the likelihood that a child referred for abuse or neglect will later experience a foster care placement in the two years after they are investigated.
Developed by a team from Auckland University of Technology, University of Auckland, University of Southern California and the University of California, the ASFT analyses personal data including birth, Medicaid, substance abuse, mental health, jail and probation records for each person reputedly involved in an allegation of child maltreatment and generates a ‘Family Screening Score’ that predicts the long-term likelihood of a child requiring protection.
The yang: Proponents of the ASFT claim it identifies high-risk cases earlier, enables case workers to focus more on direct interventions, reduces costs, and helps reduce human decision-making biases.
The yin: The ASFT has been criticised for perpetuating actual and historical biases and inequalities due to its reliance on apparently skewed data, and for perceived inadequate transparency and accountability.
Incidents and issues associated with the AFST:
Allegheny child neglect screening tool may harden bias against people with disabilities
Allegheny child neglect screening system unfairly flags Blacks kids for investigation
From our network
What advisors, contributors and others in AIAAIC’s network are up to
A team at the ADAPT Centre in Dublin, Ireland, and the EU’s Joint Research Centre are conducting a survey to assess the usefulness of AI Cards - a framework designed to provide a holistic overview of AI systems and their associated risks in human- and machine-readable formats in line with EU AI Act requirements.
Take the survey (anonymous, takes 10-15 minutes)