EU legislators must close dangerous loophole in AI Act
The EU AI Act has the potential to improve protections for people impacted by AI systems. In its original form, it outlined a list of ‘high-risk uses’ of AI, including AI systems used to monitor students, to assess consumers’ creditworthiness, to evaluate job-seekers, and to determine who gets access to welfare benefits.
The legislation requires developers and deployers of such ‘high-risk’ AI to ensure that their systems are safe, free from discriminatory bias, and to provide publicly accessible information about how their systems work. However, these benefits will be undermined by a dangerous loophole introduced into the high-risk classification process in Article 6.
In the original draft from the European Commission, an AI system was considered ‘high risk’ if it was to be used for one of the high-risk purposes listed in Annex III. However, the Council and the European Parliament have introduced a loophole that would allow developers of these systems decide themselves if they believe the system is ‘high-risk’.
The same company that would be subject to the law is given the power to unilaterally decide whether or not it should apply to them.