algorithmic discrimination
Filter by...
-
The secret services’ reign of confusion, rogue mayors, racist tech and algorithm oversight (or not)
Have a quick read through January’s most interesting developments at the intersection of human rights and technology from the Netherlands.
Read more
-
Civil society calls on the EU to ban predictive AI systems in policing and criminal justice in the AI Act
40+ civil society organisations, led by Fair Trials and European Digital Rights (EDRi) are calling on the EU to ban predictive systems in policing and criminal justice in the Artificial Intelligence Act (AIA).
Read more
-
#PrivacyCamp22: Event Summary
The theme of the 10th-anniversary edition of Privacy Camp was "Digital at the centre, rights at the margins" and included thirteen sessions on a variety of topics. The event was attended by 300 people. If you missed the event or want a reminder of what happened in a session, find the session summaries and video recordings below.
Read more
-
Amnesty International calls to ban discriminatory algorithms in its report Xenophobic Machines
On 25 October 2021, EDRi observer Amnesty International published a report on the use of algorithmic decision-making (ADM) system by the Dutch tax authorities to detect fraud. The report shows how discrimination and racial profiling were baked into the design of the ADM system.
Read more
-
Can the EU Digital Services Act contest the power of Big Tech’s algorithms?
A progressive report on the Digital Services Act (DSA) adopted by the Committee on Civil Liberties, Justice and Home Affairs (LIBE) in the European Parliament in July is the first major improvement of the draft law presented by the European Commission in December. MEPs expressed support for default protections from tracking and profiling for the purposes of advertising and recommending or ranking content. Now the ball is in the court of the leading committee on internal market and consumer protection (IMCO), which received 1313 pages of amendments to be voted in November. EDRi's member Panoptykon Foundation explores if the Parliament would succeed in adopting a position that will contest the power of dominant online platforms which shape the digital public sphere in line with their commercial interests, at the expense of individuals and societies.
Read more
-
EU’s new artificial intelligence law risks enabling Orwellian surveillance states
When analysing how AI systems might impact people of colour, migrants and other marginalised groups, context matters. Whilst AI developers may be able to predict and prevent some negative biases, for the most part, such systems will inevitably exacerbate injustice. This is because AI systems are deployed in a wider context of systematic discrimination and violence, particularly in the field of policing and migration.
Read more
-
Computers are binary, people are not: how AI systems undermine LGBTQ identity
Companies and governments are already using AI systems to make decisions that lead to discrimination. When police or government officials rely on them to determine who they should watch, interrogate, or arrest — or even “predict” who will violate the law in the future — there are serious and sometimes fatal consequences. EDRi's member Access Now explain how AI can automate LGBTQ oppression.
Read more
-
Artificial Intelligence and Fundamental Rights: Document Pool
Find in this doc pool all EDRi analyses and documents related to Artificial Intelligence (AI) and fundamental rights
Read more
-
This is the EU’s chance to stop racism in artificial intelligence
Human rights mustn’t come second in the race to innovate, they should rather define innovations that better humanity. The European Commission's upcoming proposal may be the last opportunity to prevent harmful uses of AI-powered technologies, many of which are already marginalising Europe's racialised communities.
Read more
-
Why Facebook’s proposed hate speech policy on Zionism would only add fuel to the fire
Pressured to combat surging hate speech and anti-Semitism on its platform, Facebook is looking into how it should moderate the use of the word “Zionist,” and whether to add the term as a protected category under its hate speech policy. EDRi's member Access Now doesn’t think that is a good idea, particularly given Facebook’s inability to strictly adhere to human rights principles in its content moderation practices.
Read more
-
Mass facial recognition is the apparatus of police states and must be regulated
Scientists have shown the inherent structural discrimination embedded in biometric systems. Facial analysis algorithms consistently judge black faces to be angrier and more threatening than white faces. We also know that biometric systems are designed with a purportedly “neutral” face and body in mind, which can exclude people with disabilities and anybody that does not conform to an arbitrary norm.
Read more
-
We want more than “symbolic” gestures in response to discriminatory algorithms
In an escalating scandal over child benefits, over 26.000 families were wrongly accused of fraud by the Dutch tax authority. Families were forced to repay tens of thousands of euros, resulting in unemployment, divorces, and families losing their homes. EDRi member Bits of Freedom reveals the discriminatory algorithms used by the authority and urges the government to ban their use and develop legislation on Artificial Intelligence.
Read more