Lesson 5: Exploring Algorithmic Biases

Introduction

  1. We encounter many different types of biases on many different levels (e.g. personal, social, etc.). One of the most common cognitive biases that many of us might experience is confirmation bias, i.e. looking for information that supports our existing beliefs.
  2. However, when it comes to algorithm biases, their effects can have far-reaching effects on society as a whole.
  •  Introduce students to the definition of algorithmic bias.

Pre-activity

  1. Have you encountered any algorithmic biases? What were they?
  2. Complete the activity below. Did anything surprise you about the answers?

 Lecture: Algorithm biases

  1. Explore the concept of data as a foundation for algorithms, and transfer of data biases into the biases of algorithmic systems, e.g. crime predicting software will target Black and Latino neighbourhoods in the United States, based on the biases of historical data (O’Neil, 2016).
  2. Watch the TedTalk by Cathy O’Neil, entitled “The era of blind faith in big data must end” [Transcript available].

Attribution: O’Neil, C. (2017, September 7). The era of blind faith in big data must end. https://www.youtube.com/watch?v=_2u_eHHzRto

3. Watch this video by Joy Buolamwin, The Coded Gaze: Unmasking Algorithmic Bias.

Attribution: Buolamwini, J. (2016, November 6). The Coded Gaze: Unmasking Algorithmic Bias. https://www.youtube.com/watch?v=162VzSzzoPs

Activity 1. Experience how the algorithm will judge your face.

This activity will require the use of a camera, however, your personal data will not be collected.

  1. Go to https://www.hownormalami.eu/ and follow the steps by allowing the algorithm to evaluate you based on its criteria.
  2. Explore the impact of this activity on your understanding of algorithmic biases.

Discussion questions:

  1. Were you aware of the impact of algorithms on specific groups of people?
  2. Can you think of other real-world examples where algorithms have had unintended consequences?
  3. What did you learn about algorithmic biases by completing activity 1?
  4. How will this impact your views of algorithmic systems in the future?

Self-assessment