In every reported case where police mistakenly arrested someone using facial recognition, that person has been Black::Facial recognition software has always had trouble telling Black people apart, yet police departments are still using it.

  • Mic_Check_One_Two@reddthat.com
    link
    fedilink
    English
    arrow-up
    35
    ·
    11 months ago

    This isn’t new. It’s been a known problem for a long time, because facial recognition software is trained using white people. So it gets really really good at differentiating between white people. But with black people as a tiny fraction of the sample data, it basically just learns to differentiate them with broad strokes. It’s good at telling them apart from white people, but not much else.

    • phx@lemmy.ca
      link
      fedilink
      English
      arrow-up
      34
      ·
      edit-2
      11 months ago

      It’s not just a training issue. Lighter (color) tones reflect. Dark tones absorb. There have been lots of issues with cameras or even just sensors having issues with people having dark skin tones because the lower reflectivity/contrast of dark tones. 3D scanners - even current models - have similar issues with objects having black parts for similar reasons. Training on more models can help, but there’s still an overall technical difficulty to overcome as well (which is also a good reason that using facial recognition in this manner is just bullshit, period).

      • Shihali@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        4
        ·
        11 months ago

        As a technological problem it could have a technological partial solution: the darker the skin, the higher the threshold to declare a match. This would also mean more false negatives (real matches not caught by the software) but not much to do about that.

    • Chunk@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      ·
      11 months ago

      I’m interested what dataset they’re using because simply adding more black people to the training set seems like a pretty straightforward fix.

      • elephantium@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        11 months ago

        It seems like past mugshots would be an ideal part of the training set. Are they not using those?

        Personally, I’m leaning towards “It’s not the image recognition program that’s the problem here.”