Analysis finds that an OpenCV-based facial recognition model used by exam monitoring software Proctorio fails to recognize Black faces more than 50% of the time
it is the SAME faulty, racist tech. And #Proctorio uses tech that fails to detect Black faces 57% of the time, while lying and saying their system is proprietary. #Eproctoring #InvestigateProctorio https://www.vice.com/... Bill Fitzgerald / @funnymonkey : None of this is good, but the piece that stands out is a student needed to do the work that paid adults failed to do. Why do CIOs at schools that inflict this crap software onto students still have jobs? How many of the schools that use online proctoring have Privacy Officers? @zenalbatross : last year, countless students said the exam surveillance tool Proctorio couldn't detect non-white faces. turns out they were right! a student researcher found the software is using face detection models known for their higher failure rates for Black faces https://www.vice.com/... Bill Fitzgerald / @funnymonkey : From @ToddFeathers , highlighting research from @Oxylibrium on Proctorio's repeated failures to live up to its own marketing claims. The latest fail from an online proctoring company: racist facial detection. https://www.vice.com/... Dr Stephanie Zihms / @stephzihms : I watched Coded Bias (Netflix) the other day and it's quite scary (but not surprising) how much bias is emended in algorithms due to who designs them and what their world looks like... https://twitter.com/... @hypervisible : Imagine all you want to do is take a test, and the system your institution uses as a gateway to testing doesn't recognize you as a human being. https://t.co/WSNFdq5k4W
the sweaty, clownish defensiveness of these absolute goons https://twitter.com/... https://twitter.com/...
@hypervisible
@hypervisible on x
Imagine all you want to do is take a test, and the system your institution uses as a gateway to testing doesn't recognize you as a human being. https://t.co/WSNFdq5k4W
@sorenspicknall
Soren Spicknall on x
This has been happening over and over and over again throughout schools' move to remote learning, yet education administrators keep signing these software contracts. https://twitter.com/...
@undersequoias
Jacob Metcalf on x
I hope to see some lawsuits against the institutions that bought this product without doing due diligence. It's a pretty clear case of disparate impact against protected classes. If you couldn't take a test because a racist algorithm wouldn't let you in the door: sue your edu. ht…
@ct_bergstrom
Carl T. Bergstrom on x
Instructors, don't use Proctorio. Students, if you're been forced to use Proctorio or other academic spyware, consider contacting the dean of students or dean of undergraduate education at your college. https://www.vice.com/...
@fightfortheftr
@fightfortheftr on x
Facial detection, facial recognition, facial analysis—it is the SAME faulty, racist tech. And #Proctorio uses tech that fails to detect Black faces 57% of the time, while lying and saying their system is proprietary. #Eproctoring #InvestigateProctorio https://www.vice.com/...
@funnymonkey
Bill Fitzgerald on x
None of this is good, but the piece that stands out is a student needed to do the work that paid adults failed to do. Why do CIOs at schools that inflict this crap software onto students still have jobs? How many of the schools that use online proctoring have Privacy Officers?
@zenalbatross
@zenalbatross on x
last year, countless students said the exam surveillance tool Proctorio couldn't detect non-white faces. turns out they were right! a student researcher found the software is using face detection models known for their higher failure rates for Black faces https://www.vice.com/...
@funnymonkey
Bill Fitzgerald on x
From @ToddFeathers , highlighting research from @Oxylibrium on Proctorio's repeated failures to live up to its own marketing claims. The latest fail from an online proctoring company: racist facial detection. https://www.vice.com/...
@stephzihms
Dr Stephanie Zihms on x
I watched Coded Bias (Netflix) the other day and it's quite scary (but not surprising) how much bias is emended in algorithms due to who designs them and what their world looks like... https://twitter.com/...