Analysis finds that an OpenCV-based facial recognition model used by exam monitoring software Proctorio fails to recognize Black faces more than 50% of the time
it is the SAME faulty, racist tech. And #Proctorio uses tech that fails to detect Black faces 57% of the time, while lying and saying their system is proprietary. #Eproctoring #InvestigateProctorio https://www.vice.com/... Bill Fitzgerald / @funnymonkey : None of this is good, but the piece that stands out is a student needed to do the work that paid adults failed to do. Why do CIOs at schools that inflict this crap software onto students still have jobs? How many of the schools that use online proctoring have Privacy Officers? @zenalbatross : last year, countless students said the exam surveillance tool Proctorio couldn't detect non-white faces. turns out they were right! a student researcher found the software is using face detection models known for their higher failure rates for Black faces https://www.vice.com/... Bill Fitzgerald / @funnymonkey : From @ToddFeathers , highlighting research from @Oxylibrium on Proctorio's repeated failures to live up to its own marketing claims. The latest fail from an online proctoring company: racist facial detection. https://www.vice.com/... Dr Stephanie Zihms / @stephzihms : I watched Coded Bias (Netflix) the other day and it's quite scary (but not surprising) how much bias is emended in algorithms due to who designs them and what their world looks like... https://twitter.com/... @hypervisible : Imagine all you want to do is take a test, and the system your institution uses as a gateway to testing doesn't recognize you as a human being. https://t.co/WSNFdq5k4W
Imagine all you want to do is take a test, and the system your institution uses as a gateway to testing doesn't recognize you as a human being. https://t.co/WSNFdq5k4W
This has been happening over and over and over again throughout schools' move to remote learning, yet education administrators keep signing these software contracts. https://twitter.com/...
I hope to see some lawsuits against the institutions that bought this product without doing due diligence. It's a pretty clear case of disparate impact against protected classes. If you couldn't take a test because a racist algorithm wouldn't let you in the door: sue your edu. ht…
Instructors, don't use Proctorio. Students, if you're been forced to use Proctorio or other academic spyware, consider contacting the dean of students or dean of undergraduate education at your college. https://www.vice.com/...
Facial detection, facial recognition, facial analysis—it is the SAME faulty, racist tech. And #Proctorio uses tech that fails to detect Black faces 57% of the time, while lying and saying their system is proprietary. #Eproctoring #InvestigateProctorio https://www.vice.com/...
None of this is good, but the piece that stands out is a student needed to do the work that paid adults failed to do. Why do CIOs at schools that inflict this crap software onto students still have jobs? How many of the schools that use online proctoring have Privacy Officers?
last year, countless students said the exam surveillance tool Proctorio couldn't detect non-white faces. turns out they were right! a student researcher found the software is using face detection models known for their higher failure rates for Black faces https://www.vice.com/...
From @ToddFeathers , highlighting research from @Oxylibrium on Proctorio's repeated failures to live up to its own marketing claims. The latest fail from an online proctoring company: racist facial detection. https://www.vice.com/...
I watched Coded Bias (Netflix) the other day and it's quite scary (but not surprising) how much bias is emended in algorithms due to who designs them and what their world looks like... https://twitter.com/...