{"id":17690,"date":"2021-02-01T10:49:51","date_gmt":"2021-02-01T15:49:51","guid":{"rendered":"https:\/\/abovethelaw.com\/?p=730613"},"modified":"2021-02-01T10:49:51","modified_gmt":"2021-02-01T15:49:51","slug":"examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs","status":"publish","type":"post","link":"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/","title":{"rendered":"ExamSoft Tells Senators That Facial Recognition Problems Are Everyone’s Fault But Theirs"},"content":{"rendered":"
\"\"

(Image via Getty)<\/p><\/div>\n

Late last year, a number of senators wrote ExamSoft demanding some clarity on the various issues that bubbled up surrounding the online bar exam struggles that we reported about all year. Notably, the letter sought answers to allegations of ExamSoft’s facial recognition system repeatedly flagging people for cheating based on race — something that was entirely predictable given the systemic issues in facial recognition technology.<\/p>\n

Honestly, we’d missed the company’s response. The holidays crept up and then there was a coup and we moved the entire 401k plan to Gamestop… it’s been busy. And, perhaps, that was ExamSoft’s hope. Thankfully an eagle-eyed observer<\/a> found the response and posted a link. As you might expect, the answers leave a lot to be desired.<\/p>\n

After clarifying that ExamSoft doesn’t own the facial recognition technology it uses for its exam proctoring:<\/p>\n

We are committed to ensuring that ExamID is accurate for all exam-takers, regardless of their physical appearance or dress. Though ExamSoft does not directly operate the facial recognition technology ExamID leverages, ExamSoft works to evaluate the technology’s accuracy and effectiveness by performing regular tests and working with institutions to assess the facial recognition software.<\/p><\/blockquote>\n

That doesn’t really say anything. “We buy the tech from a third party and we ‘work to evaluate’ that it’s not screwing up.” Except we heard a deluge of complaints that it didn’t work. Primarily from people of color who were consistently incorrectly recognized<\/a> by the system and forced to take the test knowing that they’d already been flagged. Throughout the letter it seems as though ExamSoft is oscillating between laying blame on the third-party technology and blaming examinees for not using the tech correctly. The only consistent theme is that it’s not ExamSoft’s fault.<\/p>\n

But ExamSoft’s main takeaway is that even though they don’t bother to keep track of the complaints they’ve received<\/em>, everything is fine and all of the primarily Black and Brown faces getting flagged are clearly the examinee’s fault.<\/p>\n

ExamSoft does not currently maintain statistics on user inquiries related to the effectiveness or accuracy of facial recognition. But we investigate all user complaints and attempt to resolve them for both the individual user and current or future users who may have the same experience. We have investigated whether there have been any systemic issues with ExamID due to individual exam-takers’ race or gender identification. It would be a key priority to resolve any such issues, but we have found none. Rather, our investigation reveals that the most common reasons exam-takers experience difficulty with ExamID are as follows: (1) internet connectivity
\n(whether due to the server, the computer, or the internet service itself); (2) poor picture quality (often due to camera issues such as out-of-date drivers, a dirty lens, or the exam-taker being out of focus); and (3) lighting issues (such as lights shining at the camera or significant under-lighting).<\/p><\/blockquote>\n

I dunno, that seems like a bold conclusion. In one of my prior posts, I even included a screenshot of a woman who was told the recognition software failed her and it certainly doesn’t look like a blurry picture or a lighting screw-up. That the feedback we received throughout the examination involved ExamSoft’s support people consistently saying that they’d never heard of any racial discrimination issues with the technology even though multiple sources had flagged this before the test started and we know that several examinees called in with this complaint, the primary takeaway from this answer is that ExamSoft should be tracking inquiries because then they might be able to see the trends plaguing the system.<\/p>\n

The fallback defense for ExamSoft is that, even if the facial recognition software screws up repeatedly, a human proctor looks at everything after the exam so no one is put out by a failure during the test.<\/p>\n

We also designed ExamID to minimize any disruption to exam-takers if the authentication software does not recognize them. As described above, the Deferred ID feature\u2014which most institutions already choose to use and ExamSoft has required the majority of institutions to use in 2021\u2014allows the exam-taker to take an exam without delay or interruption while the software analyzes their photo for later review and determination by an individual at the institution.<\/p><\/blockquote>\n

Putting aside that the system informed people that they weren’t recognized off the top requiring the examinee to endure the whole session under a cloud, which is far from ideal, this puts a great deal of faith on examiners that, empirically, isn’t warranted. Recall that California, after seeing the volume of flagged exams, including those flagged by this “Deferred ID” system, just went ahead and told one-third of the total number of examinees to prove that they weren’t cheating<\/a>. In other words, ExamSoft’s precious protocol only succeeds in minimizing the imposition upon the examinee when the state bothers to perform the necessary leg work to dispense with the system’s hyperactive flagging system. This is like the tobacco industry saying, “everything’s safe assuming our customers adhere to a strict limit of one cigarette a week” — if the safeguards are unrealistic, then they’re not safeguards.<\/p>\n

All in all, the letter exudes a self-assuredness that belies what took place in the fall. If ExamSoft had taken a different tack and said, “look, there are obviously problems with facial recognition technology that we couldn’t proactively address, but it was a public health emergency and we did everything we could to allow jurisdictions to administer the test they were intent on giving in the safest manner possible,” I’d have a lot more sympathy. Because that’s also probably more accurate! ExamSoft isn’t a mustachioed villain, they just tried to meet a need that state bar exams demanded — it’s not necessarily their fault that the parameters of this request rendered complete success impossible. For obvious reasons, they don’t want to blow up their customers, but it’s the state bar examiners who put ExamSoft in this situation, having to answer questions about how their technology failed to live up to unrealistic expectations.<\/p>\n

There’s a lot going on in government right now, but let’s hope the senators who drafted this inquiry don’t let it go. It doesn’t take much to see that the problems of the remote bar exam debacle don’t amount to a hill of beans in this crazy world, but that doesn’t mean it should be swept under the rug. Especially with the adoption of facial recognition technology spreading across the country. This may be a “bar exam problem” for some people but the uncritical acceptance of a dodgy technology can have tremendous impacts elsewhere and this provides a sizable case study to dig into this issue.<\/p>\n

(Check out the full letter on the next page.)<\/em><\/p>\n

\n

\"Headshot\"Joe Patrice<\/a>\u00a0is a senior editor at Above the Law and co-host of Thinking Like A Lawyer<\/a>. Feel free to\u00a0email<\/a> any tips, questions, or comments. Follow him on\u00a0Twitter<\/a>\u00a0if you’re interested in law, politics, and a healthy dose of college sports news. Joe also serves as a Managing Director at RPN Executive Search<\/a>.<\/em><\/strong><\/p>\n

<\/p>\n

[gview file=”https:\/\/abovethelaw.com\/wp-content\/uploads\/sites\/4\/2021\/01\/ExamSoft-letter.pdf”]<\/p>\n","protected":false},"excerpt":{"rendered":"

Sure one-third of California’s applicants were flagged for cheating, but…<\/p>\n","protected":false},"author":147,"featured_media":522168,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[174],"tags":[409,880,171,490,7],"class_list":["post-17690","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-law-schools","tag-bar-exams","tag-examsoft","tag-law-schools","tag-racism","tag-technology"],"acf":[],"yoast_head":"\nExamSoft Tells Senators That Facial Recognition Problems Are Everyone's Fault But Theirs - Above The Law's Legal Tech Non-Event<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/\" \/>\n<link rel=\"next\" href=\"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/2\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ExamSoft Tells Senators That Facial Recognition Problems Are Everyone's Fault But Theirs - Above The Law's Legal Tech Non-Event\" \/>\n<meta property=\"og:description\" content=\"Sure one-third of California's applicants were flagged for cheating, but...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/\" \/>\n<meta property=\"og:site_name\" content=\"Above The Law's Legal Tech Non-Event\" \/>\n<meta property=\"article:published_time\" content=\"2021-02-01T15:49:51+00:00\" \/>\n<meta name=\"author\" content=\"Joe Patrice\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Joe Patrice\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/\",\"url\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/\",\"name\":\"ExamSoft Tells Senators That Facial Recognition Problems Are Everyone's Fault But Theirs - Above The Law's Legal Tech Non-Event\",\"isPartOf\":{\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/#primaryimage\"},\"thumbnailUrl\":\"\",\"datePublished\":\"2021-02-01T15:49:51+00:00\",\"dateModified\":\"2021-02-01T15:49:51+00:00\",\"author\":{\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/79d334169706fb219ff99177283474ad\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/#primaryimage\",\"url\":\"\",\"contentUrl\":\"\"},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#website\",\"url\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/\",\"name\":\"Above The Law's Legal Tech Non-Event\",\"description\":\"A Legal Tech Adoption Guide For Perplexed Lawyers\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/79d334169706fb219ff99177283474ad\",\"name\":\"Joe Patrice\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/39725f4befa491dfd9b10a60abee0488ed3cd456e04382c0ba7a6af9b0acd30b?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/39725f4befa491dfd9b10a60abee0488ed3cd456e04382c0ba7a6af9b0acd30b?s=96&d=mm&r=g\",\"caption\":\"Joe Patrice\"},\"description\":\"Joe Patrice joined Above the Law in 2013. Joe received a degree in Economics and Political Science from the University of Oregon and a J.D. from the NYU School of Law. From 2001, he worked as a litigator for both Cleary, Gottlieb, Steen & Hamilton and Lankler Siffert & Wohl, representing a variety of individuals, institutions, and foreign sovereigns in criminal and civil matters. Joe left legal practice in 2012 to pursue writing, contributing to numerous publications, including ATL, before joining the full-time staff.\",\"url\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/author\/joe-patrice\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"ExamSoft Tells Senators That Facial Recognition Problems Are Everyone's Fault But Theirs - Above The Law's Legal Tech Non-Event","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/","next":"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/2\/","og_locale":"en_US","og_type":"article","og_title":"ExamSoft Tells Senators That Facial Recognition Problems Are Everyone's Fault But Theirs - Above The Law's Legal Tech Non-Event","og_description":"Sure one-third of California's applicants were flagged for cheating, but...","og_url":"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/","og_site_name":"Above The Law's Legal Tech Non-Event","article_published_time":"2021-02-01T15:49:51+00:00","author":"Joe Patrice","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Joe Patrice","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/","url":"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/","name":"ExamSoft Tells Senators That Facial Recognition Problems Are Everyone's Fault But Theirs - Above The Law's Legal Tech Non-Event","isPartOf":{"@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#website"},"primaryImageOfPage":{"@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/#primaryimage"},"image":{"@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/#primaryimage"},"thumbnailUrl":"","datePublished":"2021-02-01T15:49:51+00:00","dateModified":"2021-02-01T15:49:51+00:00","author":{"@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/79d334169706fb219ff99177283474ad"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2021\/02\/01\/examsoft-tells-senators-that-facial-recognition-problems-are-everyones-fault-but-theirs\/#primaryimage","url":"","contentUrl":""},{"@type":"WebSite","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#website","url":"https:\/\/abovethelaw.com\/legal-innovation-center\/","name":"Above The Law's Legal Tech Non-Event","description":"A Legal Tech Adoption Guide For Perplexed Lawyers","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/abovethelaw.com\/legal-innovation-center\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/79d334169706fb219ff99177283474ad","name":"Joe Patrice","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/39725f4befa491dfd9b10a60abee0488ed3cd456e04382c0ba7a6af9b0acd30b?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/39725f4befa491dfd9b10a60abee0488ed3cd456e04382c0ba7a6af9b0acd30b?s=96&d=mm&r=g","caption":"Joe Patrice"},"description":"Joe Patrice joined Above the Law in 2013. Joe received a degree in Economics and Political Science from the University of Oregon and a J.D. from the NYU School of Law. From 2001, he worked as a litigator for both Cleary, Gottlieb, Steen & Hamilton and Lankler Siffert & Wohl, representing a variety of individuals, institutions, and foreign sovereigns in criminal and civil matters. Joe left legal practice in 2012 to pursue writing, contributing to numerous publications, including ATL, before joining the full-time staff.","url":"https:\/\/abovethelaw.com\/legal-innovation-center\/author\/joe-patrice\/"}]}},"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/posts\/17690","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/users\/147"}],"replies":[{"embeddable":true,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/comments?post=17690"}],"version-history":[{"count":0,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/posts\/17690\/revisions"}],"wp:attachment":[{"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/media?parent=17690"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/categories?post=17690"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/tags?post=17690"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}