{"id":30387,"date":"2024-04-29T16:33:42","date_gmt":"2024-04-29T20:33:42","guid":{"rendered":"https:\/\/abovethelaw.com\/?p=1055010"},"modified":"2024-04-29T16:33:42","modified_gmt":"2024-04-29T20:33:42","slug":"the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results","status":"publish","type":"post","link":"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/","title":{"rendered":"The Race To Keep Law Firms From Completely Screwing Up Generative AI With Disastrous Results"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright size-medium wp-image-690755\" src=\"https:\/\/abovethelaw.com\/wp-content\/uploads\/sites\/4\/2020\/08\/GettyImages-1208598245-300x299.jpg\" alt=\"robot artificial intelligence thinks dreams\" width=\"300\" height=\"299\" \/>Every year I show up at ILTACON expecting to sit in on at least some of the overwhelming volume of educational sessions and learn something about legal tech from the decision makers driving adoption. And every year I don\u2019t manage to see any sessions. Because, frankly, there\u2019s too much happening outside the sessions to take an hour off to strap into some learning.<\/p>\n<p>Every provider is there showing off the latest updates, the industry consolidators are busy consolidating, and there are too many candid implementation war stories getting swapped in the halls (and bars) not to join in. Sadly this all keeps me away from the sessions. Obviously, as a reporter, my priorities aren\u2019t the same as most attendees, but even the most committed to the educational programming will be found on the last day lamenting that they missed some intriguing panel because they were torn in a million different directions. But that\u2019s what you get when you build one of the pillars of the legal technology calendar.<\/p>\n<p>But it\u2019s also why ILTA Evolve is such a smart addition to the conference calendar. Taking just two hot topics a year and never scheduling more than two dueling sessions at a time, it\u2019s an opportunity to slow down and actually listen to some sessions.<\/p>\n<p>This year\u2019s event tackled privacy\/security and generative AI, so the obvious kickoff session is the one focused on the nexus of the two. In \u201cPrivacy v. Security &#8211; How GenAI Creates Challenges to Both,\u201d Reanna Martinez, Solutions Manager at Munger, Tolles &amp; Olson LLP, and Kenny Leckie, Senior Technology &amp; Change Management Consultant at Traveling Coaches, walk through the looming GenAI adoption moment(s) that firms will navigate.<\/p>\n<p>By way of laying the foundation, Martinez broke down the various AI tools that partners are absolutely just going to call &#8220;ChatGPT&#8221; no matter what. But for the more tech savvy, the universe breaks down into consumer facing free products like the aforementioned ChatGPT, the enterprise level versions of those technologies, and the legal specific offerings like CoCounsel or Lexis+ AI. It probably goes without saying, but the risk profile of each category moves from the deepest red of red flags &#8212;\u00a0 Leckie cited a conversation where he was told to think of public GenAI as the &#8220;opposite&#8221; of data security &#8212; through cautiously medium amounts of worry.<\/p>\n<p>That lawyers are going to consistently disregard the line between &#8220;ChatGPT&#8221; and &#8220;our enterprise ChatGPT,&#8221; is inevitable. The next few years are going to be pure hell for IT.<\/p>\n<p>While the lawyers don&#8217;t necessarily need to know the whole process that tech staff will deploy to keep the firm from becoming a cautionary tale, it might help at a 30,000 foot level to develop an appreciation of what goes into bringing new tech under the firm&#8217;s roof.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-1055022\" src=\"https:\/\/abovethelaw.com\/wp-content\/uploads\/sites\/4\/2024\/04\/Screenshot-2024-04-29-at-2.56.43\u202fPM.png\" alt=\"Screenshot 2024-04-29 at 2.56.43\u202fPM\" width=\"2012\" height=\"1128\" \/><\/p>\n<p>The evaluation process involves assessing a product&#8217;s Data Privacy and Confidentiality, Security of Model Training and Deployment, Data Handling and Retention Policies, Vendor Security and Reliability, Risk of Bias and Fairness, and Legal and Ethical Considerations. This isn&#8217;t necessarily AI-specific &#8212; most products touch on these concerns &#8212; but this process is going on before the lawyers ever see this stuff.<\/p>\n<p>Preparing the internal environment involves building all the permissions, firewalls, encryptions, monitoring systems, audit trails, and crisis response strategies. This is where some lucky pilot program users figure out exactly how broken the product will be before it has a chance to ruin everything.<\/p>\n<p>The next stage is where the rest of you come in &#8212; what Martinez coined &#8220;the wild card.&#8221; This is where they train users\/plead with them not to bypass all their work and just dump the client&#8217;s personal data into ChatGPT. But also where they have to convince lawyers to actually use the product before it becomes a fancy digital doorstop. Understanding the work that gets the product to this point should inform the rest of the firm about how confident the experts are in the product by the time you&#8217;re sitting in training.<\/p>\n<p>You are not a unique and special snowflake brought in on day 1 to opine about the product. You have joined the game on third base. Act like it.<\/p>\n<p>The next subject in the model &#8212; the internal GPT model &#8212; involves firms building their own LLMs from scratch. The general takeaway from this was&#8230; don&#8217;t. Very few firms have the resources to do it competently and if the firm doesn&#8217;t already know whether or not they have those resources, then they do not, in fact, have those resources. So, don&#8217;t tell your tech staff, &#8220;why don&#8217;t we just build our own AI? I mean, how hard can it be?&#8221;<\/p>\n<p>Finally, after everything is up and running, the tech side remains vigilant to stop Data Poisoning, Model Theft and Intellectual Property Theft, Privacy Breaches, Deployment Risks, and Misuse of Generated Content.<\/p>\n<p>So it is not a case of &#8220;let&#8217;s go buy some AI.&#8221; This is a detailed process and it&#8217;s deliberate because the risks are higher than Snoop on April 20th. Understand your place in the machine that gets the firm into the 21st century.<\/p>\n<hr \/>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-443318\" src=\"https:\/\/abovethelaw.com\/wp-content\/uploads\/sites\/4\/2016\/11\/Headshot-300x200.jpg\" alt=\"Headshot\" width=\"189\" height=\"126\" \/><strong><em><a href=\"http:\/\/abovethelaw.com\/author\/joe-patrice\/\" target=\"_blank\" rel=\"noopener\">Joe Patrice<\/a>\u00a0is a senior editor at Above the Law and co-host of <a href=\"http:\/\/legaltalknetwork.com\/podcasts\/thinking-like-a-lawyer\/\" target=\"_blank\" rel=\"noopener\">Thinking Like A Lawyer<\/a>. Feel free to\u00a0<a href=\"mailto:joepatrice@abovethelaw.com\">email<\/a> any tips, questions, or comments. Follow him on\u00a0<a href=\"https:\/\/twitter.com\/josephpatrice\" target=\"_blank\" rel=\"noopener\">Twitter<\/a>\u00a0if you&#8217;re interested in law, politics, and a healthy dose of college sports news. Joe also serves as a <a href=\"https:\/\/www.rpnexecsearch.com\/josephpatrice\" target=\"_blank\" rel=\"noopener\">Managing Director at RPN Executive Search<\/a>.<\/em><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p class=\"summary\">Behind the scenes, firm tech staff are working to keep the security threats you&#8217;re all about to cause to a minimum.<\/p>\n","protected":false},"author":147,"featured_media":690755,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[11],"tags":[20,441,11436,11076,7],"class_list":["post-30387","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","tag-artificial-intelligence","tag-ilta","tag-ilta-evolve","tag-ilta-on-atl","tag-technology"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>The Race To Keep Law Firms From Completely Screwing Up Generative AI With Disastrous Results - Above The Law&#039;s Legal Tech Non-Event<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Race To Keep Law Firms From Completely Screwing Up Generative AI With Disastrous Results - Above The Law&#039;s Legal Tech Non-Event\" \/>\n<meta property=\"og:description\" content=\"Behind the scenes, firm tech staff are working to keep the security threats you&#039;re all about to cause to a minimum.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/\" \/>\n<meta property=\"og:site_name\" content=\"Above The Law&#039;s Legal Tech Non-Event\" \/>\n<meta property=\"article:published_time\" content=\"2024-04-29T20:33:42+00:00\" \/>\n<meta name=\"author\" content=\"Joe Patrice\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Joe Patrice\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/\",\"url\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/\",\"name\":\"The Race To Keep Law Firms From Completely Screwing Up Generative AI With Disastrous Results - Above The Law&#039;s Legal Tech Non-Event\",\"isPartOf\":{\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/#primaryimage\"},\"thumbnailUrl\":\"\",\"datePublished\":\"2024-04-29T20:33:42+00:00\",\"dateModified\":\"2024-04-29T20:33:42+00:00\",\"author\":{\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/79d334169706fb219ff99177283474ad\"},\"breadcrumb\":{\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/#primaryimage\",\"url\":\"\",\"contentUrl\":\"\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Race To Keep Law Firms From Completely Screwing Up Generative AI With Disastrous Results\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#website\",\"url\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/\",\"name\":\"Above The Law&#039;s Legal Tech Non-Event\",\"description\":\"A Legal Tech Adoption Guide For Perplexed Lawyers\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/79d334169706fb219ff99177283474ad\",\"name\":\"Joe Patrice\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/39725f4befa491dfd9b10a60abee0488ed3cd456e04382c0ba7a6af9b0acd30b?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/39725f4befa491dfd9b10a60abee0488ed3cd456e04382c0ba7a6af9b0acd30b?s=96&d=mm&r=g\",\"caption\":\"Joe Patrice\"},\"description\":\"Joe Patrice joined Above the Law in 2013. Joe received a degree in Economics and Political Science from the University of Oregon and a J.D. from the NYU School of Law. From 2001, he worked as a litigator for both Cleary, Gottlieb, Steen &amp; Hamilton and Lankler Siffert &amp; Wohl, representing a variety of individuals, institutions, and foreign sovereigns in criminal and civil matters. Joe left legal practice in 2012 to pursue writing, contributing to numerous publications, including ATL, before joining the full-time staff.\",\"url\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/author\/joe-patrice\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Race To Keep Law Firms From Completely Screwing Up Generative AI With Disastrous Results - Above The Law&#039;s Legal Tech Non-Event","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/","og_locale":"en_US","og_type":"article","og_title":"The Race To Keep Law Firms From Completely Screwing Up Generative AI With Disastrous Results - Above The Law&#039;s Legal Tech Non-Event","og_description":"Behind the scenes, firm tech staff are working to keep the security threats you're all about to cause to a minimum.","og_url":"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/","og_site_name":"Above The Law&#039;s Legal Tech Non-Event","article_published_time":"2024-04-29T20:33:42+00:00","author":"Joe Patrice","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Joe Patrice","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/","url":"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/","name":"The Race To Keep Law Firms From Completely Screwing Up Generative AI With Disastrous Results - Above The Law&#039;s Legal Tech Non-Event","isPartOf":{"@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#website"},"primaryImageOfPage":{"@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/#primaryimage"},"image":{"@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/#primaryimage"},"thumbnailUrl":"","datePublished":"2024-04-29T20:33:42+00:00","dateModified":"2024-04-29T20:33:42+00:00","author":{"@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/79d334169706fb219ff99177283474ad"},"breadcrumb":{"@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/#primaryimage","url":"","contentUrl":""},{"@type":"BreadcrumbList","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2024\/04\/29\/the-race-to-keep-law-firms-from-completely-screwing-up-generative-ai-with-disastrous-results\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/abovethelaw.com\/legal-innovation-center\/"},{"@type":"ListItem","position":2,"name":"The Race To Keep Law Firms From Completely Screwing Up Generative AI With Disastrous Results"}]},{"@type":"WebSite","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#website","url":"https:\/\/abovethelaw.com\/legal-innovation-center\/","name":"Above The Law&#039;s Legal Tech Non-Event","description":"A Legal Tech Adoption Guide For Perplexed Lawyers","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/abovethelaw.com\/legal-innovation-center\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/79d334169706fb219ff99177283474ad","name":"Joe Patrice","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/39725f4befa491dfd9b10a60abee0488ed3cd456e04382c0ba7a6af9b0acd30b?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/39725f4befa491dfd9b10a60abee0488ed3cd456e04382c0ba7a6af9b0acd30b?s=96&d=mm&r=g","caption":"Joe Patrice"},"description":"Joe Patrice joined Above the Law in 2013. Joe received a degree in Economics and Political Science from the University of Oregon and a J.D. from the NYU School of Law. From 2001, he worked as a litigator for both Cleary, Gottlieb, Steen &amp; Hamilton and Lankler Siffert &amp; Wohl, representing a variety of individuals, institutions, and foreign sovereigns in criminal and civil matters. Joe left legal practice in 2012 to pursue writing, contributing to numerous publications, including ATL, before joining the full-time staff.","url":"https:\/\/abovethelaw.com\/legal-innovation-center\/author\/joe-patrice\/"}]}},"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/posts\/30387","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/users\/147"}],"replies":[{"embeddable":true,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/comments?post=30387"}],"version-history":[{"count":0,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/posts\/30387\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/"}],"wp:attachment":[{"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/media?parent=30387"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/categories?post=30387"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/tags?post=30387"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}