{"id":27577,"date":"2023-05-23T10:49:43","date_gmt":"2023-05-23T14:49:43","guid":{"rendered":"https:\/\/abovethelaw.com\/?p=966871"},"modified":"2023-05-23T10:49:43","modified_gmt":"2023-05-23T14:49:43","slug":"how-generative-ai-works-part-i","status":"publish","type":"post","link":"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/","title":{"rendered":"How Generative AI Works (Part I)"},"content":{"rendered":"

\"artificial-intelligence-4111582_1920\"In April 2018, Mark Zuckerberg testified before the Senate Judiciary and Commerce Committee, regarding data and privacy issues. His testimony included responses to questions<\/a> like, “How do you sustain a business model in which users don’t pay for your service?” Zuckerberg answered, “Senator, we run ads.”<\/p>\n

This isn\u2019t the first time — nor will it be the last — that a member of Congress or a regulator will demonstrate a lack of understanding of technology being considered for regulation. And as demonstrated by the recent Senate hearing<\/a> AI presents even greater challenges for legislators and regulators.<\/p>\n

The New York Times recently published an article<\/a> highlighting how the federal government and regulators have been \u201chands-off\u201d about regulating artificial intelligence so far. It will be imperative that lawmakers and regulators understand Generative AI to properly regulate it.<\/p>\n

The same logic will also apply to attorneys. They must have a foundational understanding of how AI works to be able to effectively advise clients on matters pertaining to AI. Here, we\u2019ll examine the evolution of search functions \u00a0to better understand how we got to the AI that\u2019s available today.<\/p>\n

This is the first in a series of articles that will help lay a foundation so attorneys can better understand how AI works. <\/em><\/p>\n

Our journey to ChatGPT actually begins with Gutenberg. Around 1440, Johannes Gutenberg invented the movable type printing press. The result of his invention expanded the ability to communicate and had profound impacts on culture, religion, politics, power structures, and society. His invention influenced the Renaissance and the Protestant Reformation in Europe. The printing press was a tremendous technological advancement and spurred the development of copyright law.<\/p>\n

By the end of the 1500s, published works were complex enough that some publications included indexes of key words and concepts. An index provides the ability to quickly find something important in a publication without reading the entire publication. A reader simply goes to the back of the publication, looks through the listing and is directed to the specific page(s) where the subject matter appears.<\/p>\n

From Publication Indexes To Search Engines<\/strong><\/p>\n

Most people think of Google when they think of full-text searching, but the first commercial applications date back to the 1960s. The Dialog service was developed by Lockheed in 1966 and was commonly used in law firms in the 1980s and 1990s, and Mead Paper developed a search engine in the same timeframe. They launched Mead Data Central in 1973. Searching legal documents was one of the first commercial applications.<\/p>\n

The secret of how a search engine works is quite simple. Rather than a manually curated index of important words, computing technology enabled the creation of a comprehensive index of all words in a collection of documents.<\/p>\n

While a human referencing an index would be satisfied with simply knowing the page number to seek out in a book, a \u201csearch index\u201d is more comprehensive. It inventories the exact location of each word within a document for use by an algorithm. \u201cNoise words\u201d like \u201ca\u201d, \u201cof,\u201d and \u201cthe\u201d are excluded.<\/p>\n

Boolean Search<\/strong><\/p>\n

By creating a search index, Boolean searching was made possible. A user could search \u201csecurities\u201d and \u201cfraud\u201d and be presented quickly with all documents in a database that contained the words \u201csecurities\u201d and \u201cfraud.\u201d<\/p>\n

Additionally, a search algorithm could support other logical search operators (e.g., \u201cnot\u201d) to exclude words from a search result. And since the search index knows the exact location of each word in every document, the ability to search \u201csecurities\u201d within 10 words of \u201cfraud\u201d is also easy for the search algorithm.<\/p>\n

Search engines do not comb through every document. That takes too long, even for a computer. Search engines are efficient because they take the same shortcut that a human does. It accesses its search index much like a person going to the back of a book to find a word in an index. That is the magic and mystery of full-text searching.<\/p>\n

Over time, indexing has become much more sophisticated. For example, phrases and legal terms (e.g., \u201cconsequential damages\u201d) would be inventoried and indexed as if they were a single word. This would eliminate search results where the words \u201cconsequential\u201d and \u201cdamages\u201d were mentioned in a document, but the document had nothing to do with the legal term \u201cconsequential damages.\u201d<\/p>\n

Another example of how search indexing has improved over the years relates to a thesaurus. A human might reference a thesaurus to find another word with a similar meaning. A search algorithm can do the same thing. For example, in Louisiana the word \u201cparish\u201d is equivalent to the word \u201ccounty\u201d in other parts of the country. A search index that incorporates a thesaurus of terms can ensure that a user searching for \u201ccounties\u201d will receive a search result that includes \u201cparishes\u201d in Louisiana.<\/p>\n

Boolean search was popular well into the 1990s. It was precise and gave very accurate and repeatable results. Some expert searchers still prefer Boolean searching.<\/p>\n

Natural Language Search<\/strong><\/p>\n

As computing power increased, new approaches enabled more resource-intensive approaches to searching. Systems were developed to allow users to enter phrases in \u201cplain English\u201d rather than using complex Boolean connectors. This was an early application of natural language processing, and the legal industry was an early adopter of it.<\/p>\n

In Boolean search, it was common for a search result to list documents in chronological order, starting with the most recent. A user might sift through hundreds of documents to find the most relevant document. But when plain English searching, the results are provided in order of the most relevant to the least.<\/p>\n

Entering a sentence like \u201cShow me cases where compensatory damages were denied in a car accident\u201d is an example of a plain English search. The search algorithm will identify all documents that have any of the words in the search query.<\/p>\n

The secret behind early plain English searching related to tweaks in the indexing and algorithm. The search algorithm would rank documents highest based upon two factors. First, how frequently do the words occur in individual documents? The more frequent, the higher the ranking. Second, the algorithms considered how unique a word was in the overall database. Words like \u201ccompensatory\u201d might be infrequent in the database, so documents containing compensatory would get pushed toward the top of search results too.<\/p>\n

Google Search<\/strong><\/p>\n

Google\u2019s search algorithm follows the natural language \u201cplain English\u201d search at massive scale. But Google makes its money off paid advertising, much like Zuckerberg\u2019s Facebook. So the algorithm and search results<\/a> support making money. Google adjusts its search algorithm regularly. Google prioritizes search results on many factors including the quality of sites. Many other factors go into the Google algorithm such as user location and filtering objectionable content.<\/p>\n

Full-text searching sounds complex, but it\u2019s understandable when the core concepts are related to metaphors like a book\u2019s index. Additionally, attorneys have been using an early version of natural language processing, \u201cplain English\u201d search, for the better part of their careers.<\/p>\n

In ChatGPT, a user\u2019s \u201cplain English\u201d query results in a conversational answer in \u201cplain English.\u201d<\/p>\n

Next month, we\u2019ll explore how natural language processing that powers searching relates to ChatGPT.<\/p>\n

\n

\"KenKen Crutchfield is Vice President and General Manager of Legal Markets at Wolters Kluwer Legal & Regulatory U.S., a leading provider of information, business intelligence, regulatory and legal workflow solutions. Ken has more than three decades of experience as a leader in information and software solutions across industries. He can be reached at\u00a0<\/strong><\/em>ken.crutchfield@wolterskluwer.com<\/em><\/strong><\/a>.<\/strong><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

This is the first in a series of articles that will help lay a foundation so attorneys can better understand how AI works.<\/p>\n","protected":false},"author":132941,"featured_media":712235,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[11],"tags":[9509,10594,10782,7517,7],"class_list":["post-27577","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","tag-artificial-intelligence-ai","tag-chatgpt","tag-generative-ai","tag-ken-crutchfield","tag-technology"],"acf":[],"yoast_head":"\nHow Generative AI Works (Part I) - Above The Law's Legal Tech Non-Event<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How Generative AI Works (Part I) - Above The Law's Legal Tech Non-Event\" \/>\n<meta property=\"og:description\" content=\"This is the first in a series of articles that will help lay a foundation so attorneys can better understand how AI works.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/\" \/>\n<meta property=\"og:site_name\" content=\"Above The Law's Legal Tech Non-Event\" \/>\n<meta property=\"article:published_time\" content=\"2023-05-23T14:49:43+00:00\" \/>\n<meta name=\"author\" content=\"Ken Crutchfield\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Ken Crutchfield\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/\",\"url\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/\",\"name\":\"How Generative AI Works (Part I) - Above The Law's Legal Tech Non-Event\",\"isPartOf\":{\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/#primaryimage\"},\"thumbnailUrl\":\"\",\"datePublished\":\"2023-05-23T14:49:43+00:00\",\"dateModified\":\"2023-05-23T14:49:43+00:00\",\"author\":{\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/fd261adce4cb5ab4a470f3c1ef5f6a7e\"},\"breadcrumb\":{\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/#primaryimage\",\"url\":\"\",\"contentUrl\":\"\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How Generative AI Works (Part I)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#website\",\"url\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/\",\"name\":\"Above The Law's Legal Tech Non-Event\",\"description\":\"A Legal Tech Adoption Guide For Perplexed Lawyers\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/fd261adce4cb5ab4a470f3c1ef5f6a7e\",\"name\":\"Ken Crutchfield\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/075b4caf8b45311c26a89821b6b895ee1f0f45c3796befe6aaf31d7f6bea3916?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/075b4caf8b45311c26a89821b6b895ee1f0f45c3796befe6aaf31d7f6bea3916?s=96&d=mm&r=g\",\"caption\":\"Ken Crutchfield\"},\"url\":\"https:\/\/abovethelaw.com\/legal-innovation-center\/author\/kcrutchfield\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How Generative AI Works (Part I) - Above The Law's Legal Tech Non-Event","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/","og_locale":"en_US","og_type":"article","og_title":"How Generative AI Works (Part I) - Above The Law's Legal Tech Non-Event","og_description":"This is the first in a series of articles that will help lay a foundation so attorneys can better understand how AI works.","og_url":"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/","og_site_name":"Above The Law's Legal Tech Non-Event","article_published_time":"2023-05-23T14:49:43+00:00","author":"Ken Crutchfield","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Ken Crutchfield","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/","url":"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/","name":"How Generative AI Works (Part I) - Above The Law's Legal Tech Non-Event","isPartOf":{"@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#website"},"primaryImageOfPage":{"@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/#primaryimage"},"image":{"@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/#primaryimage"},"thumbnailUrl":"","datePublished":"2023-05-23T14:49:43+00:00","dateModified":"2023-05-23T14:49:43+00:00","author":{"@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/fd261adce4cb5ab4a470f3c1ef5f6a7e"},"breadcrumb":{"@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/#primaryimage","url":"","contentUrl":""},{"@type":"BreadcrumbList","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/2023\/05\/23\/how-generative-ai-works-part-i\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/abovethelaw.com\/legal-innovation-center\/"},{"@type":"ListItem","position":2,"name":"How Generative AI Works (Part I)"}]},{"@type":"WebSite","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#website","url":"https:\/\/abovethelaw.com\/legal-innovation-center\/","name":"Above The Law's Legal Tech Non-Event","description":"A Legal Tech Adoption Guide For Perplexed Lawyers","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/abovethelaw.com\/legal-innovation-center\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/fd261adce4cb5ab4a470f3c1ef5f6a7e","name":"Ken Crutchfield","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/abovethelaw.com\/legal-innovation-center\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/075b4caf8b45311c26a89821b6b895ee1f0f45c3796befe6aaf31d7f6bea3916?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/075b4caf8b45311c26a89821b6b895ee1f0f45c3796befe6aaf31d7f6bea3916?s=96&d=mm&r=g","caption":"Ken Crutchfield"},"url":"https:\/\/abovethelaw.com\/legal-innovation-center\/author\/kcrutchfield\/"}]}},"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/posts\/27577","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/users\/132941"}],"replies":[{"embeddable":true,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/comments?post=27577"}],"version-history":[{"count":0,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/posts\/27577\/revisions"}],"wp:attachment":[{"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/media?parent=27577"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/categories?post=27577"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/abovethelaw.com\/legal-innovation-center\/wp-json\/wp\/v2\/tags?post=27577"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}