{"id":16973,"date":"2023-10-24T16:03:29","date_gmt":"2023-10-24T20:03:29","guid":{"rendered":"https:\/\/www.insightpartners.com\/?p=16973"},"modified":"2023-11-28T14:38:32","modified_gmt":"2023-11-28T19:38:32","slug":"llmops-mlops-what-you-need-to-know","status":"publish","type":"post","link":"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/","title":{"rendered":"Navigating the LLMops landscape: What you need to know"},"content":{"rendered":"<p>At Insight, we have been closely monitoring the rise of enterprise adoption of artificial intelligence (AI) for years \u2013 from the <a href=\"https:\/\/www.insightpartners.com\/ideas\/theater-or-reality-emerging-economic-power-in-machine-learning-and-artificial-intelligence-startups\/\">industry-specific applications of AI<\/a> we first started tracking in 2017, the <a href=\"https:\/\/www.insightpartners.com\/ideas\/investing-in-artificial-intelligence-how-mlops-drives-enterprise-ai-wins\/\">\u201cMLops\u201d infrastructure companies<\/a> we discussed in 2021, and, along with the rest of the world, the interesting <a href=\"https:\/\/www.insightpartners.com\/ideas\/generative-ai-stack\/\">generative AI use cases<\/a> that have shown up over the last 12 months.<\/p>\n<p>Recently, from conversations with enterprise executives through our <a href=\"https:\/\/www.insightpartners.com\/ignite\/\">IGNITE<\/a> program, as well as numerous conversations with founders, we realized that the tools required to implement generative AI use cases, or \u201cLLMops\u201d tools, differ from the toolchain for more traditional prediction system machine learning (ML) models, or \u201cMLops.\u201d<\/p>\n<p>Both MLops (machine learning operations) and LLMops (large language model operations) refer to the combination of tools and infrastructure needed to train, deploy, and maintain a machine learning model.<\/p>\n<ul>\n<li>MLops is used for systems of prediction: machine learning models that typically perform objective-focused tasks (e.g.,\u00a0 <a href=\"https:\/\/tractable.ai\/\">Tractable AI<\/a>\u2019s computer vision models that take pictures of cars and assess the damage done). The outputs in these models are usually recommendations, classifications, or predictions.<\/li>\n<li>LLMops is used to build systems of creation: generative AI applications that are often open-ended or qualitative and<em> generate<\/em> new content (e.g., <a href=\"https:\/\/www.jasper.ai\/\">Jasper AI<\/a> creates marketing copy in the voice of your company).<\/li>\n<\/ul>\n<h2>How and why MLops differs from LLMops<\/h2>\n<p>Enterprises need different tools for generative AI vs. traditional prediction system ML models. Some reasons may include:<\/p>\n<h3>Transfer learning<\/h3>\n<p>Generative AI and predictive AI applications are created differently. Many generative AI products start with a pre-trained foundation model, which is then customized for a specific downstream use case. This is a different, and in some ways easier, process than creating a new, predictive ML model from scratch. Building predictive ML involves gathering data, annotating data, training the model, tuning different hyperparameters and model inputs, etc.<\/p>\n<p>By contrast, enterprises building generative AI select the LLM, fine-tune it with new data, and\/or provide context by attaching relevant reference data within the LLM prompts. This process of adapting a pre-trained generative LLM is often easier than creating a new predictive ML model from scratch, and that\u2019s a big part of the reason we\u2019ve seen an outpouring of generative AI products from incumbent software vendors over the last year.<\/p>\n<h3>Compute management<\/h3>\n<p>A second difference is in the computational resources required. The original pre-training of LLMs often requires orders of magnitude more compute. Even when leveraging a pre-trained LLM, <em>running<\/em> an LLM \u2014 what\u2019s called \u201cinference\u201d\u2014 is often very compute intensive, vs. predictive ML models, which can get away with smaller amounts of computational resources for inference.<\/p>\n<p>As a result, runtime infrastructure efficiency management, whether it is implemented by tuning the model architecture, optimizing how the compute scales, or taking another approach, is critical for LLM deployments.<\/p>\n<h3>Feedback loops<\/h3>\n<p>Many (although not all) predictive ML models will produce clear performance metrics (e.g., the accuracy of a diagnosis outputted by an ML model trained on medical images, such as for our portfolio companies <a href=\"https:\/\/www.overjet.ai\/\">Overjet<\/a>, <a href=\"https:\/\/iterative.health\/\">Iterative Health<\/a>, or <a href=\"https:\/\/screenpoint-medical.com\/?_gl=1%2A9w4hs1%2A_up%2AMQ..%2A_ga%2ANDg0NDU1NzcyLjE2OTQ1NDQ4NjE.%2A_ga_NBTBKVY458%2AMTY5NDU0NDg1OS4xLjAuMTY5NDU0NDg1OS4wLjAuMA..\">ScreenPoint Medical<\/a>).<\/p>\n<p>Generative AI models, on the other hand, typically produce more qualitative output. These open-ended generative tasks are sometimes harder to evaluate. Reinforcement learning from human feedback (RLHF) in a generative AI context is one way to gather human feedback data that can be used to fine-tune models to improve their performance. Gathering and using RLHF-type data requires tools for collecting feedback that are different from the tools used with predictive ML.<\/p>\n<p>Another concept is RLAIF (or reinforcement learning from AI feedback), in which an LLM is fine-tuned using feedback generated by an AI (sometimes an AI trained partially on human feedback). There is also the Constitutional AI approach being used by <a href=\"https:\/\/www.anthropic.com\/\">Anthropic<\/a>, which involves fine-tuning an LLM using a list of rules or values that are important to humans. For many LLM use cases, incorporating feedback using an ongoing streamlined workflow can improve the reliability of models. Trust, reliability, and safety have become an important emerging economic moat for early generative AI products.<\/p>\n<p>Click to expand the image below.<\/p>\n<p><a href=\"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-mlops-tech-stack-for-generative-ai.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-17110 size-full\" src=\"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-mlops-tech-stack-for-generative-ai.png\" alt=\" llmops-mlops tech stack for generative ai.png\" width=\"1224\" height=\"640\" srcset=\"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-mlops-tech-stack-for-generative-ai.png 1224w, https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-mlops-tech-stack-for-generative-ai-300x157.png 300w, https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-mlops-tech-stack-for-generative-ai-1024x535.png 1024w, https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-mlops-tech-stack-for-generative-ai-768x402.png 768w\" sizes=\"(max-width: 1224px) 100vw, 1224px\" \/><\/a><\/p>\n<h2>Where LLMops and MLops converge<\/h2>\n<p>For enterprise use cases, many critical pieces of the ML pipeline are shared between LLMops and predictive MLOps, including:<\/p>\n<ul>\n<li><strong>Data privacy:<\/strong> Data and software code used in prompts or in fine-tuning LLMs must be treated with care to avoid accidentally revealing personal information. While this is a real technical challenge today for enterprises, most challenges also represent product opportunities (e.g., new products that help enterprises deal with privacy risks).<\/li>\n<li><strong>Model governance<\/strong>: Complex models, whether for generative AI or predictive ML use cases, are difficult to explain and track. This is challenging for regulators and for meeting audit needs, especially in highly regulated industries with significant impact on consumers, such as healthcare and financial services.<\/li>\n<li><strong>Model security:<\/strong> Protecting data sets and the resulting model from tainted data, service attacks, or unauthorized users is key for enterprises facing potential adversarial threats on their generative AI models. We may also start to see LLM-powered cyber-attacks (e.g. like ransomware, but \u201csmarter\u201d).<\/li>\n<\/ul>\n<h2>Current LLMOps landscape<\/h2>\n<p>Click to expand the image below.<\/p>\n<p><a href=\"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-17211 size-full\" src=\"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1.png\" alt=\"Insight Partners LLMops market map\" width=\"1426\" height=\"792\" srcset=\"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1.png 1426w, https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1-300x167.png 300w, https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1-1024x569.png 1024w, https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1-768x427.png 768w\" sizes=\"(max-width: 1426px) 100vw, 1426px\" \/><\/a><\/p>\n<h3>Vector databases, prompt engineering, model monitoring<\/h3>\n<p>We have seen a proliferation of tools in these three categories. Many of these companies have been launched in the last 12 months, while others, such as our portfolio companies, <a href=\"https:\/\/wandb.ai\/site\">Weights &amp; Biases<\/a>, <a href=\"https:\/\/www.fiddler.ai\/\">Fiddler<\/a>, etc., have leveraged their existing MLops expertise and product capabilities to offer new features focused on LLMops.<\/p>\n<p>Our portfolio company <a href=\"https:\/\/www.singlestore.com\/\">SingleStore<\/a>\u00a0recently launched a powerful vector database capability, similar to the LLM-focused single-purpose vector databases \u2014 but with the advantage of mature database features like autoscaling, high availability, ingest, lots of formats, etc., and it\u2019s multi-modal so you can also use it for lots of other kinds of database workloads, and it likely already has your data in it (so less need for moving data around).<\/p>\n<h3>Compute optimization<\/h3>\n<p>As enterprises look to adopt generative AI<strong>, <\/strong>the efficiency of the inference infrastructure is proving to be a much more important and durable competitive differentiator than we expected, and advantages in efficiency seem to compound with scale. Being able to run the system at 90% lower cost and with fewer GPUs not only makes products higher gross margin but also can make the product qualitatively different and better. Some LLMOps products like <a href=\"https:\/\/www.run.ai\/\">Run:A<\/a>I and <a href=\"https:\/\/deci.ai\/\">Deci AI<\/a> can help companies address different parts of this challenge.<\/p>\n<h2>Areas warranting more focus<\/h2>\n<p>We believe some critical pieces of the LLMops pipeline are currently underrepresented in the marketplace. Enterprises that hope to deploy full generative AI products are often \u201con their own\u201d when it comes to some aspects of privacy, model security, and model governance (more information on generative AI governance can be found in our article <a href=\"https:\/\/www.insightpartners.com\/ideas\/responsible-ai-governance\/\">here<\/a>). Trust will likely be an important moat here, in that it is hard to build and can be quick to lose, making it an important source of competitive advantage.<\/p>\n<h2>What&#8217;s next?<\/h2>\n<p>One obvious shift we\u2019ve noticed between the traditional \u201csystems of prediction\u201d AI and the newer \u201csystems of creation\u201d generative AI is how much<em> easier <\/em>it is for companies to implement useful generative AI capabilities in production. The years of work, employing teams of expensive machine learning engineers, constructing intricate data pipelines and machine learning infrastructures, and amassing extensive training, inference, and feedback data just don\u2019t seem to be as important with generative AI as they were for prediction systems \u2014 at least so far.<\/p>\n<p>Existing players can leverage their distribution, product capabilities, data, and customer trust to launch powerful LLM features to compete with generative AI startups before the startups can get to scale.\u00a0 This has yielded an early advantage for existing players (including fast-growing scaleups like those in the Insight portfolio) who are enjoying advantages over generative AI-native startups in the space, at least so far. Then again, it\u2019s only been a few months.<\/p>\n<hr \/>\n<p><em>Note: Jasper, Run:AI, Deci AI, Weights and Biases, Fiddler, SingleStore, Overjet, Iterative Health, ScreenPoint Medical, Tractable are all Insight portfolio companies.<\/em><\/p>\n<p><em>This market map is up to date as of October 2023.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>At Insight, we have been closely monitoring the rise of enterprise adoption of artificial intelligence (AI) for years \u2013 from the industry-specific applications of AI we first started tracking in 2017, the \u201cMLops\u201d infrastructure companies we discussed in 2021, and, along with the rest of the world, the interesting generative AI use cases that have [&hellip;]<\/p>\n","protected":false},"author":18,"featured_media":17211,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[131,140,1,16],"tags":[],"class_list":["post-16973","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-investor-pov","category-market-maps","category-uncategorized","category-investment-team","topic-industry-insights","domain-ai-ml","domain-it-infrastructure"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v23.1 (Yoast SEO v23.1) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Navigating the LLMops landscape: What you need to know | Insight Partners<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Navigating the LLMops landscape: What you need to know\" \/>\n<meta property=\"og:description\" content=\"At Insight, we have been closely monitoring the rise of enterprise adoption of artificial intelligence (AI) for years \u2013 from the industry-specific applications of AI we first started tracking in 2017, the \u201cMLops\u201d infrastructure companies we discussed in 2021, and, along with the rest of the world, the interesting generative AI use cases that have [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/\" \/>\n<meta property=\"og:site_name\" content=\"Insight Partners\" \/>\n<meta property=\"article:published_time\" content=\"2023-10-24T20:03:29+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-28T19:38:32+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1426\" \/>\n\t<meta property=\"og:image:height\" content=\"792\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Jen Jordan\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@insightpartners\" \/>\n<meta name=\"twitter:site\" content=\"@insightpartners\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jen Jordan\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/\"},\"author\":{\"name\":\"Jen Jordan\",\"@id\":\"https:\/\/www.insightpartners.com\/#\/schema\/person\/a8493e07e95c0a29e5a5832110e82f1b\"},\"headline\":\"Navigating the LLMops landscape: What you need to know\",\"datePublished\":\"2023-10-24T20:03:29+00:00\",\"dateModified\":\"2023-11-28T19:38:32+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/\"},\"wordCount\":1349,\"publisher\":{\"@id\":\"https:\/\/www.insightpartners.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1.png\",\"articleSection\":{\"0\":\"Investor POV\",\"1\":\"Market maps\",\"3\":\"Investment Team\"},\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/\",\"url\":\"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/\",\"name\":\"Navigating the LLMops landscape: What you need to know | Insight Partners\",\"isPartOf\":{\"@id\":\"https:\/\/www.insightpartners.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1.png\",\"datePublished\":\"2023-10-24T20:03:29+00:00\",\"dateModified\":\"2023-11-28T19:38:32+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/#primaryimage\",\"url\":\"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1.png\",\"contentUrl\":\"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1.png\",\"width\":1426,\"height\":792,\"caption\":\"Insight Partners LLMops market map\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.insightpartners.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Navigating the LLMops landscape: What you need to know\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.insightpartners.com\/#website\",\"url\":\"https:\/\/www.insightpartners.com\/\",\"name\":\"Insight Partners\",\"description\":\"Scaling the Future of AI\",\"publisher\":{\"@id\":\"https:\/\/www.insightpartners.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.insightpartners.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.insightpartners.com\/#organization\",\"name\":\"Insight Partners\",\"url\":\"https:\/\/www.insightpartners.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.insightpartners.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/insightpartners.com\/wp-content\/uploads\/2023\/01\/Inisghtpartners.png\",\"contentUrl\":\"https:\/\/insightpartners.com\/wp-content\/uploads\/2023\/01\/Inisghtpartners.png\",\"width\":1255,\"height\":650,\"caption\":\"Insight Partners\"},\"image\":{\"@id\":\"https:\/\/www.insightpartners.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/insightpartners\",\"https:\/\/www.linkedin.com\/company\/insight--partners\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.insightpartners.com\/#\/schema\/person\/a8493e07e95c0a29e5a5832110e82f1b\",\"name\":\"Jen Jordan\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.insightpartners.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/95cc93892e0d46db81ac6197312850f9?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/95cc93892e0d46db81ac6197312850f9?s=96&d=mm&r=g\",\"caption\":\"Jen Jordan\"}}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Navigating the LLMops landscape: What you need to know | Insight Partners","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/","og_locale":"en_US","og_type":"article","og_title":"Navigating the LLMops landscape: What you need to know","og_description":"At Insight, we have been closely monitoring the rise of enterprise adoption of artificial intelligence (AI) for years \u2013 from the industry-specific applications of AI we first started tracking in 2017, the \u201cMLops\u201d infrastructure companies we discussed in 2021, and, along with the rest of the world, the interesting generative AI use cases that have [&hellip;]","og_url":"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/","og_site_name":"Insight Partners","article_published_time":"2023-10-24T20:03:29+00:00","article_modified_time":"2023-11-28T19:38:32+00:00","og_image":[{"width":1426,"height":792,"url":"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1.png","type":"image\/png"}],"author":"Jen Jordan","twitter_card":"summary_large_image","twitter_creator":"@insightpartners","twitter_site":"@insightpartners","twitter_misc":{"Written by":"Jen Jordan","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/#article","isPartOf":{"@id":"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/"},"author":{"name":"Jen Jordan","@id":"https:\/\/www.insightpartners.com\/#\/schema\/person\/a8493e07e95c0a29e5a5832110e82f1b"},"headline":"Navigating the LLMops landscape: What you need to know","datePublished":"2023-10-24T20:03:29+00:00","dateModified":"2023-11-28T19:38:32+00:00","mainEntityOfPage":{"@id":"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/"},"wordCount":1349,"publisher":{"@id":"https:\/\/www.insightpartners.com\/#organization"},"image":{"@id":"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/#primaryimage"},"thumbnailUrl":"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1.png","articleSection":{"0":"Investor POV","1":"Market maps","3":"Investment Team"},"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/","url":"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/","name":"Navigating the LLMops landscape: What you need to know | Insight Partners","isPartOf":{"@id":"https:\/\/www.insightpartners.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/#primaryimage"},"image":{"@id":"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/#primaryimage"},"thumbnailUrl":"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1.png","datePublished":"2023-10-24T20:03:29+00:00","dateModified":"2023-11-28T19:38:32+00:00","breadcrumb":{"@id":"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/#primaryimage","url":"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1.png","contentUrl":"https:\/\/www.insightpartners.com\/wp-content\/uploads\/2023\/10\/llmops-market-map-1.png","width":1426,"height":792,"caption":"Insight Partners LLMops market map"},{"@type":"BreadcrumbList","@id":"https:\/\/www.insightpartners.com\/ideas\/llmops-mlops-what-you-need-to-know\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.insightpartners.com\/"},{"@type":"ListItem","position":2,"name":"Navigating the LLMops landscape: What you need to know"}]},{"@type":"WebSite","@id":"https:\/\/www.insightpartners.com\/#website","url":"https:\/\/www.insightpartners.com\/","name":"Insight Partners","description":"Scaling the Future of AI","publisher":{"@id":"https:\/\/www.insightpartners.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.insightpartners.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.insightpartners.com\/#organization","name":"Insight Partners","url":"https:\/\/www.insightpartners.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.insightpartners.com\/#\/schema\/logo\/image\/","url":"https:\/\/insightpartners.com\/wp-content\/uploads\/2023\/01\/Inisghtpartners.png","contentUrl":"https:\/\/insightpartners.com\/wp-content\/uploads\/2023\/01\/Inisghtpartners.png","width":1255,"height":650,"caption":"Insight Partners"},"image":{"@id":"https:\/\/www.insightpartners.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/insightpartners","https:\/\/www.linkedin.com\/company\/insight--partners"]},{"@type":"Person","@id":"https:\/\/www.insightpartners.com\/#\/schema\/person\/a8493e07e95c0a29e5a5832110e82f1b","name":"Jen Jordan","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.insightpartners.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/95cc93892e0d46db81ac6197312850f9?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/95cc93892e0d46db81ac6197312850f9?s=96&d=mm&r=g","caption":"Jen Jordan"}}]}},"_links":{"self":[{"href":"https:\/\/www.insightpartners.com\/wp-json\/wp\/v2\/posts\/16973"}],"collection":[{"href":"https:\/\/www.insightpartners.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.insightpartners.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.insightpartners.com\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.insightpartners.com\/wp-json\/wp\/v2\/comments?post=16973"}],"version-history":[{"count":23,"href":"https:\/\/www.insightpartners.com\/wp-json\/wp\/v2\/posts\/16973\/revisions"}],"predecessor-version":[{"id":17214,"href":"https:\/\/www.insightpartners.com\/wp-json\/wp\/v2\/posts\/16973\/revisions\/17214"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.insightpartners.com\/wp-json\/wp\/v2\/media\/17211"}],"wp:attachment":[{"href":"https:\/\/www.insightpartners.com\/wp-json\/wp\/v2\/media?parent=16973"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.insightpartners.com\/wp-json\/wp\/v2\/categories?post=16973"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.insightpartners.com\/wp-json\/wp\/v2\/tags?post=16973"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}