{"id":52927,"date":"2022-08-26T17:42:19","date_gmt":"2022-08-26T17:42:19","guid":{"rendered":"https:\/\/www.techrepublic.com\/?p=3992167"},"modified":"2022-08-26T17:42:19","modified_gmt":"2022-08-26T17:42:19","slug":"why-the-database-market-keeps-growing-bigger-and-stranger","status":"publish","type":"post","link":"https:\/\/cloudnewshub.com\/?p=52927","title":{"rendered":"Why the database market keeps growing bigger (and stranger)"},"content":{"rendered":"<figure id=\"attachment_3978027\" aria-describedby=\"caption-attachment-3978027\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-3978027\" src=\"http:\/\/cloudnewshub.com\/wp-content\/uploads\/2022\/08\/why-the-database-market-keeps-growing-bigger-and-stranger.jpg\" alt=\"Cloud Database Software Concept - 3D Illustration\" width=\"1400\" height=\"774\"><figcaption id=\"caption-attachment-3978027\" class=\"wp-caption-text\">Image: ArtemisDiana\/Adobe Stock<\/figcaption><\/figure>\n<p>Quick! Name a technology category that has <a href=\"https:\/\/db-engines.com\/en\/ranking\" target=\"_blank\" rel=\"nofollow noopener sponsored noreferrer\">nearly 400 different options<\/a> vying for your attention; that pulled in over $80 billion in revenue last year but is actually <a href=\"https:\/\/www.techrepublic.com\/article\/new-gartner-report-shows-massive-growth-database-market-fueled-cloud\/\" target=\"_blank\" rel=\"nofollow noopener sponsored noreferrer\">accelerating<\/a> in its growth rate; that, decades into its existence, still spawns startups with seemingly bottomless amounts of <a href=\"https:\/\/www.businesswire.com\/news\/home\/20220824005057\/en\/Vector-Database-Company-Zilliz-Raises-60-Million-Series-B-Extension-to-Expand-Its-Operations-in-Silicon-Valley\" target=\"_blank\" rel=\"nofollow noopener sponsored noreferrer\">venture funding<\/a>; and that drove the <a href=\"https:\/\/www.techrepublic.com\/article\/python-time-you-learned-popular-programming-language\/\" target=\"_blank\" rel=\"nofollow noopener sponsored noreferrer\">most job listings<\/a> of any programming language last year. If you guessed \u201cdatabase,\u201d you\u2019d be right.<\/p>\n<p>Why is this decades-old market so incredibly hot right now? Even as database bearers like Oracle see growth slow, the category is booming. As I\u2019ve <a href=\"https:\/\/www.techrepublic.com\/article\/new-gartner-report-shows-massive-growth-database-market-fueled-cloud\/\" target=\"_blank\" rel=\"nofollow noopener sponsored noreferrer\">written<\/a>, a big reason is cloud, but the bigger reason is simply that data keeps growing in importance to every enterprise, with diverse, unstructured data giving birth to new databases to manage it all.<\/p>\n<h2>Evolution meets revolution<\/h2>\n<p>This isn\u2019t supposed to be how markets work. Product categories rise and then tend to dwindle over time, replaced by other things. For example, Microsoft minted billions in the operating system (OS) market, but today we don\u2019t really care much about the OS.<\/p>\n<p>On the desktop, things like ChromeOS have made it clear that it\u2019s the browser\/web that matters most, and on the server, businesses have increasingly been thinking in terms of serverless.<\/p>\n<p><strong>SEE: <a href=\"https:\/\/www.techrepublic.com\/resource-library\/downloads\/cheat-sheet-how-to-become-a-database-administrator-free-pdf\/\" target=\"_blank\" rel=\"nofollow noopener sponsored noreferrer\">Cheat sheet: How to become a database administrator (free PDF)<\/a> (TechRepublic)<\/strong><\/p>\n<p>Or remember when app servers, enterprise resource planning (ERP), enterprise content management (ECM) were hot new markets? Companies still depend on these products, or some variant of them, but they\u2019re not considered growth markets.<\/p>\n<p>Databases arguably should be the same. Relational databases were born in the early 1970s, and we had Oracle, Microsoft, and IBM spin up massive businesses to sell and support them. We should be seeing this market now entering its end, but we\u2019re not.<\/p>\n<p>While these vendors have seen their database revenue growth slow, the market as a whole has done anything but. Some of their customers are increasingly flirting with PostgreSQL, but even more are turning to cloud databases. Some are even taking on both, with AWS and other cloud giants offering managed PostgreSQL services.<\/p>\n<p>There has also been a profound and sustained <a href=\"https:\/\/www.techrepublic.com\/article\/non-relationals-quiet-revolution-in-databases\/\" target=\"_blank\" rel=\"nofollow noopener sponsored noreferrer\">rise in so-called \u201cNoSQL\u201d databases<\/a>. While I like the trend, I don\u2019t particularly like it because databases like MongoDB, Apache Cassandra, Neo4j, DynamoDB, Redis, and others aren\u2019t being embraced because of what they aren\u2019t, but rather for what they are \u2014 flexible, horizontally scalable and able to manage the explosion in unstructured data.<\/p>\n<p>Indeed, relational databases, with the prominent exception of PostgreSQL, have declined relative to non-relational databases over the last nine years, including over the past year, as measured by <a href=\"https:\/\/db-engines.com\/en\/ranking\" target=\"_blank\" rel=\"nofollow noopener sponsored noreferrer\">DB-Engines<\/a> (as <a href=\"https:\/\/db-engines.com\/pictures\/dbe-bcr-30-202203.mp4\" target=\"_blank\" rel=\"nofollow noopener sponsored noreferrer\">illustrated here<\/a>).<\/p>\n<aside class=\"pinbox right\">\n<h3 class=\"heading\">Must-read big data coverage<\/h3>\n<\/aside>\n<p>That\u2019s not to suggest that SQL\/relational use is on the wane. In fact, <a href=\"https:\/\/www.techrepublic.com\/article\/python-lead-ieee-programming-language\/\" target=\"_blank\" rel=\"nofollow noopener sponsored noreferrer\">SQL adoption<\/a>, as measured by job postings, keeps increasing.<\/p>\n<p>Enterprises are increasing their interest in developers who can query the databases that have been running their enterprises for years using comfortable, widely used SQL. SQL is popular because it\u2019s been a great workhorse for the enterprise.<\/p>\n<p>At the same time, enterprises are also just as clearly looking for developers that can help them query new data types and sources, which often won\u2019t involve SQL.<\/p>\n<p>It\u2019s not an either\/or decision, in other words. For enterprises of any reasonable size, it\u2019s a matter of \u201cand.\u201d Enterprises are simply trying to make the best use of their data and turn to the right database for the job.<\/p>\n<h2>Restructuring the market<\/h2>\n<p>Zilliz, the company behind the open source vector database <a href=\"https:\/\/milvus.io\/\" target=\"_blank\" rel=\"nofollow noopener sponsored noreferrer\">Milvus<\/a>, just raised $60 million, to add to the $43 million raised in 2020. Never heard of a vector database? You\u2019re not alone. A vector database is intended to manage vector embeddings. According to Zilliz\u2019s <a href=\"https:\/\/frankzliu.com\/blog\/a-gentle-introduction-to-vector-databases\" target=\"_blank\" rel=\"nofollow noopener sponsored noreferrer\">Frank Liu<\/a>:<\/p>\n<p>The increasing ubiquity of unstructured data has led to a steady rise in the use of machine learning models trained to understand [unstructured] data. word2vec, a natural language processing (NLP) algorithm which uses a neural network to learn word associations, is a well-known early example of this. The word2vec model is capable of turning single words (in a variety of languages, not just English) into a list of floating point values, or vectors. Due to the way models are trained, vectors which are close to each other represent words which are similar to each other, hence the term embedding vectors.<\/p>\n<p>As such, vector databases prove useful in things like image search or searching within video, audio, or other forms of unstructured data to understand the content, not the keywords associated with that content.<\/p>\n<p>My point isn\u2019t to offer a tutorial in vector databases. Rather, it\u2019s to show that with the continued growth of structured and, especially, unstructured data, the database market will continue to balloon. At the same time, we\u2019ll see new approaches to databases crop up.<\/p>\n<p><em>Disclosure: I work for MongoDB but the views expressed herein are mine.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Image: ArtemisDiana\/Adobe Stock Quick! Name a technology category that has nearly 400 different options vying for your attention; that pulled in over $80 billion in revenue last year but is actually accelerating in its growth rate; that, decades into its existence, still spawns startups with seemingly bottomless amounts of venture funding; and that drove the [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":52928,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[39,40,783],"tags":[],"class_list":["post-52927","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-big-data","category-cloud","category-cloudsync"],"_links":{"self":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/posts\/52927","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=52927"}],"version-history":[{"count":0,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/posts\/52927\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/media\/52928"}],"wp:attachment":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=52927"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=52927"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=52927"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}