{"id":89528,"date":"2023-05-05T19:28:05","date_gmt":"2023-05-05T19:28:05","guid":{"rendered":"https:\/\/www.techrepublic.com\/?p=4083290"},"modified":"2023-05-05T19:28:05","modified_gmt":"2023-05-05T19:28:05","slug":"how-microsoft-might-turn-bing-chat-into-your-ai-personal-assistant","status":"publish","type":"post","link":"https:\/\/cloudnewshub.com\/?p=89528","title":{"rendered":"How Microsoft might turn Bing Chat into your AI personal assistant"},"content":{"rendered":"<div id>\n<p> Commentary: After analyzing a lot of recent Microsoft developer content, expert Simon Bisson says there is a big clue into how Bing Chat will work. <\/p>\n<\/div>\n<div id>\n<figure id=\"attachment_4034092\" aria-describedby=\"caption-attachment-4034092\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-article wp-image-4034092\" src=\"http:\/\/cloudnewshub.com\/wp-content\/uploads\/2023\/05\/how-microsoft-might-turn-bing-chat-into-your-ai-personal-assistant.jpg\" alt=\"Shadowy hand holding a smartphone with Microsoft Bing on it over a blue background with the OpenAI logo.\" width=\"770\" height=\"514\"><figcaption id=\"caption-attachment-4034092\" class=\"wp-caption-text\">Image: gguy\/Adobe Stock<\/figcaption><\/figure>\n<p>If there\u2019s one thing to know about Microsoft, it\u2019s this: Microsoft is a platform company. It exists to provide tools and services that anyone can build on, from its operating systems and developer tools, to its productivity suites and services, and on to its global cloud. So, we shouldn\u2019t be surprised when an announcement from Redmond talks about \u201cmoving from a product to a platform.\u201d<\/p>\n<p>The latest such announcement was for the <a href=\"https:\/\/www.techrepublic.com\/article\/bing-ai-chat-open\/\">new Bing GPT-based chat service<\/a>. Infusing search with artificial intelligence has allowed Bing to deliver a conversational search environment that builds on its Bing index and <a href=\"https:\/\/www.techrepublic.com\/article\/gpt-4-cheat-sheet\/\">OpenAI\u2019s GPT-4<\/a> text generation and summarization technologies.<\/p>\n<p>Instead of working through a list of pages and content, your queries are answered with a brief text summary with relevant links, and you can use Bing\u2019s chat tools to refine your answers. It\u2019s an approach that has turned Bing back to one of its initial marketing points: helping you make decisions as much as search for content.<\/p>\n<p><strong>SEE: <\/strong>Establish an <a href=\"https:\/\/www.techrepublic.com\/resource-library\/downloads\/artificial-intelligence-ethics-policy\/?r=768791548\">artificial intelligence ethics policy<\/a> in your business using this template from TechRepublic Premium.<\/p>\n<p><a href=\"https:\/\/www.techrepublic.com\/article\/chatgpt-cheat-sheet\/\">ChatGPT<\/a> has recently added plug-ins that extend it into more focused services; as part of Microsoft\u2019s evolutionary approach to adding AI to Bing, it will soon be doing the same. But, one question remains: How will it work? Luckily, there\u2019s a big clue in the shape of one of Microsoft\u2019s many open-source projects.<\/p>\n<p>Jump to:<\/p>\n<h2 id=\"semantic\">Semantic Kernel: How Microsoft extends GPT<\/h2>\n<p>Microsoft has been developing a set of tools for working with its Azure OpenAI GPT services called <a href=\"https:\/\/learn.microsoft.com\/en-us\/semantic-kernel\/whatissk\" target=\"_blank\" rel=\"noopener noreferrer\">Semantic Kernel<\/a>. It\u2019s designed to deliver custom GPT-based applications that go beyond the initial training set by adding your own embeddings to the model. At the same time, you can wrap these new semantic functions with traditional code to build AI skills, such as refining inputs, managing prompts, and filtering and formatting outputs.<\/p>\n<p>While details of Bing\u2019s AI plug-in model won\u2019t be released until Microsoft\u2019s BUILD developer conference at the end of May, it\u2019s likely to be based on the Semantic Kernel AI skill model.<\/p>\n<aside class=\"pinbox right\">\n<h3 class=\"heading\">More must-read AI coverage<\/h3>\n<\/aside>\n<p>Designed to work with and around OpenAI\u2019s application programming interface, it gives developers the tooling necessary to manage context between prompts, to add their own data sources to provide customization, and to link inputs and outputs to code that can help refine and format outputs, as well as linking them to other services.<\/p>\n<p>Building a consumer AI product with Bing made a lot of sense. When you drill down into the underlying technologies, both GPT\u2019s AI services and Bing\u2019s search engine take advantage of a relatively little-understood technology: vector databases. These give GPT transformers what\u2019s known as \u201csemantic memory,\u201d helping it find links between prompts and its <a href=\"https:\/\/www.techrepublic.com\/article\/what-is-generative-ai\/\">generative AI<\/a>.<\/p>\n<p>A vector database stores content in a space that can have as many dimensions as the complexity of your data. Instead of storing your data in a table, a process known as \u201cembedding\u201d maps it to vectors that have a length and a direction in your database space. That makes it easy to find similar content, whether it\u2019s text or an image; all your code needs to do is find a vector that is the same size and the same direction as your initial query. It\u2019s fast and adds a certain serendipity to a search.<\/p>\n<h2 id=\"memory\">Giving GPT semantic memory<\/h2>\n<p>GPT uses vectors to extend your prompt, generating text that\u2019s similar to your input. Bing uses them to group information to speed up finding the information you\u2019re looking for by finding web pages that are similar to each other. When you add an embedded data source to a GPT chat service, you\u2019re giving it information it can use to respond to your prompts, which can then be delivered in text.<\/p>\n<p>One advantage of using embeddings alongside Bing\u2019s data is you can use them to add your own long text to the service, for example working with documents inside your own organization. By delivering a vector embedding of key documents as part of a query, you can, for example, use a search and chat to create commonly used documents containing data from a search and even from other Bing plug-ins you may have added to your environment.<\/p>\n<h2 id=\"skills\">Giving Bing Chat skills<\/h2>\n<p>You can see signs of something much like the public Semantic Kernel at work in the latest Bing release, as it adds features that take GPT-generated and processed data and turn them into graphs and tables, helping visualize results. By giving GPT prompts that return a list of values, post-processing code can quickly turn its text output into graphics.<\/p>\n<p>As Bing is a general-purpose search engine, adding new skills that link to more specialized data sources will allow you to make more specialized searches (e.g., working with a repository of medical papers). And as skills will allow you to connect Bing results to external services, you could easily imagine a set of chat interactions that first help you find a restaurant for a special occasion and then book your chosen venue \u2014 all without leaving a search.<\/p>\n<p>By providing a framework for both private and public interactions with GPT-4 and by adding support for persistence between sessions, the result should be a framework that\u2019s much more natural than traditional search applications.<\/p>\n<p>With plug-ins to extend that model to other data sources and to other services, there\u2019s scope to deliver the natural language-driven computing environment that Microsoft has been promising for more than a decade. And by making it a platform, Microsoft is ensuring it remains an open environment where you can build the tools you need and don\u2019t have to depend on the tools Microsoft gives you.<\/p>\n<p>Microsoft is using its Copilot branding for all of its AI-based assistants, from GitHub\u2019s GPT-based tooling to new features in both <a href=\"https:\/\/www.techrepublic.com\/article\/microsoft-copilot-ai-productivity-365-suite\/\">Microsoft 365<\/a> and in Power Platform. Hopefully, it\u2019ll continue to extend GPT the same way in all of its many platforms, so we can bring our plug-ins to more than only Bing, using the same programming models to cross the divide between traditional code and generative AI prompts and semantic memory.<\/p>\n<p> <!-- default newsletter at the end --> <\/div>\n","protected":false},"excerpt":{"rendered":"<p>Commentary: After analyzing a lot of recent Microsoft developer content, expert Simon Bisson says there is a big clue into how Bing Chat will work. Image: gguy\/Adobe Stock If there\u2019s one thing to know about Microsoft, it\u2019s this: Microsoft is a platform company. It exists to provide tools and services that anyone can build on, [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":89529,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[49,77,40,783,152,177,27],"tags":[],"class_list":["post-89528","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-artificial-intelligence","category-cloud","category-cloudsync","category-microsoft","category-open-source","category-software"],"_links":{"self":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/posts\/89528","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=89528"}],"version-history":[{"count":0,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/posts\/89528\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/media\/89529"}],"wp:attachment":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=89528"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=89528"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=89528"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}