Azure Chat - Tutorial for an internal, secure, compliant AI chatbot | Unscripted Coding

Поделиться
HTML-код
  • Опубликовано: 18 окт 2023
  • If you're looking to use ChatGPT in the workplace, but you're worried about privacy and security, you need to deploy your own chatbot. Azure Chat is one of the quickest ways to put a polished chatbot in the hands of your team. This tutorial will show you how to deploy your own chatbot based on Microsoft's Azure Chat project which runs Azure OpenAI in the backend.
    Unscripted Coding is entirely unscripted and organic. If you're looking for a tutorial, you're in the wrong place! What we do here is try and build something from scratch, filled with all the mistakes and lessons learned along the way!
    Total Time: 35 minutes
    AzureChat GitHub: github.com/microsoft/azurechat
    GitHub Signup: github.com/
    Azure Account Signup: azure.microsoft.com/
    Azure CLI Installer: learn.microsoft.com/en-us/cli...
  • ХоббиХобби

Комментарии • 30

  • @Beornious
    @Beornious 2 месяца назад +2

    11/10. Absolute superior tutorial.
    No flashy youtube clickbait or effects - Check
    Very detailed explanation from start to production (that even a complete beginner would be able to follow) - Check
    Shows example of errors and how to solve - Check

  • @amsterfy1767
    @amsterfy1767 3 месяца назад

    still working great. thank you.

  • @jackwoods8021
    @jackwoods8021 2 месяца назад

    u are a legend for this video. awesome stuff. thank u!!

  • @julianpicon243
    @julianpicon243 4 месяца назад

    Great video thanks

  • @pavelgk
    @pavelgk 5 месяцев назад +1

    Can you create a similar video about the latest version of the azure chat?

  • @yashprajapati4032
    @yashprajapati4032 Месяц назад

    New github have other fields and i cannot find best region selection and also east US is denying due to multiple load on also choose other locations i am not able to create cosmodb, cau you give some info or video of latest github work flow.
    Thank you

  • @fzhou2004
    @fzhou2004 4 месяца назад

    This is a cool project. I would like to know how to keep up with the original Microsoft chat functionality when the original open source project adding images , and other more advanced RAG features, and we don’t have to do too much modifications.

  • @Mike00254
    @Mike00254 4 месяца назад

    This is great, on the same chat bot UI I've seen you uploading the files to it, are files being store in a certain storage account or is there a way to connect the upload of the file to a blob storage account just using the code on github?

  • @rickysydney4208
    @rickysydney4208 3 месяца назад

    have you work with assistant in Azure OpenAI? And if so can you make a video like this showing how you set one up and deploy it? Thanks again you video are very inspirational.

  • @DataSpook
    @DataSpook Месяц назад +1

    Have you been able to deploy using Mistral instead of OpenAi?

  • @salmasaad198
    @salmasaad198 7 месяцев назад +2

    but can we upload our knowledge base and build something like GPTs? example: building a chatbot for employees inquiries based on our own company polices?

    • @UnscriptedCoding
      @UnscriptedCoding  7 месяцев назад +1

      I have a separate video for that. Try and search for Azure Search OpenAI Demo.

    • @salmasaad198
      @salmasaad198 7 месяцев назад

      @@UnscriptedCoding thank you for replying! I just did, is there a way we can have it as an app or does it have to be on web (GitHub) I’m not a developer but convinced the company I work for to apply AI, they can’t have copilot because it’s not available for SMB.
      What you mentioned is a good cheap option but I’m afraid it’s complicated for me to install and keep up with it because I’m not a developer? And them being turned off by these complications… do you think GPT enterprise is as a good alternative? Or is this one not really that hard?
      We deal with an IT company to handle our tech, you think they’d know how to do it? And it’s worth it?

    • @UnscriptedCoding
      @UnscriptedCoding  7 месяцев назад

      Hey there, this is a really tough question to answer. It depends on the company. ChatGPT Enterprise will probably handle a lot of the privacy/security concerns they might have, but if you're in a more sensitive industry, maybe not. No idea if your IT company is capable of pulling it off. There are really good and terrible companies.

    • @salmasaad198
      @salmasaad198 7 месяцев назад

      @@UnscriptedCodingso you’re saying only developers can install this? Do I have to know how to code to do what you did in the video?

    • @UnscriptedCoding
      @UnscriptedCoding  7 месяцев назад

      You don't HAVE to, but I would certainly recommend someone who can write a bit of code to do it. This accelerator is geared for people who can code and customize it line by line rather than a ready to use product. What happens if your business starts using it and it breaks?

  • @alx8439
    @alx8439 9 месяцев назад +1

    The "security" of this chat is just a promise of MS to not do anything with your data, nothing more. This level of "security" might be enough for some of the businesses, but not all of them. The only how this large language models can be really made secure is when they are deployed 100% locally, without any API connection to the mothership company.

    • @UnscriptedCoding
      @UnscriptedCoding  9 месяцев назад +2

      I think it's more nuanced than that. I agree that the most secure way forward is to run locally, completely cut off from the internet. At this point in time, Microsoft is legally bound because of their terms and conditions, their DPA, etc. If you dig into them, they describe their policies, they have third party auditors, etc. Basically, there's more than just a promise, there are checks and balances and real remedies if that promise is broken. I'd think most businesses should be satisfied with that level of protection, but security is definitely a spectrum that differs from place to place.

    • @protossmr2344
      @protossmr2344 7 месяцев назад

      If you use Office 365 or any Microsoft products. If they want to know your data there might be a way in their hand. And just think this azure open air is one of Microsoft's products and you use it

  • @disciplinegroup
    @disciplinegroup 9 месяцев назад +1

    I keep getting the same error when reviewing + create the custom template.
    {"code":"InvalidTemplateDeployment","details":[{"code":"SpecialFeatureOrQuotaIdRequired","message":"The subscription does not have QuotaId/Feature required by SKU 'S0' from kind 'OpenAI' or contains blocked QuotaId/Feature."}],"message":"The template deployment 'Microsoft.Template-20231031103009' is not valid according to the validation procedure. The tracking id is '7d0bd987-4301-4eb3-937c-5fed15579569'. See inner errors for details."}
    Any ideas how to resolve this?
    Many thanks

    • @UnscriptedCoding
      @UnscriptedCoding  9 месяцев назад

      Hi, it looks like it's having trouble deploying OpenAI. OpenAI isn't available in every region, and I think the SKU might be S1. Try fiddling with the region and S1, see if you can create OpenAI manually.

    • @disciplinegroup
      @disciplinegroup 9 месяцев назад

      @@UnscriptedCoding Hi, many thanks for getting back to me. I've managed to solve that. However, the final domain won't load now as it is not 'https'. It is being blocked by the browser. Any workaround??

    • @UnscriptedCoding
      @UnscriptedCoding  9 месяцев назад

      @@disciplinegroup This might just be something as simple as the URL. You need to go to the final domain but make sure it starts with rather than

    • @christopherchandra4067
      @christopherchandra4067 6 месяцев назад +1

      hi, i also have this exact error, if you dont mind how did you resolve this issue? i tried changing the region and all of them did not work and when i change the sku to S1 it says the sku id is invalid.
      edit: i also found out that you might need to ask permission to create OpenAi with microsoft first? is this correct? should i do this first? if so, how?

    • @LuisAlonsoOteroSeminario
      @LuisAlonsoOteroSeminario 5 месяцев назад

      same error:
      {"customHtml":{"htmlTemplate":"The SKU name 'S1' in account type 'FormRecognizer' is invalid.The SKU name 'S1' in account type 'OpenAI' is invalid.The SKU name 'S1' in account type 'OpenAI' is invalid.The SKU name 'S1' in account type 'OpenAI' is invalid.","viewModel":null}}
      @@christopherchandra4067