How to Run OpenAI Models Privately (Azure OpenAI)

Поделиться
HTML-код
  • Опубликовано: 28 дек 2024

Комментарии • 34

  • @JustinBellware
    @JustinBellware Год назад +10

    I am taking a course from Microsoft on Azure Open AI and this was video better than the 100 hours of info they give you. Appreciate the straightforward tutorial. Can you make a azure openai series? I would pay for that content.

  • @iandrake4683
    @iandrake4683 Год назад +2

    Perfect! Thank you! Also, I like the format of this video. I think you're improving as a youtuber!

    • @vrsen
      @vrsen  Год назад

      Thanks man, hope RUclips thinks so too haha

  • @PatrickGrueschow
    @PatrickGrueschow 2 месяца назад

    Awesome content as always. Would this be similar to using custom gpt with pinecone assistant for better answers? Or are prompt answers in custom gpt similar in quality as Azure and their vector database?

  • @PelleGrosso
    @PelleGrosso Год назад +1

    Lovely! Wish I had found you earlier! 👍👍👍 Thanks! 🙏

  • @magicismagic123
    @magicismagic123 Год назад

    Thanks for the share!
    I'm wondering what camera, microphone and lights are you using? Would appreciate your time and effort answering! Love your content!

    • @vrsen
      @vrsen  Год назад +1

      Thanks man, Zv-1 with some simple 60$ light box

  • @Evox402
    @Evox402 Год назад +1

    Hey @vrsen,
    will you make a video about the OpenAI DevDay and all the features they introduced? I'd also be interested if you could give some inside on how this could affect tips and guidelines from your previous videos (skills/tools to learn etc.) and how it may affect your daily work.
    Especially the GPTs sounded interesting or do you think they again lack customizability like the frameworks do?

    • @vrsen
      @vrsen  Год назад +3

      Yes, I'll be releasing extensive content on OpenAI's Dev Day, which significantly impacts my work and presents numerous new opportunities. Their GPTs feature is indeed revolutionary, and I'll definitely create a detailed tutorial on it. This truly is a game-changer.

    • @Evox402
      @Evox402 Год назад

      @@vrsen Nice, looking forward to it :)

  • @VikasVyas22
    @VikasVyas22 9 месяцев назад +1

    Thanks for this video really helpful. As a next step I would like to understand if I can integrate it with internet to get information where no information is available from documents uploaded or share point at the same time maintaining privacy of my data?

  • @Evox402
    @Evox402 Год назад

    Hey, again awesome video :)
    This approach sounds very interesting. How does it fit into your daily work as you told before you prefer code solutions over no-code solutions because of better control.
    What I didn't get from the video was the actual pricing, do you pay monthly for the Azure services, do you still need an OpenAi subscription and pay them for token consumption?

    • @vrsen
      @vrsen  Год назад

      Token completion luckily. It would be over if it was monthly haha

    • @Evox402
      @Evox402 Год назад

      @@vrsen Ah ok, but still used from the OpenAI key or is it a separate Azure-OpenAI key?

  • @humayounkhan7946
    @humayounkhan7946 11 месяцев назад

    Hi, thanks alot for this video! Its amazing. May i know if once all those services are deployed, will you also have a callable endpoint instead of a webapp link? So that perhap this could be used to power a customer service chatbot on a website. Appreciate your time and response!

  • @tlubben972
    @tlubben972 Год назад

    Can you use the assistant APi in azure?

  • @mumpecydrone8788
    @mumpecydrone8788 Год назад

    thanks for the video, man...learned alot. how can i add an upload feature to that webapp so that users can upload and analyze their own documents with that initial knowledge base in the ai? is it possible?

    • @vrsen
      @vrsen  Год назад +1

      No, I don’t think so. Your data needs to be vectorized in advanced, and you can only add 1 data source per web app

  • @rishavmishra5786
    @rishavmishra5786 Год назад +1

    thanx vrsen, very helpful.. I would Like to know if you
    1. use opensource models for clients for data security, I have a project where I am using opensource models.
    2. use Langchain in production. If you don't I'd like to know where I can learn the coding resource for complex tasks that can be replaced with langchain.
    I prefer to do things in code, this gives me independence and room for creativity.
    thank you very much, your content has always been good guidance.

    • @vrsen
      @vrsen  Год назад +2

      I always try to convince clients to use OpenAI instead of open source because of the function-calling feature. Unfortunately, no open source models support this yet.
      Instead of LangChain, you can start with simple RAG apps and then transition to more complex agent implementations, again emphasizing the function-calling feature, rather than autogen or other token-wasting frameworks.

    • @rishavmishra5786
      @rishavmishra5786 Год назад

      @@vrsen i understand, thank you so much Vrsen , how about you go a little technical on your next video and just explain the architecture of the complex projects you are doing and show your coding toolkit.
      We love coding❤️

  • @Lirim_K
    @Lirim_K 17 дней назад

    What do you mean by "completely private" OpenAI completion? Isn't it private if you used OpenAI directly? OpenAI does not train on your input data unless you specifically opt in for it.

  • @lipasfriends
    @lipasfriends Год назад +1

    Hey man, I'm trying to get access to azure openai but it requires a company email.. You could have mentioned this in your video :(

    • @vrsen
      @vrsen  Год назад +1

      Sorry, I didn’t know. You can buy any random domain and get it through g suite

  • @nsoe8990
    @nsoe8990 Год назад

    After uploading a doc and following your steps, I got error during the ingesting process. The error is "We couldn't connect yoru data, one or more preprocessing jobs failed". any idea? thanks for a great video

  • @jacoblagana8200
    @jacoblagana8200 Год назад

    Thanks for the video, I am trying to apply for azure openai however theres a form and from looking at reddit some people have been waiting up to months to gain access. are there any tips or tricks to get your application approved faster?

  • @magicismagic123
    @magicismagic123 Год назад

    I have one question. By the way, great video, man! I'm not a professional developer, but I know the basics of coding from different sources (with the help of AI). I can create some usable code. The Azure example is simple, so even a non-developer could do it. Since AI development is the future, I'm wondering what the best steps would be to learn AI development? Test every single chatbot platform?

    • @vrsen
      @vrsen  Год назад +1

      Freelancing is the best way to learn AI development. Build a few personal projects and post them on Fiverr or Upwork. You will then get paid for learning even more

    • @magicismagic123
      @magicismagic123 Год назад

      ​@@vrsen When you say 'post them,' do you mean sharing them as previews or examples in gigs? So that people would assume that you already have experience?

  • @omarpro8626
    @omarpro8626 Год назад

    Underrated

  • @francisokech
    @francisokech Год назад +1

    Sorry but this is too fast. Clearly you've mastered this stuff but I'm struggling to keep up. Please release another video with a more realistic pace.

  • @isaac10231
    @isaac10231 10 месяцев назад

    For those who are getting an error because of the api update, here's an example of what the new code looks like.
    Note I'm running this in vscode and not the notebook.
    import os
    from openai import OpenAI
    OpenAI.api_type = "azure"
    OpenAI.api_version = "2023-05-15"
    OpenAI.api_base = os.getenv("your key name here")
    OpenAI.api_key = os.getenv("your key name here 2")
    client = OpenAI()
    completion = client.chat.completions.create(
    model="gpt-3.5-turbo",
    messages=[
    {"role": "system", "content": "You are a helpful assistant."},
    {"role": "user", "content": "Hello!"}
    ]
    )
    print(completion.choices[0].message)

    • @rsns
      @rsns 7 месяцев назад

      looks like python ai has changed? we can no longer use OpenAI()? because i cannot connect to it. Also following the guide, looks like the resource is not available even though enabled full public network as described in this guide.