Explained: AI Tokens & Optimizing AI Costs

Поделиться
HTML-код
  • Опубликовано: 27 авг 2024

Комментарии • 31

  • @gags730
    @gags730 3 месяца назад +3

    It's AMAZING when you get a video that actually explains the topic in a clear and concise way.
    I found your video from a search on YT - "What is an AI Token?"
    Excellent job explaining the topic. Keep up the great work

  • @cheese22
    @cheese22 3 месяца назад

    thank you for getting straight to the point and being clear and concise. very informational video. rare to find nowadays! thank you!

  • @lisagrace4114
    @lisagrace4114 4 месяца назад

    Thanks so much! My response kept getting cut off and it was as simple as adjusting the max tokens.

  • @RolandoLopezNieto
    @RolandoLopezNieto 8 месяцев назад +1

    I was just wondering about this yesterday, thanks.

    • @Voiceflow
      @Voiceflow  8 месяцев назад

      No problem!

    • @RolandoLopezNieto
      @RolandoLopezNieto 8 месяцев назад

      @@Voiceflow btw, is it possible to save the token consumption to the likes of google sheets or airtable? I'm planning to have a log that'll help me make pricing decisions.

  • @user-rj6cw4sk9l
    @user-rj6cw4sk9l 8 месяцев назад +1

    One question from this video. If I follow your tutorial video to insert openAI's assistant api and use Voiceflow as UI mainly, in short I connect openAI's assistant with API.
    Is my price calculated by Voiceflow's or openAI's rate?
    I couldn't figure it out from the video.
    please answer Thanks for the video it's excellent.

    • @Voiceflow
      @Voiceflow  8 месяцев назад

      If you’re using the Voiceflow AI features, then you’d be using Voiceflow AI tokens. If you’re connecting directly to OpenAI via the API step then you are using OpenAIs tokens directly.

    • @FeanorCC
      @FeanorCC 5 месяцев назад

      Can you tell me exactly how you did this step by step with the direct API? Are there detailed instructions somewhere? I would also like to get the tokens directly from OpenAI. Thank you very much, that would help me a lot.

  • @srinivasmankala9364
    @srinivasmankala9364 8 месяцев назад

    Is there a way of making voice flow VOICE bots work on firefox and safari from a custom web page? WOrks well in IE/Chrome but can't record voice on FF/Safari

  • @gabrielchow
    @gabrielchow 8 месяцев назад

    Thanka for this! if we use the same model, is token price the same with directly using API?

    • @Voiceflow
      @Voiceflow  8 месяцев назад +1

      Depending on your query, you'll find that the cost in Voiceflow is higher since we cover related costs like embeddings and hosting the Vector DB. If you're on the teams plan we do have volume discounts available that get it closer to cost when you do higher volumes.
      But if you prefer to use AI services directly you can also do so via. the API step in Voiceflow

    • @gabrielchow
      @gabrielchow 8 месяцев назад

      Thanks and good to hear! @@Voiceflow

  • @UpheavalGames
    @UpheavalGames 4 месяца назад

    At 8:47, you say in your gpt-4-turbo model you use 24,096 tokens, which only cost a couple of cents? Wouldn't that cost 24 cents? about 1 cent per 1000 tokens

  • @hackeatutiempo
    @hackeatutiempo 8 месяцев назад +1

    Why don't you allow us to put the openAI API and consume from the platform itself?

    • @Voiceflow
      @Voiceflow  8 месяцев назад +3

      The API step can be used to connect directly with the openAI API or any other back end service

    • @purantak1093
      @purantak1093 8 месяцев назад +2

      because they wanna make money lol, They are charging 10x more than the original price of tokens

    • @hackeatutiempo
      @hackeatutiempo 8 месяцев назад

      @@purantak1093 They could continue making money by having the best chatgpt integration and charging more for the subscription... but, it has been a risky move.

    • @gabrielchow
      @gabrielchow 8 месяцев назад

      yeah but the response speed is much faster than using the API, I think it's because their model using their own memory system which makes it really faster than using API.@@purantak1093

  • @SamuelNickolas-yf7wh
    @SamuelNickolas-yf7wh 8 месяцев назад

    Hey @Voiceflow, can you please make tutorial on what response and set AI blocks does???

    • @Voiceflow
      @Voiceflow  8 месяцев назад

      You can find docs on both of then at learn.voiceflow.com. Is there anything specific that would help?

    • @SamuelNickolas-yf7wh
      @SamuelNickolas-yf7wh 8 месяцев назад

      @Voiceflow Thanks for the response! I want the AI to be able to access the knowledge base (e.g. files and URLs that I uploaded) because when I use the AI model it says: "It doesn't have access to the knowledge base"

  • @moo487
    @moo487 8 месяцев назад

    I've been experiment with voiceflow, can VF introduce a function that link up different response AI block to different knowledgebase? let say i have text, doc, URL knowledgebase, can i just hook up differrent block with specific knowledgebase?

    • @Voiceflow
      @Voiceflow  8 месяцев назад +1

      Were releasing a feature than can help with this in February:)

  • @MaliRasko
    @MaliRasko 8 месяцев назад +1

    Its probably just ..psychological perception... but I feel like I'm burning tokens much faster when using Voiceflow Response AI step compared to my own openAI API key. ...dontknow

    • @Voiceflow
      @Voiceflow  8 месяцев назад

      All the token information can be seen in the debug mode. The tracker in the app updates around every 30 seconds.
      Also be sure to keep an eye on what model you're using since they have different multipliers.
      One token in VF is not the same as one token in openAI since different models have different costs.

    • @MaliRasko
      @MaliRasko 8 месяцев назад +1

      Is it fair to say then, that purchasing additional tokens through Voiceflow is kind of exactly the same as paying for OpenAI API tokens (in their Playground thing)...given the same model, and all else being the same? @@Voiceflow

  • @xomoneybag
    @xomoneybag 3 месяца назад

    $TAO

  • @billdrumming
    @billdrumming 6 месяцев назад

    How irrelevant is this at the current rate of change in AI. Gemini is 1 million tokens

  • @xomoneybag
    @xomoneybag 3 месяца назад

    $TAO