What is Mixture of Experts?

Поделиться
HTML-код
  • Опубликовано: 20 янв 2025

Комментарии • 15

  • @vicaya
    @vicaya 4 месяца назад +10

    Looks like people are thoroughly confused by your explanation. You need to address the vast difference between mixture of experts (a model architecture, where routing happens per token/layer) and mixture of agents (a deployment architecture, where routing happens per query), which most people here seem to assume.

    • @jonniuss
      @jonniuss 4 месяца назад +1

      btw you are fully right, i only now have understood this difference.
      tbh He gave a little example by "raining cats and dogs"

  • @jimklerkx5092
    @jimklerkx5092 4 месяца назад +1

    Thanks for the video! Great content!

  • @ltgwgeorge2155
    @ltgwgeorge2155 4 месяца назад +1

    Thanks for the presentation; Can custom GPTs also be customised under this category

  • @kingkura
    @kingkura 4 месяца назад

    Actually did good this one.👍🏾

  • @thealwayssmileguy9060
    @thealwayssmileguy9060 4 месяца назад

    Question:
    So mixture of agents is a bit the same as AI agents? Like you have ai agent researcher, writer etc with than also a CEO agents that chooses which agents to use

    • @prxshetty
      @prxshetty 16 дней назад

      Experts are more on a granular level I would say tbh. AI Agents are basically LLMS with tools that are roll specific or are bounded to a particular domain but not completely. Here the experts are trained with inputs that they are specialized in, not on the general context of it.

  • @kayceefree_kazola
    @kayceefree_kazola 4 месяца назад

    This video where u write through the screen is called what and how to make such video pls enlightened

  • @ckng6126
    @ckng6126 4 месяца назад

    Good video!

  • @FOX-C75
    @FOX-C75 4 месяца назад

    Nice ❤ video presentation

  • @Aj.MetaMind
    @Aj.MetaMind 4 месяца назад +1

    Sir, Can you provide a roadmap to become a ML engineer please. there are many roadmaps, but can't trust them ☹😩

  • @sk3ffingtonai
    @sk3ffingtonai 4 месяца назад

    👏👏

  • @gunnerandersen4634
    @gunnerandersen4634 4 месяца назад

    API Gateaway for ML kind of.

  • @prxshetty
    @prxshetty 16 дней назад

    Anyone here after the release of DeepSeek-V3?

  • @jimklerkx5092
    @jimklerkx5092 4 месяца назад

    New editor? I dont need the zoom lol