Can VISION Language Models Solve RAG? Introducing localGPT-Vision

Поделиться
HTML-код
  • Опубликовано: 10 ноя 2024

Комментарии • 33

  • @bwljustus8077
    @bwljustus8077 Месяц назад +3

    ERROR - models.indexer - Error during indexing: Unable to get page count. Any ideas?

  • @MeinDeutschkurs
    @MeinDeutschkurs Месяц назад

    Wooohoooo!!! This is so cool! I need more time, I definitely have to test it!!!!

  • @kai_s1985
    @kai_s1985 Месяц назад +2

    Thanks again for the great work! I have tested similar approach with the vision model. It is especially good for pdf's with lots of unstructured data like graphs, plots, pictures, text, etc... One limitation for this approach was when I created a chatbot and wanted to get the hyperlink within the documents I couldn't because the url of the hyperlink is not visible in the image, but it was not a problem when I used markdown with the standard text based RAG system.
    Questions:
    - how many pdf's can I upload? Is there any size limit?
    - Does the chatbot has a memory of the current conversation? If so, how are you handling it?

  • @magmikefpv
    @magmikefpv Месяц назад +1

    This is amazing ! Thanks will try it out

  • @kenchang3456
    @kenchang3456 Месяц назад

    Indeed, this is an amazing project. I'll check out the code and give try. Thank you very much for sharing, there's a lot to learn from this one.

  • @eduardvendrell9136
    @eduardvendrell9136 18 дней назад +1

    Running on a laptop with GPU I am getting the following error:
    - ERROR - models.indexer - Error during indexing: Input type (torch.cuda.FloatTensor) and weight type (CUDABFloat16Type) should be the same
    Any idea?

  • @Elingsanto
    @Elingsanto Месяц назад

    Cool! Is there a context window or any strict limit on the quantity of pages or images that can be uploaded?
    WIll try it out

  • @chaitanyanerpagar6076
    @chaitanyanerpagar6076 24 дня назад

    I have uploaded a pdf for indexing and once i click on upload and indexing button getting page response as can't reach this page... Can anyone suggest me where to check the issue

  • @thenextension9160
    @thenextension9160 Месяц назад

    Very nice work

  • @unshadowlabs
    @unshadowlabs Месяц назад

    Can document metadata be included as well in the retrieval, such as document name or title, author, and publication year?

  • @nyliveechay-so3ps
    @nyliveechay-so3ps Месяц назад

    Pdf document format is specific right, so maybe posssible to compare results just using that formatted content data?
    It's closed, owned, controlled by Adobe correct?
    So why do this?

  • @akashnagarkar7560
    @akashnagarkar7560 Месяц назад

    Would love a video about the detailed architecture and code explanation. Thanks.

  • @ysy69
    @ysy69 Месяц назад

    This is awesome. Very grateful. What is your local setup, GPU?

  • @awesomedata8973
    @awesomedata8973 Месяц назад +1

    Any chance you can input the new Mistral Pixtral model in your software? -- It seems to be the best version of a local model for vision, and it's based on Nemo.

    • @engineerprompt
      @engineerprompt  Месяц назад +1

      Yes, I think it can be added. Will have a look into it.

  • @forcebrew
    @forcebrew Месяц назад

    Thank you for your expertise! Could you recommend a stable and efficient large language model for coding that I can run on my machine without it becoming unresponsive?

  • @MagagnaJayzxui
    @MagagnaJayzxui Месяц назад

    Qwen2.5 VL 72b support?

  • @trevorbaylis7423
    @trevorbaylis7423 Месяц назад

    What would be the complexity level to combining Verbi and Local GPT --Vision? Is this a realistic possibility?

  • @TeamDman
    @TeamDman Месяц назад

    VERY cool!

  • @nyliveechay-so3ps
    @nyliveechay-so3ps Месяц назад

    Great stuff though!! Nice work!

  • @bwljustus8077
    @bwljustus8077 Месяц назад

    If poppler is missing under Windows, use: choco install poppler

  • @RyanSmith-rb1ch
    @RyanSmith-rb1ch Месяц назад

    I think google-generativeai is misspelled as google-generative-ai in the requirements.txt

    • @engineerprompt
      @engineerprompt  Месяц назад

      Thanks for pointing it out, will fix that

  • @brianhopson2072
    @brianhopson2072 Месяц назад

    I like the concept of this, but I don't like the original model selection. Can you add other open ai api's like 4o?

    • @engineerprompt
      @engineerprompt  Месяц назад

      Yes, will update the list with more models

  • @dadadies
    @dadadies Месяц назад

    Can us mere mortals has a 1 click installer plox. Some sort of bat file or something that checks for whatever is required and optional and let us choose. You could tell an AI to write it for you.