Это видео недоступно.
Сожалеем об этом.
GraphRAG - Will the Dust Settle?
- Добавить в
- Мой плейлист
- Посмотреть позже
- Поделиться
Поделиться
HTML-код
Размер видео:
- Опубликовано: 26 авг 2024
Комментарии • 20
Следующие
Автовоспроизведение
Best in Class Image Extraction with Fine-Tuned Vision Language ModelTwoSetAI
Просмотров 684
Graph RAG: Improving RAG with Knowledge GraphsPrompt Engineering
Просмотров 52 тыс.
HippoRAG - Revolutionizing AI Retrieval with a 20-Year-Old Algorithm!TwoSetAI
Просмотров 1,8 тыс.
Star Wars Outlaws Review - "A New Nope?"ACG
Просмотров 341 тыс.
A Week of Cabin Life (raw, unedited)Eamon & Bec
Просмотров 411 тыс.
Here's Why My Flooded McLaren P1 Project Is Taking Way Longer Than I Thought2varish
Просмотров 484 тыс.
MURDER DRONES - Episode 8: Absolute EndGLITCH
Просмотров 10 млн
GraphRAG: LLM-Derived Knowledge Graphs for RAGAlex Chao
Просмотров 106 тыс.
Microsoft graphRAG Graphing Text and Chatting with it for freeJohn Capobianco
Просмотров 2,8 тыс.
GraphRAG in Depth: Knowledge-Driven RAG for Supercharging Querying on Complex DataCaged AI
Просмотров 1,5 тыс.
Claude 3.5 Deep Dive: This new AI destroys GPTAI Search
Просмотров 640 тыс.
"Don't Learn to Code, But Study This Instead..." says NVIDIA CEO Jensen HuangGoda Go
Просмотров 926 тыс.
Get Ahead in Your RAG! Must-Know Knowledge Graph Integration Secrets!TwoSetAI
Просмотров 1,8 тыс.
10 weird algorithmsFireship
Просмотров 1,2 млн
Bill Gates Reveals Superhuman AI PredictionNext Big Idea Club
Просмотров 258 тыс.
Meet CRAG: Don't Miss This Simple Hack for your Production RAG!TwoSetAI
Просмотров 1 тыс.
孩子太多!一碗水真的能端平吗? #瞧这一家子 #带娃 #四小只吖 #日常 #搞笑 #搞笑家庭 #姐弟 #家庭生活四小只吖
Просмотров 4,9 млн
WILL IT BURST?Natan por Aí
Просмотров 20 млн
Заявления террористов, штурм, реакция Путина: что известно о захвате колонии в Волгоградской областиRTVI Новости
Просмотров 1,6 млн
ТЫ БЫ НИКОГДА ТАКОЕ НЕ ЗАГУГЛИЛ #18Utopia Show
Просмотров 1,4 млн
АФРИКАНЕЦ ПРИКИНУЛСЯ ДОБРЯКОМ, НО ПОТОМ ПОКАЗАЛ СВОЕ ИСТИННОЕ ЛИЦОSlivkiShow
Просмотров 1,1 млн
СМАЗАЛ ДВЕРЬstunning max
Просмотров 188 тыс.
REAL MADRID 3 - 0 REAL VALLADOLID CF | RESUMEN LALIGA EA SPORTSLALIGA EA SPORTS
Просмотров 6 млн
Cool Items!🥰 New Gadgets, Smart Appliances, Kitchen Tools Utensils, Home Cleaning, Beauty #shortsCool Items Official
Просмотров 24 млн
Fantastic, I watched the whole thing. I like the "teacher -student" presentation style, even though you are both experts :-)
appreciated as always. While I am excited about graphRAG it does raise some important questions:
- how well can this integrate with LangChain/LangGraph Agentic frameworks?
- the last time we checked the amount of tokens required was almost 10x than that of RAG.
Any techniques on the horizon for limiting the cost ? If not , how can we justify those costs ?
- are there automatic graph creation methods or are quality retrievals still dependent on manual construction of the Graphs ? (couldn't we use an LLM chain to automatically do this for us ?)
🙏💻🍀
ps. Are you planning to update the RAG System workbook ?
Thank you! To answer your questions;
- There is no direct integration with langchain, but I think either langchain or microsoft will develop that part. That said, I think it's possible to use it within langchain since it's a separate library.
- Yes indeed. The amount of tokens consumed by this approach is ridiculously high and that's one of the main reasons that I think make it not practical to use in production.
- Regarding cost, what I would do is to avoid using LLM as much as possible for KG construction phase. There are many other BERT models you can use for entity/relation extraction. Which make is very cheap to build the KG.
- Building KG is a semi-automatic process. If you want to make it completely automatic, you either have to use LLM which makes it costly or end up with a graph that is not completely reliable. I mean, there could be noise in there. The best way is to define a schema manually for your KG and then populate it with info with/without LLM.
- Which RAG system workbook? Do you mean the book that I authored a few months ago?
@@MehdiAllahyari Appreciate the response. I'm indeed referring to the "A practical approach to RAG" pdf (great read btw! but It could be nice to have continuous updates seeing how fast this industry moves ).
Some more thoughts/Questions :
- if we consider graphRAG not (yet) production ready do we consider Hippo-RAG under the same umbrella ?
- for technical documentation QA (pdf) is there a specific RAG set-up you would recommend learning more about ?
Cheers !
@@awakenwithoutcoffee I'd love to update the book as there are so many new techniques and methods have been proposed. I need to find the time. :)
- Yes graphRAG and hippoRAG both use KGs as the main source of knowledge. But the way they represent and query KG is different. I'd personally like hippoRag better as it's simple to implement and maintain.
- For QA over technical documentations, there is no universal solution. I would go with a very custom one depending on the nature of the documentation and domain. The general RAG process is the same however, the implementation details will be totally different. You need to do several experimentations to figure the right end-to-end solution.
Thank you for your explanation and perspective.
Thanks!!
Thanks and I really like your take on whether its practical in a production scenario, keep making more videos like this.
Thank you! This is a great video with a clear explanation.
running triplex local (ollama) = almost instant return @ $0 (well maybe 1c for power usage... or non if using solar)
can this be applicable for ticketing (customer support)
Potentially, you can prototype with this library. We also shared pros and cons in this video about this approach. Hope it helps!
What do they call the parameter you have to enable for entity resolution?
Could you explain where/how embeddings are used here? It is not mentioned in the paper (From Local to Global..), where it seems like all the steps are done by using/calling LLM.
Also, how do they decide if a query is global or local? A kind of LLM-based router that decides a query type?
It's not mentioned in the paper, nevertheless they mention it on their website. They are using openAI embedding. but you can change it to other embedding models via configuration. Here's more details:
microsoft.github.io/graphrag/posts/config/env_vars/
I heard that there is a code chunk to use it with llama3, have you tried that? That should get rid of the token cost.
You can replace openAI models with local ones. But usually the quality is lower and latency is a lot compare to more classical methods.
you might want to experiment w/ sciphi/triplex
Thanks!