Видео

@@Mohsin.Siddique llama-index is a python package that is installed via pip, you don’t need an API key. No API keys required for this pipeline

@@harsh90dem0 are the dependant packages installed in your pipelines container? you’ll need to docker exec or kubectl exec into the container called “pipelines” Then run: pip install llama-cloud==0.0.13 llama-index==0.10.65 llama-index-agent-openai==0.2.9 \ llama-index-cli==0.1.13 llama-index-core==0.10.66 llama-index-embeddings-openai==0.1.11 \ llama-index-indices-managed-llama-cloud==0.2.7 llama-index-legacy==0.9.48.post2 \ llama-index-llms-ollama==0.2.2 llama-index-llms-openai==0.1.29 \ llama-index-llms-openai-like==0.1.3 llama-index-multi-modal-llms-openai==0.1.9 \ llama-index-program-openai==0.1.7 llama-index-question-gen-openai==0.1.3 \ llama-index-readers-file==0.1.33 llama-index-readers-llama-parse==0.1.6 \ llama-parse==0.4.9 nltk==3.8.1

@@RickySupriyadi hi, code is here: github.com/JordanNanos/example-pipelines video reviewing the code: ruclips.net/video/iLVyEgxGbg4/видео.html

@@jordannanos wow cool, thank you.

@@gilkovary2753 you’ll need to docker exec or kubectl exec into the container called “pipelines” Then run: pip install llama-cloud==0.0.13 llama-index==0.10.65 llama-index-agent-openai==0.2.9 \ llama-index-cli==0.1.13 llama-index-core==0.10.66 llama-index-embeddings-openai==0.1.11 \ llama-index-indices-managed-llama-cloud==0.2.7 llama-index-legacy==0.9.48.post2 \ llama-index-llms-ollama==0.2.2 llama-index-llms-openai==0.1.29 \ llama-index-llms-openai-like==0.1.3 llama-index-multi-modal-llms-openai==0.1.9 \ llama-index-program-openai==0.1.7 llama-index-question-gen-openai==0.1.3 \ llama-index-readers-file==0.1.33 llama-index-readers-llama-parse==0.1.6 \ llama-parse==0.4.9 nltk==3.8.1

Did you configure well pipeline ?

@@dj_hexa_official what do u mean with that ?

@@netixc9733 what error are you seeing? docker logs -f or kubectl logs -f your pipelines container and it may report an error

hi, code is here: github.com/JordanNanos/example-pipelines video reviewing the code: ruclips.net/video/iLVyEgxGbg4/видео.html

hi, code is here: github.com/JordanNanos/example-pipelines video reviewing the code: ruclips.net/video/iLVyEgxGbg4/видео.html

hi, I think if you've got a db you should be able to query it. especially if you already know how using python. I posted another video. code is here: github.com/JordanNanos/example-pipelines video reviewing the code: ruclips.net/video/iLVyEgxGbg4/видео.html

@@jordannanos Thanks a lot Jordan . Super cool

code is here: github.com/JordanNanos/example-pipelines video reviewing the code: ruclips.net/video/iLVyEgxGbg4/видео.html

Jordan thanks, I have a single gpu runpod setup would you recommend just adding a docker postgresql to existing pod? and is the python code using langchain stored in the pod pipeline settings? this sort of reminds me of AWS serverless Lambda but simpler

@@RedCloudServices if you’d like to save money I would run Postgres in docker on the same VM you’ve already got. That will also simplify networking. Over time you might want to start/stop those services independently in the event of an upgrade to docker or your VM. Or you might want to scale independently. In that case you might want a separate VM for your DB and a separate one for your UI. Or you might consider running kubernetes. Yes the python code is all contained within the pipelines container and uses llama-index not langchain (though you could use langchain too). Just a choice I made.

@@RedCloudServices in other words, you’ll need to pip install the packages that the pipeline depends on, inside the pipelines container. Watch the other video I linked for more detail on how to do this.

@@jordannanos yep! just watched it. I just learned openwebui does not allow Vision only models or multi modal LLMs like Gemini. Was hoping to setup a pipeline using a vision model 🤷‍♂️ also it’s not clear how to edit or setup whatever vector db it’s using

@@martinsmuts2557 it’s a single .py file that is uploaded to the pipelines container. I’ll cover that in more detail in a future video

@@jordannanos Do create this video soon!

@@KunaalNaik @martinsmuts2557 just posted a video reviewing the code: ruclips.net/video/iLVyEgxGbg4/видео.html repo is here: github.com/JordanNanos/example-pipelines

working on getting it to run on both vLLM + ollama endpoints with llama3.1 + mistral. prompt uses llamaindex for text-to-sql.

similar to this guide: docs.llamaindex.ai/en/stable/examples/index_structs/struct_indices/SQLIndexDemo/

Great job can't wait to see more

@@jvannoyx4 hi, code is here: github.com/JordanNanos/example-pipelines video reviewing the code: ruclips.net/video/iLVyEgxGbg4/видео.html

AI, apparently. (LLM = Large Language Model)

Why would you need more than that? Be glad for what you already have or you won't find happiness :)

Bitch i have a p40 and im over the moon. Being poor in ml is hard.

Why not podman tho

Yes, working to improve the LLM response and SQL query time