3D Visualization of embeddings using Ollama nomic-embedding-text and OpenAI text-embedding-3-small

In this Tutorial, we will create 3D embedding spaces from OpenAI text-embedding-3-small and nomic-embed-text.
00:45 Visualize the embedding space
01:41 Huggingface MTEB leaderboard for embedding models
02:34 Pull nomic-embed-text in ollama
02:56 Clone openai-cookbook
04:21 OpenAI get_embedding with text-embedding-3-small
04:39 Cosine similarity
05:10 DBPedia validation dataset on Kaggle
06:19 Reduce the embedding dimensions from 1536 to 3 using PCA
06:36 Using matplotlib.pyplot to plot the embeddings in 3D
07:41 Use embed.documents from Langchain OllamaEmbeddings
Links
OpenAI
openai.com/blo...
github.com/ope...
Huggingface
huggingface.co...
Kaggle
www.kaggle.com...
LangChain
api.python.lan...
Ollama
ollama.com/lib...
Wikipedia
en.wikipedia.o...

[@RolandoLopezNieto]

Awesome information, thanks

[@business24_ai]

Thanks for your feedback.

[@srinivasguptha9538]

Thanks!. Great content.

[@business24_ai]

Glad you liked it!

[@Blooper1980]

Nice!

[@business24_ai]

Glad you liked it.