Super useful video, thank you Tim! The thing I'm trying to do is put together an AWS Lambda function that can use the EC2-based chromadb. Any thoughts on how to stuff all of the libraries needed into a layer(s) to make them visible to the lambda function? I've tried to build a layer with chroma (about 25MB) and openai and pydantic to fit into AWS Lambda layer limitations? Thanks again.
Thanks this was a very useful video, considering that the default setup doesn't provide any kind of details on security. One question though, is it advisable to go with this security to production?
The conventional wisdom is "absolutely". There is such thing as security through obscurity so for sure set an API key. The overhead to set/reset a key as well as compensate for Auth in your code is minimal but 1000x worth it. Unless you really want anybody with an internet connection to read, create, or update your vectors, put Auth on it!
Great video! Was so easy to get the ec2 instance going and connected. One issue I found was trying to vectorize some documents to the instance using AnythingLLM I always got this error 'Error: 1 documents failed to add. parseAuthHeader is not defined' Any help would be awesome!
I'm attempting to host it on Azure, but I'm encountering problems with persistent data and authentication. While I can successfully host it, the functionality is not working as expected. Seeking assistance.
I cant speak to Azure setup as this video focuses on AWS. I can be nearly certain there are distinct differences in the setup as to why your setup is not being persisted. I would try the Chroma discord. They are very helpful with that. Just describe your issue + setup and they can help more than I can alone.
Great vid! I just had one quick question. How do I check the version of chroma on the EC2 instance? I am getting this error: "ValueError: Could not connect to tenant default_tenant. Are you sure it exists?" when I try and connect to the server in python and I saw on the chroma discord it may be due to a version mismatch between server and where I am calling it from. Let me know if you have any insight into this and keep up the great work!
Great content! Is there a possibility to deploy it on Google Cloud? Seems there is no straightforward way to do it.
Super useful video, thank you Tim! The thing I'm trying to do is put together an AWS Lambda function that can use the EC2-based chromadb. Any thoughts on how to stuff all of the libraries needed into a layer(s) to make them visible to the lambda function? I've tried to build a layer with chroma (about 25MB) and openai and pydantic to fit into AWS Lambda layer limitations? Thanks again.
Thanks this was a very useful video, considering that the default setup doesn't provide any kind of details on security. One question though, is it advisable to go with this security to production?
The conventional wisdom is "absolutely". There is such thing as security through obscurity so for sure set an API key. The overhead to set/reset a key as well as compensate for Auth in your code is minimal but 1000x worth it.
Unless you really want anybody with an internet connection to read, create, or update your vectors, put Auth on it!
Hey, How to deploy chroma vector in AWS without using docker.
Great video! Was so easy to get the ec2 instance going and connected. One issue I found was trying to vectorize some documents to the instance using AnythingLLM I always got this error 'Error: 1 documents failed to add. parseAuthHeader is not defined' Any help would be awesome!
Did you set up Chroma with an Auth key? I can only imagine that is the reason why. I am assuming you are including the key as well in AnythingLLM
this not worked as expected.
i can do request without any token
I'm attempting to host it on Azure, but I'm encountering problems with persistent data and authentication. While I can successfully host it, the functionality is not working as expected. Seeking assistance.
I cant speak to Azure setup as this video focuses on AWS. I can be nearly certain there are distinct differences in the setup as to why your setup is not being persisted.
I would try the Chroma discord. They are very helpful with that. Just describe your issue + setup and they can help more than I can alone.
@@TimCarambat thanks for the response, I did post the question in the discord but no response yet can you creat a new video how to deploy on azure
Great vid! I just had one quick question. How do I check the version of chroma on the EC2 instance? I am getting this error: "ValueError: Could not connect to tenant default_tenant. Are you sure it exists?" when I try and connect to the server in python and I saw on the chroma discord it may be due to a version mismatch between server and where I am calling it from. Let me know if you have any insight into this and keep up the great work!
There is an easy way to version check!
:/api/v1/version
Great! Thank you so much for the quick response!!@@TimCarambat
Had one more quick question if you may know the answer: how do you update the version?
@@varunjoshi3991 Did you find a solution? I am facing the same issue.