here is the problem; i have a WhatsApp chatbot, I'll have to save thread id on my supabase db, the issue is I'll have to call supabase for every single request & message, i want something like a dynamic variable that i can store my thread id once i have a new request from a new user, also it'll help me allot because for every single request i have to also call supabase to chake if the user is subscribed or not, but if i get something like dynamic variable that i can set it on begging of conversation it'll be so great.
here is the problem; i have a WhatsApp chatbot, I'll have to save thread id on my supabase db, the issue is I'll have to call supabase for every single request & message, i want something like a dynamic variable that i can store my thread id once i have a new request from a new user, also it'll help me allot because for every single request i have to also call supabase to chake if the user is subscribed or not, but if i get something like dynamic variable that i can set it on begging of conversation it'll be so great.
I can't set that thread id on front end bcs it's a WhatsApp chatbot, i need something like dynamic variable
How many tokens does one query cost with such a broad context?
What about when user upload their own document and want to get summary or details from the uploaded doc?
You can send files in user message.
thank u :)