Hey im using phi3 model 4k context.Would beam cloud cache the model which has been loaded and will this stay in cold.Any insight on this is appreciated
I'm pretty sure it does cache it for a certain amount of (configurable) time, but you do pay for keeping it alive for that time. You can read about caching the model here - docs.beam.cloud/v2/getting-started/quickstart#pre-loading
Woah i was just searching for a video on this service 😮😮 thank you forthe step by step by guide 🎉🎉
I just came across it a few days ago on a Reddit thread!
seriously underrated channel
seriously underated channel
Hey im using phi3 model 4k context.Would beam cloud cache the model which has been loaded and will this stay in cold.Any insight on this is appreciated
Helpful video. I will be giving beam a try
I'm pretty sure it does cache it for a certain amount of (configurable) time, but you do pay for keeping it alive for that time. You can read about caching the model here - docs.beam.cloud/v2/getting-started/quickstart#pre-loading
@@learndatawithmark thank you