Видео

Yeah I know, hope the video helped

Yes open webui supports function calling

Yes groq is free for now. Hopefully forever. You can make a free account. There rate limits have changed but they are better now.

Unfortunately, I don’t have a windows machine. But I would think the steps are similar. 1. ssh-keygen -t rsa -b 4096. You'll be prompted to choose a location to save the key. By default, it will suggest: `C:\Users\YourUsername\.ssh\id_rsa` - You can press Enter to accept the default location or specify a different one. - You'll be asked to enter a passphrase (optional but recommended for security). 2. SSH key location: - If you accepted the default location, Windows will create a `.ssh` directory in your user profile folder: `C:\Users\YourUsername\.ssh` - This directory will contain your private key (`id_rsa`) and public key (`id_rsa.pub`). 3. Using the SSH keys: - To use these keys for SSH connections, you'll need to add the public key to the `~/.ssh/authorized_keys` file on the Linux machine you want to connect to. - You can then connect using the command: `ssh username@linux_machine_ip -i C:\Users\YourUsername\.ssh\id_rsa` 4. Do the same thing in video for the ssh/config. That shows cursor the machine you have just setup. 5. Use that extension from that forum I mentioned in video. And don’t have any other remote ssh extension installed or it will try to use those and will not work.

Glad it helped

at which part are you stuck at? make sure you don't have the cursor or vscode suggested remote ssh extensions installed. those need to be removed/uninstalled and use the specific one I mention and it's in the description.

Good analogy. I agree with large document issue. I’m not sure why groq doesn’t do different specialty models like llama3-gradient, or deep seek I.e. I would assume it’s as easy as pulling a model from hugging face or ollama and just run the mode but I’m probably ignorant how they do it internally. But I have confidence if they will open up more and more especially when they are saying they’re going to charge you for inferences and you can’t buy the chips anymore. It makes sense to release more and more models.

@@teddyfulk I agree it's just a matter of time. I'm kind of a unicorn study: child psychiatrist dealing with the most voluminous docs. Lawyers I think would be in a similar boat.

Arc

@@RachedNoureddine is it an Arc extension? If so, which one?

Flycut is the extension. You can find it on the app store or download the dmg from GitHub. It’s truly amazing

Arc is the browser I’m using, which is great. It’s a fork of chrome so if you wanted to use extension from chrome they work in arc too. Although arc replace 90% of my extensions because it has most of the extensions I use as a daily driver built in.

Were you able to get it? Make sure your extra-openai-models.yaml only has one model_name. YT description didn't format the commented out llama model I had so I removed it. There is a plugin that someone created to make it easier once you have llm installed. You can go here: github.com/angerman/llm-groq and install the plugin and set your api key and then you should be good.