Видео

message me via telegram or linkedin and lets take a look at it. My telegram nickname is same as my github name

what is the error

Appreciate it

hi, dm me in telegram( same as my github name) or in linkedin and i will take a look. terminal showing 0.0.0.0:8188 is normal. But it should also show a second one with comfyui external ip.

I got it to work, but everything has to be followed exactly. The VM name has to be the same and the zone has to be europe central or it breaks.

yup, you need a choose a higher RAM GPU though. And tricky part is not all GCP regions allow selecting all types of GPUs.

is it a new account? You entered your correct payment information already? What text you wrote for your GPU quota change request reason?

@@ns_the_one Yes, this is a new account. And yes, Payment info is added. But the system does not allow me to even give 1 value for GPUs. Enter a new quota value between 0 and 0. Based on your service usage history, you are not eligible for a quota increase at this time. If additional resources are needed, contact our Sales Team to discuss your options for a higher quota value. Created a VM with GPU, and tried applying for quota increase from there. Don't think it worked.

Eyvallah dostum dusunmen yeter. Linkedin'den ekleyebilirsin, bir app cikariyorum yakinda denersin yorum yaparsin

@@ns_the_one istek gönderdim, tabii ki denerim

imo GCP interface is much more intuitive compared to AWS. Idk about pricing tho

@@ns_the_one thanks for your answer! Definitely GC is much more intuitive. And this setup does not stop when the VM is not in use; right? It has to be stopped manually aways to avoid overcharges?

​@@Nevalkar_ yes. i think It can be automatized in such way > 1. if you open a tab in your browser for comfyui, first check if VM is started already, if not, start it. 2. send stop the VM command automatically every 10 minutes unless browser has comfyui open.

Probably not, sign in your google cloud and go to compute engine. Check if your machine is started indeed, Check the external id. If all is good You should read the TroubleShooting part in the the repo and do the steps in there

files are in your local?

gcloud compute scp /Users/username/Documents/my_lora_file ns@comfyvm:/home/ns/ComfyUI/vm_lora_folder running this in your terminal should work if you change the folder and file paths as well as your comfyvm username (ns part ) correctly

@@ns_the_one Thank you for your helpful response, but I have one more question: how can I locate the LoRA folder within ComfUI?"

GCP VMs are easier to use/manage imo

@@ns_the_one Fair enough - thank you for your answer. I tried following the troubleshooting section because I can't access the comfyui via IP address once it's running, but when I go through the steps of "systemctl stop comfyui.service" it asks for a password, which I don't recall setting?

yup thats default port for comfyui

+1 for these questions

Yes you can. Only thing you need to do is stop your VM and then click edit, pick different hardware and save (You cant change your availability zoe and your availability zone might not all the hardware ) yes you can do this with AWS too.

@@ns_the_one Can you change the VM gpu power with COMMANDS? What I mean is, what if you want your VP capabilities to change depending on certain parameters, so it will detect automacially the need to reduce to increase the VP GPU, instead of having to do that manually?

@@EternalAI-v9b not possible in a feasible way

@@ns_the_one What's the alternative?

- Flux shcnell is less large then flux dev no? - Can you keep the simple one and make another version? I like to have simple things to learn, but maybe it is best to upgrade? your call. - I would like to learn how to "control" who gets access. I dont want any person with the ip to be able to enter, but I dont want also to have only one ip to be able. There must be something else that can say if someone can enter or not, I dont knwo yet. - Tell me, in that CLI black window I could theoreticaly create a python script of my choice that can itself control the comfy right? - question what if you want to gather mulriple prompt thourgh the day, and only want the server to run them all at once at the end of the day, would you PAY for the server beign run despite not using the GPU through the day (just gathering prompts)? - sorry for many questions, I am excited about this topic

​@@EternalAI-v9b Yup, it is configurable but most of the ways require some extra steps in terminal so I avoid sharing them. There is 1 feasible-looking way i want to check: "API Gateway or Reverse Proxy with Token Authentication: If you're exposing certain services via HTTP/HTTPS (e.g., a web server on the VM), you can front those services with an API gateway or reverse proxy that enforces authentication via dynamically generated tokens or OAuth. Steps: Set up an API gateway (such as Kong, NGINX with JWT, etc.). Use a service like OAuth2 or JWT to generate tokens for trusted users. Configure the reverse proxy to validate these tokens before allowing traffic through." Through this we might create a password and only the ones with password can access.

@@ns_the_one Impressive! I love it^^ I will copy paste it. I dont know well all this but I am sure I will be able to understand it in the future.

I would definitely include FLUX dev, I see it being used a lot for photorealism. Also, it would be great to let us know what happens if we update and change the GPU to add some faster ones and increase the memory which would lead to changing the location. For the most part, you can't do much with basic libraries and at some point, you have to agree that you have to spend more if you want to achieve good results.

@ns_the_one Flux has GGUF and many other versions that you can use for a tutorial. something that's more interesting to me (and possibly to a lot of people) is deploying ComfyUi as API endpoint on GCP. Do you know how we can do that, so we run our workflows as API endpoints in the cloud? This way we can create SaaS apps with GCP hosted comfyui backend

you can probably solve this port forwarding. You need to learn which ports touchdesigner is using to communicate with your camera. Key term is called LocalForward

you are welcome mate

@@ns_the_one You are a legend because I just searched "install comfy ui on your own sever" and was afraid because I didnot finf any good result within the 3 first results, thankfully I found yours. I will watch it now. What I liked the most is the sentece you wrote on your video descripttion about its cost. I really like that. I did not watch the video fully yet, but can we customize the server and add our own pyton scripts etc? I wonder. Will watch and see

@@EternalAI-v9b haha thanks, i just youtubed "install comfy ui on your own sever" couldnt find my video as well. Yes you can customize it. This tutorial, in it's essence, is showing you how to create a virtual machine on cloud -with GPU support- and use it for random stuff.

Hi thank you, go to the repo given in description and if you scroll down you will see a section named "How can I download new models". If you have problems feel free to ping me

Thank you blitz, What jupyter notebook are you talking about? If you want to edit code files you can SSH into VM and find the path of the file and use nano command to make simple edits.

@@ns_the_one i guess what im asking is, when i have used comfyui on runpod to rent gpus you get a port 3000 that has the code so i can edit directly instead of using the UI elements, its been helpful with some file structures that i need for certain models (Mainly mimic motion),

if I wanted to install Automatic1111 & Fooocus alongside your setup, anything I should keep in mind as to not break anything and be able to import/use the same models ?

Thank you, give it a star in github if it was helpful

when you say parameters, are they workflow parameters used in comfyui?

@ns_the_one no, what I meant to say was, my website let's you upload image, and then those image are used as input in comfyui workflow to generate a specific type of image, which is promised to users on my website, and then I deliver the generated images to the users. Now inside the workflow all the values and nodes are fixed, but the initial image to work upon changes from user to user, so such variables(in my case the initial input image) which I want the user to have influence upon I called as parameters, I guess you may have confused it with the parameter inside nodes of workflow, I am sorry for not being able to convey clearly earlier

@@rambapat588 you can wait for my next tutorial which will be about this exactly. But I am not sure when I will release it

You forgot to make the IP address static and after some time it changed by itself. Check 10:21 in the video. If it is still not working you can book a meeting with me in here: cal.com/ns-the-one

@@ns_the_one thank you for answering! I did it like in the video so it is setup right, but i still cant connect it seems, could there be a firewall issue from my local wifi or firewall issue from my local computer? I live in sweden and i use central europe, could that cause a disturbance?

@@Greatforkman there are a couple of ways to understand the problem. You can book a meeting for free and we can take a look. But If you want to solve it by yourself go to the repo and scroll down and find the troubleshooting section. This section shows debugging steps. And also see the commented lines here : github.com/karaposu/comfyui-on-cloud/blob/main/src/virgin_vm.sh I added them because I once had a similar problem with port access. They might help. I paste them here: ## run these lines in the vm to make sure port 8188 is open for external access #sudo ufw allow 8188/tcp #sudo ufw reload #sudo firewall-cmd --zone=public --add-port=8188/tcp --permanent #sudo firewall-cmd --reload #sudo apt-get install iptables #sudo iptables -A INPUT -p tcp --dport 8188 -j ACCEPT

@@ns_the_one Thank you for the help! I found different reasons as to what could have been the problem. First thing was that SSH had was not installed properly as since i got connection issues randomly when trying to connect to VM. The next was that 100gb space on the compute engine was not enough to download everything (I got an error message), so i had to raise disc space to 120gb. So i had experimented a bit, i thought it would be safest to start over. So i removed the project and everything and started from scratch. This time with the 120gb extra disc space and better understanding how to setup the SSH. And with doing all of this, i managed to get everything working at the end of it. Great guide and thank you for the help! Next thing im trying to figure out and what you could a video about is how to make VM comfyui work with Krita.

@@Greatforkman Yeah, after some updates 100gb is not enough anymore. I am glad it worked. Please star the repo in github if you have an account and have fun generations!

can you paste here command you are running and the error you get?

I came back here to ask the same question

I am glad it worked. I intentionally structured the tutorial for non-developer people. Have fun image generations!

Code base for multiuser api is partially ready. But I am working on another project for now.

@@ns_the_one thank you for your quick update, I shall look forward to it when it's ready. Cheers !

@@ns_the_one thank you. I have managed to install ComfyUI and comfyui-on-cloud using your instructions but at the end I received an error here " ./comfyui-on-cloud/src/install.sh: line 106: jq: command not found (23) Failed writing body ---------------- For health check go to this address :8188 in your browser" and I couldn't access Comfy in my browser, do you have a fix for it please ?

Its ok, managed to fix it via the docs

normally you wont need to do sth extra. gcloud sdk saves your credentials to some folder and you can start the vm with this : "gcloud compute ssh comfyvm". However, if for some reason it is not working, try to do this: "gcloud compute instances list" This outputs list of your compute engines. Check if you see comfyvm there. If you dont see it, it means you need to go through "gcloud auth" or "gcloud init" commands depending on the error you see there.

Bạn đến từ Việt Nam à?

The idea is not, not to pay, but pay the least amount.

explained here : github.com/karaposu/comfyui-on-cloud

@@ns_the_one [Errno 28] No space left on device, please help to fix this

@@pikushaa you can remove some models to open up space. But if you are going to explore new models i suggest redoing the installation with bigger disk space.

@@ns_the_one Hey man, really appreciate the work you put in to bring this to others. I'm finally able to learn and play around with comfyui without having to use colab. I have a question, how do I remove models?

@@thalla1asal1wolf i am glad it is useful. Login to your server and run this "cd ComfyUI" and then run "rm -rf ./models/checkpoints/model_name"