probably the best instructor. he explains everything and he knows, not just read. he doesnt make mistakes, or constantly clicking mouse to feel clever. im impressed
@@LondonAppDeveloper im sorry but for also for window users and im using postgressql server. i made website sir i just wanna upload and give a domain name please reply ..
Thanks Mark. With your help I got my app dokerised. I was a bit afraid of this task but really happy that I got through it. Missing London during lockdown but keeping busy learning :-)
Amazing video just what i was looking for but have 2 questions, why use static-data:/vol/static instead of actual folder static-data:/vol/WEB/static ? and in settings.py why use STATIC_URL = '/static/static/' instead of STATIC_URL = 'static/' ? thanks!
So I understand that the first configuration it is to test the application, and the nginx configuration it is to deploy into my server. I am a little confused because I have to put my database too in the configuration, but with your explanation, I understand very well Dockerfile and docker-compose, I was very confused about this, I just found your video, it is an excellent explanation and I say thank you very much! you saved me
Thanks a lot for this video. I am currently learning docker and this example by practice was very great for me to better understand how do we use it, on a real app.
Great ! I have used this tutorial to deploy CRUD project, ant i have an issue: when i make POST or enter name & password on admin page, i get SERVER ERROR (500) What can be the problem? Any help appreciated!
Great tutorial. I had some difficulty when deploying to a production server so I may be able to help others. If you deploy to prod, and can only access your page via port 8080, update docker-compose-deploy.yml ports value from "8080:8080" to "80:8080".
Excellent ! Now this is OK to run "as such". However, a quick & short explanation on : 1. How the docker containers are arranged one with each other ? django is always deployed with 2 containers while I could be sufficient (no?). 2. Why do we create a Docker container to generate the statics ? Would have bring this one step further ! I looked at all the comments and wonder who are the 17 idiots who gave you a down thumb. Great job.
Oh man you are a life saviour, it worked wonders!, although I would have to re watch this video many times to totally grasp a little more of docker, and to study more the docker official documentation. I still find hard to grasp volumes and implementing a networking with docker.
Amazing. So glad to hear that. Volumes are basically like a shared folder... You map a volume from your host to the docker container. It's a way of adding persistent data in your Docker containers.
OMG, what a great video and it makes it so painful that it's missing a, say, Heroku deployment at the end. This would have been a one-stop shop for dockerizing an app.
Thanks for sharing this walk through. I am stuck with an error in the final step when I run "docker-compose -f docker-compose-deploy.yml up --build" , I get: "app_1 | python: can't open file 'manage.py': [Errno 2] No such file or directory". Can anyone help me resolve this...
Sounds like you might have problems with your project file structure. You should have a project fold containing the dockerfile and dokcer-compose as well as requirements. Then create django project called app. The manage.py needs to be in there. Check the file structure in the source code for clarity.
Hiya, when we say app in the docker-compose.yml is it the app name ? Suppose my app name is projectx, would I put projectx instead of app: in the compose file ? Thanks.
It's copying default.conf from your project directory to /etc/nginx/conf.d on your Docker container. It won't impact /etc/nginx/cond.d on the host system.
Perfect explanation. But that's the point where I give up on technology stack decisions. That shouldn't be that hard to deploy a web app. Your explanation is perfect. But deployment mustn't be that hard we need guidelines and courses. Its 2021. web development going backward. its much easier 15 years ago. Don't get me wrong. It's not about you, it's not about Django. It's about web development ecosystem. We need a paradigm shift. For example if I decide to deploy on google cloud or AWS. ı should develop on production server. I should concentrate on development. with a command my development should convert to production. Only thing I worry about is database migration. keeping old date.
Yeah good point. Even with serverless technology like AWS Lambda or Google App Engine, it still takes a huge amount of work to get an app deployed successfully. Still a long way to go in terms of simplifying deployment.
yeah I don't know why this is such a joke. I barely have experience in software development , few months, and trying to deploy my backend is being such a pain in the neck.
Hello and thank for usefull video. I use ubuntu(if it matters) and when compose docker-compose-deploy I have error PermissionError: [Errno 13] Permission denied: '/app/vol'. It relates to created user for app. Because if I not switch to it it works fine. RUN adduser -D manager RUN chown -R manager:manager /vol RUN chmod -R 755 /vol/web USER manager, as manager it has no rights to collectstatic in entrypoint.sh but seems that it should be able to do it. I have o idea what's wrong. May be I can suggest some where should dig?
Thanks so much. STATIC_URL is the config that determines the URL path prefix for the static files (so if you have a static file called `main.css`, it would be `/static/static/main.css`). The MEDIA_URL config is similar, but instead of for the static files (which are stored with the project), it's for the media files that are uploaded to the project at runtime. We set STATIC_URL to `/static/static` and MEDIA_URL to `/static/media` and because then inside our nginx config we can set the alias for `/static` to `/vol/static` which will contain both `static/` and `media/` directories. This means the nginx proxy can handle both `static/` and `media/` URLs with one single location block here: github.com/LondonAppDeveloper/demo-django-docker-nginx-prod/blob/master/proxy/default.conf#L4 Django URL and media files are actually very confusing, especially when combined with Docker volumes. If you want to learn more, I'd suggest reading the official docs here: docs.djangoproject.com/en/3.1/topics/files/
Hey, thank you for the tutorial! I just get stuck at 17:40 (docker compose-up) and can't figure out why :( When I enter 'docker compose-up' I get the message: ERROR: The Compose file '.\docker-compose.yml' is invalid because: Unsupported config option for services.app: 'enviroment' I didn't find any information about this problem on the internet and tried differend virtualenvs. Does someone have the same problem or knows an answer ? Best regards, Justus
London App Developer Thank you for the answer! I deleted the environment part and then it worked because it only contained the debug part. I am currently doing your advanced Rest API course on Udemy and now everything with Django and Docker works as expected. Best regards, Justus
Hello Mark, one question: is there a reason why you haven't dockerized postgres db in dev mode resp. add db service in docker-compose.yml? thanks in advanced.
Hi, I am getting below error while running this command ---> docker-compose -f .\docker-compose-deploy.yml up --build Starting demo-django-docker-nginx-prod_app_1 ... done Recreating demo-django-docker-nginx-prod_proxy_1 ... done Attaching to demo-django-docker-nginx-prod_app_1, demo-django-docker-nginx-prod_proxy_1 app_1 | standard_init_linux.go:219: exec user process caused: no such file or directory proxy_1 | /docker-entrypoint.sh: /docker-entrypoint.d/ is not empty, will attempt to perform configuration proxy_1 | /docker-entrypoint.sh: Looking for shell scripts in /docker-entrypoint.d/ proxy_1 | /docker-entrypoint.sh: Launching /docker-entrypoint.d/10-listen-on-ipv6-by-default.sh proxy_1 | 10-listen-on-ipv6-by-default.sh: info: can not modify /etc/nginx/conf.d/default.conf (read-only file system?) proxy_1 | /docker-entrypoint.sh: Launching /docker-entrypoint.d/20-envsubst-on-templates.sh proxy_1 | /docker-entrypoint.sh: Launching /docker-entrypoint.d/30-tune-worker-processes.sh proxy_1 | /docker-entrypoint.sh: Configuration complete; ready for start up demo-django-docker-nginx-prod_app_1 exited with code 1 proxy_1 | 2021/03/20 11:16:58 [emerg] 1#1: host not found in upstream "app" in /etc/nginx/conf.d/default.conf:9 proxy_1 | nginx: [emerg] host not found in upstream "app" in /etc/nginx/conf.d/default.conf:9 demo-django-docker-nginx-prod_proxy_1 exited with code 1
Thank you very much for the tutorial! It's really helping with my conclusion project. There's one detail that isn't covered that I got stuck on: in the video you seem to be using SQLite as a database. I'm using MySQL on a remote server and installing the dependencies causes the Docker image to crash. Do you have any tips?
That's great, thanks for watching. You would set it up using environment variables to point to the remote server. So docker-compose.yml would have environment variables (pulled from .env file for secrets) and then settings.py would be configured to pull the MySQL database details from the env vars. Here is an example: github.com/LondonAppDeveloper/c2-recipe-app-api-2/blob/main/docker-compose-deploy.yml#L12 In that example we are using a DB hosted with Docker Compose, but you could just exclude the db: service and replace the configuration with the target DB if your DB is hosted elsewhere.
thanks for the upload, but have question, how can i link to media folder , where ever i tried , in root or next to static folder, i get error, i don't know hw link my media folder
This site can’t be reachedThe connection was reset. on port 127.0.0.1:8000/. it works fine when used without docker but with docker-compose up it is giving site can't be reached please help
Thanks. Great video. I was able to setup Nginx following your video, also I used Gunicorn instead of uWSGI. However, I get a "CSRF verification failed. Request aborted." error when I try to login or submit a form. This works fine with with just Python and Gunicorn. Any ideas please.
Thanks for the great vid! I tried to follow along but at the end received this error. How can I fix it? [emerg] 1#1: host not found in upstream "app" in /etc/nginx/conf.d/default.conf:9 proxy_1 | nginx: [emerg] host not found in upstream "app" in /etc/nginx/conf.d/default.conf:9
same error. it seems app it is not recognized by the nginx default.conf. 'app' there should be an ip address, should i cant figure out why it is not recognized.
i fix the error, app name refers to the name of the top folder of the app, where the docker-compose-deploy.yml is. you have to change app for the name of the folder and it will work.
Hi Mark, Thank you so much for your wonderful videos and it was a great learning for me. Furthermore, i need your help to resolve the below issue mentioned in the "docker-compose-deploy.yml". While execute the final step of build, i getting the below error. My OS: WINDOWS -10 Pro Error: The Compose file '.\docker-compose-deploy.yml' is invalid because: Unsupported config option for services.volumes: 'static_data' Please to hear you soon.
You're amazing. Thank you very very much. Does this exact same configuration works on an asgi app? I made changes to one of my apps since I'm using Django Channels and I want to deploy my project with a neat setup as you propose in this video. Any suggestions?
Because we use /static/ to map all static files, and /static/static/ is going to be for files generated by collectstatic and /static/media/ will be for media files uploaded by the user. It might be less confusing to use something like /webdata/static/ and /webdata/media/.
Thanks a lot for sharing this in-depth hands on session. I kinda got lost towards the end as there was no indication that your app was successfully deployed in the production environment :( . After the last step, when I access the app locally at port 8080 (and the /admin route as well), after I login I get Server Error(500). Any ideas how to resolve this... I have followed all the steps and pulled the docker image in AWS EC2 instance(regardless of the environment), and now would you please share steps on how to verify that all's working as expected. Once again I learnt a lot about the dos and don'ts from your session! :)
I had one doubt, you copy the project to the container, install dependencies and packages, create the directory for media and static files and then you create a user and provide the directory with permission with the created user. so whatever the project files like hello_world, app, and manage.py will not have that user permission right? Is it okay to keep it as root user permission for those files or will it change the user permission for those too?
@@LondonAppDeveloper thank you! Could you please make a video on deploying django in swarm mode and keep nginx infront to receive all the http request.
There are many benefits to using Docker. 1) Check the Dockerfile and configs into code base, 2) Less server setup to deploy app - simply install Docker and run the containers, 3) Avoid server overhead completely using serverless technologies like Heroku and ECS Fargate... These are just some of the reasons.
Local development works fine but when setting up nginx I ended up getting the following error: nginx: [emerg] host not found in upstream "app:8000" in /etc/nginx/conf.d/default.conf:2
How can we pass the allowed host dynamically from docker run command , because i want to run this in aws ec2 linux , so without the need of compose file, i have to run the container by pulling it into my ec2 instance. here is the below error i got: error: Invalid HTTP_HOST header: '11.232.140.160:8080'. You may need to add '11.232.140.160' to ALLOWED_HOSTS. command: docker run -p 8080:8080 rakesha/django_docker:1
We teach how to do that in our advanced DevOps course: londonapp.dev/c3 - Basically we setup HTTPS using and AWS Application Load Balancer. I'll also consider making more RUclips content about this too.
@@LondonAppDeveloper thank you sir for answering, yes, from what i googled i think pillow needs other dependencies jpeg-dev, zlib but even adding them after the linux header didn't fix my issue
NGINX is used to serve the static files (JS, CSS, Images, etc.) and uWSGI is used to execute the Python code. Although uWSGI _can_ serve these static files, it's not recommended because it's not optimised to do so. NGINX is designed to serve these types of files at scale, which is why we use NGINX to handle them and leave uWSGI to do what it does best, which is run Python code.
Hi, could you please help me, I am trying to set up the app to deploy it on google virtual machine, I've followed all of the steps like you instructed for deployment (add allowed host IP and adding secret_key and host IP in allowed_hosts in docker-compose-deploy.yml file) but I couldn't get it to work, when I access host IP, it just keeps loading and eventually fail.
Apologies but it's difficult to give help over RUclips comments because I can't see the code, issue or server configuration. Have you considered posting a question on Stack Overflow?
@@LondonAppDeveloper hey there, I am glad that you actually reply my comment. Fortunately, i have found the issue, for some reasons google vm only allow access from port 80. So i change ports from 8080:8080 to 80:80 in compose deploy yml, and also nginx default.conf . Then it works magically. Thank you, you have the best tutorial out there. Keep it up. One quick question, when I add commands to entrypoint.sh why does it only run when I start the proxy container, not when I start the app container?
@@LondonAppDeveloper Sorry. I found a typo. I'm implementing this video on my own project (not much more complex). But still getting a 500 now. The app sevice simply responds: [pid: 12|app: 0|req: 6/6] 172.18.0.1 () {54 vars in 1082 bytes} [Sun May 23 21:39:34 2021] GET /accounts/login/?next=/ => generated 2288 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 461 bytes (1 switches on core 0) I'm guessing it's permissions to de DB. I thought maybe using root to ensure access to de database but still nothing. Any recommended video to implement db as a separate service with this configuration (nginx + uwsgi)?
Hey, we will do... Currently working on some other projects (moving country/house being one), but we are planning to launch one more course and then update this course to use Django 3. Will keep you updated once it's available. Thanks for the support :)
probably the best instructor.
he explains everything and he knows, not just read. he doesnt make mistakes, or constantly clicking mouse to feel clever.
im impressed
aww thanks man appreciate it.
Terrific video
I absolutely love how you've explained every single step in the dockerfile and conf files in detail
Dude, that explanation was perfect. You deserve way more views. Thanks!
Thanks Eric :D
Might be the best DEV teacher I’ve ever had. From Udemy to RUclips, thank you so much Marc
Wow thanks man appreciate that :)
@@LondonAppDeveloper im sorry but for also for window users and im using postgressql server. i made website sir i just wanna upload and give a domain name please reply ..
The best dev channel, giving millions of information in a very short time.
Thanks mate, appreciate that :)
Damn Dude, just bought your course. Your explanation made my day.
Thank you so much.
Thanks Mark. With your help I got my app dokerised. I was a bit afraid of this task but really happy that I got through it. Missing London during lockdown but keeping busy learning :-)
Thanks for the comment, great to hear that. Are you abroad or in the UK but not commuting to London due to lockdowns?
Man this was so good and thorough. This is going to provide s many people with a strong foundation to build their own websites. Thanks so much!
Thanks Andrew :)
Love how this video is recommended to me AFTER I have created my docker image... Greate video!
Brilliant!
It’s just out of this world explanation!!! God Level !!
This is the best Django - Docker tutorial by far. You keep best practices and you do a very good job explaining! Thank you!
Thank you for that :)
Well thought out and easily explained as usual by Mark....
Thanks so much!
Thanks mark !! I love the way you present your content . Learned DjangoRest from your two courses :)
Thank you! We appreciate you supporting our content by buying our courses, and glad you like them :)
Amazing video just what i was looking for but have 2 questions,
why use static-data:/vol/static instead of actual folder static-data:/vol/WEB/static ?
and in settings.py why use STATIC_URL = '/static/static/' instead of STATIC_URL = 'static/' ?
thanks!
Hey! This was one of the most useful tutorials I've come across!!
Respect for preparing this awesome presentation and sharing your knowledge. Thank you!
You are doing greate job with those tutorials :) waiting for more quality content like this one
Thanks so much =)
So I understand that the first configuration it is to test the application, and the nginx configuration it is to deploy into my server. I am a little confused because I have to put my database too in the configuration, but with your explanation, I understand very well Dockerfile and docker-compose, I was very confused about this, I just found your video, it is an excellent explanation and I say thank you very much! you saved me
Thank you!
Seriously, thank you for this explanation. Very well done! Very thorough
Great tutorial, got a better understanding of what should be done when deploying django apps.
Thank you glad it was useful!
My man! hats off for you! one can see with you that knowledge cannot be improvised, thanks a lot for this video!
Thank you! :)
Thanks a lot for this video. I am currently learning docker and this example by practice was very great for me to better understand how do we use it, on a real app.
Great to hear that... Thank you!
Absolutely great, man!
you are just incredible my brother from my mother.
Thanks! Glad you like the video.
@@LondonAppDeveloper but quick question how should i handle(properly configure) if i want to include media folder???
That was an awesome explanation.
Glad you think so! Thank you!
I love your channel. Thanks for all the videos.
Great !
I have used this tutorial to deploy CRUD project, ant i have an issue:
when i make POST or enter name & password on admin page, i get SERVER ERROR (500)
What can be the problem?
Any help appreciated!
Great tutorial.
I had some difficulty when deploying to a production server so I may be able to help others. If you deploy to prod, and can only access your page via port 8080, update docker-compose-deploy.yml ports value from "8080:8080" to "80:8080".
Did you deploy it on VPS Linux image? If so, does it work?
That's right. Also keep in mind that you might need to open the port via security rules for your VM.
Thank you a lot, solving my concern right now !
Excellent !
Now this is OK to run "as such".
However, a quick & short explanation on :
1. How the docker containers are arranged one with each other ? django is always deployed with 2 containers while I could be sufficient (no?).
2. Why do we create a Docker container to generate the statics ?
Would have bring this one step further !
I looked at all the comments and wonder who are the 17 idiots who gave you a down thumb.
Great job.
Great tutorial, agreed you deserve more views. Thanks a lot!
Thanks so much :)
thank you for this masterpiece
You're welcome, thanks for watching :)
Oh man you are a life saviour, it worked wonders!, although I would have to re watch this video many times to totally grasp a little more of docker, and to study more the docker official documentation. I still find hard to grasp volumes and implementing a networking with docker.
Amazing. So glad to hear that. Volumes are basically like a shared folder... You map a volume from your host to the docker container. It's a way of adding persistent data in your Docker containers.
OMG, what a great video and it makes it so painful that it's missing a, say, Heroku deployment at the end. This would have been a one-stop shop for dockerizing an app.
Thanks much!! This video helped me a lot & understood so much....
Thanks for sharing this walk through. I am stuck with an error in the final step when I run "docker-compose -f docker-compose-deploy.yml up --build" , I get: "app_1 | python: can't open file 'manage.py': [Errno 2] No such file or directory". Can anyone help me resolve this...
Sounds like you might have problems with your project file structure. You should have a project fold containing the dockerfile and dokcer-compose as well as requirements. Then create django project called app. The manage.py needs to be in there. Check the file structure in the source code for clarity.
Hiya, when we say app in the docker-compose.yml is it the app name ? Suppose my app name is projectx, would I put projectx instead of app: in the compose file ? Thanks.
I got the same doubt. Someone help
Simple, Fast, Usefull 👌👌
Thankyou for such a detailed explanation, I am able dockerize my project...
You are most welcome
Hi, good tutorial ! Do you know any good Tutorial which explains how to set up Django with Docker on AWS EB? AWS don't have a documentation.
Thanks a lot! Useful and easy to follow
Thanks mate, appreciate that.
23:45 Will it copy to /etc/nginx/conf.d/ of the host system or docker nginx image (container)?
It's copying default.conf from your project directory to /etc/nginx/conf.d on your Docker container. It won't impact /etc/nginx/cond.d on the host system.
@@LondonAppDeveloper Oh that's great! Thank you!
Thank you for your great instructive video.
Thank you so much for this!
Glad it was helpful!
so much help, very useful tutorial
Happy to be of service!
Perfect explanation. But that's the point where I give up on technology stack decisions. That shouldn't be that hard to deploy a web app. Your explanation is perfect. But deployment mustn't be that hard we need guidelines and courses. Its 2021. web development going backward. its much easier 15 years ago. Don't get me wrong. It's not about you, it's not about Django. It's about web development ecosystem. We need a paradigm shift. For example if I decide to deploy on google cloud or AWS. ı should develop on production server. I should concentrate on development. with a command my development should convert to production. Only thing I worry about is database migration. keeping old date.
Yeah good point. Even with serverless technology like AWS Lambda or Google App Engine, it still takes a huge amount of work to get an app deployed successfully. Still a long way to go in terms of simplifying deployment.
yeah I don't know why this is such a joke. I barely have experience in software development , few months, and trying to deploy my backend is being such a pain in the neck.
Hello and thank for usefull video. I use ubuntu(if it matters) and when compose docker-compose-deploy I have error PermissionError: [Errno 13] Permission denied: '/app/vol'. It relates to created user for app. Because if I not switch to it it works fine.
RUN adduser -D manager
RUN chown -R manager:manager /vol
RUN chmod -R 755 /vol/web
USER manager,
as manager it has no rights to collectstatic in entrypoint.sh but seems that it should be able to do it.
I have o idea what's wrong. May be I can suggest some where should dig?
Hi. Im getting the exact same error [Errno 13] Permission denied. Have you had any success finding a solution?
GREAT VIDEO!
I just don't understand why he changed the STATIC_URL to "/static/static/".
Any help is appreciated.
Thanks so much. STATIC_URL is the config that determines the URL path prefix for the static files (so if you have a static file called `main.css`, it would be `/static/static/main.css`). The MEDIA_URL config is similar, but instead of for the static files (which are stored with the project), it's for the media files that are uploaded to the project at runtime.
We set STATIC_URL to `/static/static` and MEDIA_URL to `/static/media` and because then inside our nginx config we can set the alias for `/static` to `/vol/static` which will contain both `static/` and `media/` directories. This means the nginx proxy can handle both `static/` and `media/` URLs with one single location block here: github.com/LondonAppDeveloper/demo-django-docker-nginx-prod/blob/master/proxy/default.conf#L4
Django URL and media files are actually very confusing, especially when combined with Docker volumes. If you want to learn more, I'd suggest reading the official docs here: docs.djangoproject.com/en/3.1/topics/files/
I was looking for explanations on the environment variables. How to pass them to cloud build or any other ci-cd service?
Definitely appreciate this
Thank you! I appreciate you taking the time to watch our content and leave a comment :) Best of luck.
Thanks for sharing this ammmaizing course. I could understand what I understand and not. Best wishes,
Brilliant. Thanks so much for watching!
Hello sir, I'm facing WORKER TIMEOUT issue for Dockerized Django Application, can you please help me?
Hey,
thank you for the tutorial! I just get stuck at 17:40 (docker compose-up) and can't figure out why :(
When I enter 'docker compose-up' I get the message:
ERROR: The Compose file '.\docker-compose.yml' is invalid because:
Unsupported config option for services.app: 'enviroment'
I didn't find any information about this problem on the internet and tried differend virtualenvs. Does someone have the same problem or knows an answer ?
Best regards, Justus
Sounds like you might have an indentation issue in docker-compose.yml. Double check it matches the example.
London App Developer Thank you for the answer! I deleted the environment part and then it worked because it only contained the debug part.
I am currently doing your advanced Rest API course on Udemy and now everything with Django and Docker works as expected.
Best regards, Justus
Hello Mark, one question: is there a reason why you haven't dockerized postgres db in dev mode resp. add db service in docker-compose.yml? thanks in advanced.
Sorry not sure what you mean? We do put PostgreSQL as a service in docker-compose.yml.
@@LondonAppDeveloper i meant until 18:00 there was no db service that starts a postgres container. why is that?
Any idea how you would implement the http2 end to end solution? Happy to pay you for your help london app developer
Mint tutorial!
Thank you!
Hi,
I am getting below error while running this command ---> docker-compose -f .\docker-compose-deploy.yml up --build
Starting demo-django-docker-nginx-prod_app_1 ... done
Recreating demo-django-docker-nginx-prod_proxy_1 ... done
Attaching to demo-django-docker-nginx-prod_app_1, demo-django-docker-nginx-prod_proxy_1
app_1 | standard_init_linux.go:219: exec user process caused: no such file or directory
proxy_1 | /docker-entrypoint.sh: /docker-entrypoint.d/ is not empty, will attempt to perform configuration
proxy_1 | /docker-entrypoint.sh: Looking for shell scripts in /docker-entrypoint.d/
proxy_1 | /docker-entrypoint.sh: Launching /docker-entrypoint.d/10-listen-on-ipv6-by-default.sh
proxy_1 | 10-listen-on-ipv6-by-default.sh: info: can not modify /etc/nginx/conf.d/default.conf (read-only file system?)
proxy_1 | /docker-entrypoint.sh: Launching /docker-entrypoint.d/20-envsubst-on-templates.sh
proxy_1 | /docker-entrypoint.sh: Launching /docker-entrypoint.d/30-tune-worker-processes.sh
proxy_1 | /docker-entrypoint.sh: Configuration complete; ready for start up
demo-django-docker-nginx-prod_app_1 exited with code 1
proxy_1 | 2021/03/20 11:16:58 [emerg] 1#1: host not found in upstream "app" in /etc/nginx/conf.d/default.conf:9
proxy_1 | nginx: [emerg] host not found in upstream "app" in /etc/nginx/conf.d/default.conf:9
demo-django-docker-nginx-prod_proxy_1 exited with code 1
How can I have the static files outside the app? when I move the folder I get 404 error
You know your stuff. Subscribed
Thank you!
Thanks for this awesome guidance! It helped me a lot!
Glad to hear it helped!
Thanks a lot, great tutorial!
Nginx setup - 18:43
Thank you very much for the tutorial! It's really helping with my conclusion project. There's one detail that isn't covered that I got stuck on: in the video you seem to be using SQLite as a database. I'm using MySQL on a remote server and installing the dependencies causes the Docker image to crash. Do you have any tips?
That's great, thanks for watching. You would set it up using environment variables to point to the remote server. So docker-compose.yml would have environment variables (pulled from .env file for secrets) and then settings.py would be configured to pull the MySQL database details from the env vars. Here is an example: github.com/LondonAppDeveloper/c2-recipe-app-api-2/blob/main/docker-compose-deploy.yml#L12
In that example we are using a DB hosted with Docker Compose, but you could just exclude the db: service and replace the configuration with the target DB if your DB is hosted elsewhere.
thanks for the upload, but have question, how can i link to media folder , where ever i tried , in root or next to static folder, i get error, i don't know hw link my media folder
This site can’t be reachedThe connection was reset. on port 127.0.0.1:8000/. it works fine when used without docker but with docker-compose up it is giving site can't be reached please help
Thanks. Great video. I was able to setup Nginx following your video, also I used Gunicorn instead of uWSGI. However, I get a "CSRF verification failed. Request aborted." error when I try to login or submit a form. This works fine with with just Python and Gunicorn. Any ideas please.
Great Video...Please make a video of deploying this project on google cloud/AWS
Thanks for the suggestion, I'll keep it in mind for future content.
@@LondonAppDeveloper yes, please
Thanks for the great vid! I tried to follow along but at the end received this error. How can I fix it?
[emerg] 1#1: host not found in upstream "app" in /etc/nginx/conf.d/default.conf:9
proxy_1 | nginx: [emerg] host not found in upstream "app" in /etc/nginx/conf.d/default.conf:9
same
Also same
Same error
same error. it seems app it is not recognized by the nginx default.conf. 'app' there should be an ip address, should i cant figure out why it is not recognized.
i fix the error, app name refers to the name of the top folder of the app, where the docker-compose-deploy.yml is. you have to change app for the name of the folder and it will work.
Hi Mark,
Thank you so much for your wonderful videos and it was a great learning for me.
Furthermore, i need your help to resolve the below issue mentioned in the "docker-compose-deploy.yml". While execute the final step of build, i getting the below error.
My OS: WINDOWS -10 Pro
Error: The Compose file '.\docker-compose-deploy.yml' is invalid because:
Unsupported config option for services.volumes: 'static_data'
Please to hear you soon.
volumes needs to be at the same indentation with services i.e.
services:
#...
volumes:
static_data:
nginx: [emerg] host not found in upstream "app" in /etc/nginx/conf.d/default.conf:9
You're amazing. Thank you very very much. Does this exact same configuration works on an asgi app? I made changes to one of my apps since I'm using Django Channels and I want to deploy my project with a neat setup as you propose in this video. Any suggestions?
Everything is working except my websockets. Any resources can help!
Why did we use the STATIC_URL as /static/static and not only /static? because we are just using /static in the nginx config.
Because we use /static/ to map all static files, and /static/static/ is going to be for files generated by collectstatic and /static/media/ will be for media files uploaded by the user. It might be less confusing to use something like /webdata/static/ and /webdata/media/.
Thanks a lot for sharing this in-depth hands on session. I kinda got lost towards the end as there was no indication that your app was successfully deployed in the production environment :( .
After the last step, when I access the app locally at port 8080 (and the /admin route as well), after I login I get Server Error(500). Any ideas how to resolve this...
I have followed all the steps and pulled the docker image in AWS EC2 instance(regardless of the environment), and now would you please share steps on how to verify that all's working as expected. Once again I learnt a lot about the dos and don'ts from your session! :)
I had one doubt, you copy the project to the container, install dependencies and packages, create the directory for media and static files and then you create a user and provide the directory with permission with the created user.
so whatever the project files like hello_world, app, and manage.py will not have that user permission right?
Is it okay to keep it as root user permission for those files or will it change the user permission for those too?
It's fine if the files are owned by root as long as they have the execute permission for "other".
@@LondonAppDeveloper thank you! Could you please make a video on deploying django in swarm mode and keep nginx infront to receive all the http request.
Thank you , explanation was Great!!....
How tdo you configure it with ssl
awesome explanation --> thanks!
You're welcome, glad it was helpful and thanks for the comment :)
i am getting error /bin/sh: apk: not found, on running docker-compose up
Can we export this docker image and run this app in any machine now?
Yes
I know that WSGI and gunicorn work the same in a production environment so why did you prefer to use WSGI in docker?
There are many benefits to using Docker. 1) Check the Dockerfile and configs into code base, 2) Less server setup to deploy app - simply install Docker and run the containers, 3) Avoid server overhead completely using serverless technologies like Heroku and ECS Fargate... These are just some of the reasons.
How to solve this kind of problem.
2020/05/29 01:54:18 [error] 7#7: *3 connect() failed (111: Connection refused) while connecting to upstream, client: 172.18.0.1, server: , request: "GET /api/docs/ HTTP/1.1", upstream: "uwsgi://172.18.0.2:8080", host: "127.0.0.1:8080"
No idea as I would need to see the full source code and be able to re-produce the issue. I suggest posting a question on Stack Overflow.
Local development works fine but when setting up nginx I ended up getting the following error: nginx: [emerg] host not found in upstream "app:8000" in /etc/nginx/conf.d/default.conf:2
Double check there aren't any errors in your default.conf file.
Thank you
I've got a problem with static file, the css and js of admin not loaded!
Probably check your volume mapping and URL configuration for the static files.
Hello! it gives me an error:
error: can not modify /etc/nginx/conf.d/default.conf (read-only file system?)
I am also getting the same error. Did you find any solution? Thanks
How can we pass the allowed host dynamically from docker run command , because i want to run this in aws ec2 linux , so without the need of compose file, i have to run the container by pulling it into my ec2 instance. here is the below error i got:
error:
Invalid HTTP_HOST header: '11.232.140.160:8080'. You may need to add '11.232.140.160' to ALLOWED_HOSTS.
command: docker run -p 8080:8080 rakesha/django_docker:1
is it okay to just push to docker hub, go inside the production server pull the image and run it ?
That's one way to do it, yet.
Great video! Any ideas why I keep getting the error below??
invalid request block size: 21573 (max 4096)...skip
Thanks
Hey Nick, when do you get that error?
Thank you sooo very much, this really helped me....
Great to hear, thanks for watching!
Do you have any resources for setting this up with HTTPS?
We teach how to do that in our advanced DevOps course: londonapp.dev/c3 - Basically we setup HTTPS using and AWS Application Load Balancer. I'll also consider making more RUclips content about this too.
PROBLEM : with the alpine version and the apk add ..... you provided , i couldn't install pillow :'( , any ideas on how to fix ?
Strange. Are you sure your code is the same?
@@LondonAppDeveloper thank you sir for answering,
yes, from what i googled i think pillow needs other dependencies jpeg-dev, zlib
but even adding them after the linux header didn't fix my issue
how to open this in mobile after deploying ?
Hi how can deploy the same container to Azure? can you help please?
Sorry no idea as I've not used Azure.
great tut
Sir, I think you accidentally erased "Static" at 7:24
I'm new to this. why do we need Nginx if we are deploying django app using uwsgi ? also can we increase uwsgi workers inside docker?
NGINX is used to serve the static files (JS, CSS, Images, etc.) and uWSGI is used to execute the Python code. Although uWSGI _can_ serve these static files, it's not recommended because it's not optimised to do so. NGINX is designed to serve these types of files at scale, which is why we use NGINX to handle them and leave uWSGI to do what it does best, which is run Python code.
Hi, could you please help me, I am trying to set up the app to deploy it on google virtual machine, I've followed all of the steps like you instructed for deployment (add allowed host IP and adding secret_key and host IP in allowed_hosts in docker-compose-deploy.yml file) but I couldn't get it to work, when I access host IP, it just keeps loading and eventually fail.
Apologies but it's difficult to give help over RUclips comments because I can't see the code, issue or server configuration. Have you considered posting a question on Stack Overflow?
@@LondonAppDeveloper hey there, I am glad that you actually reply my comment. Fortunately, i have found the issue, for some reasons google vm only allow access from port 80. So i change ports from 8080:8080 to 80:80 in compose deploy yml, and also nginx default.conf . Then it works magically. Thank you, you have the best tutorial out there. Keep it up. One quick question, when I add commands to entrypoint.sh why does it only run when I start the proxy container, not when I start the app container?
Legend!!
who do we deploy from windows?
Great video! I get a 503 when trying to login. Non login views work fine. Any tips?
That's weird. Any exception errors being printed in the console logs?
@@LondonAppDeveloper Sorry. I found a typo. I'm implementing this video on my own project (not much more complex). But still getting a 500 now. The app sevice simply responds:
[pid: 12|app: 0|req: 6/6] 172.18.0.1 () {54 vars in 1082 bytes} [Sun May 23 21:39:34 2021] GET /accounts/login/?next=/ => generated 2288 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 461 bytes (1 switches on core 0)
I'm guessing it's permissions to de DB. I thought maybe using root to ensure access to de database but still nothing. Any recommended video to implement db as a separate service with this configuration (nginx + uwsgi)?
Thanks again!! It's awesome you giving out this knowledge
Thanks Mark. Besides, can you please update the Dockerfile in the udemy course "Build a backend REST API with Python & Django?
Hey, we will do... Currently working on some other projects (moving country/house being one), but we are planning to launch one more course and then update this course to use Django 3. Will keep you updated once it's available. Thanks for the support :)