@@lnk77 then I must have misunderstood the video. I understood: install Raspian, get some download from a guy called Graham, start a script. Is there an image that has everything ready?
please continue with the summaries, I find them very helpful when I'm trying to find information from your videos a long time after I first watched them.
Hello Andreas. I think the summaries are one of the things that are very distinctive from other content producers. Also they act as an important reminder of everything discussed on the video (sometimes a lot of precious information!). Very educational. Please keep up the good work!
Easily the most educational 18 minutes I have spent in a long while. I have had other people try and explain docker to me without measurable success, but you succeeded. This is exactly what I have been wanting to do ever since I (laboriously) set up an RPi with mosquitto & NR. I will get myself a fancy new RPi and re-do the whole thing. Thanks to you and Graham!
About the summary: please keep it. In my opinion, it's one of the best parts of your videos, as it helps me remember the things you teach. They're especially helpful in longer videos. Thank you for being awesome, Andreas!
This is such an incredible presentation. I have been doing many of these things for years. I am an avid Open Source advocate. I have been trying to share my knowledge with the community for many years but keep getting paralyzed by the feeling that my explanation is not good enough. Most of your viewers have no idea how hard it is to publish something like this because they have never tried. I have so much respect for your work. Thank you!
@@AndreasSpiess I've never seen your videos before, I just got a recommendation. I'm also someone similar to Bruno. It's good you were able to streamline the process for less technical people with Docker-compose and based on other people's work (and mention them by name ! very good). This shows you've figured out yourself or based on other peoples comment/suggestions, etc. What a good structure is in general (maintainable, etc.) and how to explain it. You are far above average. Only thing missing from the title was IoT. :-)
I appreciate that you always prominently feature the original creators of the tools you use. With open source / free software many forget that there has to be someone that creates the tools we use for free.
I feel the summary is very good, because you explain so much and the summary gives us a guide what we learned. Many people hangup videos after a few minutes, however often they come back to re-watch the video once they start such projects. Of course you have many experienced followers where they may don’t need a summary, however the new once are most important for the channel and the summary helps big way. Regards Helmut
May I repeat what many other observers of your channel are saying... Well done Andreas! But perhaps it is polite to say first, "Thank you, Mr Spiess! Your research, understanding and willingness to share with us all extremely useful skills and practical guides to new technology applications and solutions to infinite problems that will bring many smiles and expressions of courteous thanks throughout our international communities. You are a modern day hero! Well done Andreas!"
I vote yes for the summaries. They review all the steps covered and offer the viewer the opportunity to better understand the topic covered by the video.
I too am trying to wrap my head around docker. Many thanks. I think the summary is very professional and I hope other YT creators will consider copying the practice. Cheers.🇦🇺👍
I often only look into the summary to find out if the video is interessting or not. Not all videos are interessting for me. So this saves a little bit online time. And as said before by many otheres. If it's time to look back, the summary is perfect to restore the content in my limited brain. BTW: One of the most usable video in the last year for me. Many thanks to Mr. Garner and you.
What? The summaries are important recaps that help us remember the important stuff. Also, revisiting a video when searching for a specific solution is easier if you can watch the summary to see if your specific challenges were addressed, and to what degree of success.
I like the summaries. They are great for learning. An extra repetition is good. It makes the new knowledge stick. Advanced viewers probably skip them if they kinda already know the concepts you're talking about. Beginners will certainly appreciate them.
I would add one more backup there. Image of SD card when everything is setup so you have single image to write on SD card and then simply add volume data from dropbox.
awesome video. Clear and straight and dense information. No silly effects and uber-pathetic explanations. No Ego-Trip. Just a super competent Maker who knows his stuff. Keep it kickin.
Wow, you're done it again. Produced a brilliant and timely video. I have ordered a Pi4 and was going to look at building a new system based on a more up-to-date approach than my 3 year old LAMP configuration. I'm blown away by how much is in this presentation which fits my needs and desires so well. I do like a summary to pull things together but I think people may be switching it off because it tends to be a restatement of what's been covered rather than an overview of what's been discovered.
Andreas, I am new to Linux and Pi and could not get more excited from how much still ahead to learn after watching your video. Excellent teaching skills and content. Keep your great work flowing! Keep summaries is not a bad idea. Cheers!
@@AndreasSpiess Hi Andrea, planning to follow your tutorial to build my docker Pi Server. Couple of questions that I did not see at instructions (at least not directly mentioned). Do you use Raspian Buster Lite or any of the desktop versions? Wondering if it is better to use a 32Gb or 64Gb card?
Hi Andreas, I like the balance between "big picture" information and "lower details". Your accent is very understandable. So, after ~18 minutes of watching your video, I have the Inspiration and clear understanding of how to reproduce your setup in my hardware. THANK YOU VERY MUCH.
As an alternative to Dropbox (with less restrictions in the free version), you can try mega.nz and use mega.nz/sync on the Pi (or mega.nz/cmd for the command line/headless version). It works really well for me.
Very nice, also thanks to Graham. I would suggest a separate pi for pivpn with only running that, because a gateway that offers access from the outside should be hardened. Less services and programs running means less attack surface for hackers. I am also curious if this works with SSD to boot from. I have one pi running from a EUR 11,00, 32GB SDD for over a year. This works with raspbian image but I could not get hass.io working. If Graham's image runs from SSD I could run hass.io as a container. I make backups to my Synology on my local network. For this type of data cloud is not needed. If my house burns down, so will my iot devices and having the data still in the cloud won't be very useful.
I'd be willing to bet that most of the people who stop your videos at the summary (like I just did) are only doing so in order to post their comments, before losing the page to the next video. I save most of your videos for future reference. They provide exactly the information I need to pursue my projects. Thanks for the guidance.😎
Please consider making summarys again, they help to understand and tighten the new learned knowledge. As always, a very interesting topic and I think I will try this one. Kind Regards from Austria
This episode is too concentrated, but really helpful when I finished. I actually watched the video mulltiple times, and finally successfully installed the containers to my Pi4. Thank you so much!!!
When I'm in the kitchen trying to cook my wife throws her arms up in despair and claims "I'm all thumbs." That's great because it allows me to give this video 10 thumbs up. As another viewer commented, this video is 100% on point. Many thanks Andreas (and Graham and others who contribute to the community).
Great summary. But there's one important thing regarding remote access. The way suggested in video will only work if your router at home gets the "white" IP address from your Internet Service Provider, even if its a dynamic one. "White" here means real Internet IP address, the one you can confirm from Google. This unfortunately might not be the case for many folks, as they will be sitting behind their provider' Carrier Grade NAT, so the router at home gets "gray" IP address - local to your provider. But there's a number of solutions to that, following the same principle - to use some 3rd endpoint on internet, with white IP, to establish a network connection via it, using secured tunnel. That's a bit of big topic to cover in a single comment, so Google yourself as an example "Cloudflare tunnel" or "access behind cgnat"
Your summaries provide opportunity for self-evaluation and link nicely to the objectives and questions you present in your introductions. Your summaries also provide a good transition to the comments where further questioning can occur. I suspect a lot of us do appreciate your efforts to assure good instructional design.
This is a superb video Andreas. Contains all the concepts for a modern home automation/gateway setup . Raspberry Pi, Docker, MQTT, Node Red, InfluxDB, Grafana. This will be my first project for 2021, combined with Lora sensors (as described in other videos of yours). Thank you very much.
The summary makes the difference! It’s like in a good lecture where the prof 👨🏫 provides a summary that helps to rebuild the mental map after having heard a lot of details. Thanks for the DuckDNS tip!
FYI, databases require more than what the pi(even 4) can provide once you start having some data in. For me influx was able to kill the pi 3 with just 1 month of data from 30-40 sensors (1 sample / minute). I tried the pi 4 with the IOTstack (excellent idea, BTW) and it works better, but it is still slow at retrieving data. A request of ~4MB still needs 10 seconds. If you are considering buying a pi4 with 4GB RAM, memory card, SSD, cooling, box etc you are already in the price realm of mini PCs, intel NUC, refurb laptops, thin clients etc which all have much much faster disk access speeds. I moved all my HA stuff on an intel celeron NUC which is flying compared to the pi, while still functioning as HTPC. Thanks Andreas for another awesome video. I would like the summary back too!
You are right, the Pi is not a database server, especially not with SD cards. For my purposes it is ok, but I accept it might not be the right choice for everybody.
I found your summaries/conclusions extremely useful! In particular while rewatching older video they are very practical to get quickly to the point. I hope you will keep them in future videos!
Thank you for this video. I've been looking to rebuild my "the script" pi for a while on to a pi4 with external ssd. This looks a much better technique than the script.
@Mai Mariarti it's a good way to check if i did understand the video, I do look to the video's to upgrade my knowledge and at the end is the summaries the only thing you have to keep in your mind.
Thanks a lot for your hard work and the clarity with which you present. As a South African, I am proud and grateful that one of us did such a great job!
I would pin Remco's comment, (as * 23 * * * * will run the command many times during the 23rd hour of the day.) I test with something like: 0 23 * * * $my_command 2>&1 1>/tmp/$(date +%F_%T)_debug_to_check_my_command_is_working.log
Andreas, Of the several IOT youtubers I am able to keep up with your research presentations sit on the top. Admire how much sifting through the garbage that you have not bothered to be discouraged from, a Swiss thing of the mind that is very appealing, now how can I upload that? In respect to summaries it helps me to grasp all that you have packed into a lesson. If we ever meet the beer will be on me. Your incredible generosity is very much appreciated.
I love Andreas' voice. I would dearly love to hear him say something like: "Mr. Bond, you persist in defying my efforts to provide an amusing death for you."
I have found the summaries useful. Helps to check whether or not I missed some part of the video. I don't always watch them though. I would suggest you include summaries as long as: 1) the summaries don't take you much time to make and 2) RUclips doesn't penalize you for people not watching your videos all the way to the very end.
Thank you for your feedback. RUclips does not reward shorter view time. But I make my videos for you and not RUclips. The verdict is clear. I will keep the summaries
Including a summary on a RUclips video is a tricky matter indeed. On the one hand, it lowers some statistics because a number of people click off, which lowers your standing in "the algorithm" which has the obvious consequences. On the other hand, summaries are amazing, it repeats the important points, and wraps up the video nicely. Which, if you want to educate and teach, is invaluable! There's a reason why every paper has an abstract, content and conclusion section. I love the summary for these reasons, it helps make the video more understandable, but I also would be able to live without it if need be.
Wonderful video, just what I needed! PS I much prefer this kind of stuff I can do for myself rather than the old 80’s stuff. I love having a project idea so I have an excuse to make an AliExpress order 😁
Wow, I'm very impressed how clearly you explain Docker, VPNs, dynamic dns, firewalls and even backups using Dropbox in this video. Thanks a lot for these awesome videos Andreas!
I personally don't like videos a lot. They tend to be lengthy and don't "get to the point". Text is my old friend - you can easily skip uninteresting parts and can reread parts you don't get at first read. So basically - I am not "Generation RUclips", especially if I watch videos my kids watch... Anyhow, guys like Andreas create videos with just the right pace of information, nicely animated or otherwise visualized and additionally explained in short, sharp sentences. That is, why I love RUclips so much - and guys like Andreas. This is what I expect to be a good video tutorial. (I can watch hours of videos from the "8-Bit Guy" too, which are very entertaining and informative, but to point of tutorials, Andreas is really ahead.)
Thank you for your nice words. I like RUclips because I can go back as much as I want. And I sometimes see things the presenter did not mention, becuse it was not important for him. This is the biggest advantage of video over text in my eyes and this is why I became a RUclipsr and not a blogger...
This is an EXCELLENT project and a great video to get started. I've been fooling around with Docker for a while, but never really came up with anything to do with it. This video really turned on a light bulb over my head. Thanks!
@@AndreasSpiess no, it is not, because you have to check pre-made Docker images, scripts, settings, etc, that were put together by some random people. Those things could contain all sorts of vulnerabilities, planted with malicious intent, or simply by mis-configuration. If you neglect this, there is a risk you will end up with exploitable device, that could become a part of bot-net, or lead to data loss, or worse, become involved in serious criminal activities.
@@RmFrZQ Presumably, the community is validating these scripts by "random people" If there was anything nefarious, it would be quickly found and resolved and the credibility of the service providing these packages would be harmed. If you're paranoid, you can of course, do it all from scratch. And you probably should the first time you use any software so that you are familiar with how things should work so if something goes sideways, you have a clue where to begin solving the issue.
First time on the channel and I am blown away!! Liked and subscribed! Please keep them coming as I am a noob in the Pi world only having setup a DNS server with Pi-hole.
Docker is like shooting from a cannon to a fly. It's a good tool, but for complex setups with many services and dynamic changes in hardware, software and resource utilization. In home use it only adds not necessary, additional work, especially on something so light like raspberry pi. From a learning point of view it's better to thoroughly study configuration of one service than use some poorly documented and not tested code form github combined with docker in form of a black box that no one understand how it works. In the end i see many points of failure in this project. Even if it will work as described from the beginning, then it could fail after few months and users would not have a clue how to fix it.
You have a very valid point. I think it is very important that anyone that uses this project develops an understanding of what is happening under the hood. Specifically if was just working and all of a sudden stops. Thanks for the criticism and I will see where I can improve the project wherever I can. There has already been some community collaboration and I do hope it continues.
@ harvaldi - It is easy to criticize another's work that they have taken the time to put together and offer for free. Where is your solution? I would like like to see how you would accomplish the same.
Wow thanks Andreas This makes me want to re-roll everything on my Pi to docker containers. I like the summaries. It's always good to be reminded of everything we just learned.
Probably one of the best videos I saw so far. It's well detailed and you scripted all in a easy understandable manner. Thank you, you really disserve more subscribers. Now I'm gonna check your others videos !
My 2 cents on the summary. I do watch it. Though, it is a repeat of what you describe in the beginning. Maybe, just reprint the original and check them off. Oh, isn't that what you do anyway. Either way, 1 vote to keep it. It's more complete and professional. One of the rules of Toast Masters: tell them what you are going to share, share it, and then tell them again, what you shared. Helps us remember what we just did. :)
After battling with PiVPN for a couple of years I moved to Wireguard, what a difference, it just works especially if you have a modern Linux kernel (5.6 up) with built in support.
I don't need the summary, I'd rather you spent YOUR time on things that more poroductive for ME! If I need to review ytour video, I go back and review the relevant parts. THANK YOU for your time!
Hi Andreas. Today I've found out the IOTstack project has been drastically updated and I have spent two days now trying to install the new IOTstack and restoring my old backups onto it. Without success until now. I think a really detailed video describing how to install the IOTstack and restore the old backups will be much appreciated not only by myself. Cheers ;-)
I know it was updated. Maybe you add your learnings in the documentation? Like that it would be helpful also for others. This is an open source project and everybody can contribute ;-) I do not plan an update soon because I have many other topics in the pipeline.
Hi, I always enjoy watching your videos and I personally recommend to most of the students I teach. I would like you to make a 2nd part of this video, where maybe you can show how can we have 2 (or more) raspberry pi , doing the docker swarm setup so the load is been shared. More like a cluster but all of the guys running the docker containers. I had it but faced a lot of difficulties to setup properly. As well, it acts as a good redundancy if our whole house is dependent on the Raspberry! Thanks again for the video!
Thanks, Andreas. I appreciate your summaries at the end of your very well done videos. Please, Sir, continue to record them. I find them useful. How useful? I've suggested to other RUclipsrs that they review your format when they start wandering, instead of being consice and organized. I recognize the effort you put into your videos in scripting and organizing their format. Much appreciated.
Andreas - This is one of your best videos so far! Congratulations - excellent from start to finish - Both content and explanation of the content! What else can I say!
Thanks for the awesome video. I was able to use what you showed me here, as well as a few of your other videos, to build the RPI Docker Server that boots from an 500GB M.2 MVME. The first thing I chose to pull data from was the RPI itself. I used Python scripts to generate about 8 values from the RPI and publish them via MQTT to the Node Red. I use the same node red to monitor about 30 values of SNMP data from my NAS server and pull down real time weather data to Node Red via an API. I'm quite happy with what you've enabled me to do with this (you should see the Node Red Dashboard) and I'm much closer to realizing the home automation system of my dreams. Till now, I've been approaching home automation in pieces without a central platform for display and database. Now I have a central system that allows me to add sensors and controls in a much more modular fashion. Thanks for the excellent information and inspiration.
Nice work Andreas. I just finished a pi4 / 4GB with all the bells and wistles like mosquitto, grafana, influx etc like you showed earlier. It works, but still I had to update the packages after Peter's script. That cost me a lot of time and was sometimes frustrating. I use several esp32's with a bme680 to put enviromental data into the influx database (using your tutorials to figure out howto do this). I hope that the docker route shown is hassle free and installs the latest versions. I'll try this with an older pi3 and hopefully I will find out what works best. Dear Doctor, thanks again for showing results from your experiments. Cheers, Dr. Nick.
the summaries help me make sure I got all the information and what I may have to go over again. This was a very interesting and informative lesson on the world of IoT that I am learning. Thank You!! Peace
The graphic slide at 2:40 is wrong and may lead to misunderstanding. The containers for InfluxDB, Grafana, Node-Red, and Mosquitto are siblings on top of Docker. They should be vertically aligned so as to not be layered on top of each other. They are (for the purposes of this slide) independent docker containerized applications and as such should be vertical to indicate their separateness and dependent only on docker, not a layered stack of dependent applications. As it stands, the graphic says that Grafana is only indirectly dependent on Docker through 3 other layers of other applications.
Great video! Please keep the summaries, I like them! I always watch the videos to the end (as I also always watch the closing credits to the very end in the movies :-))
Hi Andreas, as usual a sharp video / content. I replaced my windows 2008 server by Docker on an alpine basis a 3/4 year ago. I can understand the time required. By contrast, I still have openhab installed as a home automation frontend. In it I will embed my ESP's etc. via MQTT. bye
Highly informative, clear and concise presentation, thanks, Andreas! Docker was on my list of next projects, now I have a good foundation where and how to start. Your last project, the DCF77 one, saved me an hour of tedious button-mashing on my 6 atomic clocks today as we gained one hour again today here in north america :)
Wonderful addition to the IOT toolbox! I found this today while trying to use ‘the script’ to install all this on my new Pi4 with ARM64 Ubuntu server 19.10 Pi image. This docker process from Graham has seemed to work as expected!! On this new Pi4 I now have: Ubuntu 19.10 arm64 running including the GUI Graham’s entire docker package All seems to be working properly but I have not tested everything yet. The only odd thing was having to use sudo in a few places that I did not expect to. Thank you for this tool!!
@Andreas - this video is really tops! To-the-point and very practical! A real time-saver and some complex software issues, explained in a very simple and practical way! Keep up the good work - I am a fan!
The first container I install with Docker is Portainer. Makes life easy when you have multiple Docker servers and you want to check what's going on a few months later via a GUI.
Thumbs up for such good & usefull content. But yes, I also vote for a (at least) short summary. Your videos provide so much usefull content, but if you search for something specific, summaries/overviews are very usefull (as same as your goals/content description at start) !
Other youtubers: Here are 4 concepts, let's explain them over 10 videos.
Andreas: Let's explain all of them in one awesomely understandable video.
Thank you! We all do not have a lot of time ;-)
@@AndreasSpiess Super good content! Thank you! Pls let me subscribe to this channel! :-))
Exposing local stuff to the Internet never feels quite right. 🤔
@@lnk77 then I must have misunderstood the video. I understood: install Raspian, get some download from a guy called Graham, start a script. Is there an image that has everything ready?
@@hneemann yes explaining under windows how to work with linux containers ... ))
I've only watched the first 7 minutes and already realize how many problems this solves, and how much work it must have been. Fantastic job, guys!
Thank you! Enjoy the rest!
please continue with the summaries, I find them very helpful when I'm trying to find information from your videos a long time after I first watched them.
You are not alone. They will stay.
Hello Andreas. I think the summaries are one of the things that are very distinctive from other content producers. Also they act as an important reminder of everything discussed on the video (sometimes a lot of precious information!). Very educational. Please keep up the good work!
Thank you for your feedback. Most of the commenters share your opinion. So the summary will stay...
Easily the most educational 18 minutes I have spent in a long while. I have had other people try and explain docker to me without measurable success, but you succeeded. This is exactly what I have been wanting to do ever since I (laboriously) set up an RPi with mosquitto & NR. I will get myself a fancy new RPi and re-do the whole thing. Thanks to you and Graham!
Sounds like a solid plan. Enjoy it!
About the summary: please keep it. In my opinion, it's one of the best parts of your videos, as it helps me remember the things you teach. They're especially helpful in longer videos. Thank you for being awesome, Andreas!
Most voters voted like you. So the summaries will stay.
This is such an incredible presentation. I have been doing many of these things for years. I am an avid Open Source advocate. I have been trying to share my knowledge with the community for many years but keep getting paralyzed by the feeling that my explanation is not good enough. Most of your viewers have no idea how hard it is to publish something like this because they have never tried. I have so much respect for your work. Thank you!
You are welcome. And thank you for your nice words! Maybe I am a little older and have seen a few things which help me condensing stuff ;-)
@@AndreasSpiess I've never seen your videos before, I just got a recommendation. I'm also someone similar to Bruno.
It's good you were able to streamline the process for less technical people with Docker-compose and based on other people's work (and mention them by name ! very good).
This shows you've figured out yourself or based on other peoples comment/suggestions, etc. What a good structure is in general (maintainable, etc.) and how to explain it. You are far above average.
Only thing missing from the title was IoT. :-)
“Most of your viewers have no idea” ... but some of us do. ;)
I appreciate that you always prominently feature the original creators of the tools you use. With open source / free software many forget that there has to be someone that creates the tools we use for free.
Thank you! I heavily depend on these people. And I do not need to be "bigger" than I am ;-) Too old for these games
I feel the summary is very good, because you explain so much and the summary gives us a guide what we learned. Many people hangup videos after a few minutes, however often they come back to re-watch the video once they start such projects.
Of course you have many experienced followers where they may don’t need a summary, however the new once are most important for the channel and the summary helps big way.
Regards Helmut
Thank you for your feedback. Many viewers see it like you. So, the summaries will come back. I just wanted to be sure ;-)
May I repeat what many other observers of your channel are saying... Well done Andreas! But perhaps it is polite to say first, "Thank you, Mr Spiess! Your research, understanding and willingness to share with us all extremely useful skills and practical guides to new technology applications and solutions to infinite problems that will bring many smiles and expressions of courteous thanks throughout our international communities. You are a modern day hero! Well done Andreas!"
I showed your comment to my wife to convince her that my work in the basement is worth the effort ;-) Thank you!
I have never seen a Tutorial more on point than this and im a dev since childhood. :D
Thank you for the flowers!
I vote yes for the summaries. They review all the steps covered and offer the viewer the opportunity to better understand the topic covered by the video.
You voted with the rest! They come back.
I too am trying to wrap my head around docker. Many thanks. I think the summary is very professional and I hope other YT creators will consider copying the practice. Cheers.🇦🇺👍
Cheers!
I often only look into the summary to find out if the video is interessting or not. Not all videos are interessting for me. So this saves a little bit online time. And as said before by many otheres. If it's time to look back, the summary is perfect to restore the content in my limited brain. BTW: One of the most usable video in the last year for me. Many thanks to Mr. Garner and you.
Thank you for your feedback. The summaries will stay, because most commenters share your opinion.
What? The summaries are important recaps that help us remember the important stuff.
Also, revisiting a video when searching for a specific solution is easier if you can watch the summary to see if your specific challenges were addressed, and to what degree of success.
Thank you for the feedback. The vote was clear: The summaries will stay
I like the summaries.
They are great for learning. An extra repetition is good. It makes the new knowledge stick.
Advanced viewers probably skip them if they kinda already know the concepts you're talking about. Beginners will certainly appreciate them.
The viewers voted for "summaries have to stay"!
I would add one more backup there. Image of SD card when everything is setup so you have single image to write on SD card and then simply add volume data from dropbox.
what do you use to take a flashable image of an sd card?
@@25566 dd?
awesome video. Clear and straight and dense information. No silly effects and uber-pathetic explanations. No Ego-Trip. Just a super competent Maker who knows his stuff. Keep it kickin.
Thank you for your nice words!
Wow, you're done it again. Produced a brilliant and timely video. I have ordered a Pi4 and was going to look at building a new system based on a more up-to-date approach than my 3 year old LAMP configuration. I'm blown away by how much is in this presentation which fits my needs and desires so well.
I do like a summary to pull things together but I think people may be switching it off because it tends to be a restatement of what's been covered rather than an overview of what's been discovered.
I am glad the video helps. I tried to include the most important thinks. From there, people can add more things.
Andreas, I am new to Linux and Pi and could not get more excited from how much still ahead to learn after watching your video. Excellent teaching skills and content. Keep your great work flowing! Keep summaries is not a bad idea. Cheers!
Enjoy your journey!
@@AndreasSpiess Hi Andrea, planning to follow your tutorial to build my docker Pi Server.
Couple of questions that I did not see at instructions (at least not directly mentioned).
Do you use Raspian Buster Lite or any of the desktop versions?
Wondering if it is better to use a 32Gb or 64Gb card?
by the way ANDREAS!!!
i loved your summaries and found them very useful especially after videos about complex topics !
Thank you for your feedback!
+1 Keep the summaries :-)
+1 Keep the summaries, please.
+1 for the summaries
I like the summaries. Reinforcement learning.
Hi Andreas, I like the balance between "big picture" information and "lower details". Your accent is very understandable. So, after ~18 minutes of watching your video, I have the Inspiration and clear understanding of how to reproduce your setup in my hardware. THANK YOU VERY MUCH.
After testing, the Dropbox uploader needs some "polishing". Graham plans to publish it in the next days.
As an alternative to Dropbox (with less restrictions in the free version), you can try mega.nz and use mega.nz/sync on the Pi (or mega.nz/cmd for the command line/headless version). It works really well for me.
What about Google drive?
the summary would be great in the form of a time index in the description. Best regards and thank you for the great work.
@@jacob1001bin do one.
Very nice, also thanks to Graham. I would suggest a separate pi for pivpn with only running that, because a gateway that offers access from the outside should be hardened. Less services and programs running means less attack surface for hackers.
I am also curious if this works with SSD to boot from. I have one pi running from a EUR 11,00, 32GB SDD for over a year. This works with raspbian image but I could not get hass.io working. If Graham's image runs from SSD I could run hass.io as a container.
I make backups to my Synology on my local network. For this type of data cloud is not needed. If my house burns down, so will my iot devices and having the data still in the cloud won't be very useful.
I'd be willing to bet that most of the people who stop your videos at the summary (like I just did) are only doing so in order to post their comments, before losing the page to the next video.
I save most of your videos for future reference. They provide exactly the information I need to pursue my projects. Thanks for the guidance.😎
You are welcome. I do not know why many people leave before the video. This is why I started the discussion...
Please consider making summarys again, they help to understand and tighten the new learned knowledge.
As always, a very interesting topic and I think I will try this one.
Kind Regards from Austria
The summary will stay, because it is wanted by most of commenters
This episode is too concentrated, but really helpful when I finished. I actually watched the video mulltiple times, and finally successfully installed the containers to my Pi4. Thank you so much!!!
You are welcome. I am glad you were successful in the end.
Another great video by the engineer with the Swiss accent. I like the summaries. Great job, I will use some of this for the VPN portion.
Thank you!
When I'm in the kitchen trying to cook my wife throws her arms up in despair and claims "I'm all thumbs." That's great because it allows me to give this video 10 thumbs up. As another viewer commented, this video is 100% on point. Many thanks Andreas (and Graham and others who contribute to the community).
Thank you for the nice words!
Off course: with summery!
Of course the summery is superfluous for those of use that were paying attention. ;-)
Reckless Roges Then again, what if you have to come back to the video after a few months? In that case, the summary is interesting.
I, for one, listen to the summary.
The summary will come back! The viewers voted.
Great summary. But there's one important thing regarding remote access. The way suggested in video will only work if your router at home gets the "white" IP address from your Internet Service Provider, even if its a dynamic one. "White" here means real Internet IP address, the one you can confirm from Google. This unfortunately might not be the case for many folks, as they will be sitting behind their provider' Carrier Grade NAT, so the router at home gets "gray" IP address - local to your provider. But there's a number of solutions to that, following the same principle - to use some 3rd endpoint on internet, with white IP, to establish a network connection via it, using secured tunnel. That's a bit of big topic to cover in a single comment, so Google yourself as an example "Cloudflare tunnel" or "access behind cgnat"
You are right. In this case (here for mobile networks), I use Zerotier.
Really the best - and most simple - explanation for Docker containers! .. Thank you Andreas!
Glad to read that. I enjoyed making this video because it was a longtime wish and afterwards I also understood a little more than before...
Your summaries provide opportunity for self-evaluation and link nicely to the objectives and questions you present in your introductions. Your summaries also provide a good transition to the comments where further questioning can occur. I suspect a lot of us do appreciate your efforts to assure good instructional design.
Thank you for your feedback. Most viewers voted for "summaries stay"
I really like the summary, I would like to see it continued. It's a great reminder in a succinct fashion, easy to access.
You are not alone. The summaries will stay.
This is a superb video Andreas. Contains all the concepts for a modern home automation/gateway setup . Raspberry Pi, Docker, MQTT, Node Red, InfluxDB, Grafana. This will be my first project for 2021, combined with Lora sensors (as described in other videos of yours). Thank you very much.
Enjoy your journey!
hello andreas. I enjoy the summary, it is the perfect way to remember everything about the video. Very educational.
Thank you.
Thank you!
The summary makes the difference! It’s like in a good lecture where the prof 👨🏫 provides a summary that helps to rebuild the mental map after having heard a lot of details.
Thanks for the DuckDNS tip!
Thank you for your feedback. The verdict is clear: The summaries will stay!
Hello Andreas, many thanks for your time and the good video quality you provide. You inspire the maker inside us at every video :)
For me, it is easy because I am one of you...
FYI, databases require more than what the pi(even 4) can provide once you start having some data in. For me influx was able to kill the pi 3 with just 1 month of data from 30-40 sensors (1 sample / minute). I tried the pi 4 with the IOTstack (excellent idea, BTW) and it works better, but it is still slow at retrieving data. A request of ~4MB still needs 10 seconds.
If you are considering buying a pi4 with 4GB RAM, memory card, SSD, cooling, box etc you are already in the price realm of mini PCs, intel NUC, refurb laptops, thin clients etc which all have much much faster disk access speeds.
I moved all my HA stuff on an intel celeron NUC which is flying compared to the pi, while still functioning as HTPC.
Thanks Andreas for another awesome video. I would like the summary back too!
You are right, the Pi is not a database server, especially not with SD cards. For my purposes it is ok, but I accept it might not be the right choice for everybody.
Perfect Andreas, I've been thinking about docker for a long time, excellent explanation.... Off to the workshop ! 👍🍺
I think it will be a lot of fun. So many things in such a short time...
You are the best Andreas. You summarize and wrap up things at the correct level. Excellent!
Thank you!
Thanks for the mention of disabling swapping!
I found your summaries/conclusions extremely useful! In particular while rewatching older video they are very practical to get quickly to the point. I hope you will keep them in future videos!
The verdict is clear. I will keep them!
Thank you for this video. I've been looking to rebuild my "the script" pi for a while on to a pi4 with external ssd. This looks a much better technique than the script.
That is what we thought, too...
I always watch the summary to your videos so I remember the goals and what works and doesn’t.
The summaries are back. Most voted for "stay"
please don't skip the summaries please, they are very helpfull
@Mai Mariarti it's a good way to check if i did understand the video, I do look to the video's to upgrade my knowledge and at the end is the summaries the only thing you have to keep in your mind.
Thanks a lot for your hard work and the clarity with which you present. As a South African, I am proud and grateful that one of us did such a great job!
You can be proud of Graham!
@@AndreasSpiess Indeed!!
The entry in cron like * 23 * * * does not only execute at 23:00 but executes every minute from 23:00 till 23:59
Oh. Good to know. What would then be the correct line?
@@AndreasSpiess Minute(0-59) Hour(0-24) Day_of_month(1-31) Month(1-12) Day_of_week(0-6) Command_to_execute
0 23 * * * command_to_execute
Another good idea is not to pipe cron output to /dev/null before checking /var/log/syslog entries that cron (and you) confirm it works as expected.
You can verify (and compose) Cron schedules on this web page:
crontab.guru
I would pin Remco's comment, (as * 23 * * * * will run the command many times during the 23rd hour of the day.) I test with something like: 0 23 * * * $my_command 2>&1 1>/tmp/$(date +%F_%T)_debug_to_check_my_command_is_working.log
Andreas, Of the several IOT youtubers I am able to keep up with your research presentations sit on the top. Admire how much sifting through the garbage that you have not bothered to be discouraged from, a Swiss thing of the mind that is very appealing, now how can I upload that? In respect to summaries it helps me to grasp all that you have packed into a lesson. If we ever meet the beer will be on me. Your incredible generosity is very much appreciated.
I love Andreas' voice. I would dearly love to hear him say something like: "Mr. Bond, you persist in defying my efforts to provide an amusing death for you."
:-)
I lost it at the Timbuktu reference!
Spectacular work as always Andreas!!
Timbuktu was a nice town before all the wars. But in the middle of nowhere...
To access remotely, I use "Zerotier One" since I have IP behind NAT
Most of us are behind NAT. This is the reason for using duckDNS. Your solution seems to integrate both, openVNS and duckDNS. Thanks for the tip.
I have found the summaries useful. Helps to check whether or not I missed some part of the video. I don't always watch them though. I would suggest you include summaries as long as: 1) the summaries don't take you much time to make and 2) RUclips doesn't penalize you for people not watching your videos all the way to the very end.
Thank you for your feedback. RUclips does not reward shorter view time. But I make my videos for you and not RUclips. The verdict is clear. I will keep the summaries
I think a summary helps consolidating the video. Even if it is just a long phrase rather than a list (as it could have been the case in this one)
The vote was clear. The viewers want the summary...
Including a summary on a RUclips video is a tricky matter indeed. On the one hand, it lowers some statistics because a number of people click off, which lowers your standing in "the algorithm" which has the obvious consequences.
On the other hand, summaries are amazing, it repeats the important points, and wraps up the video nicely. Which, if you want to educate and teach, is invaluable! There's a reason why every paper has an abstract, content and conclusion section.
I love the summary for these reasons, it helps make the video more understandable, but I also would be able to live without it if need be.
Most commenters voted for"stay". So they will stay.
Wonderful video, just what I needed!
PS I much prefer this kind of stuff I can do for myself rather than the old 80’s stuff. I love having a project idea so I have an excuse to make an AliExpress order 😁
The 80's stuff is more fro learning and nostalgia. But you should get projects from time to time on the channel, too.
Andreas Spiess trouble is I was a child in the 80’s (sorry 😁). Still it’s good to see how things have changed 👍
Wow, I'm very impressed how clearly you explain Docker, VPNs, dynamic dns, firewalls and even backups using Dropbox in this video. Thanks a lot for these awesome videos Andreas!
You are welcome. Glad to read you like it.
this is great. i always wanted this kind of installation on my rpi.
Me too ;-)
I personally found your summaries very useful, for example to reinforce what I have learnt - or concluded - watching your VERY helpful videos.
The commenters voted for "stay"
Please keep making summaries :)
The vote was clear. They will stay!
I personally don't like videos a lot. They tend to be lengthy and don't "get to the point". Text is my old friend - you can easily skip uninteresting parts and can reread parts you don't get at first read. So basically - I am not "Generation RUclips", especially if I watch videos my kids watch...
Anyhow, guys like Andreas create videos with just the right pace of information, nicely animated or otherwise visualized and additionally explained in short, sharp sentences. That is, why I love RUclips so much - and guys like Andreas. This is what I expect to be a good video tutorial. (I can watch hours of videos from the "8-Bit Guy" too, which are very entertaining and informative, but to point of tutorials, Andreas is really ahead.)
Thank you for your nice words. I like RUclips because I can go back as much as I want. And I sometimes see things the presenter did not mention, becuse it was not important for him. This is the biggest advantage of video over text in my eyes and this is why I became a RUclipsr and not a blogger...
Thanks for posting this wonderful idea. You just got one more patreon, Andreas!
Thank you for your support. It helps!
This is an EXCELLENT project and a great video to get started. I've been fooling around with Docker for a while, but never really came up with anything to do with it. This video really turned on a light bulb over my head. Thanks!
Glad it was helpful!
I like your summaries however it is not a deal breaker if the majority doesn’t like your summary.
The majority seems to like them :-)
I watched to the end, the summaries brought everything together for me.
So will it be also in the future...
Imagine doing security audit for every part of this thing and future updates.
I think it is similar to if you install the Apps directly on the OS
@@AndreasSpiess no, it is not, because you have to check pre-made Docker images, scripts, settings, etc, that were put together by some random people. Those things could contain all sorts of vulnerabilities, planted with malicious intent, or simply by mis-configuration. If you neglect this, there is a risk you will end up with exploitable device, that could become a part of bot-net, or lead to data loss, or worse, become involved in serious criminal activities.
@@RmFrZQ Presumably, the community is validating these scripts by "random people" If there was anything nefarious, it would be quickly found and resolved and the credibility of the service providing these packages would be harmed. If you're paranoid, you can of course, do it all from scratch. And you probably should the first time you use any software so that you are familiar with how things should work so if something goes sideways, you have a clue where to begin solving the issue.
I for one really appreciate the 'summary' , it's a reminder of all the important points -thank you.
The summary will stay!
@@AndreasSpiess Danke.
13:27 * 23 * * * means every minute! 11 o’clock is 0 23 * * *
You are right.
First time on the channel and I am blown away!! Liked and subscribed! Please keep them coming as I am a noob in the Pi world only having setup a DNS server with Pi-hole.
Welcome aboard the channel!
Docker is like shooting from a cannon to a fly. It's a good tool, but for complex setups with many services and dynamic changes in hardware, software and resource utilization. In home use it only adds not necessary, additional work, especially on something so light like raspberry pi.
From a learning point of view it's better to thoroughly study configuration of one service than use some poorly documented and not tested code form github combined with docker in form of a black box that no one understand how it works.
In the end i see many points of failure in this project. Even if it will work as described from the beginning, then it could fail after few months and users would not have a clue how to fix it.
You have a very valid point. I think it is very important that anyone that uses this project develops an understanding of what is happening under the hood. Specifically if was just working and all of a sudden stops. Thanks for the criticism and I will see where I can improve the project wherever I can. There has already been some community collaboration and I do hope it continues.
@ harvaldi - It is easy to criticize another's work that they have taken the time to put together and offer for free. Where is your solution? I would like like to see how you would accomplish the same.
I'm not criticizing anyone's work. I'm stating, that you don't use a hammer, where is need for a saw. Work may be solid, but yet not necessary.
I just got my Raspberry 4 and was wondering how to do Portainer and servers....your approach is much more useful!
Thank you!
"Graham" = gray-um
Well, here it is a comprehensive tutorial! Well done mr. Spiess, as usual!
Thank you!
Wow thanks Andreas This makes me want to re-roll everything on my Pi to docker containers. I like the summaries. It's always good to be reminded of everything we just learned.
The good thing is, you always can start a test with a new SD card and if you do not like it, just use the old one again ;-)
Probably one of the best videos I saw so far.
It's well detailed and you scripted all in a easy understandable manner.
Thank you, you really disserve more subscribers.
Now I'm gonna check your others videos !
Thank you! I hope you will find other interesting stuff...
My 2 cents on the summary. I do watch it. Though, it is a repeat of what you describe in the beginning. Maybe, just reprint the original and check them off. Oh, isn't that what you do anyway. Either way, 1 vote to keep it. It's more complete and professional. One of the rules of Toast Masters: tell them what you are going to share, share it, and then tell them again, what you shared. Helps us remember what we just did. :)
Thank you for your feedback!
After battling with PiVPN for a couple of years I moved to Wireguard, what a difference, it just works especially if you have a modern Linux kernel (5.6 up) with built in support.
Good information. Maybe you help the guys at IOT stack to include it in their project?
Summaries are an important part of your signature style and bring higher quality to your videos. You should definitely keep them.
You and the other commenters voted: They will stay!
I like the summary at the end. It really wrapped up the videos. Thanks for everything you do!
Thanks for your feedback!
Its good to have the summary, since it increases the possiblity to remember the contents.
The summaries will stay. Many voters wanted it.
I don't need the summary, I'd rather you spent YOUR time on things that more poroductive for ME! If I need to review ytour video, I go back and review the relevant parts. THANK YOU for your time!
Thean you for your feedback. Most commenters wanted the summary back...
I have to confess that I didn't even know that there was arm docker. Will have a go on it. Thanks for the video.
You are welcome!
Hi Andreas. Today I've found out the IOTstack project has been drastically updated and I have spent two days now trying to install the new IOTstack and restoring my old backups onto it. Without success until now. I think a really detailed video describing how to install the IOTstack and restore the old backups will be much appreciated not only by myself. Cheers ;-)
I know it was updated. Maybe you add your learnings in the documentation? Like that it would be helpful also for others. This is an open source project and everybody can contribute ;-)
I do not plan an update soon because I have many other topics in the pipeline.
Hi,
I always enjoy watching your videos and I personally recommend to most of the students I teach.
I would like you to make a 2nd part of this video, where maybe you can show how can we have 2 (or more) raspberry pi , doing the docker swarm setup so the load is been shared. More like a cluster but all of the guys running the docker containers. I had it but faced a lot of difficulties to setup properly. As well, it acts as a good redundancy if our whole house is dependent on the Raspberry!
Thanks again for the video!
I always have to have the size of the channel in focus when I chose topics. So I am not sure if this topic is too special :-( But you never know
Thanks, Andreas.
I appreciate your summaries at the end of your very well done videos. Please, Sir, continue to record them. I find them useful.
How useful? I've suggested to other RUclipsrs that they review your format when they start wandering, instead of being consice and organized.
I recognize the effort you put into your videos in scripting and organizing their format.
Much appreciated.
Thank you for your kind word!
Andreas - This is one of your best videos so far! Congratulations - excellent from start to finish - Both content and explanation of the content! What else can I say!
Thank you for the nice words!
I love your introductions and summaries plus all the content in between.
Please keep the summaries.
Thank you :-)
I was just in the middle of learning docker! Good timing!
So you have a playground...
@@AndreasSpiess indeed - this will be useful for me, I had no idea you could use docker on a pi! Thanks for the video
Love this video! Please do the summary at the end, I love it. You are a great teacher, people just don't know what's good for them!
Thank you for your feedback! Glad you like my videos.
Thanks for the awesome video. I was able to use what you showed me here, as well as a few of your other videos, to build the RPI Docker Server that boots from an 500GB M.2 MVME. The first thing I chose to pull data from was the RPI itself. I used Python scripts to generate about 8 values from the RPI and publish them via MQTT to the Node Red. I use the same node red to monitor about 30 values of SNMP data from my NAS server and pull down real time weather data to Node Red via an API. I'm quite happy with what you've enabled me to do with this (you should see the Node Red Dashboard) and I'm much closer to realizing the home automation system of my dreams. Till now, I've been approaching home automation in pieces without a central platform for display and database. Now I have a central system that allows me to add sensors and controls in a much more modular fashion. Thanks for the excellent information and inspiration.
Glad to read that you were successful!
Nice work Andreas.
I just finished a pi4 / 4GB with all the bells and wistles like mosquitto, grafana, influx etc like you showed earlier. It works, but still I had to update the packages after Peter's script. That cost me a lot of time and was sometimes frustrating. I use several esp32's with a bme680 to put enviromental data into the influx database (using your tutorials to figure out howto do this).
I hope that the docker route shown is hassle free and installs the latest versions. I'll try this with an older pi3 and hopefully I will find out what works best.
Dear Doctor, thanks again for showing results from your experiments. Cheers, Dr. Nick.
If you find issues or ideas for improvement please log them into the github. Like that we get the project going...
the summaries help me make sure I got all the information and what I may have to go over again. This was a very interesting and informative lesson on the world of IoT that I am learning. Thank You!! Peace
Most commenenters voted for "videos should stay"
The graphic slide at 2:40 is wrong and may lead to misunderstanding. The containers for InfluxDB, Grafana, Node-Red, and Mosquitto are siblings on top of Docker. They should be vertically aligned so as to not be layered on top of each other. They are (for the purposes of this slide) independent docker containerized applications and as such should be vertical to indicate their separateness and dependent only on docker, not a layered stack of dependent applications. As it stands, the graphic says that Grafana is only indirectly dependent on Docker through 3 other layers of other applications.
You are right.
Great video! Please keep the summaries, I like them! I always watch the videos to the end (as I also always watch the closing credits to the very end in the movies :-))
Thank you! I will keep the summaries because most commentators voted like you.
Dear Andreas SIR, you are so talented and your explanations are so simple to understand. Thank you so much
You are welcome!
Hi Andreas,
as usual a sharp video / content.
I replaced my windows 2008 server by Docker on an alpine basis a 3/4 year ago. I can understand the time required. By contrast, I still have openhab installed as a home automation frontend. In it I will embed my ESP's etc. via MQTT.
bye
Thank you. Many roads end in Rome, as we say here...
Highly informative, clear and concise presentation, thanks, Andreas! Docker was on my list of next projects, now I have a good foundation where and how to start. Your last project, the DCF77 one, saved me an hour of tedious button-mashing on my 6 atomic clocks today as we gained one hour again today here in north america :)
Great to read that! We also had our time change and my solution also worked....
Wonderful addition to the IOT toolbox!
I found this today while trying to use ‘the script’ to install all this on my new Pi4 with ARM64 Ubuntu server 19.10 Pi image.
This docker process from Graham has seemed to work as expected!!
On this new Pi4 I now have:
Ubuntu 19.10 arm64 running including the GUI
Graham’s entire docker package
All seems to be working properly but I have not tested everything yet.
The only odd thing was having to use sudo in a few places that I did not expect to.
Thank you for this tool!!
You are welcome! And of course, Graham is happy if you find things to improve. We are both no Linux Gurus ;-)
@Andreas - this video is really tops! To-the-point and very practical! A real time-saver and some complex software issues, explained in a very simple and practical way! Keep up the good work - I am a fan!
Thank you for your nice words!
The first container I install with Docker is Portainer. Makes life easy when you have multiple Docker servers and you want to check what's going on a few months later via a GUI.
True!
Thumbs up for such good & usefull content. But yes, I also vote for a (at least) short summary. Your videos provide so much usefull content, but if you search for something specific, summaries/overviews are very usefull (as same as your goals/content description at start) !
Thanks for your feedback. The summaries will stay.