After what feels like 45000 tutorials, thank you - you finally gave me the insight needed to strip out unnecessary data and CHANGE the incoming data into a payload that influx was happy with. I now have a happy little chart of how bad the air is during the Canadian wildfire season.
Just a note, when setting up the MQTT server in Node-Red you can type in the name of the docker container as it is running in the same stack as Node-Red.
Amazing Video, cannot thank you enough. I tried it myself and here is feedback. The github code you shared is having issue with NodeRed, see error below - I managed to install other containers by skipping nodered and later installed nodered as systemd. It would be nice if you can make your github repo public in that way users can report issue and can pull the working code. ############ Start Stack: docker-compose up -d --remove-orphans WARNING: Some networks were defined but are not used by any service: nextcloud Creating network "iotstack_default" with driver "bridge" Building nodered ERROR: Cannot locate specified Dockerfile: Dockerfile
This is a really excellent tutorial. Every step is clearly explained in detail. Just one issue: it is generally not advised to use a leading forward slash '/' for the root an MQTT topic. But that's a minor quibble
After struggling for a whole day trying to get mosquitto to work on my raspberry pi, following your video had me up and running within half an hour. This is a fantastic tutorial, thank you so much for the help ❤
Amazing guide! I watched it a couple of times and after a few hours I had my Grafana up and running, mind you I had never done anything MQTT before. For now I am just logging the room temp with an ESP32 and an LM35 temp sensor but I will be adding a lot of stuff soon and hopefully some solar production data in the future. Thanks a lot!
Great helpful video and website. One point, on the website it says to use 'docker-compose up' to check the status of the containers whereas you use 'docker-compose ps' in your video. I really appreciate the effort you are putting into your videos and supporting material.
@@LearnEmbeddedSystems Is it possible to build this stack in the cloud? In other words can this container be ported to the cloud? A video on it would be helpful.
Great tutorial to get started with IoT stack in R-Pi4. I am going to use this in a CM4 and use node red + mosquito talking to IO module downstream. Docker surely makes things flexible and easy.
Thank you. Nice; quick and succinct. One comment.Why skip over Portainer when - and this is from limited knowledge - I think you could have set everything up from within Portainer
Very cool video on the Pi. For Arduino the ESP8266 NodeMCU is a cheaper option as it already have Wifi built-in and better power management. ESP32 would work too. Both very small form factor.
100% esp devices are better for 95% of iot projects and they are cheaper and smaller. Only problem is they are 3.3v devices so you might need a logic level shifter.
This is a very useful tutorial and a nice presentation!! Just to be clear regarding viewing the containers using Portainer, 1) do I need to have an account in Portainer? 2) Is there any limitation on device numbers under the free account?
Great Video, I am bumbling through this on my own system, I intend to use this to monitor my solar install, hopefully remotely, so much to learn so it may be sometime before it goes live. Thanks for posting ;)
I've been debugging my IOTstack install for a week now -- I found that I had a corrupted SD Card. Best video I've seen so far getting right to the point, explaining what **should** happen. It would be nice if it included some more gotchas - I've been battling with my v2 B+ which is pretty slow running the IOTstack menu.
Storage problem is my biggest concern with Pi. Consider one with onboard eMMC or a M.2 NVMe. There are a few options out there using the CM4. Seeed minirouter, Waveshare IO boards- base B had a RTC, or the DFRobot mini router to name a few. The latter two require finding a CM4, which everyone says is on back order until Dec 2023.
Running a database where data like temperatures etc. are constantly written with an SD card is only for people who enjoy reinstalling Raspis. USB-SSD/HDD is mandatory for this application.
@@smaroukis I had the same problem, i have 5 corrupted sd cards on my desk now, I was about to try this videos method, I installed each item individually and the docker install script was killing sd cards
This is a really amazing video. Thank you. Any chance of you doing a tutorial on how to deploy Grafana Cloud connected to the local RPi Server? That way one can monitor devices away from home and even have alerting through Grafana IRM's mobile app.
Almost every single thing is very good explained in this video an exception of HOW CAN I MAKE THE INTERFACE COMMUNICATION BETWEEN MY ESP32 (WHICH IS READING THE DATA SENSOR) AND NODERED?
Hey LES! Superb video thank you so much for the information. Just had one question, I have certain scenario's where people switch of the Raspberry Pi at the end of the day's work. So when they restart will all of the tools namely, Mosquitto, Influx-DB, Node-Red and Graphana or essentially the docker container reboot as well? Thanks again for the fantastic video.
Well this video was exepsional congrats! It worked fine for me, however for some reason I can't add the libraries of the functions on the pallet in node-red.
Mine did not work as when i want to start the stack it returns an error that three of the apps are obsolete. Just wondering if you had an issue like this or any way to resolve
Great tutorial. I have so many Pi 3s lying around, and wanna know if I can use them on this project? Now Im interested to see some videos on how tos with the sensor nodes.
That's an excellent tutorial !! Congratulations !! I would like to ask in case we have many sensors in /home/sensors. How can we get the unique id of each sensor and show in grafana? I've implemented your project with wemos D1 mini + DHT22 sensor + LCD 16x2 (parallel connection) and raspberry pi 4 (8Gb) as the server. The point is that viewing grafana i only see that data comes from sensor_data which is the db name from influxdb.
Hi, Thank you for this professional tutorial. I followed it and my ESP32 client can connect to the MQTT server jus if both the Raspberry pi and ESP32 on same wifi network. What am I missing?
Amazing tutorial. May i have a question ? Say i finish all the installation above, is it possible that my system can operate completely offline ? ( reading, workflow, visualization, modifying … ) Like i connect those 2 boards to the same network which doesnt have internet connection.
Please note: In the video, you state that you can check what containers are running with the command 'docker-compose ps' while on the related web page you show the command as 'docker-compose up'
docker-compose ps shows you status of docker containers, docker-compose up execute the docker-compose.yml file(that is something like a config dile for docker) you also use this command only when starting docker
Resumo do vídeo "Raspberry Pi IoT Server Tutorial: InfluxDB, MQTT, Grafana, Node-RED & Docker" em 5 pontos: 1. *Objetivo do Projeto:* O tutorial visa criar um servidor IoT utilizando um Raspberry Pi para coletar dados de sensores, como temperatura, pressão, umidade e qualidade do ar, através de um Arduino Uno emparelhado com um sensor BME680. 2. *Protocolos e Ferramentas Utilizados:* Utiliza o protocolo MQTT para enviar dados em formato JSON pela rede para o servidor Raspberry Pi. Explora aplicativos como Mosquitto (broker MQTT), Node-RED (interpretação e envio de dados para um banco de dados), InfluxDB (armazenamento de dados do sensor) e Grafana (interface gráfica para visualização dos dados). 3. *Configuração do Ambiente:* Emprega o Docker para rodar os aplicativos em contêineres, facilitando a configuração e implantação dos componentes, tornando possível a execução desses aplicativos em diferentes dispositivos. 4. *Passos para Implementação:* - Atualização do sistema do Raspberry Pi e instalação do "iot stack". - Seleção dos pacotes desejados (Grafana, InfluxDB, Mosquitto, Node-RED, Portainer) usando o menu interativo. - Configuração do InfluxDB para armazenar os dados do sensor. - Configuração do Node-RED para interpretar e enviar os dados para o InfluxDB. - Configuração do Grafana para criar um painel visual dos dados coletados. 5. *Finalização do Projeto:* Após a configuração de todos os componentes, é possível visualizar e monitorar os dados dos sensores em um painel gráfico oferecido pelo Grafana, consolidando assim a criação de um servidor IoT funcional. É importante ressaltar que o vídeo fornece um guia detalhado de passo a passo, incluindo comandos e configurações específicas para implementar esse servidor IoT com Raspberry Pi.
Hello, excellent video! I'm Brazilian and I don't speak English (I'm using Google Translate lol) and I would like to know if I can use a conventional computer with the Raspberry Pi system installed in place of the Raspberry Pi board. Thank you in advance!I would also like to know if I can use the ESP8266 ESP-01 WiFi Module for the wireless connection, as I use an Arduino board without a built-in WiFi module.
Thank you! Very nice, well explained and easy to follow, bookmarking and saving your website tut too. I've got a couple renewable energy projects that I'm designing, and this should work perfectly for some monitoring hardware (tachometers on wind turbines and voltage readers on solar arrays). Also thinking about a few other metrics around the house I could definitely appreciate collecting :D.
Wow. You are doing what I have been reading so many tutorials to try to do. I am setting this up to remotely monitor a vacation property. I am looking at setting up a sensor that will measure the distance to the surface of water in a sump pit. I was wondering if you could provide some guidance on this. I was thinking of using a HC-SR04 to monitor the distance to the surface of the water. Wondering if you have any thoughts on this.
HC-SR04 is probably the best pre-built option - there aren't any real water level sensors out there that are bigger than a few inches. However, ultrasonic distance sensors are relatively sensitive, meaning a slight off-angle or shaking it could ruin the distance it computes. I'd recommend looking into creating your own water-level sensor, which would be the most-reliable long-term. I'm pretty sure one can be built with the right spare parts.
@@toastedregret1601 Thanks. I am thinking of mounting it to a piece of angle bar to make sure it is not moving. I have seen diy sensors that use conductance through screws and bolts. Just not sure how accurate that is going to be. I am currious how I would calibrate it outside of submersion. I also don't know that ground water with all the 'impurities' would have the same kind of conductance to get a feel for depth of the water level. Are you suggesting something different with an ultrasonic diy? Thanks.again.
@@mediaicon8774 I've used the ultrasonic distance sensors quite a bit for different projects, and they are pretty great to measure distances up to several feet, as long as you can get the transmission portion of the sensor mounted on something that would keep it from moving around. The sensor's face should ideally be as parallel as possible to the surface you're trying to get a reading on. Conductance is an alternative but the drawback is it may require calibration if exposed to liquids for a long period of time. It's probably worth trying an ultrasonic sensor and see if it suits your needs.
The video uses an arduino as the microcontroller unit (MCU), but if you don't want the hassle of connecting a WiFi module to it and managing the communication between the two modules, you can get a microcontroller with wireless capability (bluetooth, WiFi) embedded directly into it. I'd reccomend using an ESP32.
Do you have any suggestion to decrease power usage to change it to make a reading every 1 mins instead of few seconds. And using only solar energy from a panel? To make sure its fully autonomous
You could look into lower-power mode on the device you are using, and use a watchdog timer or some other peripheral on the microcontroller to power it back on after X time to take another measurement.
Based on my 3+y expirience InfluxDB wrong choice for time-series data. It can't be used on production setup. The better way - prometheus, or graphite with clickhouse backend.
Hello! Great tutorial, thanks! However, when I build the docker-compose.yml.file containing Mosquitto, Influxdb, Grafana, Node-RED, and Portainer-CE and I type the command "docker-compose ps" I don't get any list of Mosquitto, Influxdb, and so on. I get the following error responses (see the attached picture). I've been trying to troubleshoot it and rewrite everything from the beginning, but the issue persists. I've tried to add some other commands found on the internet, but no luck yet. Let me know if you have any ideas on how I might solve this problem. Thanks :)
Hi. This is very good work However, I'm trying to develop this with my raspberry pi and an arduino MKR. It happens that the WiFi library has its init method as private method, so no way you can start the WiFi in AP+STA mode (at least, I've not been able ot do it). Is there any work around. I think this is the cause the sensor node only gets one data through the node red workflow.
Hey I also noticed that the "influxdb out" pink dragbox you used in the video at around 7:48 no longer seems to be in the storage tab, or in the left toolbox space at all. What happened to it?
Hey quick question, so when you get to the menu part and have to select nodered to install in the build list, do you have to download every single package that nodered has or can you just install the default ones shown?
this video is supposing all devices are connected to the same network, right? Is there a way to implement same solution you provided, but with devices that are around 20-40 metres away from each other. either by somehow giving them same network or by working it out without same network.
very useful video, I did this Iot Server, but with DHT22 temperature sensor with ESP32. Did anyone have the problem that at 7.30 am and pm for some reason grafana stop saving data? Any suggestion?
So one topic is for each arduino with the sensor suite, so each room has a different topic? or is it a bunch of sensors sending data to one arduino and it is transmitting different topics per room?
Each arduino is an individual sensor node in the video. There are cheaper microcontroller alternatives with more IoT features (timers, power modes, WiFi, BLE), such as the ESP32. Arduino in this case was used as an example.
Can I ask a question, how do you enable the USB serial ports in docker, I want to use Arduino nodes to collect and send data over serial, is there a file I can edit for the Node Red container?
Hi there, after running the linked IoT install script and script was processed, my Raspi boots up into blackscreen, no GUI available any longer. Luckily, I had a VNC server running, so I am able to connect via VNC viewer from my PC, although with a very poor resolution, that makes it nearly impossible to operate it this way. I have tried several reboots, with no success, obviously the script has "broken" my GUI, do you know how to make it available again ? I can access ssh via VNC. I'd like to avoid having to reformat my SD card again, Cheers mate !
It should be set within your router, otherwise it will change the next time the raspberry pi power cycles. The video didn't mention that. Go to the IP address for your router, type the username and password (the very first time, it should be "admin" , "password"), find the raspberry pi in the list of devices on the router, view more info, and set "reserve" IP address.
Hello, I want to set the parameters of an industrial drive using a node through RS485 serial communication. In this project, I need to use the hex codes of an industrial drive and control the drive using the hex codes. Can you help me with this project with node-red-node-serialport?
Last week on a Friday night I was in micro center and the kid behind the counter told me they had none and they sell out in about 30 minutes. Saw about 8 in the glass case and asked a worker to grab me one, checked out with the same kid and told him there's 7 more if you want one lol. Just saying, they were there that entire day at least and didn't sell out. I'm sure by the end of the day Saturday they were gone. NYC area
The problem with this is in most scenarios you will not have a Wi-Fi network or any kind of network, imagine a farm. This would need to be achieved with Lora. So this needs to be all Lora and only one master with Internet connectivity. And raspberries are unobtanium 😢
I've been trying to get a similar setup but using CasaOS instead of IOTStack (but resorting to IOTStack for hints about how to set up Mosquitto and Influxdb which are not in the CasaOS app store). This gives a nice web front end to the various web apps and easy remote file access. Was wondering if anyone knew of a web app for Mosquitto, something that would allow web page monitoring of message traffic (similar to MQTTX, but web) and maybe some configuration GUI avoiding all the command line and config file editing jugitsu, similar to what Portainer does for Docker. Likewise for InfluxDB. I am very confused about what URL to use for one container from within another. What are the (different) URLs listed in Portainer for each container for? I found using the specific URL for the Mosquitto container worked in some cases where the URL of the Pi did not.
If I'm using influxdb on web browser instead of installing it to my pc, will it not work? Because when I'm connecting nodered with influxdb it's not binding with influxdb. I've used the host name for influxdb as my url and port as 8086.
Was so hopeful - but hit a big problem. When i run the Start Stack command, it dies quickly at the Grafana step "ERROR: no matching manifest for linux/arm/v7 in the manifest list entries" (FYI - i'm installing onto Rpi 4B) I googled that error, and found multiple questions about it for other packages, but i really don't understand enough to know how to fix it here. I'm stuck. Anybody willing to lead me out of this road block?
Hi, thx for the nice tutorial but as some people said earlier, I think there is an issue with th IOTStack and Node-red. Indeed while installing the stack the installation gets stuck and Node-red is not installed. I found out the reason was because I have configured the Raspberry IP as Static ( like shown in your previous tutorial :) ) It seems that during installation an IP has to be assigned to the containers and without DHCP it gets blocked... Can it be?
This is ,by far, the best video I have seen for explaining an IOT server, thank you
After what feels like 45000 tutorials, thank you - you finally gave me the insight needed to strip out unnecessary data and CHANGE the incoming data into a payload that influx was happy with. I now have a happy little chart of how bad the air is during the Canadian wildfire season.
Maybe I just hadn't looked hard enough before but I think you're the first person I've seen explain grafana this well.
Just a note, when setting up the MQTT server in Node-Red you can type in the name of the docker container as it is running in the same stack as Node-Red.
Amazing Video, cannot thank you enough. I tried it myself and here is feedback. The github code you shared is having issue with NodeRed, see error below -
I managed to install other containers by skipping nodered and later installed nodered as systemd.
It would be nice if you can make your github repo public in that way users can report issue and can pull the working code.
############
Start Stack:
docker-compose up -d --remove-orphans
WARNING: Some networks were defined but are not used by any service: nextcloud
Creating network "iotstack_default" with driver "bridge"
Building nodered
ERROR: Cannot locate specified Dockerfile: Dockerfile
This is a really excellent tutorial. Every step is clearly explained in detail. Just one issue: it is generally not advised to use a leading forward slash '/' for the root an MQTT topic. But that's a minor quibble
After struggling for a whole day trying to get mosquitto to work on my raspberry pi, following your video had me up and running within half an hour. This is a fantastic tutorial, thank you so much for the help ❤
Thank you for this excellent project & tutorial. It was my first step into the world of microcontrollers.
Thank you! Your video is straightforward and to the point. Other videos were a complete waste of time. I'm glad I found your videos
Amazing guide! I watched it a couple of times and after a few hours I had my Grafana up and running, mind you I had never done anything MQTT before. For now I am just logging the room temp with an ESP32 and an LM35 temp sensor but I will be adding a lot of stuff soon and hopefully some solar production data in the future. Thanks a lot!
Really good tutorial. I wish I watched this before setting up my IOT server
Great helpful video and website. One point, on the website it says to use 'docker-compose up' to check the status of the containers whereas you use 'docker-compose ps' in your video. I really appreciate the effort you are putting into your videos and supporting material.
Fantastic Video. Very crisp and to the point. Helped me learn the whole stack at one go.
Great to hear!
@@LearnEmbeddedSystems Is it possible to build this stack in the cloud? In other words can this container be ported to the cloud? A video on it would be helpful.
Great tutorial to get started with IoT stack in R-Pi4. I am going to use this in a CM4 and use node red + mosquito talking to IO module downstream. Docker surely makes things flexible and easy.
Great tutorial... I am going to get the data from my netatmo devices and data from my "solar system" into this.
Thank you for this video, i learned about portainer,grafana and influxdb in same video. thank u very much
Thank you. Nice; quick and succinct.
One comment.Why skip over Portainer when - and this is from limited knowledge - I think you could have set everything up from within Portainer
Very cool video on the Pi. For Arduino the ESP8266 NodeMCU is a cheaper option as it already have Wifi built-in and better power management. ESP32 would work too. Both very small form factor.
100% esp devices are better for 95% of iot projects and they are cheaper and smaller. Only problem is they are 3.3v devices so you might need a logic level shifter.
I use wemos mini clones plus bme280s for very compact temp/hum/pres sensors
Thanks for this guide, I have referenced and linked to it because it helped me build a server on an M5Stack CM4 Stack.
This is a very useful tutorial and a nice presentation!!
Just to be clear regarding viewing the containers using Portainer,
1) do I need to have an account in Portainer?
2) Is there any limitation on device numbers under the free account?
Great Video, I am bumbling through this on my own system, I intend to use this to monitor my solar install, hopefully remotely, so much to learn so it may be sometime before it goes live. Thanks for posting ;)
I've been debugging my IOTstack install for a week now -- I found that I had a corrupted SD Card. Best video I've seen so far getting right to the point, explaining what **should** happen. It would be nice if it included some more gotchas - I've been battling with my v2 B+ which is pretty slow running the IOTstack menu.
Maybe I could put an FAQ or common problems and how to solve them in the written article? Would that be a good compromise?
Storage problem is my biggest concern with Pi. Consider one with onboard eMMC or a M.2 NVMe. There are a few options out there using the CM4. Seeed minirouter, Waveshare IO boards- base B had a RTC, or the DFRobot mini router to name a few. The latter two require finding a CM4, which everyone says is on back order until Dec 2023.
@@LearnEmbeddedSystems that would be helpful, although I've just went the route of installing locally without docker containers and it is working
Running a database where data like temperatures etc. are constantly written with an SD card is only for people who enjoy reinstalling Raspis.
USB-SSD/HDD is mandatory for this application.
@@smaroukis I had the same problem, i have 5 corrupted sd cards on my desk now, I was about to try this videos method, I installed each item individually and the docker install script was killing sd cards
Well done and I have a number of projects in mind that will use what was explained here.
Great tutorial, would be useful if Grafana could easily plot multiple values on one graph so that many sensors could be viewed easily
Hi, yes it can do this you just add a second query panel when you are setting up the graph (+ Query button) and it outputs to the same graph
@@janhatton4405 Thank you
This is a really amazing video. Thank you. Any chance of you doing a tutorial on how to deploy Grafana Cloud connected to the local RPi Server? That way one can monitor devices away from home and even have alerting through Grafana IRM's mobile app.
Almost every single thing is very good explained in this video an exception of HOW CAN I MAKE THE INTERFACE COMMUNICATION BETWEEN MY ESP32 (WHICH IS READING THE DATA SENSOR) AND NODERED?
Really great video with written instructions. Thanks.
Hey LES!
Superb video thank you so much for the information. Just had one question, I have certain scenario's where people switch of the Raspberry Pi at the end of the day's work. So when they restart will all of the tools namely, Mosquitto, Influx-DB, Node-Red and Graphana or essentially the docker container reboot as well?
Thanks again for the fantastic video.
love the video !! can you make another video about the hardware setup plz ? and how the arduino sent data to raspberry ?
Really well explained and informative video, subbed.
Great video! Nice work. I would love to see the set up of the sensor node
Hello, this was a great tutorial! I got a little lost at the Nodered part. How do I know what is the Nodered Json interpreter that I should use?
Well this video was exepsional congrats! It worked fine for me, however for some reason I can't add the libraries of the functions on the pallet in node-red.
Mine did not work as when i want to start the stack it returns an error that three of the apps are obsolete. Just wondering if you had an issue like this or any way to resolve
Great tutorial. I have so many Pi 3s lying around, and wanna know if I can use them on this project? Now Im interested to see some videos on how tos with the sensor nodes.
Pi 3 should work just fine! ESP32 sensor Node video hopefully coming this weekend!
Incredible! Thanks for that. From Argentina.
That's an excellent tutorial !! Congratulations !! I would like to ask in case we have many sensors in /home/sensors. How can we get the unique id of each sensor and show in grafana? I've implemented your project with wemos D1 mini + DHT22 sensor + LCD 16x2 (parallel connection) and raspberry pi 4 (8Gb) as the server. The point is that viewing grafana i only see that data comes from sensor_data which is the db name from influxdb.
Hi, extremely helpful video! Can one use the sensor data to control GPIO of another raspberry pi using MQTT?
It is very good idea to let i
Pi as IoT server as all IoT things can be made by myself.
Hi, Thank you for this professional tutorial. I followed it and my ESP32 client can connect to the MQTT server jus if both the Raspberry pi and ESP32 on same wifi network. What am I missing?
I think MQTT is run upon a network, such as Wifi, bluetooth e.t.c.
Great video. But as I understand it, MQTT messages should not have a starting "/".
This is great, going to try and connect the data from my Victron solar gear, Ill get back and let you know how I get on
I actually want to do the same thing. Have you got yours working with victron?
Amazing tutorial. May i have a question ?
Say i finish all the installation above, is it possible that my system can operate completely offline ? ( reading, workflow, visualization, modifying … ) Like i connect those 2 boards to the same network which doesnt have internet connection.
Yes, it shouldn't need an active internet connection
Absolutely brilliant.
You are inspiring. Thank you for sharing.
Please note: In the video, you state that you can check what containers are running with the command 'docker-compose ps' while on the related web page you show the command as 'docker-compose up'
docker-compose ps shows you status of docker containers, docker-compose up execute the docker-compose.yml file(that is something like a config dile for docker) you also use this command only when starting docker
Resumo do vídeo "Raspberry Pi IoT Server Tutorial: InfluxDB, MQTT, Grafana, Node-RED & Docker" em 5 pontos:
1. *Objetivo do Projeto:*
O tutorial visa criar um servidor IoT utilizando um Raspberry Pi para coletar dados de sensores, como temperatura, pressão, umidade e qualidade do ar, através de um Arduino Uno emparelhado com um sensor BME680.
2. *Protocolos e Ferramentas Utilizados:*
Utiliza o protocolo MQTT para enviar dados em formato JSON pela rede para o servidor Raspberry Pi. Explora aplicativos como Mosquitto (broker MQTT), Node-RED (interpretação e envio de dados para um banco de dados), InfluxDB (armazenamento de dados do sensor) e Grafana (interface gráfica para visualização dos dados).
3. *Configuração do Ambiente:*
Emprega o Docker para rodar os aplicativos em contêineres, facilitando a configuração e implantação dos componentes, tornando possível a execução desses aplicativos em diferentes dispositivos.
4. *Passos para Implementação:*
- Atualização do sistema do Raspberry Pi e instalação do "iot stack".
- Seleção dos pacotes desejados (Grafana, InfluxDB, Mosquitto, Node-RED, Portainer) usando o menu interativo.
- Configuração do InfluxDB para armazenar os dados do sensor.
- Configuração do Node-RED para interpretar e enviar os dados para o InfluxDB.
- Configuração do Grafana para criar um painel visual dos dados coletados.
5. *Finalização do Projeto:*
Após a configuração de todos os componentes, é possível visualizar e monitorar os dados dos sensores em um painel gráfico oferecido pelo Grafana, consolidando assim a criação de um servidor IoT funcional.
É importante ressaltar que o vídeo fornece um guia detalhado de passo a passo, incluindo comandos e configurações específicas para implementar esse servidor IoT com Raspberry Pi.
Hello, excellent video! I'm Brazilian and I don't speak English (I'm using Google Translate lol) and I would like to know if I can use a conventional computer with the Raspberry Pi system installed in place of the Raspberry Pi board. Thank you in advance!I would also like to know if I can use the ESP8266 ESP-01 WiFi Module for the wireless connection, as I use an Arduino board without a built-in WiFi module.
Well Done. Thank you. Do you know if can I do that on an EC2 AWS instance?
very useful iot server guide..
Absolutely awesome content 😊 + Your voice 🌟
Thank you!
Very useful. How can I do this on windows or mac? Are the instructions the same?
Very good tutorial!! Thank you I will experiment with this.
Thank you! Very nice, well explained and easy to follow, bookmarking and saving your website tut too. I've got a couple renewable energy projects that I'm designing, and this should work perfectly for some monitoring hardware (tachometers on wind turbines and voltage readers on solar arrays). Also thinking about a few other metrics around the house I could definitely appreciate collecting :D.
Very informative video, thanks!
Great video, thanks. I would be interested in a sensor node video as well.
Wow. You are doing what I have been reading so many tutorials to try to do. I am setting this up to remotely monitor a vacation property. I am looking at setting up a sensor that will measure the distance to the surface of water in a sump pit. I was wondering if you could provide some guidance on this. I was thinking of using a HC-SR04 to monitor the distance to the surface of the water. Wondering if you have any thoughts on this.
HC-SR04 is probably the best pre-built option - there aren't any real water level sensors out there that are bigger than a few inches. However, ultrasonic distance sensors are relatively sensitive, meaning a slight off-angle or shaking it could ruin the distance it computes. I'd recommend looking into creating your own water-level sensor, which would be the most-reliable long-term. I'm pretty sure one can be built with the right spare parts.
@@toastedregret1601 Thanks. I am thinking of mounting it to a piece of angle bar to make sure it is not moving. I have seen diy sensors that use conductance through screws and bolts. Just not sure how accurate that is going to be. I am currious how I would calibrate it outside of submersion. I also don't know that ground water with all the 'impurities' would have the same kind of conductance to get a feel for depth of the water level. Are you suggesting something different with an ultrasonic diy? Thanks.again.
@@mediaicon8774 I've used the ultrasonic distance sensors quite a bit for different projects, and they are pretty great to measure distances up to several feet, as long as you can get the transmission portion of the sensor mounted on something that would keep it from moving around. The sensor's face should ideally be as parallel as possible to the surface you're trying to get a reading on. Conductance is an alternative but the drawback is it may require calibration if exposed to liquids for a long period of time. It's probably worth trying an ultrasonic sensor and see if it suits your needs.
Great video....when I try to install thsi with a static IP adress set I can not connect to the server.
When must I set the static IP adress?
Great video, also interested to see different sensor nodes that you can make and setup, thank you!
Thanks for your feedback! Will look at making a couple of videos on sensor nodes then :)
I am a novice in IoT, and appreciate if you could explain how to do the sensor board part. Thanks!
The video uses an arduino as the microcontroller unit (MCU), but if you don't want the hassle of connecting a WiFi module to it and managing the communication between the two modules, you can get a microcontroller with wireless capability (bluetooth, WiFi) embedded directly into it. I'd reccomend using an ESP32.
Hello ! thank you for your video. On which raspberry pi did you install those softwares ? RPI 3 ? RPI 4 ? thank you !
I found an RPI3 struggled, RPI4 with SSD was better
Great video! Thanks!
Thank You
Looking into this for a mesh network of environmental sensors including ground level pollution from vehicles. Thanks.
Do you have any suggestion to decrease power usage to change it to make a reading every 1 mins instead of few seconds. And using only solar energy from a panel? To make sure its fully autonomous
You could look into lower-power mode on the device you are using, and use a watchdog timer or some other peripheral on the microcontroller to power it back on after X time to take another measurement.
Very informative. Definitely going to try this.
Let us know how you get on!
great tutorial
Superb video ❤
love it!😄
Based on my 3+y expirience InfluxDB wrong choice for time-series data. It can't be used on production setup. The better way - prometheus, or graphite with clickhouse backend.
subscribed done, please make updated video for this some additional dashboard components
Well explained!
Hello! Great tutorial, thanks! However, when I build the docker-compose.yml.file containing Mosquitto, Influxdb, Grafana, Node-RED, and Portainer-CE and I type the command "docker-compose ps" I don't get any list of Mosquitto, Influxdb, and so on. I get the following error responses (see the attached picture). I've been trying to troubleshoot it and rewrite everything from the beginning, but the issue persists. I've tried to add some other commands found on the internet, but no luck yet. Let me know if you have any ideas on how I might solve this problem. Thanks :)
Very helpful
Hi. This is very good work
However, I'm trying to develop this with my raspberry pi and an arduino MKR. It happens that the WiFi library has its init method as private method, so no way you can start the WiFi in AP+STA mode (at least, I've not been able ot do it). Is there any work around. I think this is the cause the sensor node only gets one data through the node red workflow.
Hi Javier,
I’m interested in using the mkr, too. Have you received any feedback or found a solution?
Best,
Holger
Hey I also noticed that the "influxdb out" pink dragbox you used in the video at around 7:48 no longer seems to be in the storage tab, or in the left toolbox space at all. What happened to it?
Very well done.
Hey quick question, so when you get to the menu part and have to select nodered to install in the build list, do you have to download every single package that nodered has or can you just install the default ones shown?
this video is supposing all devices are connected to the same network, right? Is there a way to implement same solution you provided, but with devices that are around 20-40 metres away from each other. either by somehow giving them same network or by working it out without same network.
I think VPS digital ocean is the solution
I am confused about Node-RED. Is it design-time-only tool? Or does it have to run also at runtime, after I deploy my solution?
I have a question. This thing (API?) called "IOTstack" was made using docker?
Nice video, thanks :)
very useful video, I did this Iot Server, but with DHT22 temperature sensor with ESP32. Did anyone have the problem that at 7.30 am and pm for some reason grafana stop saving data? Any suggestion?
So one topic is for each arduino with the sensor suite, so each room has a different topic? or is it a bunch of sensors sending data to one arduino and it is transmitting different topics per room?
Each arduino is an individual sensor node in the video. There are cheaper microcontroller alternatives with more IoT features (timers, power modes, WiFi, BLE), such as the ESP32. Arduino in this case was used as an example.
Can I ask a question, how do you enable the USB serial ports in docker, I want to use Arduino nodes to collect and send data over serial, is there a file I can edit for the Node Red container?
Can I use esp32 instead od arduino with jolly module? Does it have a chance to connect with RPI?
have you ever used iobroker?
Hi there, after running the linked IoT install script and script was processed, my Raspi boots up into blackscreen, no GUI available any longer. Luckily, I had a VNC server running, so I am able to connect via VNC viewer from my PC, although with a very poor resolution, that makes it nearly impossible to operate it this way. I have tried several reboots, with no success, obviously the script has "broken" my GUI, do you know how to make it available again ? I can access ssh via VNC. I'd like to avoid having to reformat my SD card again, Cheers mate !
Where do you discuss the static IP? Should this be set in the router?
It should be set within your router, otherwise it will change the next time the raspberry pi power cycles. The video didn't mention that. Go to the IP address for your router, type the username and password (the very first time, it should be "admin" , "password"), find the raspberry pi in the list of devices on the router, view more info, and set "reserve" IP address.
Hello,
I want to set the parameters of an industrial drive using a node through RS485 serial communication.
In this project, I need to use the hex codes of an industrial drive and control the drive using the hex codes.
Can you help me with this project with node-red-node-serialport?
Can you do it with websocket and through public internet?
Like you can buy Raspberry Pis 🤣
150 Bucks / 4B 4GB @ several spare part-dealers.
@@Jannot_Gailer Yeah. Not sure they are worth 2.5x the price.
Last week on a Friday night I was in micro center and the kid behind the counter told me they had none and they sell out in about 30 minutes. Saw about 8 in the glass case and asked a worker to grab me one, checked out with the same kid and told him there's 7 more if you want one lol. Just saying, they were there that entire day at least and didn't sell out. I'm sure by the end of the day Saturday they were gone. NYC area
Paid MSRP btw, $45/2gb
@@thatApoliticalCoder Thanks for the information. They never say if it's available on their website though.. I'll walk in someday then. Thanks.
in theory this can be done on a headless pi zero from a pi because youre using the ip address to setup all the interfaces? (im a newb)
can even upload these data to an app and control the actuaters from it only?
The problem with this is in most scenarios you will not have a Wi-Fi network or any kind of network, imagine a farm. This would need to be achieved with Lora. So this needs to be all Lora and only one master with Internet connectivity.
And raspberries are unobtanium 😢
I've been trying to get a similar setup but using CasaOS instead of IOTStack (but resorting to IOTStack for hints about how to set up Mosquitto and Influxdb which are not in the CasaOS app store). This gives a nice web front end to the various web apps and easy remote file access. Was wondering if anyone knew of a web app for Mosquitto, something that would allow web page monitoring of message traffic (similar to MQTTX, but web) and maybe some configuration GUI avoiding all the command line and config file editing jugitsu, similar to what Portainer does for Docker. Likewise for InfluxDB. I am very confused about what URL to use for one container from within another. What are the (different) URLs listed in Portainer for each container for? I found using the specific URL for the Mosquitto container worked in some cases where the URL of the Pi did not.
Maybe wireshark to look at the datapackets being sent over the network? I know it's useful for UDP.
If I'm using influxdb on web browser instead of installing it to my pc, will it not work?
Because when I'm connecting nodered with influxdb it's not binding with influxdb. I've used the host name for influxdb as my url and port as 8086.
Was so hopeful - but hit a big problem. When i run the Start Stack command, it dies quickly at the Grafana step "ERROR: no matching manifest for linux/arm/v7 in the manifest list entries" (FYI - i'm installing onto Rpi 4B) I googled that error, and found multiple questions about it for other packages, but i really don't understand enough to know how to fix it here. I'm stuck. Anybody willing to lead me out of this road block?
NIce
it worked fine for a few hours and then started returning this error ( rc=-2Attempting MQTT connection...failed ) what might be the issue
Hi, thx for the nice tutorial but as some people said earlier, I think there is an issue with th IOTStack and Node-red.
Indeed while installing the stack the installation gets stuck and Node-red is not installed.
I found out the reason was because I have configured the Raspberry IP as Static ( like shown in your previous tutorial :) )
It seems that during installation an IP has to be assigned to the containers and without DHCP it gets blocked...
Can it be?
This exact thing happened to me, I also have a static IP set in /etc/dhcpcd.conf. Disabling the static IP resolved it. Nice find!