I just found your channel (watched how to setup ubuntu with software raid 1 and now the recommendation algo is pitching you 🤷🏻). I just wanted to say AWESOME work! I have been using Linux for 25 years, but 2 years ago migrated to Apple ecosystem for work... I still feel like a prisoner, I like several things (Notes app is really really top notch, nothing comes even close on ease of use AND usefulness on either web or native on other systems, and the integrated phone calls - can make and receive calls on any device, plus the health apps...) but the things I had to give up I still miss, like the endless customization of the UI, the easy scripting on any level (not only terminal but beyond) and the choice of applications - for everything you have to do there are multiple different apps and one can chose whatever fits best. Keep up the good work and good luck!
Regarding hardware, I can't believe you didn't mention mini pc/thin client. They have better specs than raspberry pi and lower cost. For the same price you will have to purchase additional components for the pi while mini pc will give you a full functional computer (minus screen).
I've been looking at mini-pcs lately, but haven't seen anything below $35 US for sure. They are often a bit on the pricier side (of course, depending on the specs). The mini-pc is a perfectly valid way to go though. I can't cover every possible bit of hardware out there, I just wanted to express that you don't need a massive server to get started homelabbing.
Maybe you are too late to that party, and maybe wrong region. Here in germany raspi 4 got around 110-180€. depending on how many ram. These tiny lenovo or dell pcs are listed between 100€-200€ depending on what deal and configuration. But with these litte monsters you can get i3,i5,i7 or ryzen. More then 8GB ram and you have 1 SSD Slot and one HDD Slot, so you can slap lots of disk space into it. For the same price more performance, x64 compatible cpu (No ARM), lots of space. But with cheaper raspi prices it less an alternative anymore.
In countries where Rasberry Pi's are very far from the prices Americans can buy them for. A second hand miniPC is the better choice. Can be had with quad core i5 Intel processors (with quicksync), memory and an SSD for less then $100 on eBay. I just got a HP EliteDesk 800 G2 as my new Docker host. Meanhile it came with a Windows 10 Pro licence and currently works as my torrent box and secondary PC. It runs cool and is almost completely silent.
I started homelabbing with my old desktop (Athlon X2 6 core 16gb of RAM) and tried Unraid. Found Docker, and I was like Bazinga. Bought a server rack, which came with 2 servers and a desktop. Moved my Unraid build to one of the servers. Fast forward, I now have 3 Proxmox servers, 3 mini PCs for a Kubernetes cluster, a ds4246 for a planned Truenas build, the original Unraid server,.
I have a lenovo PC with i7-64gb hypervisor running all my servers for free PFSENSE PacketFence Wazuh Graylog TacticalRMM Milestone Xprotect - free up to 8 cameras 3cx Windows Server runs just fine without a product key
Ok, think this may be the guide I need to start my home lab but I am truly new to this, so this is probably a really stupid question. I have a mini PC for hardware. Now, what do I install from a software standpoint to get started? I want this to be completely self hosted with my first 2 projects to be Jellyfin and Bitwarden.
Definitely get familiar with Docker. That is going to give you the best bang for your buck in hosting multiple applications on your hardware. I have guides for Jellyfin and Vaultwarden (self hosted Bitwarden), so check those out. I also have a script that can help you install Docker if you are running LInux on your mini-pc. If nothing else, jump over to my discussion forum discuss.opensourceisawesome.com and ask in the #help-me-please channel. I'm sure we can get you moving forward.
Good video but I tend to get a bit apprehensive when I have to use open source that uses for example PHP, MYSQL etc and was wondering if there is a guide to how to install and troubleshoot them when used in the context of a user rather than a developer.
If you're asking about logging, then you can use docker commands to view logs, or you can follow the logs of the running applications as you would in development mode. Just no breakpoints.
@@AwesomeOpenSource Actually I'm just talking about getting those open source projects running. Since a number of the ones I'm interested in often require PHP and msql or derby to run. I don't know enough about how to set them up and do troubleshooting if it fails.
Your definition of 'headless' is not exactly correct. It does not mean there is not GUI but only a terminal to interact with. It means there is no monitor/keyboard/mouse to interact with and is typically managed via the network which usually is with command line and a terminal emulator. Serial management is another way. Love your videos though. Helped me get into the PVE world.
Right, headleass is generally a machine without a physical monitor, and I am using it incorrectly, but hopefully my meaning was coming across. '-). Glad you enjoy the videos.
Started playing around with a Raspberry Pi because it was cheap, didn't take long to start messing around with PROXMOX and pfSense, now I have a pretty solid home network, the best part is it doesn't have to cost very much except your time and effort. Use cheap PCs with a Quad NIC installed, even if it all goes wrong you still have a PC.
Love your videos. But how can you manage to keep up the pace with the different technology shift happening? I am having trouble following up. Started with ESXi, then moved to Proxmox KVM, now LXC (then Docker then Podman) came up, then configuration management system came up (I used Saltstack), then you have infrastructure management such as terraform or salt-cloud. Basically I have the feeling that everything is changing every 6 months or so. And simply getting started with something like home assistant in a custom setup requires to learn Docker/Podman, docker-compose/podman-compose, how to deal with ZFS datasets with Docker/Podman (it's not that intuitive, had to create an ext4 zvol), how to handle backups (again not obvious... You have to poerr off your container and start it in a special way to copy paste the data somewhere else). Basically I get the feeling every project turns into 10 or more projects. Why didn't they make it easier to do backups in docker/Podman 🙄 ?
You're 100% right. It does feel like it moves really fast. I think it's more that as certain things become mainstream, they seem to move fast. Docker has been around since 2014 (almost 10 years now), Proxmox and virtualization have been around even longer (maybe 20+ years now), and while it does all evolve over time, that evolution is what makes us able to do more and more with our systems. Don't try to do everything. Try to get really proficient at one thing, and then figure out how it applies to the next evolution. VMs are the whole concept behind Docker. Building and installing the software in a manual way is how a Dockerfile is created, which then gives you the Docker image, and eventually the container you run. Kubernetes was an answer to the desire for high availability in Docker containers, and then it evolved into something even more powerful and flexible, and more complex to some extent. It all comes with time. And, I by no means keep up with everything. I do exactly what I'm telling you now, and my journey is slow and progressive.
@@AwesomeOpenSource Thank you for your answer and what you put out on this channel. Unfortunately I never got onboard the Docker train and Podman (basically Docker without Root privileges) just doesn't work that well (I faced some issues with versions between Podman, Podman-Compose, Docker-compose). I agree that if you want to learn, one thing at the time can be done :). But if you need something that "just works" (e.g. Home Assistant), Docker is a bit tricky. Don't get me wrong, I tried both docker and podman, wrote some set of scripts so I remember what I did and how. But for instance for Backups I still see no viable solution ... I just find it weird we cannot just mount -rbind a NFS filesystem for use for Configuration storage, or that we cannot copy / rsync a folder from the Docker host to a backup server. I am probably missing something ... Or maybe in the past 6-12 months things have improved a bit ? Right now I still have most of my stuff on Proxmox KVM, so Operating system updates is the downside :(.
@@silverstone7778if you have everything on proxmox why not use proxmox backup server or even plain proxmox backups? You have snapshot of the VM/LXC filesystem which you can restore anytime.
I can't at the moment, due to space and finances (for hardware), but I do eventually plan to self-host as much as I possibly can... though it may take a good while before I'm able to do so!
Hey brain, been watching you for 2 years now great stuff thanks for the awesome content, could u please make a video or a post on your show notes on how to self host a mysql DB in docker via the new zero trust cloud flare tunnels so i can access my DB remotely via a URL please, been trying for over a year can't seem to figure it out, I need it for my university projects so we can connect student projects (java spring boot backend) to the remote DB with out port forwarding?
Let me see what I can do. I'm sure I can use a tunnel, but I'm not a fan of cloud flare as their stuff isn't open source. Whatever I do should translate loosely to it at least.
@@AwesomeOpenSource thanks man really appreciate the assistance, lol I have a lot of hardware since I stared watching u, got 5 dell servers now and few mixed ones, actually started home lab for the use of a self hosted database I can access from anywhere, never got it working tho, but gained so much knowledge and so many skills from headless Linux VMs in esxi and proxmox to setting up vlans, voip and firewalls and running docker containers, thanks for being a awesome teacher!
I just found your channel (watched how to setup ubuntu with software raid 1 and now the recommendation algo is pitching you 🤷🏻). I just wanted to say AWESOME work! I have been using Linux for 25 years, but 2 years ago migrated to Apple ecosystem for work... I still feel like a prisoner, I like several things (Notes app is really really top notch, nothing comes even close on ease of use AND usefulness on either web or native on other systems, and the integrated phone calls - can make and receive calls on any device, plus the health apps...) but the things I had to give up I still miss, like the endless customization of the UI, the easy scripting on any level (not only terminal but beyond) and the choice of applications - for everything you have to do there are multiple different apps and one can chose whatever fits best. Keep up the good work and good luck!
Thanks so much, and super glad you found us!
Regarding hardware, I can't believe you didn't mention mini pc/thin client. They have better specs than raspberry pi and lower cost. For the same price you will have to purchase additional components for the pi while mini pc will give you a full functional computer (minus screen).
I've been looking at mini-pcs lately, but haven't seen anything below $35 US for sure. They are often a bit on the pricier side (of course, depending on the specs). The mini-pc is a perfectly valid way to go though. I can't cover every possible bit of hardware out there, I just wanted to express that you don't need a massive server to get started homelabbing.
Maybe you are too late to that party, and maybe wrong region. Here in germany raspi 4 got around 110-180€. depending on how many ram. These tiny lenovo or dell pcs are listed between 100€-200€ depending on what deal and configuration. But with these litte monsters you can get i3,i5,i7 or ryzen. More then 8GB ram and you have 1 SSD Slot and one HDD Slot, so you can slap lots of disk space into it. For the same price more performance, x64 compatible cpu (No ARM), lots of space. But with cheaper raspi prices it less an alternative anymore.
In countries where Rasberry Pi's are very far from the prices Americans can buy them for. A second hand miniPC is the better choice. Can be had with quad core i5 Intel processors (with quicksync), memory and an SSD for less then $100 on eBay. I just got a HP EliteDesk 800 G2 as my new Docker host. Meanhile it came with a Windows 10 Pro licence and currently works as my torrent box and secondary PC. It runs cool and is almost completely silent.
Good morning, thanks for another great video!
Absolutely my pleasure!
I started homelabbing with my old desktop (Athlon X2 6 core 16gb of RAM) and tried Unraid. Found Docker, and I was like Bazinga. Bought a server rack, which came with 2 servers and a desktop. Moved my Unraid build to one of the servers. Fast forward, I now have 3 Proxmox servers, 3 mini PCs for a Kubernetes cluster, a ds4246 for a planned Truenas build, the original Unraid server,.
That is awesome! I'm not quite as far as you on hardware, but I'm definitely getting there. I love it though.
As long as your daily driver does what you need, then it's the perfect machine. That's how I feel about all of my machines.
I have a lenovo PC with i7-64gb hypervisor running all my servers for free
PFSENSE
PacketFence
Wazuh
Graylog
TacticalRMM
Milestone Xprotect - free up to 8 cameras
3cx
Windows Server runs just fine without a product key
Nice.
Ok, think this may be the guide I need to start my home lab but I am truly new to this, so this is probably a really stupid question. I have a mini PC for hardware. Now, what do I install from a software standpoint to get started? I want this to be completely self hosted with my first 2 projects to be Jellyfin and Bitwarden.
Definitely get familiar with Docker. That is going to give you the best bang for your buck in hosting multiple applications on your hardware. I have guides for Jellyfin and Vaultwarden (self hosted Bitwarden), so check those out. I also have a script that can help you install Docker if you are running LInux on your mini-pc. If nothing else, jump over to my discussion forum discuss.opensourceisawesome.com and ask in the #help-me-please channel. I'm sure we can get you moving forward.
Good video but I tend to get a bit apprehensive when I have to use open source that uses for example PHP, MYSQL etc and was wondering if there is a guide to how to install and troubleshoot them when used in the context of a user rather than a developer.
If you're asking about logging, then you can use docker commands to view logs, or you can follow the logs of the running applications as you would in development mode. Just no breakpoints.
@@AwesomeOpenSource Actually I'm just talking about getting those open source projects running. Since a number of the ones I'm interested in often require PHP and msql or derby to run. I don't know enough about how to set them up and do troubleshooting if it fails.
This is a really good book for building a lab: Practical Linux DevOps: Building a Linux Lab for Modern Software Development - John S. Tonello
Great tip! Thanks for that.
One small computer x86 based that I am using to self-host is the Zimaboard. Very nice little computer.
Very nice!
Your definition of 'headless' is not exactly correct. It does not mean there is not GUI but only a terminal to interact with. It means there is no monitor/keyboard/mouse to interact with and is typically managed via the network which usually is with command line and a terminal emulator. Serial management is another way. Love your videos though. Helped me get into the PVE world.
Right, headleass is generally a machine without a physical monitor, and I am using it incorrectly, but hopefully my meaning was coming across. '-). Glad you enjoy the videos.
Started playing around with a Raspberry Pi because it was cheap, didn't take long to start messing around with PROXMOX and pfSense, now I have a pretty solid home network, the best part is it doesn't have to cost very much except your time and effort. Use cheap PCs with a Quad NIC installed, even if it all goes wrong you still have a PC.
Absolutely hit it right on the nose! This is the best way to get into homelab. Just start with what you ahve, and work your way up over time! Awesome!
@@AwesomeOpenSource the funny thing is that your homelab rapidly turns into your network !!
Very true.
Love your videos. But how can you manage to keep up the pace with the different technology shift happening? I am having trouble following up. Started with ESXi, then moved to Proxmox KVM, now LXC (then Docker then Podman) came up, then configuration management system came up (I used Saltstack), then you have infrastructure management such as terraform or salt-cloud. Basically I have the feeling that everything is changing every 6 months or so. And simply getting started with something like home assistant in a custom setup requires to learn Docker/Podman, docker-compose/podman-compose, how to deal with ZFS datasets with Docker/Podman (it's not that intuitive, had to create an ext4 zvol), how to handle backups (again not obvious... You have to poerr off your container and start it in a special way to copy paste the data somewhere else). Basically I get the feeling every project turns into 10 or more projects. Why didn't they make it easier to do backups in docker/Podman 🙄 ?
You're 100% right. It does feel like it moves really fast. I think it's more that as certain things become mainstream, they seem to move fast. Docker has been around since 2014 (almost 10 years now), Proxmox and virtualization have been around even longer (maybe 20+ years now), and while it does all evolve over time, that evolution is what makes us able to do more and more with our systems. Don't try to do everything. Try to get really proficient at one thing, and then figure out how it applies to the next evolution. VMs are the whole concept behind Docker. Building and installing the software in a manual way is how a Dockerfile is created, which then gives you the Docker image, and eventually the container you run. Kubernetes was an answer to the desire for high availability in Docker containers, and then it evolved into something even more powerful and flexible, and more complex to some extent. It all comes with time. And, I by no means keep up with everything. I do exactly what I'm telling you now, and my journey is slow and progressive.
@@AwesomeOpenSource Thank you for your answer and what you put out on this channel. Unfortunately I never got onboard the Docker train and Podman (basically Docker without Root privileges) just doesn't work that well (I faced some issues with versions between Podman, Podman-Compose, Docker-compose). I agree that if you want to learn, one thing at the time can be done :). But if you need something that "just works" (e.g. Home Assistant), Docker is a bit tricky. Don't get me wrong, I tried both docker and podman, wrote some set of scripts so I remember what I did and how. But for instance for Backups I still see no viable solution ... I just find it weird we cannot just mount -rbind a NFS filesystem for use for Configuration storage, or that we cannot copy / rsync a folder from the Docker host to a backup server. I am probably missing something ... Or maybe in the past 6-12 months things have improved a bit ? Right now I still have most of my stuff on Proxmox KVM, so Operating system updates is the downside :(.
@@silverstone7778if you have everything on proxmox why not use proxmox backup server or even plain proxmox backups? You have snapshot of the VM/LXC filesystem which you can restore anytime.
I can't at the moment, due to space and finances (for hardware), but I do eventually plan to self-host as much as I possibly can... though it may take a good while before I'm able to do so!
Totally understand, but as long as you know where you want to end up, you have a great place to start.
Hey brain, been watching you for 2 years now great stuff thanks for the awesome content, could u please make a video or a post on your show notes on how to self host a mysql DB in docker via the new zero trust cloud flare tunnels so i can access my DB remotely via a URL please, been trying for over a year can't seem to figure it out, I need it for my university projects so we can connect student projects (java spring boot backend) to the remote DB with out port forwarding?
Let me see what I can do. I'm sure I can use a tunnel, but I'm not a fan of cloud flare as their stuff isn't open source. Whatever I do should translate loosely to it at least.
@@AwesomeOpenSource thanks man really appreciate the assistance, lol I have a lot of hardware since I stared watching u, got 5 dell servers now and few mixed ones, actually started home lab for the use of a self hosted database I can access from anywhere, never got it working tho, but gained so much knowledge and so many skills from headless Linux VMs in esxi and proxmox to setting up vlans, voip and firewalls and running docker containers, thanks for being a awesome teacher!
So glad you've gotten so far with me. That's awesome!
Couldn’t agree more,do you have a mastodon account ?
I do. @MickInTx@fosstodon.org
I love you content
Thank you so much!