I'd recommend Storj as offsite storage. It's S3 compatible and integrated into Truenas. Plus its open source and decentralized - I've enjoyed it so far!
I like I-drive for cloud storage, they've been awesome for years. They are very generously priced, keep daily snapshots and will mail you the data if you need it in a pinch and can't download it fast enough (you'll pay for shipping and the drives)
Nice little setup. I like the self build rack. When upgrading slowly like you do, one can honor the little things more imho. Something I noticed across many of your videos: your microphone sensitivity seems to be set too high, your voice is clipping pretty badly from time to time. Keep it up!
I really thought you would have a crazy hacker enormously rack of servers Amazing just a couple of them in a diy enclosure! Good for you ! You are the best What model is your production server ?
You really need to work on your audio. I've notice in several of your videos, including this one, the audio is loud, over modulated, and even distorted at times.
Geez mate I am in Australia and I got about $60 000 worth of racks and Servers, even a Sun with 128 Cores and about 1TB of Ram a monster connected via Optic to two old IBM Storage banks and a lot of Servers mostly 1U's I think the the Storage is about 48TB more or less. and even a set of 2 long range 30KM 5g backhaul wifi, the type with the dishes almost like Ubiquity. Anybody with a UTE, Pickup can get then free, no charge. The have been sitting in my shed on the farm for the past 8 years.
Well...if I were about 12,000 miles closer, I might just drop by. Maybe another Aussie will see this as an opportunity. Seriously though, you've got a really awesome set of stuff. What do you, or did you use it all for?
Proxmox is the best thing since sliced bread. Currently I install it separately on Debian rather than using the official images but I may switch due to easier upgrades. I still use Virtual Box on my laptop.
Indeed. It's one of those things where it can be done, but you need more planning and equipment to really implement it well. You have to consider power outages, internet outages, simple networking issues that arise, and so on. That's the value of things like Digital Ocean, where their infrastructure allows you to spread an application or service across multiple hosts in multipel data centers / locations.
I've got 2x DL360p, a Cisco Nexus 3064PQ and 2x custom built NAS/SAN boxes each running 8x drives linked up to an APC Smart-UPS 1500 with additional battery packs. Gives me around 50 mins continuing runtime of all of those components if the power goes completely..
I just backup to icloud my most important docs and photos but use local USB storage for backups. I have 16tb drives as a backup that I rotate out of a fireproof safe.
Nice. Yeah, I need to slim down what I want to backup tot he cloud for sure, but I'm also thinking I might can use URBackup with a friend in another location to backup my stuff, and they can backup theirs to my system.. kind of what Crashplan offered, but in a fully open source way.
If Proxmox shows 100% RAM usage of a KVM guest, but the guest itself doesn't, then Proxmox simply allocated that amount of RAM to the guest. Meaning the guest is guaranteed that amount. Nothing to worry about.
Absolutely! My guest shows very little RAM usage in general, but the overhead view from the orchestrator (Proxmox) shows it in full use most of the time.
Thanks for showing your setup! I got a bit curious. Do you ever need to spin up a ova or ovf? Since you only run Proxmox. I understand that you can convert them but it seems a bit cumbersome.
I've a problem in netmaker , I cannot connect all the nodes that I install the VPN on , do you know why ? Route table looks ok ,still I can't ping other servers from this node I installed
Go over to my discussion site at discuss.opensourceisawesome.com and post in the #help-me-please channel. Someone, or I will take a look and see if we can help.
Oh yes. I have a pfSense firewall, and several APs around my home, but that switch is the switch taking all of those things out to the rest of my network. It's actually been a good little Gigabit switch.
Hi, what if i need to use Windows for a work with CAD software including 3d graphics? Would it work properly and smooth on the server like yours? Or i need to look for other option? Thanks
The VM for Windows isn't the issue, but whether you can allocate a GPU to the VM. Proxmox does allow GPU passthrough, and using something on a Gigabit or better wired network with RDP would likely work fine. Not having the setup to test with, I'm making presumptions about a few things. If RDP isn't fast enough, you could try something like Steam Link (lots of videos on how to use it for Desktop Sharing, not just gaming).
Instead of the cloud, find a buddy that will let you put a server in the basement. Neighbor or parent or whatever. Pay them a small amount for electric, whatever. But that way your data is backed up and cost is cheap and you are in control.
Thank you for your time and knowledge, I loved your rack, I copied your idea, and I suggest that instead of velcro you use small magnets in each corner of the wooden lid, regards
I haven't. I'm 100% certain it's a power-pig though. I'm looking forward to better server hardware built on low power stuff like Arm, and better arm support overall. I think it's headed that way, and it's exciting!
My office is kept pretty cool, so the rack itself has no built in cooling. Each server of course has it's own cooling. The fans don't spin much past idle most of the time. Battery Backup is one I got off of Amazon that is just enough to let the servers shutdown nicely, won't keep the servers running, they just use too much power.
I found iSpy to be a bit less resource intensive. I didn't realize that the open source part of iSpy was actually in their plugins, and not the software only, but it's working well, so didn't want to mess with my setup at the time. I'm looking at moving back to Frigate, or maybe something else so I may have some update videos this summer.
Let me put up a question here that I think this community will be better able to have a good answer for... So, I did all the cabling for my apartment with Cat 5e cabling, and it was kinda harsh. The apartment came with cable TV coax routed to all rooms, but in a very weird convoluted way... For instance, in order for me to reach the living room TV, which is right next to the entrance door which has the utility box, the cabling basically has to pass all rooms of the apartment in order to reach it. Let's say for instance that the living TV is like some 10 meters from the utility box, I actually had to pass some 50 meters of cabling to there there because it goes all around the apartment before getting there. Not actual numbers, but just to give an idea. It's weird like that. And also, it was almost made to fit, they used very narrow conducts, and I think some of it collapsed or are kinda disconnected because it was hell to pass a guide... I basically had to pull all the coax cable to barely fit through the Cat5e ethernet cable. I've been thinking of upgrading speeds for a while now, but I just know a Cat6 cable will be basically impossible to pass through the conducts... My question is, in terms of pricing and how difficult it is, how feasible is it to wire optical through these days? I'm on fiber already, so I know you can pass things through the building to get here, but I have no idea on how to clamp these things, the different standards, how it behaves routing inside the apartment, and stuff like that. Anything to watch out for? I know there are some pretty reasonably priced routes with fiber optic ports, but I'm not totally sure if using those in a home setting is a great scenario... they are mostly sold for business, right? Thanks!
What speeds are you looking to get? Wifi 6 is pretty fast, wireless, adn avoids all that cabling. Wired is great, but if it's inhibited, sometimes the wireless approach is better.
@@AwesomeOpenSource Hey Brian, appreciate the channel! :D Hmmm so, it's a bit less about speed, and more about reliability... I've got some interference here, reason why I wired everything. xD Both Wi-fi and Bluetooth are kind of a mess here, I guess too many people using wireless stuff around me. Willing to go through the hassle of passing cables, but I won't mess with the Cat5 cables just yet if the next step either can't go through or is just too expensive to bother... Really, I'm already fine with the speeds I have, it's just a bit of long term thinking since I'm retrofitting an old PC for TrueNAS Scale and changing things around a bit.
the new LP Sigma model SBC is performant and well rounded considering its size and scope, if not a bit pricey. can't wait for the day they come down in price to something more reasonable or go on holiday fire sale. supposedly roughly equivalent to the newer framework laptops or Intel NUCs that target the 45watt power envelope and afford solid single thread performance 😁 win-win in my book
On my Aria Server the VMs will use all of the RAM allocated to them (they reserve that RAM) from the main system. CTs only use what they need, and then will grow up to what is allocated. So on my Ubuntu VM where I allocate 24 GB, it uses 24 GB from the full 256 Available. Inside the VM it shows what's actually in use by the OS.
I was setting them up for different reasons and different testing purposes, and just never went back to re-do them. I like how they run now. I may make a cluster with some different hardware one of these days.
I explain in the description. RUclips hit me with a copyright issue on the music I use. It’s Creative Commons music and attributed in every video, but now it’s suddenly an issue and they are taking forever to resolve it. So until I have time to sit and make a custom intro song, I’ll leave it silent. Sorry for the confusion, but thanks RUclips and your not so smart AI stack.
@@AwesomeOpenSource lol it was a loose reference, I know you spell it Aria.. but I was thinking of Arya Stark and the Faceless from Game of Thrones.. 'a Girl has no name'.. if you haven't seen GoT, probably a lost reference 🤷♂
Wood? Hmmm it certainly has some disadvantages when connected with some hot IT components. We all started with some funny ideas, but at some stage it comes out that you need real rack even for pi.
I slotted the shelves, so there are gaps in the shelves that give air flow to the bottom of the servers, but really I don't run the servers hard enough to even spin their fans up beyond idle.
Sure, w x h x l = 27 x 34 x 31 (inches). Not including the casters it's on. That's just the box itself. The shelves are not solid, but have gaps from front to back as well in 4 sections so air can flow under the bottom of the servers as well.
Fabulous setup. I'm inspired by the wooden rack setup.
Thanks. One thing I didn't really show is that the shelves have gaps from front to back. This allows cooling to the bottom of the servers as well.
Your home lab setup looks clean and beautiful 🙂 Thanks for sharing this video 🙏
My pleasure. Glad you like it.
I'd recommend Storj as offsite storage. It's S3 compatible and integrated into Truenas. Plus its open source and decentralized - I've enjoyed it so far!
Awesome! Adding it to my list of options to look into.
I like I-drive for cloud storage, they've been awesome for years.
They are very generously priced, keep daily snapshots and will mail you the data if you need it in a pinch and can't download it fast enough (you'll pay for shipping and the drives)
That is awesome. Added to my list.
Amazing setup thank you for sharing and the great vids so helpful
My pleasure.
Nice little setup. I like the self build rack. When upgrading slowly like you do, one can honor the little things more imho. Something I noticed across many of your videos: your microphone sensitivity seems to be set too high, your voice is clipping pretty badly from time to time. Keep it up!
Yeah, I almost never use that lapel mic, so sorry about the audio there.
I really thought you would have a crazy hacker enormously rack of servers
Amazing just a couple of them in a diy enclosure!
Good for you ! You are the best
What model is your production server ?
My production server is a Dell R730-XD with 256 GB RAM and 2 CPUs with 12 Cores each.
Restic + Backblaze makes for a solid cloud backup solution
Looking into Restic as we speak.
Is possible to make own personal or business purpose cloud hosting and object storage using Intel NuC mini pc we have 10 + mini pc powerful pc
Sure, just takes a bit of work, planning, and time. But the tools to do it absolutely exist today.
You really need to work on your audio. I've notice in several of your videos, including this one, the audio is loud, over modulated, and even distorted at times.
Yep, always working to try and improve it.
Hi. Great setup! What hardware are you running TrueNAS on?
I believe it's a Dell R710 server with several large HDDs in ZFS Raids.
Geez mate I am in Australia and I got about $60 000 worth of racks and Servers, even a Sun with 128 Cores and about 1TB of Ram a monster connected via Optic to two old IBM Storage banks and a lot of Servers mostly 1U's I think the the Storage is about 48TB more or less. and even a set of 2 long range 30KM 5g backhaul wifi, the type with the dishes almost like Ubiquity. Anybody with a UTE, Pickup can get then free, no charge. The have been sitting in my shed on the farm for the past 8 years.
Well...if I were about 12,000 miles closer, I might just drop by. Maybe another Aussie will see this as an opportunity. Seriously though, you've got a really awesome set of stuff. What do you, or did you use it all for?
Proxmox is the best thing since sliced bread. Currently I install it separately on Debian rather than using the official images but I may switch due to easier upgrades. I still use Virtual Box on my laptop.
Love Proxmox. it has been an awesome tool!
Loving all your content
Thank you so much!
Only thing I miss is the high availability for essential services
Indeed. It's one of those things where it can be done, but you need more planning and equipment to really implement it well. You have to consider power outages, internet outages, simple networking issues that arise, and so on. That's the value of things like Digital Ocean, where their infrastructure allows you to spread an application or service across multiple hosts in multipel data centers / locations.
I've got 2x DL360p, a Cisco Nexus 3064PQ and 2x custom built NAS/SAN boxes each running 8x drives linked up to an APC Smart-UPS 1500 with additional battery packs. Gives me around 50 mins continuing runtime of all of those components if the power goes completely..
Hi, please make again a new video about how to install and configure netmaker... Would be great!
I have 2 videos on doing this today.
Here's the link for one of them ruclips.net/video/X-BYDYoM_3w/видео.html
bia (second server) is an R610. It would have Xeon v3 or v4 CPUs if it was an R630 (not the Xeon E5645s that it has).
Thanks. I couldn’t remember exactly. It runs great still, no matter. Used it for testing on two new videos today. Just solid hardware.
@@AwesomeOpenSource Yup I had 6x R610s for a few years before I upgraded.
I just backup to icloud my most important docs and photos but use local USB storage for backups. I have 16tb drives as a backup that I rotate out of a fireproof safe.
Nice. Yeah, I need to slim down what I want to backup tot he cloud for sure, but I'm also thinking I might can use URBackup with a friend in another location to backup my stuff, and they can backup theirs to my system.. kind of what Crashplan offered, but in a fully open source way.
If Proxmox shows 100% RAM usage of a KVM guest, but the guest itself doesn't, then Proxmox simply allocated that amount of RAM to the guest. Meaning the guest is guaranteed that amount. Nothing to worry about.
Absolutely! My guest shows very little RAM usage in general, but the overhead view from the orchestrator (Proxmox) shows it in full use most of the time.
Thanks for showing your setup!
I got a bit curious. Do you ever need to spin up a ova or ovf? Since you only run Proxmox.
I understand that you can convert them but it seems a bit cumbersome.
No, I never use OVA or OVF. But, if I want to make a template in proxmost it's not hard, and can save a ton of time when experimenting.
I've a problem in netmaker , I cannot connect all the nodes that I install the VPN on , do you know why ?
Route table looks ok ,still I can't ping other servers from this node I installed
So, without more detail on how you've set it up it's hard to know for sure.
@@AwesomeOpenSource how to send you ?
Go over to my discussion site at discuss.opensourceisawesome.com and post in the #help-me-please channel. Someone, or I will take a look and see if we can help.
You run all this equipment through just this generic switch ?? Do you have extra network equipment you did not show in the video maybe ?
Oh yes. I have a pfSense firewall, and several APs around my home, but that switch is the switch taking all of those things out to the rest of my network. It's actually been a good little Gigabit switch.
@@AwesomeOpenSource Great Setup. Thank you for sharing.
For your cloud backups, have you considered Linode?
I have. I'm thinking about a VPS provider with something like MinIO running the object storage, but just not decided quite yet.
Hi, what if i need to use Windows for a work with CAD software including 3d graphics?
Would it work properly and smooth on the server like yours?
Or i need to look for other option?
Thanks
The VM for Windows isn't the issue, but whether you can allocate a GPU to the VM. Proxmox does allow GPU passthrough, and using something on a Gigabit or better wired network with RDP would likely work fine. Not having the setup to test with, I'm making presumptions about a few things. If RDP isn't fast enough, you could try something like Steam Link (lots of videos on how to use it for Desktop Sharing, not just gaming).
Instead of the cloud, find a buddy that will let you put a server in the basement. Neighbor or parent or whatever. Pay them a small amount for electric, whatever. But that way your data is backed up and cost is cheap and you are in control.
100% love that concept. I think just having the right software to make it simple and automated is key. For me, this is what Crashplan really did well.
Excellent content mate, loving this channel!
Thanks, and glad you're here.
For anyone else looking for that Home Lab Dashboard that was 1/3 of your video. Dashy!
Yes, thank you. I do use Dashy! I talked about it in my previous videos on the Open Source software I use everyday.
Thank you for your time and knowledge, I loved your rack, I copied your idea, and I suggest that instead of velcro you use small magnets in each corner of the wooden lid, regards
What a great idea! Love it.
Sorry about your dad. All my condolences.
I appreciate it. It's never easy to lose someone, but he left me with incredible life lessons, and drive to learn, and be better.
@@AwesomeOpenSource THANKS. This is what I've been trying to do for a long time but I only have people who only take advantage of me and my family...
hi, How is the power consumption of your server cabinet, have you ever measured it? :)
I haven't. I'm 100% certain it's a power-pig though. I'm looking forward to better server hardware built on low power stuff like Arm, and better arm support overall. I think it's headed that way, and it's exciting!
@@AwesomeOpenSource If you don't mind, can I ask you something from the e-mail address on your channel? Thank you
Sure thing.
That's cool ! Question: For running all of that power. What type of battery backup do you have? And how do you cool that rack down?
My office is kept pretty cool, so the rack itself has no built in cooling. Each server of course has it's own cooling. The fans don't spin much past idle most of the time. Battery Backup is one I got off of Amazon that is just enough to let the servers shutdown nicely, won't keep the servers running, they just use too much power.
Great setup! Is there a reason you chose to use iSpy over ZoneMinder? I know you have covered both (I think?) so wasn't sure if there was a reason
I found iSpy to be a bit less resource intensive. I didn't realize that the open source part of iSpy was actually in their plugins, and not the software only, but it's working well, so didn't want to mess with my setup at the time. I'm looking at moving back to Frigate, or maybe something else so I may have some update videos this summer.
Let me put up a question here that I think this community will be better able to have a good answer for...
So, I did all the cabling for my apartment with Cat 5e cabling, and it was kinda harsh. The apartment came with cable TV coax routed to all rooms, but in a very weird convoluted way...
For instance, in order for me to reach the living room TV, which is right next to the entrance door which has the utility box, the cabling basically has to pass all rooms of the apartment in order to reach it. Let's say for instance that the living TV is like some 10 meters from the utility box, I actually had to pass some 50 meters of cabling to there there because it goes all around the apartment before getting there. Not actual numbers, but just to give an idea.
It's weird like that. And also, it was almost made to fit, they used very narrow conducts, and I think some of it collapsed or are kinda disconnected because it was hell to pass a guide... I basically had to pull all the coax cable to barely fit through the Cat5e ethernet cable.
I've been thinking of upgrading speeds for a while now, but I just know a Cat6 cable will be basically impossible to pass through the conducts...
My question is, in terms of pricing and how difficult it is, how feasible is it to wire optical through these days? I'm on fiber already, so I know you can pass things through the building to get here, but I have no idea on how to clamp these things, the different standards, how it behaves routing inside the apartment, and stuff like that. Anything to watch out for?
I know there are some pretty reasonably priced routes with fiber optic ports, but I'm not totally sure if using those in a home setting is a great scenario... they are mostly sold for business, right?
Thanks!
What speeds are you looking to get? Wifi 6 is pretty fast, wireless, adn avoids all that cabling. Wired is great, but if it's inhibited, sometimes the wireless approach is better.
@@AwesomeOpenSource Hey Brian, appreciate the channel! :D
Hmmm so, it's a bit less about speed, and more about reliability... I've got some interference here, reason why I wired everything. xD Both Wi-fi and Bluetooth are kind of a mess here, I guess too many people using wireless stuff around me.
Willing to go through the hassle of passing cables, but I won't mess with the Cat5 cables just yet if the next step either can't go through or is just too expensive to bother...
Really, I'm already fine with the speeds I have, it's just a bit of long term thinking since I'm retrofitting an old PC for TrueNAS Scale and changing things around a bit.
Proton Drive e2ee
Nice, and the pricing isn't too bad.
Great setup, thanks for sharing!
My pleasure!
great, lets see :D ahha
have you checked out the new Latte Pandas and similar hardware making their way to the markets for low power nodes?
Not yet, but I’ll look them up.
the new LP Sigma model SBC is performant and well rounded considering its size and scope, if not a bit pricey. can't wait for the day they come down in price to something more reasonable or go on holiday fire sale. supposedly roughly equivalent to the newer framework laptops or Intel NUCs that target the 45watt power envelope and afford solid single thread performance 😁 win-win in my book
Noice
Thanks.
Which VM /CT exactly is eating so much ram? From the names of them I can t figure it out.
On my Aria Server the VMs will use all of the RAM allocated to them (they reserve that RAM) from the main system. CTs only use what they need, and then will grow up to what is allocated. So on my Ubuntu VM where I allocate 24 GB, it uses 24 GB from the full 256 Available. Inside the VM it shows what's actually in use by the OS.
How you made those servers silent ?
They aren't silent. I just did some post-processing on the audio so they wouldn't overpower my audio.
Why do you dont have all your server in a cluster?
I was setting them up for different reasons and different testing purposes, and just never went back to re-do them. I like how they run now. I may make a cluster with some different hardware one of these days.
No sound in intro?
I explain in the description. RUclips hit me with a copyright issue on the music I use. It’s Creative Commons music and attributed in every video, but now it’s suddenly an issue and they are taking forever to resolve it. So until I have time to sit and make a custom intro song, I’ll leave it silent. Sorry for the confusion, but thanks RUclips and your not so smart AI stack.
A server has no name
Mine do. Their name tags say Dell, but I call them by any name I like. ;-)
@@AwesomeOpenSource lol it was a loose reference, I know you spell it Aria.. but I was thinking of Arya Stark and the Faceless from Game of Thrones.. 'a Girl has no name'.. if you haven't seen GoT, probably a lost reference 🤷♂
@@TheTrulyInsane I totally missed that! Hahahaha
I love your content, but if you ever want to grow you need to tackle your bad audio situation.
Working on it.
Wood? Hmmm it certainly has some disadvantages when connected with some hot IT components. We all started with some funny ideas, but at some stage it comes out that you need real rack even for pi.
I slotted the shelves, so there are gaps in the shelves that give air flow to the bottom of the servers, but really I don't run the servers hard enough to even spin their fans up beyond idle.
Give TarSnap a try, might meet your needs
looks interesting. I'll keep digging in. Thank you.
I really like your wooden box for your servers. Do you have the diameters for it?
Sure, w x h x l = 27 x 34 x 31 (inches). Not including the casters it's on. That's just the box itself. The shelves are not solid, but have gaps from front to back as well in 4 sections so air can flow under the bottom of the servers as well.
@@AwesomeOpenSource Thank you.