Ahhh the data hoarder. Caught in the wild. Watch as he backs up his art on the fridge from the first grade and then replicates it 3x because a mirror is not a backup. I’m pretty sure Wendell has that tattooed on his body somewhere!!! I love this shit btw
Wendel has a back tattoo of Sinbad as Shazam... he's from the original time line. He must be attempting to preserve it's knowledge here in the darkest time line.
I bought 5x 12TB Seagate Exos Recertified, from them. I live in Canada, so, at the border it got hit with duties. But even with shipping AND duties AND currency conversion it was still cheaper than buying a new (or 5 new) drives. And yes, their shipping is freaking INCREDIBLE!
I'm really glad that I watched until the end! When I saw the 45 drives HL15, I had the same thought to setup a tailscale mesh or ceph cluster between friends.... So please make that video! I think the goal should be to replace "crucial" but exploitative services with community services from within our peer group.
I just ordered from these guys a couple months ago, great customer service. Learned about them from some dude on reddit. They got the drives out right after the hurricane too.
All my NAS drives (16x 12tb) are retired WD/HGST drives from serverpartdeals and other similar places. Never had any issues. Coincidentally I am now using an external HBA inside of a MS-01 connected to a Super Micro JBOD. It's been great!
At my job we're probably moving offices & will need a lot more space for the NVR/Camera storage. Since we're always going to have access to the system, I'm running TrueNAS for storage & I'm a huge fan of RAID-Z3 I recommended using recertified drives. If you lose data with RAID-Z3 you either neglected the array for a decent amount of time or there was a disaster on-site. Get 2+ extra drives as well - one for a warm replacement & one for a cold replacement plus monitor report emails and the system will be set.
The biggest issues I've run into out of SPD has been a batch of Exos X16 16TB drives. Started with 10 drives, 2 DOA, replaced 4 more within the 2 year warranty, including one that was an RMA drive already. I blame that on that series of drives though. My X18 drives and WD DC5xx drives have had zero failures. I'll go back to them again next time I need to upgrade.
I did bough 12pcs X16 16TB drives and 8 of these failed in a month. Rest during next 6 months. Approved few replacement drives from different batch but also these failed. To be honest I did drive full scans on all and many failed during that. Not during operation but first ones. So please always tress test recert drives before trusting these.
I bought a couple used Supermicro 36 bay and 72 bay chassis with SAS2/3 backplanes and redundant 1.2KW PSUs. They have been great! Reasonably low noise once I replaced the stock 80/92mm fans with 3 x Noctua 140mm fans.
I've been a customer of SPD for years. My "shucked" 8TB drives got replaced with 16TB Exos drives from SPD over the course of a few years, and recently I bought 8 20TB Exos drives from them; most of those are going into a backup server that will be hosted at a friend's house. (Local access to 70+ TB of Plex material is a good incentive...)
That's where I bought my 23 TB drives from. WORKS AMAZING! Was able to consolidate all my 23 drives of data from all the way back to 2003 on up to 2024. AND I STILL HAD SPACE LEFT! And this point, its saving up for a tape drive so I can get all my data backed up to cold storage for the long haul. But with how CHEAP these drives are? I can buy spares, and just make multiple copies and not worry to much about it as the O.G. tapes last for quite a bit since they are almost all data grade.
@@Fractal_32 Russia and Japan are my off site backups. Heard the NSA may have a copy too. . The stuff I really care about is my old family videos and times in the Military of people long gone & digital backups of film / Photos. Of course the best memories are the ones you never filmed or documented. Sappy, sure... But its the truth. I'm just glad I saved so much media that has disintegrated over time like old VHS tapes. To bad I can't digitally store my Pee wee or Ernest talking dolls. Hopefully, they make it into the hands of a real collector one day. Have a HAPPY thanksgiving!
Amazing, love your videos and the way you show the home labber stuff that only professionals in the computer industry can know. Cheers, most of us cannot afford these things, but its great to see where these techs are going.
Perfect timing. My old pfsense box just died and i have been running pfsemse on proxmox as a stop gap. I would like to see a video exploring how to get the most 4kQD1 performance in a VM without passing through optane. virtio scsi or virtio-fs. Maybe more details on how you run your workstation with your p5800x passed through, how do you handle backps from the p4800x
Hey Wendell, we use Docker in LXC all the time, mostly to avoid having Docker containers directly on host, mainly to be able to backup or move the whole environment if needed.
Right there with you on the “powers for evil”! I have a decomm’d 2020 45Drives Stornado (32x 2.5” SSDs) upgraded to AMD Epyc 7713. Still wrapping my brain around what I can do with this monster.
We fit this setup (same motherboard, 128-core AMD, redundant PSU, 100G NIC, and 14x 30.72TB NVME 2.5" SSDs) into a rugged carry-on case for a govt program. Great to see someone else doing a crazy build just like it!
I can remember when VCR came out and I had to program my parents VCR for them as it was too Complicated" for them 🤣 Happy to host your off shore back solution in the future, of course I will need to watch all dvds to ensure integrity
A big online retailer in my country sells these recertified drives in the 16TB size. Both exos and ironwolf. Have a few of the 16TB exos in my home server and they seem to be doing fine! The same can't be said for the ironwolfs though though. We installed 8 of them to a new nas at work. One was completely doa, and within a day or two another one failed with a large amount of bad sectors. Then in a couple weeks another one failed. Within about half a year all but one of them failed in the same way, so we also returned the last working one when the second last one failed. Replaced them all with brand new exos drives, as my boss, rightfully so, wasn't feeling like taking a chance with recertified anymore. Luckily none of the drivers failed catastrophically and no data was lost due to us running raid-z2 and having backups. The retailer also lists the return percentage of all products they sell, ironwolfs had something like 50% (yikes), and the exos has it under 2%, which is interesting as they are supposedly the same hardware as the exos drives, with a different firmware. Looks like they have since stopped selling the ironwolfs probably for that reason.
I just replaced my Fractal 140mm fans in my R6 with a 5 pack of Arctic's F12s. I mainly replaced them 140mm fans due to age and the bearings were making noise. So I cleaned out the PC from any dust intrusion, cleaned the filters, changed all the fans, and the nice part of Fractal's cases, the standardized fan board that uses standardized connectors. PC is nice and quiet again, and running cool again.
Thank you Wendell for the heads up on Server Part Deals. i have an old Synology DS1515+ NAS lying around that I could reuse with some serious storage. Have been using a Win 11 box with storage spaces as off site at my studio and a Synology DS1621+ as a replacement for the DS1515+ at home. Hmm time to think where I could deploy the old DS1515+ it irks me leaving it sat doing nothing.
That's interesting, I also have docker running in LXC containers in proxmox, but never had it restart. But there is not a lot of communication between the host and the docker container, as the storage and nfs mounts are just passed through to the LXC. Most communication happens inside docker or between LXC containers.
Well shit Wendell.... I follow so many channels I'm always a month or so behind so I'm just getting to your video. The other day I went to buy a drive from my fave vendor and found that prices had shot up and wondered WHY. Well, I guess I know - you told everyone the secret! I've had a bad sector or two from drives from these guys occasionally but never a bad drive. Their prices had always been damn good too lol. Seagate has proven to be faster than WD in my experience, I run those EXOS w/unRAID. Damn good stuff!
I have to second the comment about the arctic fans. Pro tip: buy the 5 packs of them, even if you only need a few, they're way cheaper per unit that way and you will find a use for the extras in the long run
phison under pascari brand has them out too 122,88TB capacity, no price available though yet, samsung and kioxia should start mass production of 4xx layered nand flash any time now, hope flash beats hdd in price vs capacity very soon and large capacities become available for mere mortals
I recently bought a stack of 12tb enterprise sata drives for $75 each with a 5 year warranty and I couldn't be happier with the decision. A drive failed after a little over 6 months and they replaced it very quickly. You're probably building some sort of raid anyway so just keep a cold spare ready and you're good to go.
I thought I was a mad lad planning out my Hakoforge mini + Epyc Seina future NAS setup then Wendell reminds me I'm a shrimp in a very vast ocean. I've been buying drives from server part deals and water panther for a good number of years now and have been happy enough with both of them that for my home stuff I just buy a few extra drives and save money.
I'm not following the ZFS VDEV layout @ 15:00. At 15:10 Wendell says "four RAIDZ1 VDEVs". That would only utilize 12 of the fifteen disks, leaving three unutilized/spare? Then at 15:20 he says "Four drives...three drives of capacity RAIDZ1...and then you have a hot spare." This sounds like it's four disks per VDEV with one hot spare each? Then at 15:50 he says "With four VDEVs the performance is really good. You're giving up four plus one drives worth of capacity." I'm not sure if something was lost in the edit here, but instructions unclear. Now fork is in my VDEV, and my AI DeVito has broken free from his pen.
@@Level1Techs Four 4-drive VDEVs would be 16 drives plus (at least) one hot-spare puts you up to (at least) 17 drives. Made me scratch my head, too. 17 drives in a 15-bay chassis?! 😂
Around 16:10 Wendell talks about ZFS configurations. Using raidz1 for performance if you’re doing VMs/NVR stuff. Are there any videos or forum links to go into this topic? I have my NAS on raidz2 and my NVR and a few VMs do use it for storage but I never noticed any performance issues but I am new to this.
Would love to hear how loud this turned out while running. I was considering the HL15 with 28 TB drives to replace my Storinator with 10 TB drives but it's really only worth it to me if I can cut down on the noise. As you mentioned with the Arctic fans, I replaced all my stock Storinator fans with Noctuas but the triple PSUs are just so darn loud.
I've bought WD since '94. Not a single failure. (3 external cages failed, no drives.) Two years ago tried an EXOS 10TB. Dead in 8 months... (I know, not statistically significant...)
Bought multiple drives from server part deals, zero issues. Bout to throw 8 recertified drives from them in a nas. Kinda dumb to buy new nas drives at those steep discounts. Also, the hard drives are protected in the box very well, even better than the manufacturers. I bought a 2.5 drive directly from western digital, they put it in a static bag, and a bubble envelope to ship. I was surprised it worked when I installed it. Crazy shit.
I thought I was the only one plugging his fiber ONT directly into a dedicated vlan on his switch to enable router redundancy :D - it's a neat trick. though, given all of the other basic components in your setup have redundancy, i'm a little surprised you don't have 2 10g switches set up with mlag (and one isp on each switch given it's unlikely that you can set up a lag on your ont/cable modem).
I have a lot of projects and assets, and I have already half filled my 16TB NAS, and assets only keep getting bigger, yet storage seems to be slowing down. This may end up being the same direction I go when it gets time to upgrade.
as a non sponsor. i literally bought new seagates then every since the 2x 14tb drives every month. had one bad one they sent in like 6 hrs shit was lazer fast for a replacement
Had to rplace a bunch of Fans the other day 80 and 120 mm. I went with Arctic and I have to agree prettyy damn ice fans and for that price they are a total no brainer.
Only issue with buying 1 NAS that big is I would need 2 of similar size. lol. Can't have everything in 1 spot. I currently have a Buffalo Terastation 32 TB. I built a TrueNAS with 6x 4TB for about 20 TB space. (~17 TB). I have 2 other servers ready to go, just have to populate them with HDD's.
You should keep us updated, sort of like making a intranet of you and your friends. You people who want to preserve what has been in an accurate way should be applauded The ptb want to wipe out the past and redo it all, and that means rewriting history totally.
They don't need to wipe anything for that, look att wiki, within minutes they can have the document rewritten, all without the very noticeable act of removing said info first.
The storage amount alone already screams enterprise grade storage you don't see that large storage of an HDD floating around in the used market very often even more so if its SSD its even rare to get any enterprise grade SSD on used market for cheap
I'm a complete noob at this stuff but this is a direction I'm trying to build towards. I don't think it's realistic for every household to have their own cloud infrastructure but I also don't like big tech holding everything. What I want to see is more community level cloud infrastructure where someone like me can spearhead setting things up and making cloud infrastructure available to my friends and family where the circle of trust is much smaller. But this goal seems quite challenging because you do need things highly-available-enough that people don't get frustrated and jump ship, but also on a manageable scale for basically a roided out home lab.
Thanks for the video. What I am trying to find out is size of a format shift tv show from DVD. TV show 1 hour long 1080p 24fps plus good 5.1 audio, how big is this 1 hour show. With the info then can find out how big a storage system I would need. With the 15 x 22 tb drives and just storing movies and tv how many hours could you store on that system with a 2 drive redundancy, using this would just build a second as a back up.
So, I just tried using tailscale which you are pushing quite a lot on this channel, I found that it's inferior to zerotier: - You cannot join many tailnets at the same time - You cannot create many tailnets under one account - You cannot automate things as far as I could tell, the joining device gives you a link you have to open in a browser... and then it's bound to the "global account" network - If you were to host your own controller you have to fiddle with "coordination server" address - The coordination server has to be reachable over the open internet - The coordination server needs to be online at all times, in zerotier it's only needed for adding/banning peers in a network and for changing configuration - The flow rules in zertotier look a bit more sane as far as I can tell
It's worth noting that TS and ZT have somewhat different philosophies on how to architect an overlay network which results in some intrinsic advantages and disadvantages depending on workload. Tailscale's big thing is zero configuration on the client, you can't automate it but you can scan that QR code for grandmother and that's literally the entire configuration to get her system on your Tailnet. There's also some methods to make links between Tailnets including sharing a client from one Tailnet to another using the coordination server, and you can use ACLs to separate resources within a Tailnet even though you only get one Tailnet. Calling it inferior is a bit unfair, it's just making different tradeoffs that mean that ZeroTier fits your use case better
@bosstowndynamics5488 but zerotier is also completely zero configuration, you just give someone the ID of a network you want them to join and ln your account just click authorize when that client shows up as wanting to join the network. There are also "public" networks where any client can join without auth. ACLs in tailscale are overly complicated if you just want to separate your VPS from friends gaming PCs. Simpler is better if you care about security at all. Also to show that tailscale really needs more configuration - my network controller can be behind two NATs and a firewall on zerotier - and when someone wants to join my network on that controller I still just give them the ID of that network. On a tailscale like I said - it needs to have at least a public IP. I just completely don't get it, how can you recommend tailscale over zerotier. I guess their management panel is a little bit dumbed down and thus won't scare the non-technical users?
I'm definetely going to use that webpage with your code. Do you know how to contact them to handle tax free locations? I was setting the cart but they are trying to charge me tax.
they have a whole series on "forbidden routers" lol .. in my small apartment I am running a 5 bay drive, a mini pc and an 8 port switch with 3 vlans and it is a really slick compact setup.
it’s just that overseas air shipping something like individual mechanical HDDs is something I try to avoid. I doubt those will get handled like ASML machines with their specialized shipping and cargo plane.
I made a plex (plus) server running unraid. 4 (were new 8tb reds), 4 server part deals 20tb recerts (they could only be 18ish months old at the time). Now I feel like it's too small.
Thank you serverpartdeals.com for sponsoring this video
Check them out here: serverpartdeals.com/L1T
discount code level1techs ftw :D
@@wendelltron Nice!
Nice 😂
Not worth it in my country. Why would I pay more for a second hand HGST or Exos drive that's louder and hotter than a brand new WD Red Plus?
@@wendelltron Is the discount meant to be $5 USD only? It seems like it is mistakenly $5 USD off instead of 5% off.
Ahhh the data hoarder. Caught in the wild. Watch as he backs up his art on the fridge from the first grade and then replicates it 3x because a mirror is not a backup. I’m pretty sure Wendell has that tattooed on his body somewhere!!! I love this shit btw
Wendel has a back tattoo of Sinbad as Shazam... he's from the original time line.
He must be attempting to preserve it's knowledge here in the darkest time line.
Tattooed in multiple places on his body (and several offsite) for redundancy.
“we live in a society that perhaps is on the border of something bad happening” never have a heard a more accurate statement
Wendell: "This is my ten year system."
(And six months from now, he'll create another "ten year" system. 😂)
5:36 It's the Wendell from the old days!
Hah once I saw this I immediately had flashbacks lol
lol that's a deep reference, nice
only the OG's know
They couldn't afford to animate the lip sync back then so he had to be behind something.
I bought 5x 12TB Seagate Exos Recertified, from them. I live in Canada, so, at the border it got hit with duties. But even with shipping AND duties AND currency conversion it was still cheaper than buying a new (or 5 new) drives.
And yes, their shipping is freaking INCREDIBLE!
Thanks for letting us know! 🇨🇦
@@shazzz_land Linux isos
5:34
Wendell doing his best Home Improvement Wilson cosplay.
I'm really glad that I watched until the end! When I saw the 45 drives HL15, I had the same thought to setup a tailscale mesh or ceph cluster between friends.... So please make that video! I think the goal should be to replace "crucial" but exploitative services with community services from within our peer group.
I just ordered from these guys a couple months ago, great customer service. Learned about them from some dude on reddit. They got the drives out right after the hurricane too.
All my NAS drives (16x 12tb) are retired WD/HGST drives from serverpartdeals and other similar places. Never had any issues. Coincidentally I am now using an external HBA inside of a MS-01 connected to a Super Micro JBOD. It's been great!
At my job we're probably moving offices & will need a lot more space for the NVR/Camera storage. Since we're always going to have access to the system, I'm running TrueNAS for storage & I'm a huge fan of RAID-Z3 I recommended using recertified drives. If you lose data with RAID-Z3 you either neglected the array for a decent amount of time or there was a disaster on-site. Get 2+ extra drives as well - one for a warm replacement & one for a cold replacement plus monitor report emails and the system will be set.
I have a bunch of drives from SPD (14TB Exos) and they have been great. They have the best packaging, everything is really well protected.
The biggest issues I've run into out of SPD has been a batch of Exos X16 16TB drives. Started with 10 drives, 2 DOA, replaced 4 more within the 2 year warranty, including one that was an RMA drive already. I blame that on that series of drives though. My X18 drives and WD DC5xx drives have had zero failures. I'll go back to them again next time I need to upgrade.
I did bough 12pcs X16 16TB drives and 8 of these failed in a month. Rest during next 6 months. Approved few replacement drives from different batch but also these failed. To be honest I did drive full scans on all and many failed during that. Not during operation but first ones. So please always tress test recert drives before trusting these.
I bought a couple used Supermicro 36 bay and 72 bay chassis with SAS2/3 backplanes and redundant 1.2KW PSUs. They have been great! Reasonably low noise once I replaced the stock 80/92mm fans with 3 x Noctua 140mm fans.
I've been a customer of SPD for years. My "shucked" 8TB drives got replaced with 16TB Exos drives from SPD over the course of a few years, and recently I bought 8 20TB Exos drives from them; most of those are going into a backup server that will be hosted at a friend's house. (Local access to 70+ TB of Plex material is a good incentive...)
That's where I bought my 23 TB drives from. WORKS AMAZING! Was able to consolidate all my 23 drives of data from all the way back to 2003 on up to 2024. AND I STILL HAD SPACE LEFT!
And this point, its saving up for a tape drive so I can get all my data backed up to cold storage for the long haul.
But with how CHEAP these drives are? I can buy spares, and just make multiple copies and not worry to much about it as the O.G. tapes last for quite a bit since they are almost all data grade.
Datahoarding is a mental health problem.
@@prashanthb6521 this is disinfo. data hoarders, continue with the preservation efforts since corporations actively destroy old things.
Datahoarding must be investigated by medical professionals.
Don’t forget to make an offsite backup of your tapes, a safe deposit box at your bank may be a good location to store a tape or two.
@@Fractal_32 Russia and Japan are my off site backups.
Heard the NSA may have a copy too. .
The stuff I really care about is my old family videos and times in the Military of people long gone & digital backups of film / Photos.
Of course the best memories are the ones you never filmed or documented.
Sappy, sure... But its the truth.
I'm just glad I saved so much media that has disintegrated over time like old VHS tapes.
To bad I can't digitally store my Pee wee or Ernest talking dolls.
Hopefully, they make it into the hands of a real collector one day.
Have a HAPPY thanksgiving!
Amazing, love your videos and the way you show the home labber stuff that only professionals in the computer industry can know.
Cheers, most of us cannot afford these things, but its great to see where these techs are going.
Wendell is now also Johnny Mnemonic. Loved the "Don't call me Shirley" bit (RIP Jim Abrahams)
ooooh pls keep us updated on the offsite mesh zfs setup. looks very interesting!
Perfect timing. My old pfsense box just died and i have been running pfsemse on proxmox as a stop gap.
I would like to see a video exploring how to get the most 4kQD1 performance in a VM without passing through optane. virtio scsi or virtio-fs.
Maybe more details on how you run your workstation with your p5800x passed through, how do you handle backps from the p4800x
just bought some drives from them today and this video shows up in my feed, awesome!
Hey Wendell, we use Docker in LXC all the time, mostly to avoid having Docker containers directly on host, mainly to be able to backup or move the whole environment if needed.
Just ran out of space on my TruNAS server- you just saved me a ton of $$$ Thanks!!
Right there with you on the “powers for evil”! I have a decomm’d 2020 45Drives Stornado (32x 2.5” SSDs) upgraded to AMD Epyc 7713. Still wrapping my brain around what I can do with this monster.
Holy, that Icedock is something else.
We fit this setup (same motherboard, 128-core AMD, redundant PSU, 100G NIC, and 14x 30.72TB NVME 2.5" SSDs) into a rugged carry-on case for a govt program. Great to see someone else doing a crazy build just like it!
I can remember when VCR came out and I had to program my parents VCR for them as it was too Complicated" for them 🤣
Happy to host your off shore back solution in the future, of course I will need to watch all dvds to ensure integrity
A big online retailer in my country sells these recertified drives in the 16TB size. Both exos and ironwolf.
Have a few of the 16TB exos in my home server and they seem to be doing fine!
The same can't be said for the ironwolfs though though. We installed 8 of them to a new nas at work. One was completely doa, and within a day or two another one failed with a large amount of bad sectors. Then in a couple weeks another one failed. Within about half a year all but one of them failed in the same way, so we also returned the last working one when the second last one failed. Replaced them all with brand new exos drives, as my boss, rightfully so, wasn't feeling like taking a chance with recertified anymore. Luckily none of the drivers failed catastrophically and no data was lost due to us running raid-z2 and having backups.
The retailer also lists the return percentage of all products they sell, ironwolfs had something like 50% (yikes), and the exos has it under 2%, which is interesting as they are supposedly the same hardware as the exos drives, with a different firmware. Looks like they have since stopped selling the ironwolfs probably for that reason.
I just replaced my Fractal 140mm fans in my R6 with a 5 pack of Arctic's F12s. I mainly replaced them 140mm fans due to age and the bearings were making noise. So I cleaned out the PC from any dust intrusion, cleaned the filters, changed all the fans, and the nice part of Fractal's cases, the standardized fan board that uses standardized connectors. PC is nice and quiet again, and running cool again.
You could have oiled the fans and saved some money.
We have loot od IT in Poland and now we have loot of cheap 12 TB drives on local allegro and it makes me exited ;)
Thank you Wendell for the heads up on Server Part Deals. i have an old Synology DS1515+ NAS lying around that I could reuse with some serious storage. Have been using a Win 11 box with storage spaces as off site at my studio and a Synology DS1621+ as a replacement for the DS1515+ at home.
Hmm time to think where I could deploy the old DS1515+ it irks me leaving it sat doing nothing.
The 15+ generation has the atom c2000 CPUs that are known to detonate fyi
@@empedance1933 They can be fixed by soldiering a pull-up resistor.
Dammit Wendell. You let the secret out. How are we gonna find cheap drives in stock now?? 😅
That's interesting, I also have docker running in LXC containers in proxmox, but never had it restart. But there is not a lot of communication between the host and the docker container, as the storage and nfs mounts are just passed through to the LXC. Most communication happens inside docker or between LXC containers.
"it's a crime against entropy" XD XD
Well shit Wendell.... I follow so many channels I'm always a month or so behind so I'm just getting to your video. The other day I went to buy a drive from my fave vendor and found that prices had shot up and wondered WHY. Well, I guess I know - you told everyone the secret!
I've had a bad sector or two from drives from these guys occasionally but never a bad drive. Their prices had always been damn good too lol. Seagate has proven to be faster than WD in my experience, I run those EXOS w/unRAID. Damn good stuff!
I have to second the comment about the arctic fans. Pro tip: buy the 5 packs of them, even if you only need a few, they're way cheaper per unit that way and you will find a use for the extras in the long run
Solidigm sees Wendell fooling about with 15 HDD's goes to shipping and sends out 15 of their new 122TB SSD's...
phison under pascari brand has them out too 122,88TB capacity, no price available though yet, samsung and kioxia should start mass production of 4xx layered nand flash any time now, hope flash beats hdd in price vs capacity very soon and large capacities become available for mere mortals
I recently bought a stack of 12tb enterprise sata drives for $75 each with a 5 year warranty and I couldn't be happier with the decision. A drive failed after a little over 6 months and they replaced it very quickly. You're probably building some sort of raid anyway so just keep a cold spare ready and you're good to go.
honestly. just have a solid cache setup and it will help lengthen the refurbed drives lifespan
Thanks for the link and the content you madman.
I thought I was a mad lad planning out my Hakoforge mini + Epyc Seina future NAS setup then Wendell reminds me I'm a shrimp in a very vast ocean. I've been buying drives from server part deals and water panther for a good number of years now and have been happy enough with both of them that for my home stuff I just buy a few extra drives and save money.
I'm not following the ZFS VDEV layout @ 15:00. At 15:10 Wendell says "four RAIDZ1 VDEVs". That would only utilize 12 of the fifteen disks, leaving three unutilized/spare? Then at 15:20 he says "Four drives...three drives of capacity RAIDZ1...and then you have a hot spare." This sounds like it's four disks per VDEV with one hot spare each? Then at 15:50 he says "With four VDEVs the performance is really good. You're giving up four plus one drives worth of capacity."
I'm not sure if something was lost in the edit here, but instructions unclear. Now fork is in my VDEV, and my AI DeVito has broken free from his pen.
I may have shoved disk #16 in the back :D
@@Level1Techs lmao outside the lines...NICE I dig it
@@Level1Techs Four 4-drive VDEVs would be 16 drives plus (at least) one hot-spare puts you up to (at least) 17 drives. Made me scratch my head, too. 17 drives in a 15-bay chassis?! 😂
Wendell jank is the best jank :D Love the content!!!
Around 16:10 Wendell talks about ZFS configurations. Using raidz1 for performance if you’re doing VMs/NVR stuff. Are there any videos or forum links to go into this topic? I have my NAS on raidz2 and my NVR and a few VMs do use it for storage but I never noticed any performance issues but I am new to this.
iirc Allen Jude and friends say draid should start ~24-36 drives.
Would love to hear how loud this turned out while running. I was considering the HL15 with 28 TB drives to replace my Storinator with 10 TB drives but it's really only worth it to me if I can cut down on the noise. As you mentioned with the Arctic fans, I replaced all my stock Storinator fans with Noctuas but the triple PSUs are just so darn loud.
@8:45 what you saying is ,This is the REFIT ,Kinda like how the starship enterprise was refitted in The Motion Picture.
I've bought WD since '94. Not a single failure. (3 external cages failed, no drives.) Two years ago tried an EXOS 10TB. Dead in 8 months... (I know, not statistically significant...)
@5:50 Wendell does his best Wilson impression.
I ran the same thing with my machine randomly rebooting with docker in an lxc container! I also ran into data corruption bugs! Please dive into this!
Bought multiple drives from server part deals, zero issues. Bout to throw 8 recertified drives from them in a nas. Kinda dumb to buy new nas drives at those steep discounts. Also, the hard drives are protected in the box very well, even better than the manufacturers. I bought a 2.5 drive directly from western digital, they put it in a static bag, and a bubble envelope to ship. I was surprised it worked when I installed it. Crazy shit.
Can you clarify the layout ?
15 drives (10 for storage + 5 for redundancy)
4 vdevs in raidz1
4 (3 + 1) - vdev1
4 (3 + 1) - vdev2
4 (3 + 1) - vdev3
2 (1 + 1) - vdev4
1 - spare
Great video. Thanks for you wonderful content as always. :)
I thought I was the only one plugging his fiber ONT directly into a dedicated vlan on his switch to enable router redundancy :D - it's a neat trick. though, given all of the other basic components in your setup have redundancy, i'm a little surprised you don't have 2 10g switches set up with mlag (and one isp on each switch given it's unlikely that you can set up a lag on your ont/cable modem).
I have a lot of projects and assets, and I have already half filled my 16TB NAS, and assets only keep getting bigger, yet storage seems to be slowing down. This may end up being the same direction I go when it gets time to upgrade.
Wow, MythTV. Forgot about that one. Great piece of software.
as a non sponsor. i literally bought new seagates then every since the 2x 14tb drives every month. had one bad one they sent in like 6 hrs shit was lazer fast for a replacement
I too am working on something awesome for all of us but for right now its just for me . Nice
When do we get the tape backup added to this backup scheme?
Seeing the old set already has me feeling nostalgic…
20TB Seagate Exos drives are the best for seagate refurbs. Second only to shucking 20TB WD Drives
Had to rplace a bunch of Fans the other day 80 and 120 mm. I went with Arctic and I have to agree prettyy damn ice fans and for that price they are a total no brainer.
i JUUUUST yesterday rebult my main ns with 12TB drives but ill only ever use wd or hgst...i got hgst hellium SATA drives used and theyre AWESOME!
Wendell is my favorite mad scientist
I love the intro music.
Only issue with buying 1 NAS that big is I would need 2 of similar size. lol. Can't have everything in 1 spot. I currently have a Buffalo Terastation 32 TB. I built a TrueNAS with 6x 4TB for about 20 TB space. (~17 TB). I have 2 other servers ready to go, just have to populate them with HDD's.
Yee love your Dual 6' Displays aye?! You should have said so during the Studio clean up/re-arrangement :P
I've been using re-certified 16TB Exos in my Synology for awhile now. No real complaints with them or SPD.
You should keep us updated, sort of like making a intranet of you and your friends.
You people who want to preserve what has been in an accurate way should be applauded
The ptb want to wipe out the past and redo it all, and that means rewriting history totally.
They don't need to wipe anything for that, look att wiki, within minutes they can have the document rewritten, all without the very noticeable act of removing said info first.
Their customer support is great. Got a dead drive replaced with no hassle
What cables did you buy to connect the motherboard to the backplane? Do you have a build thread, I didn’t see one on your forum?
Looks cool, but I would recommend they put the currency selector at the top of the page so it is obvious. Took me a while to find it.
The storage amount alone already screams enterprise grade storage you don't see that large storage of an HDD floating around in the used market very often even more so if its SSD its even rare to get any enterprise grade SSD on used market for cheap
I also run Docker inside an LXC container on proxmox for the sole purpose of passing specific zfs datasets.
I checked out their site and most things were more expensive than new! Am I missing something??
I just checked out their site, 5 x 12Tb Helium drives shipped to AU for under $1000 AU. WOW!!!!!!!!!!!
do seagates still suck with failure rates?
I'm a complete noob at this stuff but this is a direction I'm trying to build towards. I don't think it's realistic for every household to have their own cloud infrastructure but I also don't like big tech holding everything. What I want to see is more community level cloud infrastructure where someone like me can spearhead setting things up and making cloud infrastructure available to my friends and family where the circle of trust is much smaller. But this goal seems quite challenging because you do need things highly-available-enough that people don't get frustrated and jump ship, but also on a manageable scale for basically a roided out home lab.
@The1Elcil that's a subject I'm actually not a noob in. So yes..
A couple drives in an old computer also works, you don’t need expensive/high end hardware to run your own storage “server.”
@@Fractal_32 that's what I do. But I'd like to be able to have more resiliency to hardware failures. For availability, not integrity.
Thanks for the video.
What I am trying to find out is size of a format shift tv show from DVD. TV show 1 hour long 1080p 24fps plus good 5.1 audio, how big is this 1 hour show. With the info then can find out how big a storage system I would need. With the 15 x 22 tb drives and just storing movies and tv how many hours could you store on that system with a 2 drive redundancy, using this would just build a second as a back up.
So, I just tried using tailscale which you are pushing quite a lot on this channel, I found that it's inferior to zerotier:
- You cannot join many tailnets at the same time
- You cannot create many tailnets under one account
- You cannot automate things as far as I could tell, the joining device gives you a link you have to open in a browser... and then it's bound to the "global account" network
- If you were to host your own controller you have to fiddle with "coordination server" address
- The coordination server has to be reachable over the open internet
- The coordination server needs to be online at all times, in zerotier it's only needed for adding/banning peers in a network and for changing configuration
- The flow rules in zertotier look a bit more sane as far as I can tell
It's worth noting that TS and ZT have somewhat different philosophies on how to architect an overlay network which results in some intrinsic advantages and disadvantages depending on workload. Tailscale's big thing is zero configuration on the client, you can't automate it but you can scan that QR code for grandmother and that's literally the entire configuration to get her system on your Tailnet. There's also some methods to make links between Tailnets including sharing a client from one Tailnet to another using the coordination server, and you can use ACLs to separate resources within a Tailnet even though you only get one Tailnet. Calling it inferior is a bit unfair, it's just making different tradeoffs that mean that ZeroTier fits your use case better
@bosstowndynamics5488 but zerotier is also completely zero configuration, you just give someone the ID of a network you want them to join and ln your account just click authorize when that client shows up as wanting to join the network. There are also "public" networks where any client can join without auth.
ACLs in tailscale are overly complicated if you just want to separate your VPS from friends gaming PCs. Simpler is better if you care about security at all.
Also to show that tailscale really needs more configuration - my network controller can be behind two NATs and a firewall on zerotier - and when someone wants to join my network on that controller I still just give them the ID of that network. On a tailscale like I said - it needs to have at least a public IP.
I just completely don't get it, how can you recommend tailscale over zerotier.
I guess their management panel is a little bit dumbed down and thus won't scare the non-technical users?
What? That ICYDock was listed as a concept until recently.
Is this really purchasable now? SUATMM
Such a cool video dude.
I'm definetely going to use that webpage with your code.
Do you know how to contact them to handle tax free locations? I was setting the cart but they are trying to charge me tax.
20:09 my mind is blown by using VLANS to connect router virtual machines to the ISP modems.
they have a whole series on "forbidden routers" lol .. in my small apartment I am running a 5 bay drive, a mini pc and an 8 port switch with 3 vlans and it is a really slick compact setup.
I've been wanting to get some big drives and I don't make too much money. I might want to grab a few, would it be okay to get cold spares too?
They didn't give you a code for us?
What do you put on that drives? Insane video collection?
"We live in a society where something bad may be about to happen. So anyway, bubble wrap and foam."
Is there a comparable trustworthy seller like Serverpartdeals in Europe?
SPD ship to Europe and they have a DDP option, so you don't have to worry about customs.
They appear to have an ebay store. Seem to be the same company from what I can tell.
it’s just that overseas air shipping something like individual mechanical HDDs is something I try to avoid. I doubt those will get handled like ASML machines with their specialized shipping and cargo plane.
@@abavariannormiepleb9470 The packaging's pretty solid! The couple I've ordered from them so far have been solid here in the UK :)
I run docker in an LXC so it can use my GPU without passing the whole card through to it.
And for a moment I thought it was for "Certifiably Ingame" channel" :)
🤔 interesting, thanks Wendell
How often do you defrag such a system? Downtime?
How long will it take to rebuild after replacing one of 22tb drives?
Are you using ZFS through proxmox? Or passing through the drives to a TrueNAS VM or something?
I made a plex (plus) server running unraid. 4 (were new 8tb reds), 4 server part deals 20tb recerts (they could only be 18ish months old at the time). Now I feel like it's too small.
这视频创意十足，真是让我刮目相看！
Thank you for this vid
Wouldnt mdraid at raid10 run far faster ? ZFS is quite the overhead on NVMe IO rates
what do you to burn in the new large drives 12 tb or bigger? badblocks doesnt seem to work anymore