What ever happened to that tech i saw back in the 90's, where they used lasers to store data inside carbon crystals? We need some of that super dense carbon diamond data storage for you Linus.
I got a great laugh out of that one, because the pair of 500 meggers I mention in my last comment were Samsung drives and they may still be working today in a system I upgraded for someone else, so I could move onward and upward.
@@joshyc2006 Yes, all your friends magically turn into pussies whose wives run their lives. It's like a disease. Like, are you that much of a pussy that you're going to let your wife tell you what you can and can not do, or what you can buy. They're usually so happy that a girl let them stick their tiny donger in her, that they just shut their mouths.
@@joshyc2006 It started happening to me when I got into highschool a year ago, I realized how much time I was spending on homework and not spending time with family and friends, and me realizing after 12th grade I go into the Navy for 6 years.
There are cases where inert gas fire suppression systems caused large amounts of hard drives to fail. The sound of the very high pressure gas coming from the nozzles was enough to wreak havoc over a data center of the ING Bank for example. Here is an example of someone shouting at disks: ruclips.net/video/tDacjrSCeq4/видео.html Here is a longer article from a data recovery company: www.ontrack.com/blog/2017/01/10/loud-noise-data-loss/
By the way, if disks aren't running, the heads are in parking position (removed from the platters). They are fairly resilient to vibration and shocks in that state, so banging on the table is relatively harmless. But rattling them over a parking lot in a shopping cart is something else. I can imagine that this can move the heads from the parking position to the non-moving platters. If this happens, the heads will almost immediately stick to the platters. The spindle motor isn't able to start and if some unqualified person opens the disks and forcefully moves the spindle or tries to lift the heads from the platters, it is very likely that the heads get ripped off. If a disk doesn't spin up after being dropped or exposed to excessive vibrations, the 2nd best thing to do is bringing the disk to a reputable data recovery company. (The best thing is having backups, and as the data center inert gas fire suppression incident shows, it is also good to have off-site backups;))
He really isn't, or that storage array would have been set up correctly and not set up like a home user having a go. In the land of the blind, the one eyed man is king.
@@FirstnameLastName-mr8lk Ooof, had to delete my previous reply because I wasn't thinking straight lol, but the reason this confused me was because on my screen, the . is on the line above the zeroes, making it very hard to notice
By BackBlaze standards, 180B wouldn't even be a bandaid. I'm pretty sure that's less than their DAILY deployment in recent times, given they passed the EXABYTE (1000 Petabytes) mark earlier this year.
Linus Tech Tips - helpful hint #1... if you are putting the drives back in the same spot, don't put them on a cart and move them, leave the cart next to the rack and just move the empty case to your work bench...
Legend has it Seagate are named Seagate, because the sea is blue like the blue screen, and gate because it's their controversy for having such terrible drives.
there is an 80mb Seagate in an ms-dos pc-xt clone I built in 88 and both the computer and drive are still working today. all Seagate drives aren't bad. nobody makes a 100% reliable hard drive, NOBODY.
nah let me try and convert it down first that way I can still keep it let me see if I can find some other stuff to delete as well. 53 hours and 13 drives later 3.5 gigs freed fuk it just gonna buy a new wd external
Anthony genuinely seems like a nice guy who just loves what he does and to share his knowledge. Get him more screen time! Give him his own segment that dives deep on Linux. I would love to learn from him.
Second that. Also, RUclips Algorithm is failing me here, so hivemind, please tell me what channels I should subscribe to if I like this kind of content. Level1Linux posts too rarely to satiate the craving :(
To be fair, Linus has incentive to archive old video footage seeing as his business revolves heavily around media production. It isn't the same as some random person who fills up their harddrive.
@TomGreen 99 Your type of thinking led to there being forever lost early episodes of the show Doctor Who. Some idiot at the BBC decided to erase a bunch of the masters, with there being no backups.
"Ridge" is a fake brand! They're a middle man! All their wallets are on ali express! *I got one for $2!* They pay RUclipsrs to advertise for them and it's apperently very successful. I would be jealous but I don't like scamming people.
they need each other...will anthony success without LTT in vlog? maybe...will Linus success without anthony? also maybe. But combine both of them what make LTT store..Linus full of energy and entertaining to watch. While anthony knowledge and technician skill is better...and not to mention those other guys in LTT. Without them for sure LTT will feel less entertaining. Yes other tech youtube channel maybe has better tech content but sometimes is not entertaining to watch, people get bored..its just the same if you go to into classroom with your professor. most people will get bored if their professor is not entertaining and only teaching..while professor with jokes and some entertaining skill make the class lively and student more interest to learning.
There was no need to re-insert drives in the same slots. ZFS will automatically take care of swaps for you as each drive is internally labelled with a UUID. You can mix and match drives in any slots and let ZFS sort it out for you.
@@cptmorgan92 Yep, I think that is why they were labeled in sharpie. The system may not care which drive is connected where, but people do. (Yes, I am quite aware of at least basic ZFS capabilities, had the same pool on my desktop for 3 motherboard changes, 4 OS changes, and at least 5 drive deaths in a 2 disk mirrored vdev). Now just don't get the carriers mixed up, and all is fine ;)
I normally don't comment on youtube videos, but this video hurt me so much that I HAD to. 1) When configuring a ZFS Raid you add devices through their unique identifier (so not through sdx) so that you don't have to label your disks and put them in "the right order". 2) You have a gluster system and you take all the positive aspects of it and throw it out the window, because you use zfs for so many parts of it. If you have that much storage that you need multiple servers and you already use gluster then you should use it for the erasure coding (or RAID as you would call it) as well. Distributed Dispersed would be what you would want. 3) Normally I would recommend a ceph solution for storage clusters of your size and tell you to use multiple smaller servers instead of your setup that has so many failure points, but you now have the setup you got and ceph would be probably too much for you to handle anyway. 4) The many small Servers instead of 2 big ones concept applies to gluster as well and you wouldn't have the downtimes you got if you would use that system. It's easier to maintain, easier to scale and could even be cheaper (but hey we all know you like overkill) 5) If you read till here thank you and now the last tidbit of information: If you would use gluster like it was intended, you could also add your other storage systems (for instance your local steam cache) and _add_ it to the cluster. Than you wouldn't have run out of storage at all! Just add one volume without any replication or erasure coding for the steam cache and one with erasure coding for your editors. BOOM! More space for free! Edit: updated formatting
You saved me writing my comment, so even if no-one else does, i appreciate your comment. Also, i'm a SAN guy, if i saw a setup like that, i'd walk away. There really needs to be someone trained in maintaining and setting up this equipment on site and from the video is was clearly apparent that there isn't. Love LTT and the videos that are pretty much untrained people making the videos, thats the fun, but when it comes to a server room and networking, id definitely suggest getting someone in who knows how to do it properly as that setup is a mess, clearly very inefficiently setup and not maintained correctly. Not knocking LTT here as I love the channel and have been a big fan for a long time, but if youre going to do something that fits a standard, surely it should be done correctly?
This is not a standard build. Anthony said something about "their driver," which suggests that there is some 45-drives magic going on under the hood. I'm sure you noticed they had to maintain a disk-to-slot mapping, and I would speculate that the OEM software does that mapping under the hood, presenting specific slots the way we saw here. I mean, sure they might just be doing it wrong, but it seems unlikely that they'd get to this point in that system's lifecycle without both knowing and mentioning this particular best practice for ZFS. The best part of Gluster is when you can retire it. A broken Gluster setup is a nightmare, and it's prone to breaking IME. I would never use it for this much data and for such trivial reasons-they just want to present multiple servers as a single share.
@@andrewbobulsky3505 Theres not really such a thing as a standard build in SAN architecture, more standard practices, of which, not many were followed. Im not personally looking for an argument btw, I have worked in this industry for a lot of years and im just saying what I see, but i can assure you that anyone in the SAN industry that ive sent this video to have all said the same thing, someone more technical in this field needs to be there. Anthony is great and I think he does some fantastic videos, but I think the "hacking" sort of field seems to suit him and Id have said the commercial IT field would be better left to someone who has worked in this field. Absolutely not a dig at Anthony however, we all have our specialist field within IT, his hacking (the real meaning of hacking, not the script kiddie kind) ability is clearly excellent and very informative.
I mean... in RED's uncompressed raw format at ~5 GB per second, this 15-minute video would be a whopping 4.7 TB. One petabyte would hold about 58 hours of raw footage. (You'd be insane to store everything in raw, but I wouldn't put it past them.)
@Guitar Absolutely nobody has ever forgotten that, and Linus needs Anthony because nobody knows everything. Quit being a stiff and just let people have a laugh.
@@charlesgray6385 Just about all answers are on the internet! If you don't trust regular IT-stuff, then you can even resort to PhD - research and publicly published papers!
Well, the next logical step is an exabyte. That ought to last him a while. Using the 100 TB SSD ExaDrives from NIMBUS, he ought to be able to pack in 100 PB per rack, and I'm sure he can find enough room somewhere in his building to handle 10 racks. Mind, it will be interesting to see how he raises the money to purchase all those drives...
@@meemo4556 Considering that the retail cost of 10,000 ExaDrives (100 TB each) would be about $500 million dollars, I wouldn't expect him to pay full price. But I also wouldn't expect NIMBUS data to give him that many drives free either. And if instead of those 100 TB SSD drives, he goes to something spinning, the number of required drives goes from 10,000 to over 62,500. But Linus wouldn't possibly use that much storage. It's inconceivable.
"I hope it wasn't Samsung" LMAO, that little piece of editing and commentary is why I don't just find these videos interesting, but actually really really funny and entertaining
Linus Sebastian, building an empire from donated cutting edge hardware. LTT: "We need hard drives for a cool project" Seagate: "Got you covered, please make it great" LTT: "That project is dead, let's use the free stuff for our server" Love you guys
See, THIS is the kinda crap I wanna be watching on LTT! I really enjoy them systematically going through each problem logically and trying to troubleshoot with their server/networking jargon. Honestly really enjoyable, and I learn a thing or two each time I watch.....
@Donald Duck ... thats the point 50 tera bytes is fuck all for them but its alot to the average person. You just want to argue to seem smart good for you
You know, everyone says to back up your computer, but I don't remember anyone ever saying, "Back up your phone," despite how many people are super-attached to their phone in the modern era.
They not only need proper RGB for disco lighting, they also need to come with a decent 20KW amp on board so you can get that server-room party really started. Oh, wait... maybe we shouldn't give them any more stoopid ideas.
I work for a Data Centre company here in Canada. Depending on the rack, you can actually get proper HEPA filter inserts for the doors or door replacements with the screen built in. That rack looks like is designed for a DC which is great, but means its meant for a clean space. May also wish to consider some form of containment for hot air on the back side, just a simple insulated curtain to separate intake from exhaust and have an exhaust and intake dedicated for front vs rear. Takes very little time, but lowers your cost and increases efficiency of the servers. Since well... helps with cooling so its not eating its own exhaust. We use a vinyl curtain system here, but keep in mind your temps and needs as the vinyl can have issues if temps are too high for prolonged periods of time. But really anything is better than nothing.
"How long did we tell the editors this was going to be?" Use the Scotty formula: think it will take 2 hours? Say 8. If you get it done in 2, you're a miracle worker. Massive overrun? You're on time.
1. Using AWS for backup storage 2. Using SSD based storage server 3. Using Harddisk based storage server 4. Storing all backup data on CDs 5. Storing all back up data on floppy drives 6. Storing all back up data on punch tape 7. Physically writing all data in 1s and 0s on paper.
Anthony is the the perfect sidekick or in this case the captain. He's cool, calm and collected and if anything it's that demeanor that helps them figure this whole thing out.
that depends on what cup size the girl in question has I have seen references of cup sizes up to the letter K and those look like they could not only feed a whole block of children, but hold multiple petabytes
2:37 "these two..." He's saying something confusing there, he doesn't literally mean those two actual drives are the parity, he means that out of 15 drives you lose about the space of two.
I would hope they are using 10. IPs.... That said, they may not be allowed to show console windows. Don't know much about Gluster, but if it's not open source it could be licensed in such a way that prevents them since they monetize their videos.
Linus in charge of moving and handling dozens of sensitive to vibration harddisks..... really!????? wow... that's mission impossible 7 right there guys.. definitely worth watching... 🤣🤣🤣
just a recommendation do not put red at the bottom of your video thumbnail, at first glance thought I already watched the video and almost skipped it.....
It’s caught my attention numerous times when thumbnails feature a red line at the bottom, honestly it may be a viable strategy to get people to notice your video. Not saying that is the reason the thumbnail is the way it is in this video
@Mike Mckay You are one nasty pseudo intellectual, and wrong, you were complaining and trying to deflect it with a bogus definition. Your type is just awful, insulting over simple things, but you're too busy trying to sound smart than to worry about that.
Linus: wtf we are out of storage
Hard disk manufactures: aww shit here we go again
Hard disk manufacturers hate him, here's why
@@thegremlin9876 reason number 4 will amaze you!
Hard disk prices: rise
Hard disk manufactures: stonks
What ever happened to that tech i saw back in the 90's, where they used lasers to store data inside carbon crystals? We need some of that super dense carbon diamond data storage for you Linus.
It's marketing, which is a small price to pay for tech you tuber with 9.1 million subscribers
LTT: our storage is full!
Seagate *Sweats in the distance*
Man i was laughing for a minute reading this!! :D
Samsung wants to make petabyte ramdisk...?
Sweats and then instantly fails - like a Seagate HDD.
It Just like YESTERDAY.. now its FULL what..
He paid for those HDDs. He said it in his RED camera Holy shit episode.
LTT in a nutshell: builds hardware to store footage of them building hardware to store footage...
and then stores the footage of that on that hardware
You just bugged my brain LUL
@Konzy and its really fun to watch dogs chasing their tails :D
just like the picture of the man painting a picture of himself looking into a mirror, etc, etc, ad nauseam.
BIG BRAIN ENERGY
Normal human: I’m out of storage again, I’ve only got 5GB
Linus: Only 20TB left? We need an upgrade right now
😅😅
Yeah but he campares it relatively to full capacity, 5/256 is small, but 20/1000 is also
Then you got phone user's in the corner like wow I have 10 mB left that's so much space
@@1nk_edd even for phones 10mb free space is basically nothing
@@baraapudding I was exaggerating the small file size of most phone apps
It was a joke
Entire internet: He’ll never fill a entire petabyte of storage.
Linus: Hold my LTT water bottle.
Me: *DROPS IT*
The amd tech bear sksksksk
Linus: Hold my sandals
It's all pictures of Linus in his underwear
And just think Library of congress is estimated to be 4 Petabytes
Still pumped that Anthony is getting tons of screen time, dude’s the man
Loving seeing him regularly
Benjamin Lamb when Linus finally retires it will be Anthony Tech Tips
Dude gets winded from breathing. Don’t want to see that shit.
someusername121 Nobody cares what you want to see or not
someusername121 lol. That’s my only gripe. Being fat sucks, lemme tell ya.
It's just a matter of time before LTT has its own cloud storage department
Isn't that what FloatPlane project is about?
@@IraQNid that's creating a RUclips alternative
'has it is own'
Linus Web Services
Anthony needs a raise. That dude has figured so much stuff out for LTT to keep it running in videos.
Yeah he should be promoted to co-ceo
@@T4ckyy nah i think linus should just retire and give him all the assets
@@yessir843 well yes but actually no shadow (linus's cat) should have it all
He needs enough $ to buy some shampoo and a haircut.
Anthony videos are boring as fuck, more scrapyard wars.
"I hope it wasn't Samsung"
Arrested development narrator: "It was."
Cue the curb your enthusiasm theme
brilliant
I got a great laugh out of that one, because the pair of 500 meggers I mention in my last comment were Samsung drives and they may still be working today in a system I upgraded for someone else, so I could move onward and upward.
HILLARIOUS
Crazy to think I watched the Petabyte Project 2 years ago, Time has really started to fly by.
In a few years it'll go by so fast you will literally be scared of blinking too often. :)
...late 20s is where it started like that for me, it's when your mates start having kids you start to see how fast a year really flies lol
@@joshyc2006 Yes, all your friends magically turn into pussies whose wives run their lives. It's like a disease. Like, are you that much of a pussy that you're going to let your wife tell you what you can and can not do, or what you can buy. They're usually so happy that a girl let them stick their tiny donger in her, that they just shut their mouths.
@@xenonram seek help my man, tidy your room
@@joshyc2006 It started happening to me when I got into highschool a year ago, I realized how much time I was spending on homework and not spending time with family and friends, and me realizing after 12th grade I go into the Navy for 6 years.
"The vibrations could kill the drives."
Proceeds to slap table multiple times
There are cases where inert gas fire suppression systems caused large amounts of hard drives to fail. The sound of the very high pressure gas coming from the nozzles was enough to wreak havoc over a data center of the ING Bank for example.
Here is an example of someone shouting at disks: ruclips.net/video/tDacjrSCeq4/видео.html
Here is a longer article from a data recovery company: www.ontrack.com/blog/2017/01/10/loud-noise-data-loss/
When the drives are free and filled with old crap you'll never use, who cares?
@@zvpunry1971 Here's another one. ~grin~ ruclips.net/video/1y8Rqvz-Jcg/видео.html
vicsrealms: thats what actually happens inside of the disks. ;)
By the way, if disks aren't running, the heads are in parking position (removed from the platters). They are fairly resilient to vibration and shocks in that state, so banging on the table is relatively harmless.
But rattling them over a parking lot in a shopping cart is something else. I can imagine that this can move the heads from the parking position to the non-moving platters. If this happens, the heads will almost immediately stick to the platters. The spindle motor isn't able to start and if some unqualified person opens the disks and forcefully moves the spindle or tries to lift the heads from the platters, it is very likely that the heads get ripped off. If a disk doesn't spin up after being dropped or exposed to excessive vibrations, the 2nd best thing to do is bringing the disk to a reputable data recovery company. (The best thing is having backups, and as the data center inert gas fire suppression incident shows, it is also good to have off-site backups;))
Anthony is the real final boss of LTT. The protector of power, the server master.
Without him the whole shop would be in dissaray
@taco bales that NVIDIA box throne
the destroyer of Macs
The Goat 😏
He really isn't, or that storage array would have been set up correctly and not set up like a home user having a go. In the land of the blind, the one eyed man is king.
Loved the bit @13:22 where Anthony unleashed .000000000012% of his computing power.
Balkan Bloodpaw Ultra Instinct Anthony is too powerful to be fully unleashed
@@WandererAtNight there is a decimal at the front why would their need to be a decimal between each 0?
@@WandererAtNight the number he said is 0.00000000012% so it isnt 12 percent
@@FirstnameLastName-mr8lk Ooof, had to delete my previous reply because I wasn't thinking straight lol, but the reason this confused me was because on my screen, the . is on the line above the zeroes, making it very hard to notice
Shaggy would be proud
The reason why other RUclipsrs got Jellyfish server is because Anthony works for LTT
LLT ?
LLT? LTT maybe? Perhaps LMG?
BLT?
CMOS?
@@cts006 BIOS?
When 180 TB is considered a "bandaid solution"
hehe
By BackBlaze standards, 180B wouldn't even be a bandaid.
I'm pretty sure that's less than their DAILY deployment in recent times, given they passed the EXABYTE (1000 Petabytes) mark earlier this year.
Gavin from Slo-Mo guys gets through 500TB a year...
*Me using 120GB Hard Disk*
I still have couple of gigs left..
*Linus*
Our PETABYTE of storage is full
*me with 250G NVMe SSD, 500 GB SATA SSD, 3 TB RAID 1 HDD pair with 1TB free space*
TB or not TB? I'll decide on Black Friday.
@@Aereto lol. It's not even half of my total
It is still over 50 000GB left on his servers
You: "Man I only have megabytes of storage left"
Linus: "We are down to our LAST TERABYTE, this is cutting it close!"
Im on location covering an event with my main machin with just 40GB left o.O"
Linus Tech Tips - helpful hint #1... if you are putting the drives back in the same spot, don't put them on a cart and move them, leave the cart next to the rack and just move the empty case to your work bench...
logic 101 :D
Now that you said it, there was really no point putting the drives on the cart and drive them around :D
@@MrTheTotto what's life without some risk on all your data
Linus - Only 20 terabyte available
Me worrying about the 70GB left on my 1 TB hard disk
I got a solution .. format your drive . 😂
Should’ve went with the 2 tb drive
I'm down to 7GB on 5TB don'r feel bad
I have 20 mb no joke
I have 300GB left on my 8TB drive, and lord knows how tighter my other terabyte drives are at
Now make one for The Slow Mo Guys so they can make videos for another month.
Jaxper Gav made a video about getting a 130TB Storinator for himself (from Linus ofc) and he filled it up in like a month
Yes, that's the joke.
"Seagate actually sent over these!"
1 month later: "We lost all our data AGAIN!"
Oh boy. 😂
Legend has it Seagate are named Seagate, because the sea is blue like the blue screen, and gate because it's their controversy for having such terrible drives.
@@infernaldaedra You got data to back that up other than memes?
there is an 80mb Seagate in an ms-dos pc-xt clone I built in 88 and both the computer and drive are still working today. all Seagate drives aren't bad. nobody makes a 100% reliable hard drive, NOBODY.
@@richardbenjamin8535 yeah but that box has like 500 hours power on time. :D
@LinusTechTips Guys, don't put a red bar on the bottom of the thumbnail. It looks like I've already watched the video and I might me missing it.
Was thinking the same thing.
Ikr it’s annoying
This, absolutely this.
lol, just commented the same thing
No wonder why I was like...was this auto-played? And I checked the date was like...wait. w/e. Thanks for fixing my brain.
Me: Only 20GB left on this drive, time to delete this 2GB movie.
Linus: We have only 20TB left, we're out of space.
On a phone, 1 gig is usually good to have for spare when using a phone
@@LightslicerGP *laughs in 128gb s10 storage
nah let me try and convert it down first that way I can still keep it let me see if I can find some other stuff to delete as well. 53 hours and 13 drives later 3.5 gigs freed fuk it just gonna buy a new wd external
Aaron Bell Laughs in 256GB.
@@ahnafhabib1890 laughs in 256gb+1tb
Anthony genuinely seems like a nice guy who just loves what he does and to share his knowledge. Get him more screen time! Give him his own segment that dives deep on Linux. I would love to learn from him.
I'm so happy. LMG Moving Vlog's and server upgrades are my favorite LTT videos
too
Yuup :D
Second that. Also, RUclips Algorithm is failing me here, so hivemind, please tell me what channels I should subscribe to if I like this kind of content. Level1Linux posts too rarely to satiate the craving :(
moving vlogs were 3 years ago.
too
*Everyone:* _running low on space, let's delete stuff_
*Linus:* _running low on space, let's make another RED video_
I was thinking they need some type of data management, but another video was better.
Difference between home use and business use
To be fair, Linus has incentive to archive old video footage seeing as his business revolves heavily around media production. It isn't the same as some random person who fills up their harddrive.
@@Fraggr92 bc ppl will be watching LTT like old seinfeld episodes in 20yrs?
@TomGreen 99 Your type of thinking led to there being forever lost early episodes of the show Doctor Who. Some idiot at the BBC decided to erase a bunch of the masters, with there being no backups.
Linus - “Ridge Wallet”
*Skips 20 seconds*
Linus - “Alright”
Lol
@Audiocronic what?
"Ridge" is a fake brand!
They're a middle man!
All their wallets are on ali express!
*I got one for $2!*
They pay RUclipsrs to advertise for them and it's apperently very successful.
I would be jealous but I don't like scamming people.
@@ChaosBW exactly
Meme Machine do you have a link to the AliExpress link?
Sometimes it feels like Anthony is the only reason LTT still exists into 2019.
oh probably. hes got a better voice than linus does and seems to know his way around more lol
Also r/pcmasterrace
they need each other...will anthony success without LTT in vlog? maybe...will Linus success without anthony? also maybe. But combine both of them what make LTT store..Linus full of energy and entertaining to watch. While anthony knowledge and technician skill is better...and not to mention those other guys in LTT. Without them for sure LTT will feel less entertaining. Yes other tech youtube channel maybe has better tech content but sometimes is not entertaining to watch, people get bored..its just the same if you go to into classroom with your professor. most people will get bored if their professor is not entertaining and only teaching..while professor with jokes and some entertaining skill make the class lively and student more interest to learning.
@@slyztercoreveanged3175 Let's hope it doesn't go the same way Tek Syndicate did :(
dont forget about 6 dedicated peoples for freaking editing alone.
There was no need to re-insert drives in the same slots. ZFS will automatically take care of swaps for you as each drive is internally labelled with a UUID. You can mix and match drives in any slots and let ZFS sort it out for you.
Nice to see technology has advanced.
Nice to read this comment and not understand a thing
Was thinking the same thing tbh, the system identifies and mounts drives to a point/array via the UUID not from a slot ID :|.
I’m not familiar with storage servers but this makes it hard to recognize and swap dead drives isn’t it?
@@cptmorgan92 Yep, I think that is why they were labeled in sharpie. The system may not care which drive is connected where, but people do. (Yes, I am quite aware of at least basic ZFS capabilities, had the same pool on my desktop for 3 motherboard changes, 4 OS changes, and at least 5 drive deaths in a 2 disk mirrored vdev). Now just don't get the carriers mixed up, and all is fine ;)
7:59
Anthony: I hope it wasn't Samsung
*Samsung has left the chat*
I was reading this comment right when i was on that
Can someone explain the Samsung pun? :)
EDIT: Oh, nvm :D
@@sdHansy smasung removed the headphone jack from their new note 10 and had it on the s10 so everyone is not amused
Anthony savage as usual
Samsung left the chat, my coffee left through my mouth and my nose.
I normally don't comment on youtube videos, but this video hurt me so much that I HAD to.
1)
When configuring a ZFS Raid you add devices through their unique identifier (so not through sdx) so that you don't have to label your disks and put them in "the right order".
2)
You have a gluster system and you take all the positive aspects of it and throw it out the window, because you use zfs for so many parts of it.
If you have that much storage that you need multiple servers and you already use gluster then you should use it for the erasure coding (or RAID as you would call it) as well.
Distributed Dispersed would be what you would want.
3)
Normally I would recommend a ceph solution for storage clusters of your size and tell you to use multiple smaller servers instead of your setup that has so many failure points,
but you now have the setup you got and ceph would be probably too much for you to handle anyway.
4)
The many small Servers instead of 2 big ones concept applies to gluster as well and you wouldn't have the downtimes you got if you would use that system.
It's easier to maintain, easier to scale and could even be cheaper (but hey we all know you like overkill)
5)
If you read till here thank you and now the last tidbit of information: If you would use gluster like it was intended,
you could also add your other storage systems (for instance your local steam cache) and _add_ it to the cluster.
Than you wouldn't have run out of storage at all!
Just add one volume without any replication or erasure coding for the steam cache and one with erasure coding for your editors. BOOM! More space for free!
Edit: updated formatting
You saved me writing my comment, so even if no-one else does, i appreciate your comment. Also, i'm a SAN guy, if i saw a setup like that, i'd walk away. There really needs to be someone trained in maintaining and setting up this equipment on site and from the video is was clearly apparent that there isn't. Love LTT and the videos that are pretty much untrained people making the videos, thats the fun, but when it comes to a server room and networking, id definitely suggest getting someone in who knows how to do it properly as that setup is a mess, clearly very inefficiently setup and not maintained correctly. Not knocking LTT here as I love the channel and have been a big fan for a long time, but if youre going to do something that fits a standard, surely it should be done correctly?
This is not a standard build. Anthony said something about "their driver," which suggests that there is some 45-drives magic going on under the hood. I'm sure you noticed they had to maintain a disk-to-slot mapping, and I would speculate that the OEM software does that mapping under the hood, presenting specific slots the way we saw here. I mean, sure they might just be doing it wrong, but it seems unlikely that they'd get to this point in that system's lifecycle without both knowing and mentioning this particular best practice for ZFS.
The best part of Gluster is when you can retire it. A broken Gluster setup is a nightmare, and it's prone to breaking IME. I would never use it for this much data and for such trivial reasons-they just want to present multiple servers as a single share.
@@andrewbobulsky3505 Theres not really such a thing as a standard build in SAN architecture, more standard practices, of which, not many were followed. Im not personally looking for an argument btw, I have worked in this industry for a lot of years and im just saying what I see, but i can assure you that anyone in the SAN industry that ive sent this video to have all said the same thing, someone more technical in this field needs to be there. Anthony is great and I think he does some fantastic videos, but I think the "hacking" sort of field seems to suit him and Id have said the commercial IT field would be better left to someone who has worked in this field. Absolutely not a dig at Anthony however, we all have our specialist field within IT, his hacking (the real meaning of hacking, not the script kiddie kind) ability is clearly excellent and very informative.
I'd love to know Anthony in real life. Dude seems like a genius and I love how he kept his cool during all that.
He is the chosen one. He will bring salvation to the LTT channel and bring forth a tsunami of likes and subs
The only one that could fill a petabyte of red 8k footage is Linus
no MKBHD can in like a week
@@HillelFriedler Can you say it in English?
@@ba7260 Hi (sorry for bad engrish)
@SigmayerStillClosed dude, clam down
I mean... in RED's uncompressed raw format at ~5 GB per second, this 15-minute video would be a whopping 4.7 TB.
One petabyte would hold about 58 hours of raw footage. (You'd be insane to store everything in raw, but I wouldn't put it past them.)
“With only 20 Terabytes available...”
Dhruv Kallianpur ikr
Ye. 1tb is big for me 2tb Is almost godly.
I mean you can buy a 2 TB hard drive for 60$. It is a lot but not really Godly
@@RichRacc ya but your not a company filming in 8k raw every day
Me over here saving for a single 10tb hdd
Whenever open source enters the episode you know Anthony will appear
while using an Iphone... 11:05
"It may be degraded, but it's bigger."
This is my kind of storage management.
If someone filmed me while I was trying to fix server issues, then that footage alone would require a petabyte server upgrade
How about you filmed it using old nokia phone it need about 1gb
The look on Anthony’s face when Linus said “he’d helped’” 😂😂
@Guitar Absolutely nobody has ever forgotten that, and Linus needs Anthony because nobody knows everything. Quit being a stiff and just let people have a laugh.
"Watch as two grown men fumble with literally millions of dollars of footage while Googling fixes to figure out if hard drives are broken or not"
That happens more frequently than you may think
Millions of dollars of footage? Seriously?
Googling fixes is pretty much just computer configuration and general IT to be fair. Incredibly common.
@@charlesgray6385
You can't know everything, but the internet does...
@@charlesgray6385 Just about all answers are on the internet! If you don't trust regular IT-stuff, then you can even resort to PhD - research and publicly published papers!
5:23 I hope the table is ok XD
Wait elite what are you doing here? Gathering intel for your own server?
YE IKR
finally enough storage for my "homework" folder
Ok Isaac Newton
Isaac you perv
Calm yur tits Isaac Newton
I would expect nothing more of you sir o7
Hi Newton
heads up, the red bar at the bottom in the preview makes it look like ive alrdy seen the video before! might want to change the thumbnail if possible
indeed
Yeah noticed this, not ideal if you are trying to optimise view count and stuff...
I hadn't noticed. RUclips red bar is always the same shape, so I know it's not RUclips when it doesn't look like RUclips.
True
The petabyte project was two years ago. God I’m old :(
Really. 😭🤪😳😳😳😳
I don't even dare to ask what you call "old" >_< (/crying inside)
Lol, I've been around since Whole Room Watercooling and I wouldn't even call myself an "old" fan :')
Something you remember happening two years ago does not make you old. Try remembering something from 20+ years ago...
I watched my neighbors daughters grow up and lose their virginity before me.
Get on my level.
Can you please give Anthony his own server and linux and cool tech series
PLS
Yes please!
yaas!
I'm just here to see Linus drop the petabyte project. It has to happen eventually, right?
I am from the future and I guarantee you that it will happen
@@rishabprasoon5970 don't you mean "has happened"?
@@RandomUser311 He's talking relative to our current timeline
@ 5:24 I'm pretty sure Anthony was expecting it...
@@YOEL_44 a yes, everything is relative :)
How soon can i ditch my google drives account and get me a linus drives one instead
Probably a better security as well;)
but he would drop your data?
@@styx7535 hackers cant steal what linus has gravity'd into non-existence.
@@dippst that's true
@@styx7535 If yes, there should be a counter for how many times users' data has been dropped.
2019: Out of storage, time for an upgrade
2020: Another Upgrade required
Well, the next logical step is an exabyte. That ought to last him a while. Using the 100 TB SSD ExaDrives from NIMBUS, he ought to be able to pack in 100 PB per rack, and I'm sure he can find enough room somewhere in his building to handle 10 racks. Mind, it will be interesting to see how he raises the money to purchase all those drives...
Jhon cochran he will get the money from ltt water bottles
@@johncochran8497 You think he pays full price for the drives? He outright says he is sponsored by seagate, so he barely pays anything, if at all.
@ 8k raw video from the RED cameras
@@meemo4556 Considering that the retail cost of 10,000 ExaDrives (100 TB each) would be about $500 million dollars, I wouldn't expect him to pay full price. But I also wouldn't expect NIMBUS data to give him that many drives free either. And if instead of those 100 TB SSD drives, he goes to something spinning, the number of required drives goes from 10,000 to over 62,500. But Linus wouldn't possibly use that much storage. It's inconceivable.
"I hope it wasn't Samsung" LMAO, that little piece of editing and commentary is why I don't just find these videos interesting, but actually really really funny and entertaining
Hey Linus, if you remove the door off the server rack you'll be able to.............aw screw it...
Yeah, screw it back in.
A Petabyte of nearly Linus’ voice, no wonder it needs an upgrade.
Linus: "Speaking of x"
Everyone: "Oh no, prepare for pain"
Home user: We only have 2gb left, we need more storage.
Linus: We only have 20tb left, we need more storage.
Google: Hold my beer!
@Lose TracTion it's not not even for a phone
@@lollol-kz8vc for a phone its quite ok
Francisco Serra well i guess i use my phone for some high other stuff like...homework
Microsoft: Hold my glass
@@lollol-kz8vc that explains it
“1.91 gigs/second, should only take a few days...” Linus, 2019
Linus: "WE HAVE FILLED UP A PETABYTE OF DATA"
Me: *Cries in 256GB HDD*
Laughs in 64mb hdd
128 mb ssd :(
@@sinchrotron wtf kind of pc can work on a 256mb ssd??? Is your computer from the 90's?
@@cameronh3260 Old. But not obsolete.
@@sinchrotron Windows 10 takes up 20GB of space just to work....how old is your pc?
Linus Sebastian, building an empire from donated cutting edge hardware.
LTT: "We need hard drives for a cool project"
Seagate: "Got you covered, please make it great"
LTT: "That project is dead, let's use the free stuff for our server"
Love you guys
Linus is not only an annoying salesman but also a conman. Poor sponsors.
See, THIS is the kinda crap I wanna be watching on LTT! I really enjoy them systematically going through each problem logically and trying to troubleshoot with their server/networking jargon. Honestly really enjoyable, and I learn a thing or two each time I watch.....
I don't care what anyone says but LTT got way better when Anthony started appearing in videos.
agreed
Nah
I clicked immediately because it was a server video.
Slow😑😑😑😑
i poke your butt because you know butt is butt
I know these are sorta boring but its actually interesting
@@CaptainRemixerOfficial O_o how do you think they are boring those are da best videos , so good i even closed pornhub
Go back to minecraft kid
"...UGH it's hooked on my fly" 4:20
.
.
.
Great out of context lol.
"we have less then 5% storage space left" oh no only 50 terabytes left what a crisis
Here I was happy with my 950gb ram thinking I can get all the games I would ever want
Yes i know that. Point is thats still 50x more then my desktops storage anyway
@Donald Duck ... thats the point 50 tera bytes is fuck all for them but its alot to the average person. You just want to argue to seem smart good for you
@@godslayer9000 sarcasm?
It’s not much, when you are saving 8k footage
Anthony has achieved demi-god status. He can now take the wheel whenever Jesus doesn't want to.
I dont think that Tech Jesus has any plans to stop anytime soon.
Cossak Rose I'd argue that this stuff is even more technical than what GN does
I wasn't talking about that Jesus tho.... LOL
All he has to do is make Half Life 3 now.
Linus: “ONLY 20TB left”
Me with my 1.6 megabytes left of phone storage: ._.
Kriglum07 yes,people like us-when we get 50 gb we are very happy,
Linus-“man,petabyte was so small!!”
bro stop complaining 2 mb of 64 gb is not much but 20 tb of 1 pb is also not much
defob my phone has 5 gigs not 64
You know, everyone says to back up your computer, but I don't remember anyone ever saying, "Back up your phone," despite how many people are super-attached to their phone in the modern era.
Their footage is so stupid big
Imagine a 1 minute clip being 1.5 terabytes
Guys how about a round of a plause for Anthony, that guy seems to be genius!
he is
He became a genius, but he payed with his hairline.
Just a joke.
it could use a wash
therogueasgardian 4lg So did One-Punch Man
the reason the server wasn't working because *you did not have enough rgb*
and watercooling!
Don't forget the 50 ROG Zephyrus(s?) Because Linus apparently has an obsession with ROG.
SERVERS don't run on RGB. It's so rare in servers, LTT actually did a video about a server with RGB.
Servers still need RGB like c'mon.
They not only need proper RGB for disco lighting, they also need to come with a decent 20KW amp on board so you can get that server-room party really started. Oh, wait... maybe we shouldn't give them any more stoopid ideas.
Every video I see Anthony doing something incredible I just imagine his pay getting raised an extra $10,000 a year lol
I work for a Data Centre company here in Canada. Depending on the rack, you can actually get proper HEPA filter inserts for the doors or door replacements with the screen built in.
That rack looks like is designed for a DC which is great, but means its meant for a clean space.
May also wish to consider some form of containment for hot air on the back side, just a simple insulated curtain to separate intake from exhaust and have an exhaust and intake dedicated for front vs rear. Takes very little time, but lowers your cost and increases efficiency of the servers. Since well... helps with cooling so its not eating its own exhaust.
We use a vinyl curtain system here, but keep in mind your temps and needs as the vinyl can have issues if temps are too high for prolonged periods of time. But really anything is better than nothing.
When you have so many channels and a camera that does has such high bandwidth you fill up 1000TB in record time
Couldn’t be me no cap
Yeah totally dude **no cap**
cooldarkfire?
"It may be degraded... but its bigger" - Linus Sebastian - 2019
Here in my garage, just downloaded Flight simulator 2020 on my 2 petabyte server.
9:06 yeah so im gonna need a solo album thanks
in 2034 : is one petabyte still useful in 2034 ?
1 tb usb
Yes video games, music, and files are probably not going to get much bigger because we are close to maximum graphics possible in modern AAA games
@@bik3r230 queue the music for 8k texture packs.
*of RAM
@@randomperson9105 256gb are already here for cheap prices
I don't need a Ridge Wallet to keep my wallet bulge slim... all I have to do is buy ASUS's new "budget" monitor
Apple monitor and the stand.
My wallet runs and cowers in the corner when ever I think about buying that combo
Because after buying it, you will be living on a tight budget?
@Andrew Ballard cause we roll like that
Or just any semi-good quality vesa Mount
Next Upgrade: playing Flight Simulator 2020 offline mode with max details.
lolz...gonna need a whole datacenter for that
7:40 ASMR while my parents are arguing in background?
they pounding yo
Stop, you've violated the law
"How long did we tell the editors this was going to be?"
Use the Scotty formula: think it will take 2 hours? Say 8. If you get it done in 2, you're a miracle worker. Massive overrun? You're on time.
As Taran said once
Whenever linus tells us how long its gonna take something, i just double it in my head, and its usually right
I just love Anthony and Linus working together
Nathan Reinwolf
Linus "working" together with Anthony 😂
It makes me moist
name a more iconic duo
"It sure is cold in this server room"
Yes, I'll take "sentences that have never been uttered" for $2000 Alex.
My high school server room was very chilly back in the day
‘Shoulda just got a Jellyfish’ Ooooooohooohoooo
Also ‘Anthony take the wheeeeeel, take it from my hands, I can’t do this on my own’
"WOOAAAAAHHH!!! It's hooked on mah d.... it's hooked on my fly." 4:25
Well, at least Linus has nothing to lose there.
1. Using AWS for backup storage
2. Using SSD based storage server
3. Using Harddisk based storage server
4. Storing all backup data on CDs
5. Storing all back up data on floppy drives
6. Storing all back up data on punch tape
7. Physically writing all data in 1s and 0s on paper.
Big brain !
🧠🧠🧠🧠🧠
paper is not secure enough stone tablets might be more secure... so lets secure all the 0 and 1 on stone tablets
@@bigdwarffrosta7877 titanium alloy
8. Building a redstone circuit in Minecraft that uses chests and hoppers to computationally store dirt and sand, which represent binary units of code.
Lol Anthony is such a nice guy. He never gets annoying
5:23 a part of Anthony died when they picked up the storinator onto its side XD
These are my fav types of vids because there not scripted videos. It’s real Linus being Linus
the one who complains so that Anthony comes to save the day.
I click for Linus, I stay for Anthony
Every datacenter needs an Anthony.
"Why can't I stack all these hard drives?"
I love you, Anthony, have my babies.
Gamers rise up
Anthony is a hero
Anthony is the the perfect sidekick or in this case the captain. He's cool, calm and collected and if anything it's that demeanor that helps them figure this whole thing out.
"Oh its hooked on my fly"
*Yvonne has a flashback to Linus lusting after the server at hooters*
I said it once and I will say it again, Linus is a petaphile
How many terabytes do the Hooters servers have?
that depends on what cup size the girl in question has I have seen references of cup sizes up to the letter K and those look like they could not only feed a whole block of children, but hold multiple petabytes
Check out that rack. Man the servers here....
13:25 *intense music intensifies*
Anthony: "we're in!"
4:00 "It's cold in this server room" Yeah right buddy, and my MacBook can run Crysis 3 at ultra settings
Kush Shah the server room has its own air conditioner running inside it, so yes it would be pretty cold.
It has 2 air conditioning units one on each side
why on earth would it be weird for it to be cold in the server room
No, but my laptop will :P
in most countries maybe but in canada they might as well have gimped the ac
2:37 "these two..." He's saying something confusing there, he doesn't literally mean those two actual drives are the parity, he means that out of 15 drives you lose about the space of two.
Would love it if you could capture your terminal screen so we, the viewers, can see what you're doing. :-)
Their terminal contains a lot of sensitive information. Like IP addresses' and ports.
Steve Brincat through ports and ips someone who really wanted to do some damage could remote in and even delete data.
I would hope they are using 10. IPs....
That said, they may not be allowed to show console windows. Don't know much about Gluster, but if it's not open source it could be licensed in such a way that prevents them since they monetize their videos.
@@rallywagon261 Gluster is open source.
Jesse Newton exactly
5 years later...
LinusTechTips : THE EXABYTE SERVER IS FULL !... Time to upgrade
Pyzi “..we have completely filled our holographic storage bank...it’s time for an upgrade”
I'm taking a screenshot of this comment!
Well, they can keep going until they hit a zettabyte. Once they hit a zettabyte they're kinda boned.
@@Niarbeht How?
@@user-tm3fz7qx3s ZFS is the Zettabyte File System.
Linus=Anthony you wana take the wheel
Anthony=sure.....
13:25
click some buttons 👉 there we go.
You remind me of myself
“Did I just help on a Linux thing? “
“Woo I helped “
Hey Linus, did you know if you removed the door to your server it would make things easier?
@@Mattexe77 smort
Intelligence 100
Linus in charge of moving and handling dozens of sensitive to vibration harddisks..... really!????? wow... that's mission impossible 7 right there guys.. definitely worth watching... 🤣🤣🤣
he is the chosen one to that task, if something happens he can blame himself, if it were someone else...
just a recommendation do not put red at the bottom of your video thumbnail, at first glance thought I already watched the video and almost skipped it.....
Lol same
happened to me too, i wonder how many people actually skipped this.
If you don't remember at all if you watched a video and can't recall anything from the video then just watch it...
@@AG.Floats Skimming thumbnails, my eyes tend to skip over those with red at the bottom, before even paying attention to what the video actually is.
I’m an average bloke. More than average. That being said, i see Anthony on the thumbnail, i press the video.
linus i hope you are happy. you got me interested enough in stuff like this that im now going to an IT school
red bottom of the preview picture makes video look like its been watched already. could you aviod it in the future?
I was just about to mention that!
Yes I noticed that as well
It’s caught my attention numerous times when thumbnails feature a red line at the bottom, honestly it may be a viable strategy to get people to notice your video. Not saying that is the reason the thumbnail is the way it is in this video
or at least a different shade of red, it just so happend that they pick the same exact one YT uses.
Can someone explain what this means? I would love having an indication that I had previously watched a video. But I don't.
me: need to upgrade my server
seagate: pay 6000€
ltt: need to upgrade petabyte server
seagate: we send you 15*12tb hdd
me: ç_ç
@Mike Mckay they where gifted to ltt because it provides marketing to Seagate
@Mike Mckay then why are you complaining?
@Mike Mckay You are one nasty pseudo intellectual, and wrong, you were complaining and trying to deflect it with a bogus definition. Your type is just awful, insulting over simple things, but you're too busy trying to sound smart than to worry about that.
Having worked in the industry for 20 years, if I had a tech disaster, I'd want Anthony right next to me.
Guy never loses his cool or focus - ever!!