This is my Endgame - Mother Vault Server Room Update

Поделиться
HTML-код
  • Опубликовано: 6 июл 2024
  • Check out the Manta toolkit at: www.iFixit.com/LTT
    The JBODs and the head server are here which means it's FINALLY time to deploy the mother of all archival storage solutions, housing up to 270 hard drives. EEEEK.
    Discuss on the forum: linustechtips.com/topic/14475...
    Check out Supermicro JBODs: lmg.gg/ztt2P
    Check out Supermicro A+ Servers: lmg.gg/8G7vz
    Check out Kioxia CM6 Enterprise NVMe SSDs: lmg.gg/xESWf
    Check out Micron Registered ECC DDR4: lmg.gg/RXyzo
    Check out Mellanox ConnectX-6 Network Cards: lmg.gg/YCwI2
    Check out AMD EPYC 74F3 CPUs: lmg.gg/Gm7ql
    Purchases made through some store links may provide some compensation to Linus Media Group.
    ► GET MERCH: lttstore.com
    ► SUPPORT US ON FLOATPLANE: www.floatplane.com/ltt
    ► AFFILIATES, SPONSORS & REFERRALS: lmg.gg/sponsors
    ► PODCAST GEAR: lmg.gg/podcastgear
    FOLLOW US
    ---------------------------------------------------
    Twitter: / linustech
    Facebook: / linustech
    Instagram: / linustech
    TikTok: / linustech
    Twitch: / linustech
    MUSIC CREDIT
    ---------------------------------------------------
    Intro: Laszlo - Supernova
    Video Link: • [Electro] - Laszlo - S...
    iTunes Download Link: itunes.apple.com/us/album/sup...
    Artist Link: / laszlomusic
    Outro: Approaching Nirvana - Sugar High
    Video Link: • Sugar High - Approachi...
    Listen on Spotify: spoti.fi/UxWkUw
    Artist Link: / approachingnirvana
    Intro animation by MBarek Abdelwassaa / mbarek_abdel
    Monitor And Keyboard by vadimmihalkevich / CC BY 4.0 geni.us/PgGWp
    Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0 geni.us/mj6pHk4
    Mouse Gamer free Model By Oscar Creativo / CC BY 4.0 geni.us/Ps3XfE
    CHAPTERS
    ---------------------------------------------------
    0:00 Intro
    2:15 The head server
    8:24 Going on a storage adventure
    9:40 Last parts
    10:58 Nightmare fuel
    11:10 ITS LOUD... sort of
    12:10 Does the head server work?
    12:58 The game plan
    14:13 They lied to us
    15:44 Linus & Jake start a moving company
    20:13 Pressing the button
    21:09 IT'S ALIVE
    23:58 Testing it
  • НаукаНаука

Комментарии • 3 тыс.

  • @rkgkjr
    @rkgkjr Год назад +9010

    We all know Linus' real endgame is having enough storage to finally upload his consciousness into a machine, then he can run LTT in perpetuity as a sentient AI that constantly drops database tables

  • @cognitivesimilarity889
    @cognitivesimilarity889 Год назад +3743

    With the rate that Linus is going, he'll make a seperate channel talking about all his servers

    • @mito-pb8qg
      @mito-pb8qg Год назад +330

      Great, that's what I care about the most

    • @echidna8857
      @echidna8857 Год назад +242

      I would subscribe to that instantly.

    • @Deep42Thought
      @Deep42Thought Год назад +68

      I would subscribe to that past century.

    • @PhazzeeYeehaw
      @PhazzeeYeehaw Год назад +38

      i’d binge watch it

    • @OtherTheDave
      @OtherTheDave Год назад +64

      “Linus Linux Tips”

  • @tehpanda64
    @tehpanda64 Год назад +1030

    It is always so great to see big name content creators/tech wizards like Jake Tech Tips and Anthony Media Group collaborate with young and upcoming screw driver enthusiasts like Linus.

    • @jrkbgk1111
      @jrkbgk1111 Год назад +18

      Definitely one of the, if not THE, most underrated comment in this thread!

    • @shapelessed
      @shapelessed Год назад +5

      Well, you could say Linus has a talent to... Screw things up....

  • @brettearl1382
    @brettearl1382 Год назад +2499

    As a server engineer, every time I watch Linus and Jake work on servers I cry a little inside.
    Please, for the love of your HR department and your own health, please purchase a server lifter. You spend big money on lots of things, this will save your backs and potentially Linus' body if he keeps choosing to lie under servers...
    I also love the change management
    Normal Company: I need to raise a change with 5 business days lead time with install and back out plans, passed by Change Advisory Board and approved by change manager\service control manager. Notice sent out to all impacted users.
    LTT: YO GUYS IM CHANGING STUFF, GET OFF THE DISKS!!!

    • @MisterSixty
      @MisterSixty Год назад +184

      Absolutely true and absolutely NECESSARY to start good business practices as his business is growing.

    • @agafaba
      @agafaba Год назад +246

      To be fair they did give advance notice, they just went the extra step of walking around to say its happening now instead of the usual "your fault for not listening, your fault its now gone"

    • @Peregrine101
      @Peregrine101 Год назад +81

      If Linus keeps going around like this, there might be the event of him dropping a server on any part of himself. In the event of the part of him that is crushed being his head, the outcome maybe really bad and the endgame part a bit too real. Technically the way they are doing things, the event of any of Jake's extremities being in peril is not to be excluded from the equation. That would be as bad, and a bit of a liability for the company, too.

    • @cattythecat9161
      @cattythecat9161 Год назад +17

      The same thought, i got, when i watched this video... why dont they buy some kind of forklift for handling the Servers in their rack 😓

    • @kwith
      @kwith Год назад +92

      I shudder to think of what would happen to me if I was doing this on PRODUCTION servers just on a whim like how its depicted here. Now I get it, a smaller operation like this isn't going to have Lab/Dev/QA/Prod environments, but to go basically from the lab to production and just "hope and pray" it works, I cry along side you.
      I sent one of these videos to our OH&S guy a few years back, I honestly think he had a stroke because he just sat there staring at the screen mouth agape and twitching the whole time.
      All humour and joking aside, they REALLY need to have better safety practices, every one of these videos is just a worker's comp agent's worst nightmare.

  • @joemarais7683
    @joemarais7683 Год назад +761

    Can't wait for the next "endgame" server next year.

    • @cthecheese1620
      @cthecheese1620 Год назад +25

      We all know how this story goes 😂

    • @danieljonsson8095
      @danieljonsson8095 Год назад +19

      That's what happens when you constantly choose a technology which is fundamentally not designed to be expanded (even if it with a lot of work can be but not designed for it). And discounting technology because "no one here knows how to set up and maintain it", and instead choose a different technology that ALSO clearly no one there knows how to set up and maintain and are learning bit by bit on the fly...

    • @SevenHunnid
      @SevenHunnid Год назад

      We only live physically once so we shouldn’t be afraid to do anything bro, i smoke weed on my RUclips channel and i ate Mcdonald’s inside Walmart 😈😈, screw anyones opinion 🎯

    • @RedRingOfDead
      @RedRingOfDead Год назад +4

      I give them 9 months

    • @iamalittler
      @iamalittler Год назад +3

      He just needs a separate server for server videos

  • @HEADSHOTKILL1
    @HEADSHOTKILL1 Год назад +904

    Linus: The weight of this heavy server isn’t being supported
    Also Linus: Yeah I’m just gonna rest my head under it.

    • @JETWTF
      @JETWTF Год назад +32

      My thoughts exactly, and he was poking at the support.

    • @saladgreens912
      @saladgreens912 Год назад +39

      OSHA is a privilege

    • @honer723
      @honer723 11 месяцев назад

      He had on protective headwear at least?

  • @TrueNAS
    @TrueNAS Год назад +159

    ZFS for the win! Great pick guys! This time we know your data is safe (unless someone drops a server)!

    • @Nalianna
      @Nalianna Месяц назад +2

      unless? - until.

  • @MatthiasClan
    @MatthiasClan Год назад +230

    Might I recommend the acquisition of hydraulic table carts. Makes transferring heavy things like that from different heights much easier and safer for both the equipment and your staff.

  • @maristheone3237
    @maristheone3237 Год назад +410

    I love how professional these videos are… right up until they start installing things

    • @SIlverwolf-fy8ci
      @SIlverwolf-fy8ci Год назад +44

      Belive me, it's sometimes more near to reality how they do things then one would think. :D

    • @LastGunslingerTull
      @LastGunslingerTull Год назад +29

      Can confirm. It’s all good until someone opens the debug console, or grabs a screwdriver. Then it’s all asses and elbows

    • @user-rr5ce1wb2j
      @user-rr5ce1wb2j Год назад +14

      This went smoothly compared to some jobs I've done. One rack was in a room so small that the 35kg servers had to be angled at more than 45 degrees just for the font of them to clear the wall and there was only space for one person to do so...from the side of the rack.

  • @GreenCinco12Official
    @GreenCinco12Official Год назад +381

    17:45 Linus be like:
    "Yeah let me just lay here under a sever with 60 drives in it that isn't mounted correctly and play with the mounting hardware. Not that it could just fall down and will splash my head."

    • @TheFalseShepphard
      @TheFalseShepphard Год назад +18

      Poor linus, He has to lay in a sewer just to make ends meet my condolonces 🙏

    • @oliverboi
      @oliverboi Год назад +12

      @@TheFalseShepphard Ikr poor linus and his very overpriced Sewer system

    • @LiLBitsDK
      @LiLBitsDK Год назад +5

      he would be just fine, yes it is heavy but he would still be fine

    • @marcusbell4449
      @marcusbell4449 Год назад

      @@LiLBitsDK 60 drives would make a jbod weigh 210 lbs or so idk

    • @marcusbell4449
      @marcusbell4449 Год назад +1

      @@LiLBitsDK actually in the video it says 290 lbs and that may be when empty

  • @jasonlib1996
    @jasonlib1996 Год назад +250

    honestly i love the server content more than the typical videos. because its legit just linus and jake spending a day nerding out and having a laugh while they do it. and this server stuff is far more interesting than another overpriced gaming pc

  • @grdprojekt
    @grdprojekt Год назад +15

    13:30 always love when Linus & Jake "playing" around with the server, comes the time to shut the server down and had to hesitantly tell the editors.
    But this episode comes with a twist lol

  • @Shadepariah
    @Shadepariah Год назад +1059

    Hope Wendell can do a video on how he restored some of Linus's bit-rotted files. I've never made this mistake but it would be interesting to see the repair.

    • @LiLBitsDK
      @LiLBitsDK Год назад +2

      bit rotted?

    • @user-nm4kq5kw4f
      @user-nm4kq5kw4f Год назад +114

      @@LiLBitsDK bit-rot is when the bits that make up your files are changed / corrupted over time.
      If data is just stored on a hard drive, it will degrade and you can lose the data.
      ZFS has something called "scrubbing" which checks this and fixes issues before they become unrecoverable.
      I believe LTT did not have scrubbing setup or it was setup incorrectly so they were not protected against bit-rot

    • @kaptenkrok8123
      @kaptenkrok8123 Год назад +44

      @@user-nm4kq5kw4f it was not a bit rot issue...it was a totaly missconfigured setup...

    • @Catsrules1
      @Catsrules1 Год назад +23

      You might be interested in this video ruclips.net/video/tU0Wc6Kj6IQ/видео.html Wendell goes full computer janitor on recovering data from an old Enterprise SSD.

    • @tobiwonkanogy2975
      @tobiwonkanogy2975 Год назад +3

      he did mention it a few times . the server build series might be helpful as well. Wendell covers a lot of topics including software and backups.

  • @Garfuck
    @Garfuck Год назад +518

    I think Linus needs help, this whole storage thing becomes like an addiction. I don't think there's enough storage in the world to satisfy Linus' hunger for more.

    • @vibonacci
      @vibonacci Год назад +41

      haha. You should talk to a Google employee. Linus' data hoarding is childs play.

    • @Mice-stro
      @Mice-stro Год назад +14

      Haha my starting home nas is 40TB, i don't even know what I'm gonna use it for yet. But data aggregation is almost exponential.

    • @poetryandlilies
      @poetryandlilies Год назад +6

      Linus is the IT equivalent of Galactus confirmed

    • @ubermidget2
      @ubermidget2 Год назад +2

      Nah, if that were true he'd be investing in knowledge of Ceph.
      With a single head node, he knows what the Storage upper limit is.
      With a proper cluster, he could scale to dozens of PB

    • @Blacklands
      @Blacklands Год назад +2

      It sounds like a lot, but there's plenty of people who have something approaching (or exceeding) a petabyte at home as a hobby (so, not making money specifically with it)! He runs a business, so even if he wouldn't need quite _that_ amount of storage, a couple of petabytes is pretty reasonable, no?

  • @sampeterson1966
    @sampeterson1966 Год назад +11

    Jake's job is so cool. He gets to design and build these amazing projects for Linus and spare no expense you normally would. With the house and everything he does at the office hes become my favorite face on LTT.

  • @zoeyundergroundcanada
    @zoeyundergroundcanada Год назад +6

    Can’t forget the fire in the old old server rooms and how many you guys had it was crazy but did a very nice recovery on that one

  •  Год назад +432

    you know, when I worked in Inventec, we had lifting thingies for carrying servers, so you could just adjust height and slide even full 150gk 4u server in and out of test rack by yourself without help, no matter if it was almost on ground level or 2m high (it wasn't in regular racks, it was more like store shelves with rails, so putting in and pulling out servers was easy)
    I bet logistics guys would love this thing

    • @invisi1407
      @invisi1407 Год назад +26

      Yeah, I don't know why they don't have something like that - that would make it a ton easier and safer.

    • @robertt9342
      @robertt9342 Год назад +15

      @@invisi1407 . Probably don’t mover servers that much.

    • @ferky123
      @ferky123 Год назад +10

      They just need a lifting cart.

    • @AVPEx
      @AVPEx Год назад +4

      He likes Jake's help.

    • @thekwoka4707
      @thekwoka4707 Год назад +1

      Yeah, any kind of rolling scissor jack.
      I've used them for automotive stuff, like lifting transmissions into vehicles.

  • @cxdeblue6055
    @cxdeblue6055 Год назад +278

    As someone that manages enterprise IT equipment at an MSP, I love these videos about your backend infrastructure.

    • @danieljonsson8095
      @danieljonsson8095 Год назад +21

      Don't use LTT as a source for good enterprise IT management... Just don't... You're going to be in for a rough time if you do.

    • @samnope7344
      @samnope7344 Год назад +18

      16:45 For the others who enjoy Linus' backend

    • @HilbertXVI
      @HilbertXVI Год назад +9

      @@danieljonsson8095 It wouldn't be half as entertaining otherwise lol

    • @danieljonsson8095
      @danieljonsson8095 Год назад +9

      @@HilbertXVI Certainly. I'm just saying, be well aware that LTT is an ENTERTAINMENT channel, not "good practices" channel.

    • @xnetpc
      @xnetpc Год назад +19

      @@danieljonsson8095 as an enterprise IT Server Engineer, I cringe at everything Linus chooses for his server and network core solutions.
      It is obvious that Linus, nor anybody who works for him has ever worked in corporate/enterprise IT.

  • @hanshix
    @hanshix Год назад

    Cool stuff! I love these techy server vids, especially when it shows exactly what LMG are using on-site.

  • @jaredcomer1684
    @jaredcomer1684 Год назад +1

    Can I just say how much I LOVE videos with Jake and Linus, you can tell these 2 are bros and genuinely enjoy their time together

  • @Level1Techs
    @Level1Techs Год назад +15

    Love you too

    • @guy_autordie
      @guy_autordie Год назад

      @Jonathan Z they will. Wendell tease it on twitter.

  • @webluke
    @webluke Год назад +254

    LTT data storage sure has come a long way from random hard drives on the back of a toilet to this beast of a "Storage Solution." I could see Jake having a new channel called "Server Super Fun," and he just reviews and talks about server stuff.

    • @Lizlodude
      @Lizlodude Год назад +17

      I went back and watched that tour video, I loved the archival bathroom lol. Like here's the company's backups, yes the sink is connected, please do not touch it. XD

    • @ArifKamaruzaman
      @ArifKamaruzaman Год назад +1

      Hahaha. random stack of disk on bathtub. That's hilarious.

    • @fade2black001
      @fade2black001 Год назад +1

      Well with the insanely overpriced things he sells (and people buying them) he can afford some shit

  • @Lizlodude
    @Lizlodude Год назад +3

    18:50 "Breaking: CEO crushed under too much server"

  • @Briggie
    @Briggie Год назад +12

    I would finally be able to install my entire steam library with a setup like this.

  • @jalbertgo
    @jalbertgo Год назад +208

    I wonder if this is just the way Linus deals with his own mortality, and the need for permanence in time

    • @cloudtaker633
      @cloudtaker633 Год назад +3

      Even so, we all will eventually be forgotten, no matter what we do.

    • @randombrit13
      @randombrit13 Год назад +1

      It’s similar to how i do it.

    • @ZaHandle
      @ZaHandle Год назад +3

      He’s gonna upload himself in one of these servers and one on his grandchildren will trip on the power cable

    • @jalbertgo
      @jalbertgo Год назад +2

      @@ZaHandle I can only guess that's the final point, to make a copy someday and for it to be tax deductible hehehehehe

  • @Neoxon619
    @Neoxon619 Год назад +414

    Having followed the new server videos for a while, I’m glad to see things get finalized. Although part of me wonders if Linus was partially inspired by the SSD-based server used for the new house.

    • @jackhemsworth7515
      @jackhemsworth7515 Год назад +40

      Or the million dollar all SSD server that they made a video of and then completely forgot about.

    • @vjuOG
      @vjuOG Год назад +4

      @@jackhemsworth7515 its not optimal to run this many ssds, a million for a server is not cheap

    • @ZuppaD.Cipolle
      @ZuppaD.Cipolle Год назад +3

      @@jackhemsworth7515 they had to return the parts to the sponsor, it wasn't meant to be a stable thing

  • @TheEhlek23
    @TheEhlek23 Год назад

    Server update videos are hands down my favorite LTT videos

  • @MrGatlin98
    @MrGatlin98 Год назад

    It's nice to see the intro still being used. I've noticed some videos don't have it and I miss it.

  • @YorugataTV
    @YorugataTV Год назад +52

    3 years later...
    Linus: We bought another unit, and we're turning it into the LMG Data Center!

    • @5dashes
      @5dashes Год назад +4

      AWS competitor -- Linus Web Services

    • @Blacklands
      @Blacklands Год назад +1

      @@5dashes They intentionally (totally intentional, wasn't a mistake at all, we swear!) delete/corrupt all your data every 6 months to keep you on your toes and remind you that backups are important!

  • @sparkycasegbr
    @sparkycasegbr Год назад +104

    If there is ever a shortage of hard drives, we know Linus has bought them all.

  • @randomlyentertaining8287
    @randomlyentertaining8287 Год назад +7

    Linus has got to be one of the only people to make a video building a new data server sound like it's going to be an epic tale that will one day be sung about. Also, he makes it all seem so easy but you can tell when they're talking about adding insulation and temps in the room, his hair at his forehead is soaking wet, meaning he's been sweating his ass off.

  • @RCShufty
    @RCShufty Год назад

    Man, you guys get the coolest toys to play with.

  • @LonelySandwich
    @LonelySandwich Год назад +25

    “It’s LeviosAAAAH”
    That reference did not go to waste. 11/10

  • @mathewtodd480
    @mathewtodd480 Год назад +86

    I love that Jake knows he's in the untouchable zone, ordering food not only infront of the bossman but on video

    • @illiiilli24601
      @illiiilli24601 Год назад +24

      Jake is Linus' adopted son, he is untouchable

    • @XTJ7
      @XTJ7 Год назад +16

      And insists the editor leaves it in! :D

    • @ravenof1985
      @ravenof1985 Год назад +15

      ive noticed an inversion of the early Jake/Linus dynamic, nowdays it feels like Jake is the adult and Linus is the child.

    • @shapshooter7769
      @shapshooter7769 Год назад +2

      This is why Linus hires employees - so he is free to act like a child in camera.
      Which is of course, content.

    • @OfficialSamuelC
      @OfficialSamuelC Год назад +2

      I absolutely love their dynamic, and I’m constantly impressed at Jake’s knowledge and skills.

  • @christopherkelly7594
    @christopherkelly7594 Год назад

    I like the funny dynamic in this video, it's refreshing and actually makes it fun to watch

  • @lummoxicide1502
    @lummoxicide1502 Год назад +2

    How dare Jake not drink from an LTT water bottle! What a monster! 12:33

  • @sebastiane7556
    @sebastiane7556 Год назад +35

    I love how linus just casually lies directly under extremely heavy servers which are poorly held in place.

  • @MrKrock164
    @MrKrock164 Год назад +41

    LTT video editor: "How many flashy text fields do you want? How big shall they be?"
    LTT marketing guy: "Yes."

    • @repzo5551
      @repzo5551 Год назад +9

      Yeah it's gotten worse over the past few months, more clickbaity and seems to treat their audience as children or preteens

    • @Lizlodude
      @Lizlodude Год назад +4

      Yeah not a fan of those. I get the thumbnails, YT makes the rules, and however annoying they are you get shanked if you don't play by them, but it gets annoying when it spans the first minute of the video.

    • @Shanghaimartin
      @Shanghaimartin Год назад +3

      I love LTT, but I'm genuinely considering unsubbing with the childish tiktoky style choices they're making these days :(
      I just really grates on my nerves for some reason

    • @repzo5551
      @repzo5551 Год назад

      @@Shanghaimartin same

    • @shapshooter7769
      @shapshooter7769 Год назад

      Go pay for Floatplane then.

  • @bygodwearemen
    @bygodwearemen Год назад

    I love watching you. It seems you really love what you do. Nothing is more enjoyable to watch especially since I love computing and electronics generally myself.
    All the stuff you have in there. It's like an Ali Baba treasure trove. So enjoyable to watch.

  • @alexjay8867
    @alexjay8867 Год назад

    i love the editing in this video. give that editor a raise!

  • @vinicius401
    @vinicius401 Год назад +82

    I love Jake. LTT just has such an amazing crew.

    • @OfficialSamuelC
      @OfficialSamuelC Год назад +7

      Ditto. He is clearly so knowledgable, continues to amaze me what he knows and the broad spectrum of things he knows and is capable of!

    • @kierasher1
      @kierasher1 Год назад +5

      Yeah. He's like a super chatty LAN admin. You don't see those very often. It's fun.

  • @00kidney
    @00kidney Год назад +289

    I can't wait for Linus to create a new channel just to show off his backup servers. He could call it Linus Backup Tips?

    • @sihamhamda47
      @sihamhamda47 Год назад +6

      More like "Linus Backup and Restore Tips"

    • @DVAerden
      @DVAerden Год назад +5

      As long as it's not "Linus backs his tip up", 'cause that's not exactly RUclips material.

    • @MRtecno98
      @MRtecno98 Год назад +1

      Linus Back Tips

    • @laboulesdebleu8335
      @laboulesdebleu8335 Год назад +6

      Linus' Back That Thing Up, Just the Tip, and Only for a Second!

    • @skippingbear92
      @skippingbear92 Год назад

      Linus server tips

  • @kwith
    @kwith Год назад +4

    Ok I'm gonna have an aneurysm from watching Linus laying under the server. Gah!
    Also, WHERE are your steel toes? Those sneakers, yea no. Maybe some basic safety precautions you guys? I mean at least they wore ear protection, sort of.

  • @Inflatableorc
    @Inflatableorc Год назад +1

    8:30 - 9:40 I had a litle bit of ... the plant ... and this storage adventure scene really tripped me out. 10/10
    25:27 MaN-TaH. MoN-TuH.

  • @Johnny_Decaptacon
    @Johnny_Decaptacon Год назад +38

    18:14 I love how enthusiastic Linus promotes their screwdriver like "EASY!" while Jakes knee is almost getting crushed by the weight of the JBOD 😂

    • @TheCoheedIndeed
      @TheCoheedIndeed Год назад +4

      Then the sponsor is for a competitors screwdriver 🤣

  • @ahmedghoraba2153
    @ahmedghoraba2153 Год назад +555

    I think the perfect backup for your archives would be an automated tape storage room
    Edit : yeah tape writing and accessing is slow but it is just a backup for a very dark day

    • @donc-m4900
      @donc-m4900 Год назад +11

      VHS or Beta?

    • @WTFdoNOTpeeONme
      @WTFdoNOTpeeONme Год назад +5

      @@donc-m4900 fish tape

    • @ssu7653
      @ssu7653 Год назад +61

      As a backup yes, for reading 100% NO

    • @mach1negum
      @mach1negum Год назад +9

      900,000 feet of tape!

    • @zixaxi
      @zixaxi Год назад +6

      he would probably need LTO10. Even then... could you imagine trying to backup all that data he has?

  • @actualarthur
    @actualarthur Год назад

    LMG banter is the best. Couldnt imagine a better place to work!

  • @jmickeyd53
    @jmickeyd53 Год назад +80

    Linus: We almost lost all of our data. Also Linus: We're going to build a new storage system with a single point of failure.

    • @Cyberguy42
      @Cyberguy42 Год назад +24

      By single point of failure, are you referring to the 'head' server? If that goes down, they will temporarily lose access to their data, but the data itself will still be safe, they'll just have to import the zpool on another server, same as they did on the new server in this video. So while there may be a single point of failure, I don't think it is inconsistent with the goal of avoiding losing data in the future.

    • @jmickeyd53
      @jmickeyd53 Год назад +9

      @@Cyberguy42 A clean hardware failure is far from the worst case scenario. I've seen processors with incorrect AES s-boxes, silently mis-encrypting all data. I've seen memory bit flips lead to incorrect indirect jumps in the processor. Or power spikes (lightning) taking out multiple drives simultaneously. Or just simple software bugs. The list goes on.

    • @Blacklands
      @Blacklands Год назад +6

      @@jmickeyd53 I mean, you still need backups, yeah. I don't think they contested that? Doesn't Linus always try to throw at least one "RAID is not a backup!" into these videos?

    • @ray89520
      @ray89520 Год назад +2

      @@jmickeyd53 For pure curiosity: How would your preferred setup look like? Because I don't see how two head servers will solve your mentioned issues from my basic infrastructure knowledge.

    • @susanyoung6579
      @susanyoung6579 Год назад +3

      @@ray89520 Ceph cluster would have been better immho.

  • @CautiousCrow
    @CautiousCrow Год назад +72

    You need a hydraulic lifting table (jack). It's normally used to lift stuff onto the bed of a pickup truck, but seems like a perfect fit here too. They even have wheels so you can cart heavy stuff around.

    • @q1joe
      @q1joe Год назад +19

      They make ones specifically for loading racks.

    • @wobblysauce
      @wobblysauce Год назад

      Yep, can get them in a veritable sizes

    • @donc-m4900
      @donc-m4900 Год назад +4

      Or use Jake and another guy instead...

    • @mj41374
      @mj41374 Год назад +9

      See my comment earlier: battery powered server lift. I installed an entire datacenter by myself with it!

    • @whencuriositystrikes880
      @whencuriositystrikes880 Год назад +2

      They seriously better get around to getting some of that before anyone of them seriously injures themselves. Being fun and goofy is cool until people get hurt.

  • @ioio5993
    @ioio5993 Год назад +123

    You really need a larger server room - something on the order of 5x larger. That one rack should be 3. You really need 5 feet in front and back of clear space for access, and then at least a half a rack for network appliances and patch panels. This would make working on the physical plant a whole lot easier.

    • @Ornithopter470
      @Ornithopter470 Год назад +2

      I don't think they actually have enough need for that. It'd make sense if they were doing more than basically meming with the server room.

  • @deafno
    @deafno Год назад

    favorite series from LTT!

  • @tomato6102
    @tomato6102 Год назад +30

    I love seeing the behind the scenes of LMG, it was hilarious seeing the logistics banter

  • @MrBobybob
    @MrBobybob Год назад +12

    Server and Moving Vlogs are still the best. Watching since 'whole room water cooling' 😁

  • @kobracommader
    @kobracommader Год назад

    love the server update/upgrade vids

  • @RezaAvanluna
    @RezaAvanluna Год назад +26

    "Endgame"
    we all know a "bigger, better, and faster" one is coming in a few months for Lab 2.

  • @oehlrichhans7
    @oehlrichhans7 Год назад +12

    Linus: this Server, that needs four people to lift is not mounted correctly and only held in place by a piece not designed for heavy loads
    Also Linus: says that with his head directly beneath it

  • @u2bemark
    @u2bemark Год назад +278

    LMG guys: I am curious... this will allow you to have access to all those projects.. how do you know which project file to grab what desired clip from? What is a typical list of keyords/tags you might use for a given project and how does your search for relevant video get achieved? Is there any kind of AI invloved in creating metadata for future searches or is it all manual? That might make for an interesting video.. at least I'd watch it. Not a lot of hardware to it.. but the whole workflow thing is interesting and worthy of a video.

    • @joshjlmgproductions3313
      @joshjlmgproductions3313 Год назад +45

      They probably date their videos and name them the same name as the RUclips upload.

    • @JuneNafziger
      @JuneNafziger Год назад +27

      @@joshjlmgproductions3313 or the internal name for the project, rather than the clickable title on RUclips

    • @yearswriter
      @yearswriter Год назад +11

      they could also search for a video on youtube and then have more info about raw material, if there is some naming convection consistency

    • @EoRdE6
      @EoRdE6 Год назад +3

      @@joshjlmgproductions3313 sure but often a simple video title doesn't tell you all the things in a video, especially when you have a specific product or clip in mind that wasn't the highlight of the video...

    • @kaukospots
      @kaukospots Год назад +1

      pretty sure this is only archival, not active projects, so they probably don't go back to it very often

  • @murphyslaw907
    @murphyslaw907 9 месяцев назад

    Watching you guys struggle with those chassis makes me happy I have a server lift. That looks like a PITA.

  • @jimmysoncookland5446
    @jimmysoncookland5446 Год назад

    Linus is killing it lately. Goes to show the hard work going on in a time of not much news.

  • @paulbrooks4395
    @paulbrooks4395 Год назад +53

    Reminds me of every experience I've had doing projects in IT, especially new SAN / storage migrations. There's a million little things that are slightly off, with many tasks that have to be finished to deal with the last lingering issues before everything is "right". About what you said on the zones, most people don't use these kinds of setups, and there are always issues that come up. Only vendor appliances are truly headache-free (Nimble / Pure arrays). They are the reason most enterprises don't use these kinds of setups, appliances are vastly more easy to standup and their support is worth its weight in gold--they are the definitive experts so we don't have to be.

    • @Braindead154
      @Braindead154 Год назад +2

      For their use case, they should just toss it in a Amazon S3 Glacier bucket and call it a day… would save him so much money and time.

    • @weirdguybr
      @weirdguybr Год назад +10

      ​@@Braindead154 I'm not so sure about that. I'm a bit of a data hoarder myself and every time people suggest me to use cloud to store my data, I redo the math and it always ends up being cheaper to just store it locally, even at my scale (under 100TB).
      For example, using an unofficial glacier calculator, with 3.6PB of data, just to store (not retrieve) it for a year, it's giving me a quote of 175K USD.. And if you are actively retrieving data, you soon end up adding tens of thousands of dollars - as an example, the retrieval cost for 20TB costs 25K USD and requires a minimum of 4 hours.
      Now, compare to their new server - it's probably close to 200K in hardware (too lazy to do the parts list math myself), but they get so much free stuff from sponsors that I'd be surprised if it ended up costing more than 50K for the build (they got most of the drives for free, got the RAM for free, etc). And, maintained properly, the yearly cost of operation will be much lower than any cloud storage (it's just power plus the occasional hard drive replacement) and you get unlimited retrieval for no additional cost (and it's much faster than 4 hours for 20TB).

    • @ddognine
      @ddognine Год назад +4

      @@Braindead154 There is no such thing as the cloud, just someone else's computer.

    • @Braindead154
      @Braindead154 Год назад +1

      They aren’t storing 3.6PB of data, they are storing a fraction of that and using raid for redundancy. You don’t have to do any of that with S3, durability is just there and to a much higher level. Even if they are getting paid to build with the equipment they use, I still hope that they have some offsite data storage.

    • @Toramt
      @Toramt Год назад +1

      @@ddognine ... with dedicated support teams who watch the health of the arrays over time, regular hardware maintenance and operations documentation in a trio of purpose-built datacenters, with proper fire suppression and spread across a large enough geographic area that any one minor disaster doesn't lose your data, instead of someones spare time between script reviews and a closet.

  • @distantanomaly9649
    @distantanomaly9649 Год назад +4

    Nice! Server content is my favorite part of the channel lately.

  • @Carnage8
    @Carnage8 Год назад

    Epic server room updates love these storage server videos :D Really seems endgame this time unless you go for that no controller pure storage setup one day for some reason lol good stuff!

  • @TurinAlexander
    @TurinAlexander Год назад +1

    I loved that Segway during the segue.

  • @AttilaSVK
    @AttilaSVK Год назад +12

    I love when Linus and Jake are doing server stuff :) Also I love how they have an order of magnitude more TB of SSD storage than the capacity of my HDD based NAS :D

  • @kevinb2469
    @kevinb2469 Год назад +6

    Clever way of showing “logistics” which has been mentioned many times but hasn’t been seen (by me) until now.

  • @neil3428
    @neil3428 Год назад

    Server videos are always fun I don't understand anything they are saying but it is still fun to watch

  • @HeikkiHeer
    @HeikkiHeer Год назад

    i am happy to see that you also have trouble with server shelfs...

  • @Warshuk
    @Warshuk Год назад +105

    " Trust takes years to build, seconds to breaks and forever to repair"
    That's an amazing quote right there 🥰.

  • @cheesefries7436
    @cheesefries7436 Год назад

    I've got that same JBOD enclosure at work full of SSDs, it's wild. That one shelf and the machine it's connected to are worth more than my life.

  • @Matt.Gillard
    @Matt.Gillard Год назад

    I'm drooling! I want this storage setup so bad!

  • @b1oo71
    @b1oo71 Год назад +75

    It’s your endgame… for now, you’re gonna have a new server by 2023 lol

    • @q1joe
      @q1joe Год назад +3

      If they do it right, this should be extendable by updating the "head" servers or adding more arrays.

  • @matthiashavrez
    @matthiashavrez Год назад +3

    The fact that Level1techs forum seems to be a technical ressource of almost every big tech youtuber is so cool.

  • @gpturismo
    @gpturismo Год назад

    Love to see a chart showing hardware redundancy etc. in case an entire array goes offline. When I was working, servers racks you couldn't easily stand on both sides to load stuff were hell. Glad you bolted it down too, had a server rack not bolted down at a clients site once and yeah. Finally, time to convert one of the bigger rooms into a full service server room with hvac, raised floor, etc XD

  • @ocheng724
    @ocheng724 Год назад

    Whoever edited this video… we’ll done my friend, we’ll done! I haven’t laughed with a LTT video intro in a while. Kudos!

  • @surveyingfleaproductions
    @surveyingfleaproductions Год назад +24

    Damn dude, as someone who's lost poetry and artwork that only existed in digital form, I feel your pain on whatever wasn't recovered. People say, you can create it again... And it's like no.. you can't..
    Glad y'all got the majority recovered. You guys are living my dream, lol not counting RUclips stuff. Stay awesome

    • @Lizlodude
      @Lizlodude Год назад +5

      One benefit in their case is that the majority of the content is actually still on YT and can be downloaded, just in significantly reduced quality and organization.

  • @rynndash
    @rynndash Год назад +4

    Imagine waking up in the morning and his new video ITS HERE
    Me: wow

  • @davisdiercks
    @davisdiercks 2 месяца назад

    10:59 made me actually cry i literally had to pause thanks for that

  • @CutThroxt
    @CutThroxt Год назад

    i am beyond confused on how the entire layout of the servers work, but i still enjoy watching the videos on it all lol

  • @DominicRusso17
    @DominicRusso17 Год назад +98

    How does Linus not have a "proper" server room/rack by now? I've seen Cogen plants that have better server rooms. I get that he has absolutely insane SERVERS, but they'd probably last a lot longer with proper cooling, ventilation, spacing, etc.

    • @shapshooter7769
      @shapshooter7769 Год назад +6

      But he does though.

    • @LiLBitsDK
      @LiLBitsDK Год назад +18

      it IS a proper server room, albeit small AND it is a professional rack... so what are you talking about?

    • @DominicRusso17
      @DominicRusso17 Год назад +32

      @@shapshooter7769 he really doesn't though. That server room is way too small for the contents of that rack. If AC goes out or is underperforming, the smaller the room, the quick things burn out/up; hence the comment in the video about their UPS burning up in the past. Also, they should be insulated (both thermally and audibly) which they've kind of done once (based on past videos) but clearly not well since both sound and heat can leak out the vented door.
      I love Linus and especially all his server videos, I just figure by now he'd have a state of the art server room to match his BETTER than state of the art servers 🙂

    • @deepblue812
      @deepblue812 Год назад +19

      It does look like where the janitor keeps his supplies after hours. LTT has enough square footage, I'd like to see something more 'bright tech clean-room' and less 'broom closet vibe' :)
      With how often they end up filming segments in there you'd think they'd want more space.

    • @ChaosNebulai
      @ChaosNebulai Год назад +10

      I agree, being able to walk in, have a few shelves for bits and bobs and being able to walk the whole way around the rack is night and day, probably not feasible due to the effort of terminating everything somewhere else though

  • @williamwins5711
    @williamwins5711 Год назад +7

    "Leftover" 30 TB NVME Drives from Dream's build. Man the stuff that "falls off a truck" at LMG in any given week is prolly worth more than my house. . .

  • @2Eblom
    @2Eblom 9 месяцев назад

    I love these kind of videos :D

  • @t_ozy884
    @t_ozy884 Год назад

    Linus's segways catch me out everytime, but that one at the end had me crying on the floor

  • @GadgetAddict
    @GadgetAddict Год назад +19

    That transition a few seconds after 9:37 💯

    • @neelb980
      @neelb980 Год назад +3

      I mean it's a pretty basic slide transition lol, nothing crazy tbh

  • @lukeweeks3470
    @lukeweeks3470 Год назад +4

    I just love how Linus is being all serious and Jake is more interested in when his burrito will arrive 🤣

  • @mocko69
    @mocko69 Год назад

    New editor? Loved this one!

  • @MrUltraDreamz
    @MrUltraDreamz Год назад

    I love the relationship Linus and Jake have 😆 Really makes for a great viewing experience

  • @johnnyxp64
    @johnnyxp64 Год назад +13

    I love the Server projects especially with AMD. They are epyc.

  • @MrWadezz
    @MrWadezz Год назад +20

    Hey great work on these, I love seeing you guys work on datacenter hardware/software solutions ! Next logical upgrade : geo replication on those storinator (now that you have multiple buildings)? I think trueNAS has some implementation of gluster Georeplication in the SCALE version, so that could be an interesting thing to try out !

    • @animefreak5757
      @animefreak5757 Год назад +1

      the two buildings he has are VERY close together. I don't think that's what your usually going for with geo replication.

    • @MrWadezz
      @MrWadezz Год назад

      @@animefreak5757 Well, it depends. From what I remember, they're a few hundred meters apart (maybe 90-150m apart or smthg). It's definitely enough for fire to not spread across the two buildings, and it puts both storage cluster on different power circuit, which is probbly enough for a company the size of LMG.

  • @Kekktye
    @Kekktye Год назад +5

    Sometimes I think Linus' company is worryingly inefficient, but then I go to work

    • @xantishayde-walker4593
      @xantishayde-walker4593 Год назад +1

      Then you look back at Linus and his team and go "You know what, those guys are doing a great job! I wish my company was more like theirs."

  • @NineKeysDown
    @NineKeysDown Год назад

    Love these videos and seeing sysadmin Jake

  • @WigWoo1
    @WigWoo1 Год назад +5

    Now you just need all those drives to be those Exobyte SSD drives for the largest SSD storage you could ever get

  • @otodos-ian6627
    @otodos-ian6627 Год назад +4

    literally cannot the amount of space needed for these videos we realize now is absolutely insane

    • @mdd1963
      @mdd1963 Год назад

      Haven't they been using 8k cameras for many projects for quite a while? Nothing like recording /storing stuff in 8K so that folks can watch it in 1080P (1/16th it's original res)

  • @ro8inmorgan
    @ro8inmorgan Год назад

    Oh man seeing you guys lifting those heavy servers out of the rack really brings back memories. Nowadays I work only on cloud services, but I kinda miss my times at the datacenter :/

  • @sergey75217
    @sergey75217 Год назад

    This is the reason why i watch this channel

  • @RedLogicYT
    @RedLogicYT Год назад +7

    Linus: "Hard drives are dead"
    Also Linus: "I bought 270 hard drives"
    I just hear Linus saying the Kylo Ren *MORE* meme 🤣

  • @yourfavoritetrex
    @yourfavoritetrex Год назад +4

    I almost had a heart attack when linus ran in there with the smaller server

  • @eliaskpst
    @eliaskpst Год назад +2

    16:26 is the best part 😂. Two qualified IT specialists in that little Server room move out old servers in new ones in. Love it!
    Btw, very interesting video!

    • @bretl8130
      @bretl8130 9 месяцев назад

      qualified is a streach

  • @aserta
    @aserta Год назад +34

    17:37 when that happens, get a hex wrench of the right size and L it up in there. If you don't have enough leverage, just get a hex driver with the right tube wrench and make yourself an extra lever. CAUTION, if the rack is 100% full, you risk bending the leg. I usually grab the offending corner and then push the rail in.
    ALSO, i can't believe you put the rack directly on the floor. WTFrak. No shock mounts?

    • @marc0523
      @marc0523 Год назад +5

      I've never seen shock mounts, is it possible you live in an earthquake zone and that's why you have them?

    • @killingtimeitself
      @killingtimeitself Год назад +2

      @@marc0523 also depends on where you are locating i suppose, if its a building with any possibility of having substantial vibrations shock mounts would make sense.

    • @katarjin
      @katarjin Год назад +1

      Only place I have seen racks with shock mounts is on ship installs.

    • @mal2ksc
      @mal2ksc Год назад +1

      It's not like Vancouver never gets earthquakes, either.

  • @jojosworlds1208
    @jojosworlds1208 Год назад +4

    Because of LTT I started to build my own NAS with Truenas Core and tried to Backup anything that I can't recover from the Cloud. It's not easy because you can buy only this much as a Teenager but soon I can store the Backups on another place, so that I much safer from getting a data loss than the average citizen.

    • @jojosworlds1208
      @jojosworlds1208 Год назад

      @@ianvisser7899 I only backup important document and photos but I don´t want to lose these, but the rest is in the cloud or not important enough so..... And I have not nearly this amount of raw data, must of the things on my PC are games that are already in the cloud.

  • @CBDani
    @CBDani Год назад

    that's a BEAST ..... :O and that 90 TB of SSD is the lid ! WOW