Unsure about that unless the processing is done elsewhere. A lot of modern electronics are running into issues of getting even smaller due to how small they have already gotten. You can only get so small.
I work at another clustered file company, Qumulo who also makes these huge systems on Supermicro systems. We're actually kinda competitors with Weka. Can confirm that drive fault protection process they talked about is a really complex process that has scientific whitepapers backing it. When the drive goes down you reprotect the EC stripes for those pages. Then when new drives are added to the cluster you actually want to "rebalance" data so that heavy multistream workloads will hit all the new drives equally.
With your petabyte project i am becoming numb to numbers "400Gb pers second" "1Pb of storage" No big deal.... wait 1 Pb is 1,000 Tb 400Gb per second is about 50 to 120 times faster then any single m.2 storage on the common market..... thats fast
You are mixing up gigabit and gigabyte here! 1 gigabyte = 8 gigabit. So the 400GBit connection relates to roughly 50GByte/s transfer rate - which is still REALLY fast though, albeit "only" like 7 times as fast as the fastest consumer NVME drives :)
@cak01vej Sorry, my brain can't handle that kind of information. Are you telling me they have to build one of these every day just to keep up with their own experiments?
@@Excludos Purely speculation, but they probably have a bank of similar things that they use in cycle while they process the backlog. Like, one is taking in new information while one or two are being processed. I know absolutely nothing about this.
This really put into perspective my colleges server room, literally a 40x40 room full of server racks double the height of the server y'all built. I never really considered how nuts that was until y'all built this.
This video series is a great example of how recursive LTT's business is. They build servers to store and process the material they film while building said servers. LTT is one of the biggest self-referential meta channels on RUclips. Edit: ITT: People who know that LTT won't keep this server and also what meta actually doesn't mean. Read on to be educated 👌
@@patrickkearney8774 Because them being posted doesn't ensure they will remain. Having the raw footage for can be extremely useful for future use and reference. Also, would you want to risk years of work?
@@patrickkearney8774 Scenario: Russia hacks RUclips, uses some previously unseen exploit to explode all their servers. Suddenly LTTs years of work are gone, nowhere to be found and lost forever. Or they can keep it all and are safe, or in case some other videosite rises up and becomes more popular because people are sick of RUclipss poor ad payout and awful copyright system. Or their editors want to put in a clip of a previous video into a current one. There's plenty of scenario's as to why you would want to keep all your files, in raw high quality format.
Insurance: So you're sending this to a RUclipsr whose personality profile includes dropping very expensive things? Super Micro: Yes. Insurance: **cash register noises
@@brucepreston3927 insurance works for regular stuff. This system is anything but regular and probably half decade in front of what they are planning to do :D
Imagine being a multimillionaire, wanting a computer and giving 1.000.000 dollars to then wait for them to build you a computer with, and THIS is the video they post of the process
Honestly as a big/medium iron IT professional it's kinda cringey. They don't really understand how enterprise gear works. *You don't need full surge power for all devices in the rack. Use staggered power-on, or random power-on delay when power is restored. *They don't seem to understand how server PS deal with 3 phase vs 240 single phase, that just because the PS is 1100W does not mean the switch USES 1100W, the manufacturer just used their standard light duity 1U PS. *Enterprise server fans go full power until the ILO comes online for hardware safety, even if the system is powered off. It keeps the hardware from baking if the ILO crashes and can't manage the fan speed. *Copper DAC cables are NOT expensive. *Copper DAC cables they are using don't have much if any logic in them. Active cables would, but those are not active cables. *Those servers were NOT that loud, this was just standard 1U server noise. Connect power to a rack of Sun/Oracle SPARC servers, that is much louder. I've had DC management call me because my SPARC servers were the loudest in the building and causing comments from the other side of the (100,000 sq.ft.) room. Also ZFS resilver times are dependent on data size, not pool size. it was fast to resilver because there was no *data* to resilver.
@@danlandia4399 That's fair, but I'm pretty sure in the past, Linus and co have very much mentioned when it comes to actual enterprise and server stuff, they're just.... doing whatever. Most of Linus' videos and whatnot aren't reallllly that informative, it's just fun. This was quite the fun.
Linus, I love how you add little bits of wisdom about owning and running companies (like the health form in this video). In many ways, it’s one of the most educational parts of your content, and I always appreciate it.
"OSHA requires employers to implement a hearing conservation program when noise exposure is at or above 85 decibels averaged over 8 working hours, or an 8-hour time-weighted average (TWA)." The shorter your exposure, the higher you can go, much like radiation and other harmful influences.
To be fair, I'm pretty sure, the standard for soudn measurement is 1m away from the thing. He was way closer than that. No doubt this beast is hella loud. 100db is considered max volume in a nightclub.
Dude Linus is my favorite. I also do IT like this in the states, on an extremely high level lol… but Linus is like a GOD in the IT world… next time I work for one of my clients in Canada I’m gonna try to get in touch and just meet this dude
As a comparison, you can weld 1/4 inch steel with that amount of Amperage coming out of a 240V. That'll run them about $1 an hour in electricity; not cheap. But not terrible, I guess.
@@2tapkiddyyyy110 glad I lived in Indonesia 20$ USD is enough to power my entire house for a month maybe 30$ if I use my welding machine and another heavy electronic devices, somehow we are having energy surplus here, thx to my corrupt government I think.
I remember thinking how cool the DAC connectors looked when I first built and setup our servers and network at work. They previously had CAT 5e everywhere and a combination of 1Gbps and 100Mbps "fast ethernet". For less than the price of 1 server from Dell (that only had SATA SSDs and 1Gbps networking...) I built out a workstation/server that is faster in every conceivable way, has NVMe drives for the SQL database, dual 40Gbps connections, and an "old" network switch (thanks Wendell for the great videos and forum posts!) that has 48 ports @ 10Gbps (rj45) and 4/40Gbps ports. I saw you guys also got your DAC cables from FS, and I gotta say, I was thoroughly impressed at their prices and quality. My deployment has been going strong for over 2.5 years at this point, and it's still the fastest, and most reliable server we've ever had. Put some 10Gbps NICs in all of the engineers workstations, and had their room wired up with CAT6A, and the productivity increase has been phenomenal. Finally got the internet upgraded to 1Gbps symmetrical fiber, and it's made working from home even better. Thanks LTT for really getting me heavily back into tech a few years back. I'm an engineer, but I still do a ton of IT related tasks just because of how much of your content I watch and the curiosity it sparks!
Wow we share a lot of the same tech experiences. I just deployed another storage server about two months ago with two QSFP+ connections to two used enterprise 48-port 10Gbase-T switches that each have 4 QSFP+ ports using DACs from FS (great stuff). The bunch of other storage servers in the rack are connected the same way except for the oldest one that's connected via 4 x 10GBase-T LACP. We also wired the entire office with CAT6A and the infrastructure has served the company exceeding expectations for just over 2 years since we moved in. The difference is that we're a video business and I'm an image technician that does IT related work because I absolutely loved it since I was a kid. 10GBase-T has been very reliable and no one needs to mess around with hard disks and desktop-NASes after ingest anymore. The mechanical sliding and clicking of DIMMs, drive sleds, rack rails, and transceivers locking into place never gets old. I'm so glad I get to be hands on with IT even though I ultimately decided to pursue a different career.
@@robertgarrison1738 most IPMI (or iLo or CIMC) are on if any of the power supplies are plugged in (even when machine is off). Unless both A and B side power supplies have failed, IPMI should be up (in my history with super micro, if you upgrade IPMI to latest firmware, they run fine for years and years). In theory you could remotely cycle the power with an IP PDU, if you really had to. You could also log into your Top-of-Rack out-of-band management switch, where most of your IPMI should be connected, and make sure you are getting MAC/ARP for IP, etc.
@@matthewesunderland why are you responding to me with this? Obviously I know what ipmi is and how it works. I was asking the method for which he has set it up on his custom servers he built.
@@robertgarrison1738 You asked "For NOC purposes how do you get them back up remotely on a weekend if they drop?". I have 5 supermicro servers in my basement, all of which have IPMI ports that I have used for years (9+), most of the time remotely over VPN. I was trying to say, short of a loss of power, or a loss of networking, when upgraded to the latest firmware, they never drop (maybe once on one board, I had to reset the IPMI in the very early days ... that required pulling the whole tray out and getting access to the board.) I can't imagine LTT/LMG would be doing anything different. As for the IPMI type, I just logged into the IPMI port I use the most on my server, and it branded SuperMicro, and I see no evidence it was made by anyone but them, it looks like an internal software version called "Redfish". Which from this: www.supermicro.com/en/solutions/management-software/redfish looks like an API. Which VMware vSphere can use for things like DPM.
I love how just pure nerdy these two genuinely get over this, it's absolutely catching an always end up smiling along with em. Let alone these two make a hilarious pair.
When Jake first started he was on the childish side but he’s mellowed out while Linus seems to be more childish and happier overall. They definitely developed some good chemistry.
Having been involved in setting up a single cabinet blade server system with little to no experience this brought back memories. I laughed a bit to hard when they had the wrong 240 plug.
18:44 - as the fans spin up and reach full tilt (which I'm sure they aren't at that point), all I can imagine is that THX demo that was before feature films...
@@sfisosg7904 I know that a possible one is noise exposure duration, 106db is loud as hell, the recommendation without hearing protection would be at most 3minutes 45seconds if you go by NIOSH's standards, it's a lot more lax with OSHA standards tho so idk
@@no1DdC *Socks with sandals:* +3 Intelligence, -5 Dex The Linus Build: The only combination of Skills and Items that results in a Dex-Level under zero 😂😂😂
Oh yes. I can’t imagine how cool it would be to handle tech of this scale, so good luck, have fun, and DON’T DROP THE SERVER LINUS!!! I’m just waiting for the video titled “I broke a $1,000,000 computer”
Trust me its cool and scary. I know from personal experience. Imagine holding computer circuit card that is worth more than Lamborginue. I have. Part of my past work which I am certified for is to fix really expensive computer circuit card/boards
Got an EOL IBM AS400 out of a skip in the basement, sounds like a Harrier spinning up, 86dB at idle. It probably has half the processing power of a modern desktop :)
I actually respect that he sort of checked his statement because he doesn't want to discourage anyone in his company from reporting injuries. It's fine if he doesn't want to hassle with reporting his own injuries, but preventing a generally negative perception and work culture toward injury reporting is a ethical decision as an employer. The last thing you want is for your employees to think, consciously or not, that they are somehow whiney or weak or being "that guy" if they report issues.
@@DaimyoD0 That's exactly what you want them to think. Filling out a form for a cut is just for losers. The main reason people get the "you're not what we're looking for at this current time" call, after an interview, is because they're whiny losers.
@@DaimyoD0 There was an episode a while back where he hurt/cut himself minor and was like no this doesn't count. But then Linus asked who I presume is the health and safety staff member who went yes this is workplace injury and basically ordered him to complete the relevant form in. A workplace where a staff member is able to do that to the owner boss who listen, they're fine.
Love the description text: "keyword optimized description (should be two lines long in the RUclips text editor and include the product name) - Copy from Trello"
@@shreyam1008 probably a boo boo. They’re done this a few times before. The video is uploaded and readied before publishing, but they forget to change that template description before publishing
A recommendation to Jake and Linus: Buy a molle ballistic plate carrier. I'm a Mechanical Engineer at work and I'm expected to assemble a lot of the stuff I design. Having a molle vest means I can secure a bunch of standard pouches to my chest like a tool belt, so nothing is ever out of arm's reach of me as I'm working and everything has a specific place on my torso. I even have room for an Ifixit kit, a full socket wrench set, metric and imperial allen wrenches, and some other stuff all on my basic vest. Downside is I look like I'm gonna go on a mass shooting when I wear it, but in Canada that shouldn't be an issue for you guys
I really hope they installed (off-camera) the small flush-mount screws that supermicro rails need to be fully secured to the sides of the servers. Yes, the rails clip on nicely (9:22) to the server sides via back-to-front force and seem secure . But they'll pull right off the server again with any front-to-back force put along the rail. . . which is likely to happen as you pull the server out of the rack for maintenance. Especially when you're de-racking. This can lead to the server suddenly falling as you pull it out, usually when you hit the stops. Ask me how I know (I didn't rack the servers that taught me this!).
@@SocietyUnplugged the screws to which I am referring screw into the sides of the server. They are tiny and screw in flush with the rails so they don’t interfere with sliding while still making it impossible for the rails to just come “unclipped” from the sides of the server. The concern is that the rails are merely “clipped” and not screwed to the sides. What they are doing at 12:56 is just screwing the front screws in to keep the server from sliding on the rails normally (which can happen inadvertently while plugging things into the back, etc.).
I've spent the past few months building a data-centre for the first time, and actually, morale and spirits are generally pretty high on site. Not quite this much larking about though!
When you boot real servers they always spin up full speed until the OS boots and can turn the fans down with low load. They are offensively loud when you boot a rack
7:44 the insanity of linus being known to drop something (usually important in some way) and yet he still has the confidence to handle equipment of this caliber is the confidence that i aspire to have one day.
Tool sash. PC tools are smaller, so you don't need as much space, and I'd assume you'd mostly only need to grab tools with one hand, meaning a sash would be more ergonomic. Touching your left shoulder with your right hand is easier than your left hip
i dont know why any company involved in this said yes im just glad they did i cant wait to see what comes next also im pretty sure every1s job is safe hahaha you guys are fun i pre ordered or email secure what ever for both
@@rswl_mrwn1175 Because the company's who can afford this need a demo and Linus is building it for comparative peanuts, and using his contacts to make it happen.
They probably did all the testing and prepared all the demos they need to do with this configuration. I could think of it as a next-gen enterprise configuration that would get much more exposure via Linus. So once they had everything they wanted to do to it internally, they sent it over. I also am pretty sure everything is insured here, so no worries there.
Im not gonna lie I got excited just watching you two set this up, and I know NOTHING about servers. Even just the sheer amount of hardware and connections is just... wow
"I didn't cut myself so I don't have to fill out that stupid form.." Lol I worked as a fish cutter in a processing plant in my 20s and I had to fill out A LOT of those forms
I remember when Google announced they had several pedabytes of storage between their servers, and it felt like only a company as rich and powerful as Google would ever have that much storage. This was when having a 1 terabyte in your PC required 4 drive bays.
It hasn’t been cheap but my homelab has around half a PB over 24 HDDs and 24 SSDs. About 10 years ago that lab started with an old Lenovo desktop from work and a 1TB drive. I have gigabit fiber internet at home, which in itself is massive growing up in the dialup era. I still get impatient waiting for a 200gb game to download in ~20 mins when back then I had to do mp3 downloads overnight. Hell, just smartphones in general. I’m not that old but I remember having a phone (Nextel i930) with Windows Mobile on it. It got like 2 hours of battery life and there really wasn’t data or WiFi support but it was so cool at the time. Now my 14mo son can navigate a smartphone and tablet.
@@velo1337 even cooler, a midsize company doesn’t even need to own the hardware. Just pay someone else pennies and they have conceptually limitless storage and compute available without ever knowing where that hardware actually lives.
Okay so today I learned that server rails have the exact same mechanism that I use for my socks drawer. Which is worth nowhere near $1000000. Cool, cool
I'm really interested in that software. Would love some comparisons to other data/file storage systems and software. Looks crazy, that visualization and stuff...
@@EricTanGH0ST 1ru is in the order of $100 a month (heavily dependent on where you are in the world and the services and qualifications the DC provides)
Fun fact, the most expensive part of a new defense weapon system isn't the hardware -- it's the software (referencing their mention of the $400K file system).
As a network engineer, I'm pretty used to QSFP direct attach cables. What is awesome is that the cables are rated at 200Gb/s. I have dealt with some QSPFs that run at 400Gb/s but anything over 100Gig is rare for the work I do.
@@user-rd3jw7pv7i Not sure how insane working as a network engineer for a technology partner that works with enterprise customers sounds. There are a lot of jobs like mine that work with high speed links.
@@bassman87 Unless your in consumer service and repair like me, I wish I could do service and repair on these puppies, holy shatner are these cool as hell to look at.
@@MinecraftLD10 Yeah I work at a value added reseller, we have partnerships with Cisco, HPE, Juniper, Palo Alto Networks, ect. Because of this I get to deploy these technologies for our enterprise customers. its not lost on me that LTTs audience traditionally includes consumer level tech leaning into the small business tech, so enterprise gear can seen foreign. But like I said on my first post, even in the enterprise side of things I rarely see links over 100gig (excluding stacking cables which can have a throughput up to 1Tb/s), so the 200gig and 400gig are still interesting.
I am always so incredibly nervous to watch Linus handle ANYTHING of value. He has the "dropsies" worse than anyone, ever. It's also only going to get worse as he gets older. Please put carpet pad underneath all of your sets! lol. I've never had more fun watching a channel! Jake, ummm...please wear a belt maybe? :)
Supermicro rails also threw me off when I first saw them, but I also grew to appreciate them. They're pretty easy to work with once you understand the design.
At 25:09 we see a man whose wildest dreams and aspirations have not just come true, but been exceeded in every way. Like the culmination of the last 15 years of Linus's career on RUclips in one face of unbridled joy.
I actually think it almost always makes sense to file a claim against its own company: If you pay out money to the shareholders (here Linus) you get taxed but if you not pay out and rather let the company pay for your health problems related to work, you sort of don't have to pay taxes because it ain't pay out.
@@Camelotsmoon Worth. standing operating procedure, i.e. starting and maintaining a precedent for future claims while also not being completely unfamiliar with those processes when you are at your most vulnerable in a future incident.
@@TheNewton Eh, I think you're thnking too corporate for Linus. Linus is the guy who has said he'd rather his employees come at him as a person rather than an employee.
@@Camelotsmoon no, he's saying you should familiarize yourself with a task while you can think clearly before attempting it when you're not at your best. Nothing about familiarity or not, just standard lessons.
They need to pay more attention to rail screws. It's a bad time when months later you expect to pull something out of the rack half way and it ends up on you or the floor.
To be clear, that's 32A _per circuit_ - each socket is only 13A. But that's still >3kW per socket and 7.6kW for the circuit (though you don't want to sustain either of those figures for extended periods, especially with less trusted wiring). (Not disagreeing; just making sure people don't get the wrong impression :)) Much of mainland Europe actually has us beat in that regard, as the Schuko socket can handle 16A, I think, which is around 10% more power even at the lower 220V or 230V. Not to mention that it's common in some mainland European countries for houses to have a 3-phase, ~400V socket in the garage or similar 😮 (More of that in the UK please! Having a 415V 32A socket on the wall would be pretty sweet :)) And a perhaps overlooked benefit of 240V is not really having to worry about voltage drop, even when drawing 13A over a 20m extension lead. You have to try _really hard_ for that to ever be a problem 😸
I think Canada uses the same standards as the US which means standard lines are 110-120V but the power coming in is actually 220-240V. We have a center tap on the transformer coming into the house/building so there's actually 3 lines coming in and by connecting to the 2 outermost connections we can get 220-240V. I do wish we had more 3 Phase (our system is split phase) since it allows for far more efficient motor design (allowing for more efficient heatpumps/AC and fans). The 120V standard is a bit safer overall (so even though we don't have fancy fuses and guards on all of our outlets you're not likely to die if you get shocked, it just stings a bit, unless you hold onto it then your dead). 240 is more efficient and provides more power for heating and motors, technically it could be more efficient for everything but in practice most electronics have to be run at much lower voltages anyway so afaik there's no practical difference there. Due to our size (not to mention political hurdles) changing the infrastructure across the US is basically impossible.
@@TheCrazyP8 Only _nominally_ 230V :) The European grid is specified as either 230V -6%/+10% or 230V -10%/+6% - I don't immediately recall which. That range allows the UK to continue using 240V, and historically 220V countries to remain on 220V, while all being """230V""" 😹 This house in the south of England sees about 238V on average (yes, that's technically an average of an average (RMS) :)). In the past week, the lowest and highest peaks were 231V and 243V, but it was 235-240V for the vast majority of that time. I vaguely recall hearing that some part of the country is now _properly_ on 230V, but most of the UK is still very much 240V, as far as I'm aware :)
Those cables just looked to be normal qsfp. You wouldn't need them to be active for such short lengths and the circuit boards in them just have RC filters on each lane. Active cables are typically for lengths over 5 or 10m when you need to boost the signal strength just to get a clean reading at the other end. I used to work for a company that made these and my job was to design, build, and program systems to do electrical performance QA on these connectors/cables (and many other connector standards). Basically automated a fancy oscilloscope and some very expensive multi position switches to collect measurements, process the data, and give an overall pass/fail.
More importantly than being short, having small hands is advantageous for tech geeks. I'm a 6'2" embedded systems engineer with mongo hands and would give the world for Linus' tiny fingers.
I can also confirm something similar I have big hands but they're also really thin (I'm skinny as hell) and working on my PC, I recall one bit I was able to do decently was installing an M.2 drive I was watching my boyfriend do the same thing recently and he has fatter hands than mine (not hard) and he was having a hard time getting the M.2 in from it
There are 2 factors that are advantageous. Small hands, and steady hands. I've got the first but boy do the shakes make it hard to solder small smd parts
Awesome video. It makes me a bit anxious how they handle the hardware sometimes, but in fairness it is for entertainment purposes and it works and they know what they are doing. Great to see the company that I work for being represented on LTT in this matter.
To be honest I think a lot of the enthusiast world is quite janky. Think like Jerry rigging and early overclocking. But yeah, it's a little tough to see them just fuck around with this much money. But... It's fun! So...
To shoot the intro when Linus says "wait where'd it go" they must have shot the resulting build after the "you have to build it first" I like the planning the script through, neat trick
The excitement that I had for you guys is astronomical! This kind of hardware is literally what dreams are made of. I cannot wait to see more updates on this project and further server ventures!
Now the editing on this video was on point A great hook,lots of energy from the second you click the video Really entertaining and such an epic project
Hearing about this project on WAN Show is what finally got me to build my own rack and finally get organized with all my various server boxes and random drives that have just been strewn about on floors and tables and in closets and who knows where else. My budget is considerably smaller, my rack is only 15U and I'm using only 9U of it, but as I've been migrating everything, building a proper rack mount NAS, and getting everything nicely organized and cable managed, I've felt like an absolute boss. I even have a proper switch on the thing, it's glorious. So anyway, thanks for finally giving me the kick in the pants that I've needed for a long time now, making me geek out about this thing and making me want to be able to finally geek out about my own modest set-up. I mean heck, I've got rack mounted Raspberry Pis on this thing, overall it's not that fancy. But everything is in one place and clean, and it's already impressed the absolute crap out of my friends and relatives sending them pictures. I should have done this years ago and it's this series of videos that made me do it.
i want to make a smaller version of one of this for my PC, so i can finally blow up 100 explosive barrels at the same time in Gmod [Gmod is such a lag machine for a PC, how they should test how strong PC's are, is how many of the barrels can be exploded at once without crashing the game]
16:28 They're SFPs! The logic on them is not just for translating from one medium to another, but also usually for reporting diagnostics (though not all modules will report). I mostly work with fiber SFPs and the ones we use at the company I work for report the current fiber light levels and other diagnostic information like what the threshold is for too high or too low of light levels and if the SFP is getting enough voltage. Some will even record a brief history of changes of statistics. They're pretty cool. The fastest I've worked with is 100 Gbps.
is there a followup video for this? at the end they don't actually show the performance and I'm wondering where the next installment is or if there's a release date scheduled?
The server you installed over the switch should went beneath, with the other five, so you'll have room to put your hand in case you need to reach the switch coolers or power suplies.
I think the reason that the switch had to be in between them is the length of the DAC cables. For DAC cables of that speed they have to be really short.
Discovering the change in power in the shop reminded me of the movie "Hidden Figures"; They were installing an IBM mainframe, but they forgot to measure the door, and it was too small to get the computer in the room. :-)
Maybe it's just the RUclips algorithm (I know, this video was uploaded more than 1 year ago), but I have the feeling that you guys build a new overpowered server rack every week 😁
13:49 I cringed when I saw Linus was propping the box on top of those protruding metal thingymagigs, and then came the crunch of the box being pierced, my heart sank.
Love how they get all excited about the power bars and those are just kinda normal at Data Centers and we even have 3 phase power in some racks....welcome to enterprise grade.
You know you’re cooking with something special when your cooling system makes the THX noise 18:37
I was hoping I wasn't the only one that heard the similarity
This deserves more likes
underrated comment
Loooool
now i cant unhear it.
In twenty years, I guess I'll be carrying one of these in my pocket. Or in my earlobe or whatever.
@@Nico-ds9nz I also want to remind your future self that you said ore instead of or
fr
fr
Unsure about that unless the processing is done elsewhere. A lot of modern electronics are running into issues of getting even smaller due to how small they have already gotten. You can only get so small.
moore's law doesn't work anymore.
ahh my favourite content, Jake and Linus being children around expensive server equipment. Give me more
Comment “make this a chain!”
I fully agree
MOAR
100%
Just the sweeties babies, groanin on their toizzz.
I work at another clustered file company, Qumulo who also makes these huge systems on Supermicro systems. We're actually kinda competitors with Weka. Can confirm that drive fault protection process they talked about is a really complex process that has scientific whitepapers backing it. When the drive goes down you reprotect the EC stripes for those pages. Then when new drives are added to the cluster you actually want to "rebalance" data so that heavy multistream workloads will hit all the new drives equally.
puff puff pass
So how many gigashits per megafart are we talking here?
@@DylanCrowlGolf this was so funny that I didn't laugh
@@DylanCrowlGolf😂😂😂
Weka will blow qumulo out of the water in terms of performance though. Qumulo will win on price
With your petabyte project i am becoming numb to numbers
"400Gb pers second"
"1Pb of storage"
No big deal.... wait 1 Pb is 1,000 Tb
400Gb per second is about 50 to 120 times faster then any single m.2 storage on the common market..... thats fast
for him its like 4gb/sec and 100Tb
You are mixing up gigabit and gigabyte here! 1 gigabyte = 8 gigabit. So the 400GBit connection relates to roughly 50GByte/s transfer rate - which is still REALLY fast though, albeit "only" like 7 times as fast as the fastest consumer NVME drives :)
@cak01vej Sorry, my brain can't handle that kind of information.
Are you telling me they have to build one of these every day just to keep up with their own experiments?
@@Excludos Purely speculation, but they probably have a bank of similar things that they use in cycle while they process the backlog. Like, one is taking in new information while one or two are being processed. I know absolutely nothing about this.
@@swagatrout3075 1 Petabyte is 1024 Terrabytes
Linus: There's business grade computer, and then there's enterprise grade computer.
Also Linus: Let's YOLO it
Some more EPYC Swiftshader madness across all those overclocked threads would be cool 😎
And then there is Tech demo grade like this project.
and after Enterprise grade you have data center grade
This is honestly normal for enterprise grade.
@@88porpoise *fingers to chin* i wonder where it all goes
I love how he's put links to the parts in the description like we're gonna build a $1,000,000 PC 😂
Please dont click that
its all cheap smb gear anyways.
Well obviously not. You need to build two so you can play with a friend
Im gonna build it
@@memecity4468 ok, go ahead
This really put into perspective my colleges server room, literally a 40x40 room full of server racks double the height of the server y'all built. I never really considered how nuts that was until y'all built this.
This video series is a great example of how recursive LTT's business is. They build servers to store and process the material they film while building said servers. LTT is one of the biggest self-referential meta channels on RUclips.
Edit: ITT: People who know that LTT won't keep this server and also what meta actually doesn't mean. Read on to be educated 👌
"They build servers to store and process the material they film while building said servers" that feels wrong smh.
@@patrickkearney8774 it’s not past projects only, but also WIP’s, templates, etc etc etc.
@@patrickkearney8774 Because them being posted doesn't ensure they will remain. Having the raw footage for can be extremely useful for future use and reference. Also, would you want to risk years of work?
They aren't keeping this server so your entire premise flawed at the most fundamental part
@@patrickkearney8774 Scenario: Russia hacks RUclips, uses some previously unseen exploit to explode all their servers. Suddenly LTTs years of work are gone, nowhere to be found and lost forever.
Or they can keep it all and are safe, or in case some other videosite rises up and becomes more popular because people are sick of RUclipss poor ad payout and awful copyright system. Or their editors want to put in a clip of a previous video into a current one. There's plenty of scenario's as to why you would want to keep all your files, in raw high quality format.
The next LTT hire is confirmed to be a person just to lift heavy things.
Necessary skills: Lift heavy things...WITHOUT DROPPING THEM. :P
Literally me as a field tech
Known as "Jack"?
Terry Crews
I volunteer as tribute. Ill work for merch and I can start tomorrow cuz I'm Canadian
I can’t imagine how nervous everyone at super micro was watching Linus handle this expensive tech and almost dropping it several times
That's what insurance is for...I imagine Linus knows the insurance people well! lol
Insurance: So you're sending this to a RUclipsr whose personality profile includes dropping very expensive things?
Super Micro: Yes.
Insurance: **cash register noises
@@brucepreston3927 insurance works for regular stuff. This system is anything but regular and probably half decade in front of what they are planning to do :D
wrst case he breaks it and gets more views aka more marketing... its all good baby baby
They probably already wrote it off when they shipped it to LTT. SuperMicro is a big company , this isn't going to hurt them. lol
Imagine being a multimillionaire, wanting a computer and giving 1.000.000 dollars to then wait for them to build you a computer with, and THIS is the video they post of the process
I would be damned up
Technically this was sponsored. They didn’t pay anything
@@SteveDonev I said, *imagine*
What’s wrong with that?
@@XeroDash0 Bro they are playing with the computer like it's a toy. Funny, yes But if you paid for the thing, no
I love how much fun both LInus and Jake have together with all these expensive and crazy components. It's infectious as heck.
linus and jake have such great chemistry, i enjoy every video they do together so much.
Honestly as a big/medium iron IT professional it's kinda cringey. They don't really understand how enterprise gear works.
*You don't need full surge power for all devices in the rack. Use staggered power-on, or random power-on delay when power is restored.
*They don't seem to understand how server PS deal with 3 phase vs 240 single phase, that just because the PS is 1100W does not mean the switch USES 1100W, the manufacturer just used their standard light duity 1U PS.
*Enterprise server fans go full power until the ILO comes online for hardware safety, even if the system is powered off. It keeps the hardware from baking if the ILO crashes and can't manage the fan speed.
*Copper DAC cables are NOT expensive.
*Copper DAC cables they are using don't have much if any logic in them. Active cables would, but those are not active cables.
*Those servers were NOT that loud, this was just standard 1U server noise. Connect power to a rack of Sun/Oracle SPARC servers, that is much louder. I've had DC management call me because my SPARC servers were the loudest in the building and causing comments from the other side of the (100,000 sq.ft.) room.
Also ZFS resilver times are dependent on data size, not pool size. it was fast to resilver because there was no *data* to resilver.
@@danlandia4399 That's fair, but I'm pretty sure in the past, Linus and co have very much mentioned when it comes to actual enterprise and server stuff, they're just.... doing whatever.
Most of Linus' videos and whatnot aren't reallllly that informative, it's just fun. This was quite the fun.
@@danlandia4399 Classic gatekeeping
@@Mavis847 Yeah. Can you imagine the watchability of these videos if a proper serious enterprise guy was in charge?
Cut to 2 years from now: "we blew through our Petabyte server, so we bought another building to store an entire YOTTABYTE of data"
Yolobyte*
Yeet
Hey man, gotta store that 32K footage somehow
but can it run crysis
@@pranavarora9976 32k is for peasants! Linus only shoots in 256k
When it switched on for the first time, the sound of the fans was a near perfect harmony of the THX sound
Exactly
YES, my thoughts exactly!
I was like woah thx
Yep
i had hoped they would cut that in XD
Linus legit carried me through my IT course in college. Soo nostalgic to see him 8 years later haha
@animateamor9192 Stands for Information Technology
Whoever does HR for LMG must self medicate after these kinds of episodes
That's Linus and his wife lol
There have external HR beyond Team management
That's Yvonne
They put Xanax in their bathroom auto release air freshener
I don't understand the joke, anyone kind explaining?
Linus, I love how you add little bits of wisdom about owning and running companies (like the health form in this video). In many ways, it’s one of the most educational parts of your content, and I always appreciate it.
You can run companies, research facilities, military operations etc. all on open source tech.
Linus Business Tips
20:14
For those wondering
75 decibels is considered the limit without hearing protection before you have a chance of irreversible hearing damage
"OSHA requires employers to implement a hearing conservation program when noise exposure is at or above 85 decibels averaged over 8 working hours, or an 8-hour time-weighted average (TWA)."
The shorter your exposure, the higher you can go, much like radiation and other harmful influences.
To be fair, I'm pretty sure, the standard for soudn measurement is 1m away from the thing.
He was way closer than that.
No doubt this beast is hella loud.
100db is considered max volume in a nightclub.
Dude Linus is my favorite. I also do IT like this in the states, on an extremely high level lol… but Linus is like a GOD in the IT world… next time I work for one of my clients in Canada I’m gonna try to get in touch and just meet this dude
22:47 the moment Linus realizes how much power it draws
22:48 the moment he realizes he has to pay for it.
As a comparison, you can weld 1/4 inch steel with that amount of Amperage coming out of a 240V. That'll run them about $1 an hour in electricity; not cheap. But not terrible, I guess.
@@ryanj610 1$ in my country could power on my entire house for 2 days
Did the math itd be a little under 16$ for 24 hours. Expensive for electricity, but not expensive.
@@2tapkiddyyyy110 depends on your country money value
@@2tapkiddyyyy110 glad I lived in Indonesia 20$ USD is enough to power my entire house for a month maybe 30$ if I use my welding machine and another heavy electronic devices, somehow we are having energy surplus here, thx to my corrupt government I think.
I remember thinking how cool the DAC connectors looked when I first built and setup our servers and network at work. They previously had CAT 5e everywhere and a combination of 1Gbps and 100Mbps "fast ethernet". For less than the price of 1 server from Dell (that only had SATA SSDs and 1Gbps networking...) I built out a workstation/server that is faster in every conceivable way, has NVMe drives for the SQL database, dual 40Gbps connections, and an "old" network switch (thanks Wendell for the great videos and forum posts!) that has 48 ports @ 10Gbps (rj45) and 4/40Gbps ports. I saw you guys also got your DAC cables from FS, and I gotta say, I was thoroughly impressed at their prices and quality. My deployment has been going strong for over 2.5 years at this point, and it's still the fastest, and most reliable server we've ever had. Put some 10Gbps NICs in all of the engineers workstations, and had their room wired up with CAT6A, and the productivity increase has been phenomenal. Finally got the internet upgraded to 1Gbps symmetrical fiber, and it's made working from home even better. Thanks LTT for really getting me heavily back into tech a few years back. I'm an engineer, but I still do a ton of IT related tasks just because of how much of your content I watch and the curiosity it sparks!
Wow we share a lot of the same tech experiences. I just deployed another storage server about two months ago with two QSFP+ connections to two used enterprise 48-port 10Gbase-T switches that each have 4 QSFP+ ports using DACs from FS (great stuff). The bunch of other storage servers in the rack are connected the same way except for the oldest one that's connected via 4 x 10GBase-T LACP. We also wired the entire office with CAT6A and the infrastructure has served the company exceeding expectations for just over 2 years since we moved in. The difference is that we're a video business and I'm an image technician that does IT related work because I absolutely loved it since I was a kid. 10GBase-T has been very reliable and no one needs to mess around with hard disks and desktop-NASes after ingest anymore.
The mechanical sliding and clicking of DIMMs, drive sleds, rack rails, and transceivers locking into place never gets old. I'm so glad I get to be hands on with IT even though I ultimately decided to pursue a different career.
What sort of IPMI are you running on those machines? For NOC purposes how do you get them back up remotely on a weekend if they drop?
@@robertgarrison1738 most IPMI (or iLo or CIMC) are on if any of the power supplies are plugged in (even when machine is off). Unless both A and B side power supplies have failed, IPMI should be up (in my history with super micro, if you upgrade IPMI to latest firmware, they run fine for years and years). In theory you could remotely cycle the power with an IP PDU, if you really had to. You could also log into your Top-of-Rack out-of-band management switch, where most of your IPMI should be connected, and make sure you are getting MAC/ARP for IP, etc.
@@matthewesunderland why are you responding to me with this? Obviously I know what ipmi is and how it works. I was asking the method for which he has set it up on his custom servers he built.
@@robertgarrison1738 You asked "For NOC purposes how do you get them back up remotely on a weekend if they drop?". I have 5 supermicro servers in my basement, all of which have IPMI ports that I have used for years (9+), most of the time remotely over VPN. I was trying to say, short of a loss of power, or a loss of networking, when upgraded to the latest firmware, they never drop (maybe once on one board, I had to reset the IPMI in the very early days ... that required pulling the whole tray out and getting access to the board.) I can't imagine LTT/LMG would be doing anything different.
As for the IPMI type, I just logged into the IPMI port I use the most on my server, and it branded SuperMicro, and I see no evidence it was made by anyone but them, it looks like an internal software version called "Redfish". Which from this: www.supermicro.com/en/solutions/management-software/redfish looks like an API. Which VMware vSphere can use for things like DPM.
I love how just pure nerdy these two genuinely get over this, it's absolutely catching an always end up smiling along with em. Let alone these two make a hilarious pair.
When Jake first started he was on the childish side but he’s mellowed out while Linus seems to be more childish and happier overall. They definitely developed some good chemistry.
They are the 'Cheech & Chong', 'Laurel & Hardy' or 'Abbot & Costello' of the geek tech world.
Well they're nerds so its norma 4 them to be nerdy
Having been involved in setting up a single cabinet blade server system with little to no experience this brought back memories. I laughed a bit to hard when they had the wrong 240 plug.
11:47 I like how the most replayed part is where Linus flips his screw driver
not gonna lie... that was a pretty awesome flip ;D
Cyber geeks are gonna be cool as shit in 2077
Linus is the main character
clean flip
How do you check the most replayed part?? Wtf
18:44 - as the fans spin up and reach full tilt (which I'm sure they aren't at that point), all I can imagine is that THX demo that was before feature films...
I'm thoroughly impressed, Linus only violated 4 Labour Laws in this episode
And they are....
@@sfisosg7904 i would also like to know
@@IRMacGuyver duuuuude🤣🤣🤣
It's the charm of the channel
@@sfisosg7904 I know that a possible one is noise exposure duration, 106db is loud as hell, the recommendation without hearing protection would be at most 3minutes 45seconds if you go by NIOSH's standards, it's a lot more lax with OSHA standards tho so idk
Linus: has the grip strength to do chin ups on the server rack, but doesn't have the grip strength to pick up a GPU
RACKING them chin ups, while wrecking them GPUs.
It's all or nothing.
It's because he is lighter than a GPU.
He maxed out STR for his character class, but neglected to invest any points into DEX.
@@no1DdC
*Socks with sandals:*
+3 Intelligence, -5 Dex
The Linus Build: The only combination of Skills and Items that results in a Dex-Level under zero 😂😂😂
"As long as nobody tries to tilt it" - Jake, after just trying to tilt it.
Oh yes. I can’t imagine how cool it would be to handle tech of this scale, so good luck, have fun, and DON’T DROP THE SERVER LINUS!!! I’m just waiting for the video titled “I broke a $1,000,000 computer”
LMAO
DID YOU SEE LINUS PUT THAT BOX WITH A SERVER IN IT RIGHT ON TOP OF THE LATCHES FOR THE BIG BOX AND YOU CLEARLY HEAR IT PUNCTURE THE BOX?!?
Trust me its cool and scary. I know from personal experience. Imagine holding computer circuit card that is worth more than Lamborginue. I have. Part of my past work which I am certified for is to fix really expensive computer circuit card/boards
@@MichaelJordan-uo2ke What's a Lamborginue?
@@kennyb123 Fancy version of a shitty car
man I always get fascinated by tech, love it
you know your PC is good when the fans revving up sounds like the THX sound 😂
Got an EOL IBM AS400 out of a skip in the basement, sounds like a Harrier spinning up, 86dB at idle. It probably has half the processing power of a modern desktop :)
im glad im not the only one who thought that, i heard it and thought they added that in at first
Shhh the movie is starting 🍿🤣
@@Kotafox93 F U R R Y
You know it's good when the case is so large that it comes on a pallet and needs to be moved with a pump jack
linus: "I didn't get cut so I don't have to fill out that stupid form"
linus' brain:"BACKTRACK! BACKTRACK!"
I actually respect that he sort of checked his statement because he doesn't want to discourage anyone in his company from reporting injuries. It's fine if he doesn't want to hassle with reporting his own injuries, but preventing a generally negative perception and work culture toward injury reporting is a ethical decision as an employer. The last thing you want is for your employees to think, consciously or not, that they are somehow whiney or weak or being "that guy" if they report issues.
That was trippy. I started to read this comment just as he said it.
@@DaimyoD0 Calm down
@@DaimyoD0 That's exactly what you want them to think. Filling out a form for a cut is just for losers. The main reason people get the "you're not what we're looking for at this current time" call, after an interview, is because they're whiny losers.
@@DaimyoD0 There was an episode a while back where he hurt/cut himself minor and was like no this doesn't count. But then Linus asked who I presume is the health and safety staff member who went yes this is workplace injury and basically ordered him to complete the relevant form in. A workplace where a staff member is able to do that to the owner boss who listen, they're fine.
Love the description text: "keyword optimized description (should be two lines long in the RUclips text editor and include the product name) - Copy from Trello"
LMAO
lol. . loved it.
is this a gag? or was it a boo boo??
@@shreyam1008 probably a boo boo. They’re done this a few times before. The video is uploaded and readied before publishing, but they forget to change that template description before publishing
A recommendation to Jake and Linus: Buy a molle ballistic plate carrier. I'm a Mechanical Engineer at work and I'm expected to assemble a lot of the stuff I design. Having a molle vest means I can secure a bunch of standard pouches to my chest like a tool belt, so nothing is ever out of arm's reach of me as I'm working and everything has a specific place on my torso. I even have room for an Ifixit kit, a full socket wrench set, metric and imperial allen wrenches, and some other stuff all on my basic vest. Downside is I look like I'm gonna go on a mass shooting when I wear it, but in Canada that shouldn't be an issue for you guys
18:45 You know you have powerful equipment when it makes the THX sound as it turns on
Came looking to see if anyone else heard it too lmfao
And so the time-honored tradition of, "Two Men, One Computer" builds continues...
Why are you like this?
*One cup memories intensifies...*
For what this is useful?can we play games and studing on it?
@@rswl_mrwn1175 this type of machine is beyond your pedestrian "Racecar Johnny" needs.
This is more “Two Computer Super-nerds and A Blank Check”.
I really hope they installed (off-camera) the small flush-mount screws that supermicro rails need to be fully secured to the sides of the servers. Yes, the rails clip on nicely (9:22) to the server sides via back-to-front force and seem secure . But they'll pull right off the server again with any front-to-back force put along the rail. . . which is likely to happen as you pull the server out of the rack for maintenance. Especially when you're de-racking. This can lead to the server suddenly falling as you pull it out, usually when you hit the stops. Ask me how I know (I didn't rack the servers that taught me this!).
It'll end up as the 785,000 pc once Linus breaks it
when comes the next part?
12:56
@@SocietyUnplugged the screws to which I am referring screw into the sides of the server. They are tiny and screw in flush with the rails so they don’t interfere with sliding while still making it impossible for the rails to just come “unclipped” from the sides of the server. The concern is that the rails are merely “clipped” and not screwed to the sides. What they are doing at 12:56 is just screwing the front screws in to keep the server from sliding on the rails normally (which can happen inadvertently while plugging things into the back, etc.).
Nope ruclips.net/video/5Hxr9k5Vdc4/видео.html
but can it run minecraft
Imagine you hire some technicians to build you a server and they are having this much fun
Only when there's one server rack to build. God bless the datacenter techs that do this everytime a server farm crops up.
I've spent the past few months building a data-centre for the first time, and actually, morale and spirits are generally pretty high on site. Not quite this much larking about though!
I'd charge the technicians for the privilege. . .scratch that, I'd pay for the privilege to do it for someone else.
Imagine you can have fun at work.
I live that dream 5 days a week. It cures my commute blues.
When you boot real servers they always spin up full speed until the OS boots and can turn the fans down with low load.
They are offensively loud when you boot a rack
finally a computer that can run a geometry dash level.
@quicksi _ stereo madness.
Probably still can't get 60fps on White Space
Finally 59 fps on minecraft rtx with upscaling to 69k
Can it run Crysis tho?
@quicksi _ Untitled 1
Dang the software being 400k caught me off guard, that's crazy
Linus saying "Look at these connectors!" after mentioning he'd love playing with this server even if it was broken is so wholesome!
Weirdly the average UK oven consumes as much power, and doesn't need cables as thick as a babies arm.
@@EvileDik those were for networking
@@EvileDik the thiccboi powerplug also has to be that diameter, because of voltage drop on long distance. canada has 110ac.
Let’s take a minute to appreciate how far Linus has come from the ncix days to now. :)))
For what this is useful?can we play games and studing on it?
@@rswl_mrwn1175 lol what?
I love how Linus-Jake interactions during server related videos are like 70% innuendos
If you like innuendos, check out the April 1st series by LockPickingLawyer. The visuals are about locks but the audio makes it sound a bit different.
7:44 the insanity of linus being known to drop something (usually important in some way) and yet he still has the confidence to handle equipment of this caliber is the confidence that i aspire to have one day.
"Linus being a kid that opens his Christmas present for 27 minutes" go!
For what this is useful?can we play games and studing on it?
That would be a cool product. "LTT toolbelt" like the ones for constrction workers but for multiple pc construction tools.
Tool sash. PC tools are smaller, so you don't need as much space, and I'd assume you'd mostly only need to grab tools with one hand, meaning a sash would be more ergonomic. Touching your left shoulder with your right hand is easier than your left hip
Gotta admit Linus made his best joke yet, “Im Oscar the Tech Grouch”
“What the f@ck is wrong with you kids” 10/10
He said that the very instant I finished reading your comment, it was kinda spooky tbh
Watching Linus Team fumble over standard enterprise mounting hardware warms my heart.
i dont know why any company involved in this said yes im just glad they did i cant wait to see what comes next also im pretty sure every1s job is safe hahaha you guys are fun i pre ordered or email secure what ever for both
For what this is useful?can we play games and studing on it?
@@rswl_mrwn1175 Because the company's who can afford this need a demo and Linus is building it for comparative peanuts, and using his contacts to make it happen.
They probably did all the testing and prepared all the demos they need to do with this configuration. I could think of it as a next-gen enterprise configuration that would get much more exposure via Linus. So once they had everything they wanted to do to it internally, they sent it over. I also am pretty sure everything is insured here, so no worries there.
Im not gonna lie I got excited just watching you two set this up, and I know NOTHING about servers. Even just the sheer amount of hardware and connections is just... wow
"I didn't cut myself so I don't have to fill out that stupid form.." Lol I worked as a fish cutter in a processing plant in my 20s and I had to fill out A LOT of those forms
You must be a real cluts
I worked at Tyson. Im very familar with the form. lmao
For what this is useful?can we play games and studing on it?
This is no criticism, I admire you guys. But, i would have left at least 1 space in between racks for a better thermal stability.
I remember when Google announced they had several pedabytes of storage between their servers, and it felt like only a company as rich and powerful as Google would ever have that much storage. This was when having a 1 terabyte in your PC required 4 drive bays.
nowadays every midsize company needs that much :)
It hasn’t been cheap but my homelab has around half a PB over 24 HDDs and 24 SSDs. About 10 years ago that lab started with an old Lenovo desktop from work and a 1TB drive.
I have gigabit fiber internet at home, which in itself is massive growing up in the dialup era. I still get impatient waiting for a 200gb game to download in ~20 mins when back then I had to do mp3 downloads overnight.
Hell, just smartphones in general. I’m not that old but I remember having a phone (Nextel i930) with Windows Mobile on it. It got like 2 hours of battery life and there really wasn’t data or WiFi support but it was so cool at the time. Now my 14mo son can navigate a smartphone and tablet.
@@velo1337 even cooler, a midsize company doesn’t even need to own the hardware. Just pay someone else pennies and they have conceptually limitless storage and compute available without ever knowing where that hardware actually lives.
@@jsbzoh6 What do you use it for?
@@michaelhenry3234 Facebook... stores 4PB every day in their "hive".
Okay so today I learned that server rails have the exact same mechanism that I use for my socks drawer. Which is worth nowhere near $1000000. Cool, cool
I don't think you socks drawer can extend a 300Kg load 1.5 meters out.
socks probably cost more than the rails ngl
@@iwontlagback7236 my socks drawer draws ten kilowatts in order to keep all my socks warmed to the exact temperature
@@cvspvr lol
Depends on the server. Lenovo toolless slide rails are *chef's kiss*
I'm really interested in that software. Would love some comparisons to other data/file storage systems and software. Looks crazy, that visualization and stuff...
I'd love to see the electric bill after running that bad boy. What a crazy server setup. Holy crap
A larger datacenter's power bill can be upwards of $50k per day and that's with a couple thousand of these running.
The real difference between consumer and enterprise. Enterprise can afford the power bills for their gear.
@@tyrannicpuppy If what Nick said it's true 50K per day for power bill, they could be making like more than 100K per day as well...so..
@@EricTanGH0ST 1ru is in the order of $100 a month (heavily dependent on where you are in the world and the services and qualifications the DC provides)
Fun fact, the most expensive part of a new defense weapon system isn't the hardware -- it's the software (referencing their mention of the $400K file system).
As a network engineer, I'm pretty used to QSFP direct attach cables. What is awesome is that the cables are rated at 200Gb/s. I have dealt with some QSPFs that run at 400Gb/s but anything over 100Gig is rare for the work I do.
You need to come over to HPC. We have 4000+ nodes all sitting on fat-tree 400Gb/s infiniband ;)
Did you both realize how insane you guys sound? "Oh yea I worked on 400Gb/s networking" :(
@@user-rd3jw7pv7i Not sure how insane working as a network engineer for a technology partner that works with enterprise customers sounds. There are a lot of jobs like mine that work with high speed links.
@@bassman87 Unless your in consumer service and repair like me, I wish I could do service and repair on these puppies, holy shatner are these cool as hell to look at.
@@MinecraftLD10 Yeah I work at a value added reseller, we have partnerships with Cisco, HPE, Juniper, Palo Alto Networks, ect. Because of this I get to deploy these technologies for our enterprise customers. its not lost on me that LTTs audience traditionally includes consumer level tech leaning into the small business tech, so enterprise gear can seen foreign.
But like I said on my first post, even in the enterprise side of things I rarely see links over 100gig (excluding stacking cables which can have a throughput up to 1Tb/s), so the 200gig and 400gig are still interesting.
I am always so incredibly nervous to watch Linus handle ANYTHING of value. He has the "dropsies" worse than anyone, ever. It's also only going to get worse as he gets older. Please put carpet pad underneath all of your sets! lol. I've never had more fun watching a channel!
Jake, ummm...please wear a belt maybe? :)
That rack powering up really sounds like the old THX sounds lmao.
The servers I usually work with only sound like that when somethings wrong with them lol.
lol
Supermicro rails also threw me off when I first saw them, but I also grew to appreciate them. They're pretty easy to work with once you understand the design.
linus and jake's energy is unmatched
For what this is useful?can we play games and studing on it?
At 25:09 we see a man whose wildest dreams and aspirations have not just come true, but been exceeded in every way. Like the culmination of the last 15 years of Linus's career on RUclips in one face of unbridled joy.
I actually think it almost always makes sense to file a claim against its own company: If you pay out money to the shareholders (here Linus) you get taxed but if you not pay out and rather let the company pay for your health problems related to work, you sort of don't have to pay taxes because it ain't pay out.
Meh, if it's just a cut I doubt it's worth the paperwork. If the server fell on his arm and broke his arm in 5 places, then it may be worth it lol.
this sounds smart so I agree
@@Camelotsmoon Worth. standing operating procedure, i.e. starting and maintaining a precedent for future claims while also not being completely unfamiliar with those processes when you are at your most vulnerable in a future incident.
@@TheNewton Eh, I think you're thnking too corporate for Linus. Linus is the guy who has said he'd rather his employees come at him as a person rather than an employee.
@@Camelotsmoon no, he's saying you should familiarize yourself with a task while you can think clearly before attempting it when you're not at your best.
Nothing about familiarity or not, just standard lessons.
They need to pay more attention to rail screws. It's a bad time when months later you expect to pull something out of the rack half way and it ends up on you or the floor.
I love how the power situation was such a problem but in the UK we have 240V 32 amp on regular wall sockets. Single phase too.
To be clear, that's 32A _per circuit_ - each socket is only 13A. But that's still >3kW per socket and 7.6kW for the circuit (though you don't want to sustain either of those figures for extended periods, especially with less trusted wiring).
(Not disagreeing; just making sure people don't get the wrong impression :))
Much of mainland Europe actually has us beat in that regard, as the Schuko socket can handle 16A, I think, which is around 10% more power even at the lower 220V or 230V.
Not to mention that it's common in some mainland European countries for houses to have a 3-phase, ~400V socket in the garage or similar 😮
(More of that in the UK please! Having a 415V 32A socket on the wall would be pretty sweet :))
And a perhaps overlooked benefit of 240V is not really having to worry about voltage drop, even when drawing 13A over a 20m extension lead. You have to try _really hard_ for that to ever be a problem 😸
I think Canada uses the same standards as the US which means standard lines are 110-120V but the power coming in is actually 220-240V. We have a center tap on the transformer coming into the house/building so there's actually 3 lines coming in and by connecting to the 2 outermost connections we can get 220-240V. I do wish we had more 3 Phase (our system is split phase) since it allows for far more efficient motor design (allowing for more efficient heatpumps/AC and fans). The 120V standard is a bit safer overall (so even though we don't have fancy fuses and guards on all of our outlets you're not likely to die if you get shocked, it just stings a bit, unless you hold onto it then your dead). 240 is more efficient and provides more power for heating and motors, technically it could be more efficient for everything but in practice most electronics have to be run at much lower voltages anyway so afaik there's no practical difference there. Due to our size (not to mention political hurdles) changing the infrastructure across the US is basically impossible.
@@AndrewGillard Aaaand it is no longer running 240V, but 230V since 2003. We need to keep the facts straight :D
@@TheCrazyP8 Only _nominally_ 230V :)
The European grid is specified as either 230V -6%/+10% or 230V -10%/+6% - I don't immediately recall which. That range allows the UK to continue using 240V, and historically 220V countries to remain on 220V, while all being """230V""" 😹
This house in the south of England sees about 238V on average (yes, that's technically an average of an average (RMS) :)).
In the past week, the lowest and highest peaks were 231V and 243V, but it was 235-240V for the vast majority of that time.
I vaguely recall hearing that some part of the country is now _properly_ on 230V, but most of the UK is still very much 240V, as far as I'm aware :)
@@AndrewGillard no, it is 230v as EU and UK harmonized it in 2003. So 238v is easily achievable with +4%
Those cables just looked to be normal qsfp. You wouldn't need them to be active for such short lengths and the circuit boards in them just have RC filters on each lane. Active cables are typically for lengths over 5 or 10m when you need to boost the signal strength just to get a clean reading at the other end. I used to work for a company that made these and my job was to design, build, and program systems to do electrical performance QA on these connectors/cables (and many other connector standards). Basically automated a fancy oscilloscope and some very expensive multi position switches to collect measurements, process the data, and give an overall pass/fail.
When you spend all day working with this type of stuff, yet you still find yourself watching Linus get really excited using it.
Glad I'm not the only one that feels that way.
Yes. Also I'm sure there were a few of us screaming "mount the rails first" during the switch segment...
More importantly than being short, having small hands is advantageous for tech geeks.
I'm a 6'2" embedded systems engineer with mongo hands and would give the world for Linus' tiny fingers.
wait isnt linus 6'1? if so than why is he calling hiself short?
I can also confirm something similar
I have big hands but they're also really thin (I'm skinny as hell) and working on my PC, I recall one bit I was able to do decently was installing an M.2 drive
I was watching my boyfriend do the same thing recently and he has fatter hands than mine (not hard) and he was having a hard time getting the M.2 in from it
@@ceandremayweathers9450 Nah he's like 5'6"
If he was 6'1" then all of his employees would be absolute giants
There are 2 factors that are advantageous.
Small hands, and steady hands.
I've got the first but boy do the shakes make it hard to solder small smd parts
Awesome video. It makes me a bit anxious how they handle the hardware sometimes, but in fairness it is for entertainment purposes and it works and they know what they are doing. Great to see the company that I work for being represented on LTT in this matter.
To be honest I think a lot of the enthusiast world is quite janky. Think like Jerry rigging and early overclocking. But yeah, it's a little tough to see them just fuck around with this much money. But... It's fun! So...
I work on enterprise systems like this almost every single day and its hilarious watching them geek out. I still do it too from time to time.
To shoot the intro when Linus says "wait where'd it go" they must have shot the resulting build after the "you have to build it first"
I like the planning the script through, neat trick
The magic of video editing software.
The fans starting up at 18:52 sounds like the old THX intro lmao
6:44 The moment when Linus realized that some Canadian regulators probably watch his channel.
VERY GOOD FORMS!
*This is one of the coolest idea for intro I've seen after watching 15,000 videos.*
18:46 when the fans spin up, it sounds just like the loud ass THX movie intro sound from our childhoods lmao
You beat me 2 it
@@redtapionellice5352 I was like WAIT, I know that sound from somewhere lmao
The excitement that I had for you guys is astronomical! This kind of hardware is literally what dreams are made of. I cannot wait to see more updates on this project and further server ventures!
14:23 Linus is close to nerdgasm and it's kind of wholesome cuz he's passionate about the absolute mad power of he technology he's handled
Oh My God He's Giggling so much. So Wholesome
Seeing Linus and his son Setting up a server was so wholesome.
Now the editing on this video was on point
A great hook,lots of energy from the second you click the video
Really entertaining and such an epic project
This setup is gonna be insane once its finally done! Can't wait to see the final project in action!
How did you watch a 27min clip in 30 seconds of it being uploaded? 🤔
@@O-x.Muhammed.x-O I'm guessing he's a member?
he wants likes
Hearing about this project on WAN Show is what finally got me to build my own rack and finally get organized with all my various server boxes and random drives that have just been strewn about on floors and tables and in closets and who knows where else. My budget is considerably smaller, my rack is only 15U and I'm using only 9U of it, but as I've been migrating everything, building a proper rack mount NAS, and getting everything nicely organized and cable managed, I've felt like an absolute boss. I even have a proper switch on the thing, it's glorious. So anyway, thanks for finally giving me the kick in the pants that I've needed for a long time now, making me geek out about this thing and making me want to be able to finally geek out about my own modest set-up. I mean heck, I've got rack mounted Raspberry Pis on this thing, overall it's not that fancy. But everything is in one place and clean, and it's already impressed the absolute crap out of my friends and relatives sending them pictures. I should have done this years ago and it's this series of videos that made me do it.
i want to make a smaller version of one of this for my PC, so i can finally blow up 100 explosive barrels at the same time in Gmod
[Gmod is such a lag machine for a PC, how they should test how strong PC's are, is how many of the barrels can be exploded at once without crashing the game]
16:28 They're SFPs! The logic on them is not just for translating from one medium to another, but also usually for reporting diagnostics (though not all modules will report). I mostly work with fiber SFPs and the ones we use at the company I work for report the current fiber light levels and other diagnostic information like what the threshold is for too high or too low of light levels and if the SFP is getting enough voltage. Some will even record a brief history of changes of statistics. They're pretty cool. The fastest I've worked with is 100 Gbps.
is there a followup video for this? at the end they don't actually show the performance and I'm wondering where the next installment is or if there's a release date scheduled?
Agree! Came here just to post this question.
yes have they broken it or sth?:)
Yeah they normally don't post this click bait crap. But essentially that's all this was. Want to see how a $1,000,000 pc performs? Well too bad!
I feel like in a lot of these videos they show way too little of the performance
@@Wisco-Titan I feel like at that point, it's no longer a *personal* computer.
13:36 Wow a remastered version of the OG LTT dropping box intro
Ein sehr schöner PC Perfekt für alle 4 K Blu-Rays auf der Welt um ein Streaming Dienst zu machen in voller Qualität mit DTS-HD und Dolby Atmos
Finally a server specially dedicated for chrome tabs. 😂
Morely to host 3 Chrome instances.
The server you installed over the switch should went beneath, with the other five, so you'll have room to put your hand in case you need to reach the switch coolers or power suplies.
That was bugging me too, if for not other reason than the aesthetics.
+1 for aesthetics but I wonder if the DAC cable length was why it needed to be mounted like that ?
@@thecomputertech It seemed like it would be in the quick shot I saw of the back.
It's possible with the DAC cables they had, there isn't enough length to reach the last server, so one needs to be over the switch.
I think the reason that the switch had to be in between them is the length of the DAC cables. For DAC cables of that speed they have to be really short.
Discovering the change in power in the shop reminded me of the movie "Hidden Figures"; They were installing an IBM mainframe, but they forgot to measure the door, and it was too small to get the computer in the room. :-)
Thanks, you forced me to look up a movie i'd never heard of lol ;P
Maybe it's just the RUclips algorithm (I know, this video was uploaded more than 1 year ago), but I have the feeling that you guys build a new overpowered server rack every week 😁
Linus should see some of the 400gb/s DACs we use at datacenters, so chunky that they have to have their own heatsinks
if you're in a position to invite him, I don't think he would hesitate
13:49 I cringed when I saw Linus was propping the box on top of those protruding metal thingymagigs, and then came the crunch of the box being pierced, my heart sank.
I LOVE lmg's editors. Do we say that enough? Such amazing humors.
It sounds SO MUCH like the noise the view-plate made in the STOS episode " The Doomsday Machine" when Kirk finally got the viewing screen running.
12:18 "Wait which ones are my racks?"
"I don't know, sounds like a *U* problem."
_I see what you did there._ ;)
Love how they get all excited about the power bars and those are just kinda normal at Data Centers and we even have 3 phase power in some racks....welcome to enterprise grade.