Touring the Liquid Cooling Lab
HTML-код
- Опубликовано: 7 июл 2024
- We take a tour of the CoolIT Liquid Lab in Calgary Canada to see how liquid cooling systems are prototyped and tested for next-generation server CPUs, GPUs, and accelerators. This is the lab where we filmed our recent Gigabyte liquid-cooled server review and we show a number of steps in the process.
Note: As mentioned, CoolIT paid for my travel up to Calgary to film this but it was done editorially independently and they did not get to review the video before it went live.
STH Main Site Article: www.servethehome.com/how-liqu...
STH Merch on Spring: the-sth-merch-shop.myteesprin...
STH Top 5 Weekly Newsletter: eepurl.com/dryM09
STH Forums: forums.servethehome.com
----------------------------------------------------------------------
Where to Find STH
----------------------------------------------------------------------
STH Forums: forums.servethehome.com
Follow on Twitter: / servethehome
----------------------------------------------------------------------
Other STH Content Mentioned in this Video
----------------------------------------------------------------------
- Gigabyte H262-ZL0 CoolIT Liquid Cooled Server Review - • How Server Liquid Cool...
- PhoenixNAP Data Center Tour - • A Fun Data Center Tour...
- AMD EPYC 7773X Milan-X Review - • Crazy! AMD's Milan-X D...
- AMD EPYC 7003 Milan Launch - • AMD EPYC 7003 Milan Pe...
- AMD Announces Milan-X and MI250X - • AMD Just Rocked the Da...
- GB era of Server CPUs - • Why Server CPUs Are Go...
- All about server power efficiency - • How To Save $$$ Poweri...
- Dual AMD EPYC 8x NVIDIA A100 Server - • Top-End AI Training In...
- Liquid cooling AMD EPYC and NVIDIA A100 Servers - • Liquid Cooling High-En...
- SC21 Liquid Cooling - • Liquid Cooling Takes O...
- Intel Ponte Vecchio - • Intel Ponte Vecchio is...
----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction
03:16 Prototyping Parts
05:39 Assembling Liquid Cooling Loops
06:32 Temperature and Pressure Testing
08:02 Fluid Compatibility and Rack Level Integration Testing
09:55 Data Center Simulator Container
11:26 Why Innovate? 40kW to 1 Megawatt CDUs
13:37 Why Liquid Cooling in the Future?
16:25 The "L-word" 
Наука
I love those on-the-floor videos, it's great to have someone on the datacenter side of things. There are many doing consumer and gaming, but you really help complement that with a prosumer and datacenter perspective on things.
Thanks. That is the idea
Looks like CoolIT was using motorcycle names for their machines in the Liquid Lab. Pretty neat.
Yes! Nice
Great video. I love seeing the high end computing and also when you show water cooling systems
the new article on sth - 400gx64 switch is pretty awesome - dual 400g cards for almost 1t of bw? with new mi300, cxl things are getting much spicier for hpc and all this tech will trickle down faster than smb move to 10g - the key is that nvme is so scalable - bonded 400g will be great for big nvme raid0 arrays - the cooling is just another part of the chain needed to have reliable sla #swr matching #counterpoise #block device #netfs benchmarks
Love this because water cooling is pretty cool for consumer products, but with servers it has to be designed to be extremely reliable. And inevitably these advancements trickle down to consumer products too. Also if you want to even use the top of the line upcoming products coming out its basically required.
Exactly right
I feel like enthusiast liquid cooling has already become very reliable. Also in terms of AIOs in the higher end pre made cooler market. But this could trickle down into the consumer market
@@ServeTheHomeVideo 😂
@@ServeTheHomeVideo ❤❤❤
@@ServeTheHomeVideo ❤😊😅😮😢🎉😂umciuqq BN lss. L
IT admin of a small company: "guys we need to upgrade our servers to these"
Company: "why would we need that?"
Admin: "don't ask dumb questions"
(Accountant looks over and wags finger)
+20 points for Canadian content!
Great video!
Definitely impressive the level of r&d and the stringent validation that is done reassures me a ton.
Looks like they are using Raspberry Pis for those CDUs for some function
I use an aio on my box but it’s real cool to see liquid cooling deployed on a much larger level. Thanks!!!
Welcome to Canada Patrick :)
You're such a great video host! Thanks for posting this video - super informative.
Wow that has to be the cleanest HAAS I've ever seen!
Bunch of genius engineers in the same facility, what could go wrong.
CoolIT has some really cool solutions, Liquid is the only way to cool high power compute nodes! Thanks, Patrick!
Damn it. I saw him at the airport I thought I recognized him but I disregarded it as I have confused people before. Frick should have asked for a photo
Ha where/ when was this? I have been flying non-stop lately
@@ServeTheHomeVideo Not 100% sure on the date but I think I saw you at Calgary International Airport near the check in for Air Canada and West Jet in the evening
The quality of these videos keep getting better. Very engaging and interesting! Keep it up!
Patrick rolling in like a dark souls boss
Ha!
I really hope that those advancements in liquid cooling technology for data center and super computers trickle down to consumer workstation.
It is a bigger challenge with the traditional workstation form factors
Liquid cooling is the only advancement that will allow regular everyday consumers to integrate those servers into their home setups 💪
Offsetting heating cost, and can be a income for server rental
In-house skiving?! Wild.
I still have the CFD pictures from when I was trying to design my own waterblock for the Socket 940 AMD Opteron back in around either 2006 or 2007.
It's definitely interesting to me, because I was already talking about the necessity of water/liquid cooling back then, so it's nice to see it being talked about/covered here, and now, 15 years later.
Another symphonic masterpiece from Rachmanifold 🙃
Great video!
Thank you
3:00 it certainly looks like a few steps up from my water cooled 4-something GHz Pentium 4 Extreme days 😁
One obvious way to detect coolant leaks would be to use the same method as in an RCD: if the in and out flow differ, there is a leak.
That's one way to do it but not as cheap or sensitive as a rope leak sensor.
I saw stainless steel, copper, and brass (maybe bronze). Was there any aluminum used in the loops that you saw (aluminum that's exposed to coolant).
We operate a datacenter with in-row cooling and cold water infrastructure. I'm thinking about skipping all this DLC stuff and go directly to immersion cooling. Would allow me to keep the same cold water infra in place while ensuring a better (and quieter!) job on IT gear.
try immersion on a small-scale first. even just one machine. whole new can o worms
What kind of maintenance is expected on systems like this? To follow that up, what kind of lifespan is anticipated on systems like this?
We've just bought some new servers where I work and we bought them with 5 year warranties, so we're expecting to get at least 5 years working life out of them. What can be expected with these liquid cooling solutions?
I'm disappointed that they're that superstitious. Wasn't expecting that from scientists. At least they're building cool stuff!
I love that they are using raspberry pi's in there cooling blades for management.
Are they called the Coal Chamber? Or Oven?
Good to know server heaven is water cooled
Cant wait for server scale LN2 cooling for the inevitable exawatt scale systems
What benefit is this level of cooling relative to air cooling in terms of temperature difference?
That depends on inlet temp, flow rates and etc. The bigger thing is that it can actually cool higher power chips
Great video! We need Linus to do a video there too
"Hey there guys. This is Patrick from SpongeBob Squarepants" *new intro*
You can see the CoolIT guy is running some calculations in his head during the interview.
one lightning strike and everything goes up - better to go with sep discrete rather than big cdu - you can have lightning protection but will it really work #marine electronics #bonding plate
Chambers are named after old spots cars; coupes.
This is really cool!! (pun intended) I could see something like this being used in crypto mining. I wonder why liquid cooling isn't a popular option for that anyway. You could collect the waste heat and recycle it into something useful. It would be a win-win.
Immersion tends to be bigger for crypto mining.
Looks like they are named after motorcycles.
Got it
is that a server from "that US government machine" with, possibly, the funny BIOS vendor sticker? :D
i need it for my home lab server. It's too noisy
Cool...ing :)
Cool IT does a nice job, however ZutaCore is doing a much better job with a higher cooling efficiency, low pressure systems, simpler, and no leaks risk. Just saying....
so rubber coating my computer, & cooling it in a wine chiller. isn't so crazy! looks like all that computer stuff, is flushed in generous amounts of fluid!! wow! "COOL"!!
I had to increase the playback speed as Patrick isn't talking as fast as he normally does.
Hahaha!
Guess Patrick has cooled down a bit ...
1