Liquid Cooling Takes Over at SC21
HTML-код
- Опубликовано: 7 июл 2024
- At Supercomputing 2021 (#SC21) I walked the show floor and checked out all of the different liquid cooling vendors that were exhibiting at this show.
STH Main Site Articles: (See links below)
STH Merch on Spring: the-sth-merch-shop.myteesprin...
STH Top 5 Weekly Newsletter: eepurl.com/dryM09
----------------------------------------------------------------------
Where to Find STH
----------------------------------------------------------------------
STH Main Site: www.servethehome.com
STH Forums: forums.servethehome.com
Follow on Twitter: / servethehome
----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction
03:04 A Look at Supercomputer Nodes
05:34 Immersion cooling
13:11 Rear door heat exchangers and CDUs
18:44 Blocks, Couplers, Pumps, Tubing, and Components
27:51 Final Words
----------------------------------------------------------------------
Other STH Content Mentioned in this Video
----------------------------------------------------------------------
- WILD hardware of OCP 2021 - • WILD Cloud Hardware at...
- Submer liquid immersion cooling - www.servethehome.com/submer-i...
- Liquid Cooling in Servers with 400W and 500W A100's - • Liquid Cooling High-En...
- Facebook OAM Launch Hands-on - www.servethehome.com/facebook...
Disclosure: Kioxia gave me the mask the day prior because I broke the one I had. 
Наука
St. Louis-I'm from there!
Dude Im a mechanical thermal engineer, these vids are amazing!!!
Super late to watching this but THANK YOU for this fantastic video. Ton of fantastic info.
The Iceotope chassis has to be the most innovative out there? The only immersion cooling solution (complete removal of air flow in the rack) where it is possible to maintain cooling during servicing events and no requirement to lift the server out of the rack with lifting cranes like tank immersion.
My first liquid cooled computer was built 20 years ago. It was overkill with a five gallon bucket reservoir and an industrial pump. Love seeing this technology in the data center now.
🔥🔥
"What is this? An immersion rack for ANTS?!? It needs to be at least ... THREE times bigger!"
Awesome! I like the fact our audience gets that reference.
THIS!
Cool to CEJN shown. Finally a vendor I use at work. Their hydraulic and pneumatic connectors are fantastic quality. Staubli is Stah-blee. They're popular in motorsport for fuel or liquid quick disconnect.
This was like a kid in a candy store for me. Thanks for take me around the show :)
Nice. I miss conferences and shows
Me too. Or at least the big vibrant ones.
@@ServeTheHomeVideo I really enjoy this format btw
You witnessed a Zoolander moment with the GRC ice rack solution. 😂
I was so tired I could not remember the quote, but yes.
Hyperscaling for ants! Microhyperscale!
My thoughts exactly =D
Feel real bad for the guy who tried to make the reference that nobody got lol
Now that's my jam... I was really into watercooling, remember the beginnings of EK (yes, I know Edward and some early employees from local tech forum, also did lots of custom loops myself back in the days of high school), and now I'm really into enterprise servers, and this really makes me goosebumps :DD I was waiting for that moment that liquid cooling will dominate the server space, especially seeing GPGPU and different really powerful accelerators used more and more and more and especially CPU TDP bump up and essentially more than doubling the TDP that used to be like less than a decade ago... Too bad I wasn't financially able to spin up my own company focusing on that, I've been planning different cooling systems for almost 20 years now since I was 11, 12 years old and started moving my focus to that space exactly a decade ago, when BTC GPU mining was in, before all FPGA and ASIC and ton of nonsense crypto started rolling out and got dominated with players with big initial investment, which I didn't had funds for at the time...
Great video of SC21. I was not able to attend unfortunately. Thanks for getting the CEJN name right! I am Sales Engineer for Thermal Control Applications at CEJN NA.
Liquid know how to attract interest
IBM should have exhibited an old mainframe. Or Cray…
This is great reporting, thank you!
Glad you got to visit the STL Arch and go up to the top; it's a super cool nerdy destination that not enough people have heard of.
Love watching your channel and your enthusiasm, even if I'm still hosting my containers on a Raspberry Pi. :)
Sincerely, a Missourian on the KC side.
LTT: You don't need liquid cooling for you RAM
STH: Hold my SuperMicro
Don't touch the glass! :P
This is literally cool
Impressive review! Thank you, mate!
Absolutely bonkers to hear these multiple hundred kilowatts of cooling in the size of packages as those were. I also wonder if the 3M Novec stuff will start to leak to us mere mortals now that it seems it is starting to be more widely used in the industry.
Highly unlikely, it's ridiculously expensive, ~£50 per kg (and it's ~1.6kg per litre roughly) and awful for the environment, high global warming potential. It has to be extremely well controlled. Not for the DIYer.
@@T0mParker According to 3M the Novec line has GWP of 1 which is comparable to plain CO2
I hope icetope will sell the chassis without servers in them. I’d love to try one. Also 4u chassis for a diy server would be cool
when i was at school over 5y ago i discovered rear heat exchange door. For some reason they had that in place.
I have never seen any liquid cooling since in DC, and i've work on HPC and big company...
I really hop I'll get to work on hardware like that without working for a gafam.
13:05 they cool people with the liquid in a bar :D
"These coolers are cool" - you have to listen carefully as Patrick is using the same word in two different ways - a treat for linguists. But what if a particular technology was proving really popular, and thus hot? And did he mention Coldplay?
Hopefully next year I'll be at some of these!
Busy this year getting our new data center suite finished up!
I do hope that Fluorinert fountains return as a trend in datacenter decor!
"I'm here at LIQID ... they don't actually do liquid cooling, but there's a lot of people at their booth because they have a BAR!" Hahaha. Really enjoyed this video. Thanks, Patrick.
Every afternoon they had lots of people. Every afternoon they had a bar.
Ahhh Missouri. Forever shall they be remembered in my heart as the state that tried to ban the f12 key
I love the Dynatron products! I've always wondered if there was such a cooler to fit into my 2U server. Thanks to your video I've found the answer to that question. Although it'll be complete overkill for my needs, I'm buying this today! By the way, love the videos! Dynatron L3 CPU Cooler for 1U Server 👍
Loved watching this, and I really hope Motivair sees this and maybe reaches out to do something one-on-one. What a missed opportunity on their part! I've certainly encountered these weird cold shoulder thing as some shows in the past.
The way it should be if you want to run one of those fast servers at home 🖥
Quite excited about the fluid microchannel plates.
I wonder how dense you could make stuff with that level of cooling.
Enjoyed this video. I appreciate you taking the time. Video idea: Liqid's new PCIe Gen 4.0 CDI Device Expansion.
I see exactly zero chance that anyone would adopt submerged cooling as anything more than a demo or for extremely niche systems that need massive cooling capacity. It seems fun enough, but that's a ridiculous hassle to deal with when servicing systems, the infrastructure takes up massive amounts of space. Compare to that something like the rear door cooler capable of 200 kW or the quickconnect liquid manifolds, where you can avoid pretty much all of the hassle. We adopted the rear door coolers about seven years ago with good success (the boss just way overbuilt the solution).
Hi everyone,
Firstly great informative video.
Can someone share best solution for a cooling system that can hold 4 to 6 s19 pro miner.
These miner are best used by product describ in your video.
Hey Ryan. How's it going.
:D
@@1mrhamel Hi Ryan!
Definitely need to narrow the parameters of the focus of that camera.. maybe to a centre point or small centre area.. Multipoint is obviously not your friend at shows like this.
That was some serious hardware,...............and by the way, the audio and video seemed fine to me.
Yeah, sounded great here!
Bar next to the booth? What a great idea, stealing that one for my next booth setup.
They had it again this afternoon.
These look fancier than my solution. Two box fans, an old furnace thermostat, zip ties, and an outlet controlled by a relay. Pretty sure I can cool at least 1KW 😂
aww coolio, but i was hoping you would mention laminar flow! i'm sure some very very high end systems use it, idk tho :)
that was REALLY eye opening for me!! - TOO BAD you camera didn't want to focus properly :( - was there a setting that wasn't set to use in close up shots? maybe was better suited for distant landscapes?
anyway, I think that the company doing immersion INSIDE the chassis was the most useful... I always thought that full immersion tanks were really wasteful... wasteful of having so much extra liquid and VERY WASTEFUL of space- you CANNOT put a second immersion tank over top of one on your ground level without some SERIOUS infrastructure to hold all that weight.... when you immerse each board in a small amount of the liquid, then have it flowing in a purposefully directed way, you can draw off the warm liquid and cool it in a smaller heat exchanger then pump it back into each machine.... this allows you stay with vertical setup and use MUCH LESS on tubing inside each chassis, fewer pumps if you let gravity do some of the work, less metal on creating surface area (i would think, but I'm not sure of that totally) and you just pump the fluid into the chassis with some guides so that it flows over each component you need cooled and out the warm side. it's not under high pressure so you can only have a small amount of liquid in each chassis and there is still tons of space above it. this reduces the amount of liquid (which costs less) and the weight of the whole system is cut down DRAMATICLY (so you don't have to think of infrastructure needing to be super overkill compared to a huge tub of liquid)
sorry for rambling, but I had thought a bit about this the first time I found out that full immersion tubs are a thing (which I learned about from THIS AMAZING CHANNEL in their fairly recent liquid cooling video) and just saw how much waste there was and that there HAS to be an easier way to do it.... I feel like this would be the MOST efficient cooling system compared to all others taking up the same amount of space. (if you are factoring in everything like space, weight, costs of liquid, pumps, tubing, heat exchanger, fins for surface area, etc.... but I'm only guessing based on what I've seen here... I could be COMPLETELY WRONG lol)
THANK FOR THIS GREATR VIDEO!!! :D
Thanks for the amazing comment. I think the company you are looking for is Iceotope.
I DO wonder though, if "Direct-to-CPU" cooling is actually synonymous with "direct die" cooling (because direct die cooling was also something that I had learned about in the mid 2000's whilst I was working on designing and engineering my own waterblock for said Socket 940 AMD Opterons).
What‘s the price for the 3M liquid right now?
No idea on that.
What is the point of filming and uploading 4k if you never take the time to make sure things are in focus? Half your video was a blurry mess. Focus peaking displays and external monitors exist for a reason. And for god sakes, image stabilization and holding the camera steady, instead of shaking it all about? Please?
This was literally a "ok 60 min to run through the floor" activity. All of those things exist (and the FX3's stabilization was on) but using them would have meant this video would not have happened because there was no time. I was the only independent media not just doing paid projects at SC21 so it was either this or nobody would have shown off all of the stuff on the floor this year. The SC21 Top 10 at least had a gimbal that arrived the next day after this was filmed. Normally I would have someone shooting to do all of this, but harder to get extra people during a pandemic show.
What is this!? A center for ants!?
The building has to be at least three times bigger than this!
I love your videos and your content.. but dude. it may be time to hire a video guy lol... The focus is all over the place, its not your fault, its hard to talk and pull focus at the same time but like you could even hire some highschool AV kid to follow you around at the trade show or something.
100% This is still a challenge of the pandemic. It is harder to get a camera person in. Once things open up a bit more, there will be someone running the camera like we had Joe at the PhoenixNAP tour and some of the recent Supermicro videos.
@@ServeTheHomeVideo Darn COVID lol.. still love the videos anyways!
@@ServeTheHomeVideo Or at least a steadycam type dealy? I love the video but legit got motion sick watching it and had to turn it into a postage stamp in the corner of the screen.
My 300$ Samsung phone has better image stabilisation than that camera. Can't watch videos like that.
He is a computer guy and not a video guy. Yes. A DJI mobile phone gimbo will do.
lol, give him a break, he is luckier then us :P
Ditch the stupid mask.
Required in the St Louis convention center