$90000 NVIDIA A100 GPU Server
HTML-код
- Опубликовано: 16 янв 2024
- #ai #gpu #workstations
CPU: Intel Xeon Scalable 5220 (2EA)
M/B: ASUS WS C621E SAGE
RAM: SAMSUNG DDR4-3200 ECC/REG 256GB(32Gx8)
SSD: SK Hynix PLATINUM P41 M.2 NVMe 2TB
VGA: NVIDIA A100 80GB (4EA)
CASE: 4U RACK
POWER: SuperFlower SF-2000F14HP LEADEX PLATINUM
FAN: Phanteks PH-F120T30 (9EA)
CUSTOM PARTS: Alphacool 3647 (2EA), Alphacool A100 Carbon (4EA), Alphacool 360mm 60T (2EA),
Alphacool PUMP, Manifold 7Port, Quick Disconnect 6Set, Black PVC
Yangcom Home Page
www.yangcom.co.kr
Yangcom Instagram
/ yangcom_official
Yangcom Facebook
/ yangcompc
Yangcom Blog
blog.naver.com/combox0 
Наука
![Stray Kids [INTRO "Lose My Breath (Feat. Charlie Puth)"]](http://i.ytimg.com/vi/udz0a5Wecxk/mqdefault.jpg)
You know shit gonna be real expensive when you don't even recognize half of the hardware's names.
Could not be for cheap one
But all of them are easily recognizable?
tell them that you get nvidia A100 to some average gamer and see their reaction@@BlackJobZ
We r talking about kinda above average pc user, not tech professionals@@BlackJobZ
Jelous 😂😂😂😂
Finally a build that can run Crysis in 1080p 30fps,nice 👍🏼
640p 20 fps Maximum
@@Porsche_x my results are using Frame Generation and low settings
@@des7royerz So yes, I said 640p at 20 fps using graphics very low without dlss and without frame generator
LTT ran Crysis on AMD Server CPU with software rendering and got like 10 or so
with dlss 3, fsr 3 and low seting 🤣
This PC consumed more power than my entire house electronics combined
about 2kw when all processores is max-loaded
Your water kettle would easily consume more power than this machine.
@@NowhereNear42 we talking about electricity, not heat
@@thenasiudk1337 You talking about power. This PC uses electricity to produce heat. So does your water kettle.
Doesn't use more than 2kw.
Finally, a server for running Latest version of minecraft in the future.
😂😂😂😂😂 Minecraft
Tetris
still only get 45fps in vanilla MC
Vastly underrated comment. 😂
А ты в теме😎
I can't imagine how satisfying it must be to train LLM´s on that thing.
you can easily rent set up like this for around $4 per hour
@@user-vp2tv8ff8j Renting is not satisfying as owing and running and training LLM's locallly
@@rd_626what the hell are you talking about?.The satisfying OP said isn't about “owning and training”...its about how fast it will train LLMs.
Try renting tpuv4 or even the new ones tpuv5s....smooth as butter. you will never ever run anything on gpus again lol
@@sohailmd123 Just FYI..... I wasn't saying that to the op
@@rd_626 “satisfying” is literally OPs point of contention. you can't take it out of OPs context....any ML engineer only gets satisfied/orgasms on how fast his large data is being trained before his eyes....not by owning costly shit just to see it train mid compared to tpus
would not like a coolant leak in that
finnaly a pc to compile gentoo
You would have the fastest emerge times in the world
my i5 13600kf took 4h to emerge -avq
this thing would do that in 10 sec xD
-Для чего тебе такая сборка.
-Чтобы Excel работал без лагов.
Наконец-то я смогу открыть 4 вкладки в хроме))
I'm afraid to ask this question and rather just look at this beauty but "Does it even run..?"
Crysis....
Used for AI backend stuff. Mostly for training. Runs only on linux
Love to see the performance stats on it once it's powered up.
It must be so scary to work on gpu's that expensive
I am not a fan of liquid cooled servers, but we have air cooled units with similar specs (mainly Supermicro) and they are way more crowded and noisy as hell. That one looks really nice and neat, and you should be able to sit next to it without going deaf. Also, in the long run it won't end so full of dust and crap. This one of yours is a custom unit though, so the client probably had certain requirements in mind, but not others. I see he/she decided to skip things like plug and play redundant PSUs, for example. Also, any leak could cause catastrophic failure and down time, which is not always acceptable. Anyway, very nice.
I completely agree, liquid cooling in the server environment is a complete nonsense. It doesn't matter how qualitative is the cooling system, it will leak sooner or lately.
@@noJobProgrammer I know some servers use liquid cooling but it's probably more like AC, with heat exchanger close to the server racks rather than using water blocks directly on components
In high density applications such as HPC or AI training liquid to chip can be used, particularly in the 80kW/rack+ range
IBM Mainframe can be liquid cooled. Since its reputation for reliability, I’m sure reliability isn’t an issue if do it correctly.
@@noJobProgrammerif it leaks, you haven't done it right. Does your house plumbing leak every few years for example? If you do it correctly, there is absolutely no problem to be had there
i guess a single cooling fan is worth my entire house but okok 👍
Why don't you do an actual review of the power it has? Some benchmarks. It would be awesome.
Watching that cloth glove get close to the socket in the first 5 seconds was nerv racking
Kinda want to see the thermal performance of this build. The fans don’t seem like powerful enough.
Its not about the fans. Its about shitty MX-4 that he put on the everything
Yeah, the most overrated thermal compound. Noctua NT-H2 is way better for example.
@@Turboriderthermal compound isn't making or breaking this build lol. Maybe the most unimportant part of cooling as long as it's applied right.
@@MustafaKhan-hg8lu I have my own experience that I have made over the last decade on many different computers and laptops. But I'm not going to argue just do whatever you think is right.
@@Turboriderthen you should use Kryonaut Extreme or a Kryosheet. I myself work on a lot of stuff and MX-4 is completely fine for everything you could want as a "normal" person.
It also really depends on what you want to do with it. For example I've had a bunch of issues with NT-H2 squishing away from my GPU die due pump out caused by the extreme heat and power I was pushing through that card (3090 with an XOC BIOS).
On my 7900X, its another story. No direct die setup. NT-H2 was fine and pretty okay, one of the better pastes that I used. But with Kryonaut Extreme, I got way more stable clock speeds while pushing the same amount of power and thermals. Heat transfer is simply just better with this one.
However, I would not recommend it to anyone that doesn't want to push for the absolute best results. It's simply too expensive. But for everything I use personally, I use not much else anymore.
I can't imagine how satisfying is disassembly and repaste all again in the correct way.
It's crazy how much tech goes into pumping around less than 2 volts through a few chips, and then we need a hoover dam to keep it all cool.
guys thats pure power, nothing else
Is that 2kw PSU enough to run two Xeons and 4 A100s?
Yes
If you assume 500W per component at full power (it could happen), then it's 1000W short.
@@NegativeROGA100's are 250 W.
@@Mr.Not_Sure lul
@@Mr.Not_Sure A100 on AWS can use upto 450W. Still, in most local setups people will limit its usage to 350-ish because even a good liquid cooling won't cut it.
Fyi, the instance i use is p4d.24xlarge so they are 40Gb versions. not 80Gb. i don't know if 80Gb ones work in lower watt or not.
Bro build his own personal super computer 😮
Props to the guy building it, has to be the first person I have seen who isn't deathly afraid of a little extra thermal paste.
interesting setup. is 2kw power supply enough to fuel system like this? and what about temperatures with closed cover?
All zero maintenance tubing too. Very nice.
엔비디아 폼 지린다
Hmm, this build needs a bigger acrylic case, awesome setup!
Just one A100 would be my dream frfr
why would you need one ? It's mostly for data centers and stuff, unless you're doing something to use that 80gb of vram, because for gaming it would be pretty uderwhelming, as the driver suport wouldn't be the best.
@@cooooooooooooooool3 because ai applications in general, aswell as LLMs run like shit on the RTX 4070. Training obj detection nets also take quite a while even with pytorch+cuda :(
@reapiu8316 That makes sense, you have pretty vram intensive workloads. My dayjob is video editing, so I never exceed 4gb of vram use even with 4k editing
@@cooooooooooooooool3my Firefox uses 11 gb vram :(
Depending on the task. Nvidia Tesla P40 is not a bad entry for 24gb of vram in the used market. Runs RVC smooth as butter in my experience
i bet this rig can finish the f@h workloads my rig does in a week, in like an hour
now im ready to play minecraft
Ready to open google chrome with 10 tabs)))
It sounds like a jet engine while its running and needs cooling made for a small office to keep it running. Unless you are 100% gpu and 100% ram usage, it won't hit near its total wattage consumption. In comparison to a dgx1, it can do 40% more work while consuming 20% less power doing a task that would max out a dgx1.
That's progress. In the 90's we would pay this voor a DEC VAX 128MB memory expansion.
How it felt to work on the big box palsma tvs back in the day.
Bros getting ready for gta 7
i need this for my school works
One can dream.. but never have.
finally a PC that can run MS word at 240 FPS👍
Thanks, amazing, will be nice if you power on the server. Windows? Linux?
"bro the servers are bad im lagging"
The servers in question:
Diesen Arbeitsplatz würde ich auch gerne haben. Den ganzen Tag mit Teurer Hardware basteln .
This PC goes into the category of:"Nasa Super Computer" 😅
you can have the best waifu simulator on this thing
Nice boiler!
Everyone talked shit until the snow part of crysis then parts started to melt
amazing how they could get the cooling plate of the gpu on the market..
Very nice build, but this watercooling loop seems underpowered
Finally, something adequate to run Tetris
I would’ve mounted this in an enthoo pro 2 server case😊
Ok I can build my setup I have the Alphacool A100 Carbon, now I need a A100 80GB.
Such beauty.
C'est Gleen qui monte le pc 😮Omg
Il lui ressemble sur les reflets x)
Any reason it should be mounted this orientation? Why not upside down, so leaking coolant will not damage the mobo?
Where are your CPU heat sink clips? Or do those water blocks not allow them?
Insane.
Q: What does this computer do?!
A: yes.
Let's see on Facebook marketplace 10 years later
What the hell IS bro cooking
His CPU's most likely with that thermal paste application.
Bro gonna create another dimension
Why are you wearing gardening gloves? 😂😂
oh so that is why we have a pc part shortage
I actually have 2 of those SK hynix M.2 2tb for my pc
Refilling water is gonna be nightmare better use mineral oil
The lack of redundant power supplies worries me
BGM kinda reminds me of Dr. Driving..btw the build is
thats cute but tiny setup probobly order for some small Ai research shop, not many if any institutions will go go for liquid cooling on large scale in data center for 4 GPUs
A *0.00000000000000000041%* of Quantum computer's power 💀
only fittingsa and tubes cost are more than my desktop's
Moore’s law says that in 9 years, this level of power will be in your laptop.
this bro built for gta 6 high settings
❤❤
Finally a server that python can print 1 to 10000000000 in 1 second
Now we can watch skibidi videos without getting stuck...
I'm waiting for the benchmark test, do you have it? how long does it takes to train nanoGPT medium size model?
He just wanted to show off and prove he could afford one.
@@shidongxu3410 They are an actual computer shop! This is for their client
@@shidongxu3410 This is probably his job and he's just showing the process
@@shidongxu3410 no way someone can own 4 A100's and use it for personal usage
@@rd_626 a lot of people can but why would these people do it is the proper question.
Watercooling A100s is brazy.
"Yeah mom, it's for school."
How long will game streamers have to play before you get your money back, including the energy bill.
Gloves +socket pins= pain
I can finally open 24 Chrome tabs at the same time!
Almost got to wormhole phase 😂😂
-Mom, this is just for school study
Proper rig for Cities Skylines 2
mom I need this for my zoom classes
Strange setup IMO. These GPUs are built to run in servers, passive cooled by server hi speed fans, connected between each other with nvlink for rapid data transfer. Water cooling is quieter of course, but who cares about noise in datacenters? BTW nvidia produce a100 in sxm credit card size format, you can easily fit 8x GPUs into 2U server. Oh, the second PSU would be nice for some redundancy.
smx is not the size of a credit card ,but more like a phone like s23 Ultra ,
2 киловатта могут легко разогреть такой объем воды
Yes
Still not enough to max out Alan Wake 2 at 4K 30FPS😂
"It is for studying, mom!"
automática mente yo cuando dice gantate lo que sea en la tarjeta de crédito
Super flower psu!? No way!
2 questions: 1- Why not fill the remaining memory slots with 4x32GB?
2- Would custom length cables have removed some clutter and added to the airflow in the U4 chassis?
Nice job, I've already got a perfect spot picked out for it.
Why you didn't put ram in all slots? I think you crippled the memory speed quite a bit. 🤷♂️
more vram than normal ram in that thing
No way that doesn't run hot with the cooling solution they chose. I mean it is probably all within specs, but would run with less power if they used more in terms of cooling.
A build like that, and not even using redundant PSU? 😮
ur crazy
@@lastlyhi Thanks
no ram, vrm, eth cooling, different length of tubes lead to uneven water flow, correct me if I'm wrong
I would never ever place the thermal compound on the bare GPU chip in that way. The CPU has an heat spreader so it can work well even if some part of the spreader ends up without thermal compound be the bare chips of the GPUs don't have so much luck. I would spread the thermal compound with a plastic tool so as to make sure every part of the gpu chips is covered.
yeah if pasting on a bare die it's definitely a better idea to manually spread to cover the whole die
el verdadero pc de la nasa
now I can play Minecraft in 8K ultra HD
круто выглядит
Expensive build
MX-4? Seriously???? Why didnt you use Noctua NT-H2 thermal paste? Or Thermal Grizzly Kryonaut Extreme?
Y'all have been marketed to too hard. The thermal paste is maybe the least important part of cooling this over here as long as the paste is applied evenly. You don't actually need thermal grizzly unless you wanna overclock or if you just really like RUclips sponsors
@@MustafaKhan-hg8lu you know its A100 we are talking about, right?.. its not your average 4060
там и GD900 справится
Dear Santa...