Unleashing the "Modern" Dual Xeon Beast!
HTML-код
- Опубликовано: 7 фев 2025
- In this video, I’m building a dual-socket Intel Xeon server using the SuperMicro X11DPI-N board-and then putting it through its paces on Windows, Ubuntu, and Proxmox. We’ll do performance benchmarks, talk about the hardware, and see if this setup can handle everything from virtual machines to heavy workloads. Whether you’re curious about multi-OS servers, looking for a high-core-count build, or just love seeing powerful machines in action, stick around to find out if the “Xeon Beast” can truly roar. Don’t forget to like, comment, and subscribe for more server builds and tech adventures!
LGA3647 CPU List
www.cpu-monkey...
The links below are not affiliated, don't know the sellers, just sharing the links
Motherboard:
www.ebay.com/i...
Motherboard specs: www.supermicro...
CPU I used
www.ebay.com/i...
CPU Specs: www.intel.com/...
The cooler I used
www.ebay.com/i...
#dualxeon #xeon #intel #supermicro #lga3647 #serverbuild #proxmox #ubuntu #windows #benchmark #cpubenchmark #virtualization #pcbuild #tech #hardware #budgetserver #ddr4 #servers #homecloud #computers #serverlife #hypervisor #cpus #highcores #diybuild #homelab #homelabsetup #techchannel #data #buildguide
why do they call those boards super micro when they are so big ?
Asking the real questions here.
@@TechnicallyUnsure It is the brand name, company name, like Asus, Gigabyte, ASRock etc. They USED to operate in the consumer market but not anymore. They cater to the server market now. They costed more back in the day but they were loaded with features too. They were out of my price range back in the day.
Because they would be 20 times bigger if other company made them.
Run by size queens
20 minutes after this video released, the price of the motherboard increased from 360$ to 500$
Well, that's unfortunate... Did not expect it to happen, not this fast at least. It's terrible, I searched eBay and looks like all the sellers increased their prices... How?!
@@TechnicallyUnsure It is pretty common for ebay sellers to do that, I'm not entirely sure why or how but this issue seems to be specific to the lga3647 market
May be the seller is one of your fan 😂😂
@@TechnicallyUnsure 133K subscribers. Yup, that's enough to move an economy!
😢
Those silver connectors above the orange sata ports are actually occulink connectors.
I recently bought X99 chinese board with Xeon E5-2680 v4 & 64gb ecc ram. So far, works fine, yes it is not as power efficient but for my needs it's good enough.
People who complain about it being old or the new gen being too pricy will complain regardless what you suggest.
My older brother's dream... NICE VIDEO!
If you can find them, you can them with 2tb of optaine ram that can be used as a static storage for insane speeds
New here and I love your videos on the aliexpress boards. I will def buy one now for testing, thanks a lot!
Correct me if I am wrong, but the Xeon LGA 3647 CPU's have 6 channel memory. They will support 8 sticks of ddr4, but the speed will be lower. I have some workstations that use the same chipset. The memory configuration guide says "For best memory bandwidth performance, Lenovo recommends optimizing the overall memory configuration to use 6 DIMMs per CPU."
Thats how my Lenovo Thinkstation P920's work. Your milage may vary. Not wanting to come across as pedantic. Running Unraid 7 w/two 8168's & 384GB ram.
i scored a x11dph-t for sub 300, its a slightly upgraded board and going with a 6248 and a combo of optane and ram. its going to be my virtualization server to learn with. funny enough water cooling these cpus is cheaper than air cooling from what i can find online for sale, so ill be going that route most likely.
Great video!!! Thank you for running these tests.
This is awesome!
Installing theses CPUs is scary. You have to attach them to the cooler and put the cooler on the socket blind.
I remember when we first started using scalable we were all like 'wtf' when it came to the CPU install. Not so bad once you get used to it but Epyc install so much easier.
you dont HAVE to do it that way, it's just the recommended way.
To drive the point home, you should do a dual socket EPYC 9965 build. The question here is not what you're gonna do with 768 threads and 9 TB of RAM, but the concept of it.
Are you goin to sponser this buid?
Small correction on ollama, you provided prompt token evaluation per second, use bottom one eval count so actual numbers are 11token/s for 8b and 2-3token/s
Thanks for the correction, you are right
😮
That is not the correct value either...
You want us to pay brides to the power company! What will the next server build require of us? Will we need to kidnap and ransom a ceo next?
In my experience, changing between X8, X16, on PCIe 3.0, and PCIe 4.0 doesn't make much difference, except in the synthetic PCIe benchmarks. I assume AI ~could~ push it harder. Most modern applications just don't need more than 7.5GB/s. 15GB/s, and 30GB/s could help, but usually only by a few percent, which could often just be run-to-run variance.
Not sponsored i dont even know if it works , Gold
I did this same thing but with single socket AMD mainboard : AMD EPYC 7282 16C32T (60$), SuperMicro H11SSL-i Rev.2 (399$), 256GB R-ECC DDR4 overall for about 1246$.
Planning to get 64 core Epyc soon as they are afforable enough, right now they are bit expensive at around 800$.
AMD EPYC 7532
Great Video!
and, importantly: Skylake!!!
very similar to mine, i got X11DHP-T. I get the same LLM performance but i suspect it can do more, I don't think ollama is very NUMA aware so its put everything in the RAM of one CPU and both are trying to use it. If you i limit it to running off of one cpu i actually get slightly better performance. I'm going to try recompiling ollama at some point and failing that, try 2 vms with one cpu each and try clustering ollama to force it to max out the full 6 channels of DDR 4 on each CPU.
I did my first time upgrading/ installing "modern" xeon cpu on Dec 2024, because I need extra cores for database processing. I try to take pictures before replacement, and read the instruction carefully, however at last step I still confused did I put the cpu in the correct orientation, because the marking is too subtle and the design is not foolproof. So I just cross my finger, close the top cover and press the power button. Upgrade from 6c12t to 10c20t. Sorry I forgot the cpu model number, but I am sure it is an HPE Proliant 380 g10 system.
Did need a new homelab a year ago and do not need that much CPU power as 2 of these just one is enough so i build a AMD system just with a new 7700 non X variant because it was cheap and its speed is smack in the middle of the 2 cpu's mentioned here. But it runs around the old stuff single thread like 2 times the speed. While costing less got cpu + mb for 400,-. And it runs cool because it only uses 65W. Put a intel X550-T2 so i have 1x 2.5Gb and 2x 10Gb networking have 2x M2 (1x pcie 5.0 and 1x 4.0)and 4x Sata. Put 192Gb of DDR5 memory in it so it is close enough to a real server to function at home while being cheaper less hot and makes almost no noise.
For the most part under 'typical' homelab use Epyc/Xeon will run pretty cool, my NAS is a v3 Xeon and it's got a passive cooler on it, barely ever breaks 50c and idles as low as 39c. Power use isn't that crazy either, if I remember right a 7700 system idles at something like 35-40w so nowhere near as impressive as modern Intel stuff. Sure Epyc is higher idle and for most CPU's max wattage but you also have the option of more cores and a metric f ton more pcie, not to mention ECC support so it's all about what you want/need vs cost for your homelab.
Nice! Pay attention to hexa memory mode - these CPUs supports 6 channel memory, but you have 8 DIMMS for each CPU
P.S. For ES CPUs I think you need to search for custom bios
You are correct and I didn't find a custom BIOS unfortunately.
@TechnicallyUnsure I googled a little and find out that this time you were not so lucky - this is only X11 board that don't support ES cpus with early bios releases, so I don't think there is a custom bios for it.
Yes, unfortunately. After recording this video I noticed that I had Xeon Platinum 8268 as well... but it was already too late, maybe another video
@@TechnicallyUnsure you have an interesting closet with interesting hardware 😁
Great video 🔥
I was hoping you would start testing speed of 70b llm's!. The X11DPI-N with its 1 DIMM per memory controller is about 70% faster running 70B than my 7500f with DDr5(6000). Impressive but still too slow. Need something with memory bus speed of apples M2 Ultra (800 GB/s), but without its price tag, to run 70B at a better clip. Thanks for vid. Very interesting.
I like your videos man lol. SHowing this machines. I really enjoy the epyc one. Which one is better between those 2? Also that cpu cooling its enough?
Thank you, glad you enjoyed the videos. CPU cooler is decent enough, it's just loud. As for better, well AMD one is much more expensive, so that one's faster, but I love both. Both are decent for all sorts of projects.
Great video! Could you please do a budget build with a single socket? Thanks
id skip the engineering sample poop and go with the 8168 if the board can support 205 watt cpus , btw the chips only pull that much at full tilt
oh wow are those cheap, might just have to swap out my 6138s for those. Running a C621E SAGE btw, so it can defo handle it.
Hi, Great video, which version of Windows did you install?
Thanks. The TPM arrived late, in the video, I am using win10, but later I was able to install 11 with TPM
@@TechnicallyUnsure Wow! i am looking forward to see it😍
I have the same moba, with the oldest bios and it Does support my ES cpus. newer bios versions blocked that
every day i am more convinced that x299 was a shared hallucination
X299 is trash.
@@TienNguyen-ky4dx Idk what intel was thinking with that one. I really don't. Why change the number of pcie lanes based on the cpu, why have an i3 and i5 on the platform, i can't remember but i think that there were some chips that even ram channels weren't active on.
Beware the "ES" engineering sample chips. They're cheap, but compatibility with the final version of the chip is not guaranteed. Even just error-free operation is not guaranteed.
Stay tuned, an upcoming video will showcase ES chips and I'll be exploring "if it's wortth it". Not the ES CPU mentioned in this video, much more powerful one.
nice watch dude, what is it?
Thanks, it's Franck Muller Yachting
This is exactly what I am looking to setup. Would you happen to have a guide on how to setup the jellyscale and reverse proxy?
Not familiar with Jellyscale, maybe you mean Jellyfin? a streaming media platform similar to Plex?
I will try to have a video on how to setup some very common home server software, jellyfin, reverse proxy, pfsense, truenas, etc
@TechnicallyUnsure sorry I meant jellyfin not jellyscale 😅 I'll be looking forward to seeing that video
Seems like the seller knows you now
Question: can we assume the power usage at idle and full power will be half when we only fit one CPU? I am interested to built my own server, but i still live at home and don't want to use too much power.
Kind of, but not exactly. Also remember I used every single RAM slot, each ram uses 2-3 watts, so in my video around 35-50 watt is just RAM
@TechnicallyUnsure thank you!
Not apples to apples but H12ssl-i +7302 with all ram slots populated, 10gbe NIC, HBA, 2 M.2 and 2 U.2 idles ~80w and I could get it around 200-220w during stress test. With a few VM's running it's usually around 110-120w which is about the same as my desktop (13700k+3070) when the system is active but not working that hard.
@@nadtz thank you that very interesting! I am really considering it!
I have been using a Chinese dual board for three years without any downtime, and it is 300-500% cheaper than the SuperMicro board he purchased.
Which one?
im sorry what there's a $60 cpu option and a $2,000 option? Whats the difference
$2000 is new and original price. What i use in video is $60 used CPU which works fine
Does this mobo support Above 4g decode and Rebar.
Above 4G decoding, yes, but I don't see Rebar option, although you can use something like this if you really need the Rebar github.com/xCuri0/ReBarUEFI
@@TechnicallyUnsure Yes, I was looking at this for my HP Servers that I'm running as HomeLab, but it turns out they are not as user friendly as I wish in terms of modding. When I get the time, I'll try with a Ch241a programmer and if I am not successful most probably will make my own build that is not as restricted. Main purpose would be to be able to utilize a cheap low powered GPU like the Arc A380 for transcodding and use of a VM for Fusion 360 (for 3D printing design) purposes. Thanks!
If anyone wants almost this exact same motherboard but for near half the price (someone said it’s $500 now?? Wtf) look into the Supermicro x11DAi-N. Everything is the same except the sas ports are replaced by 8 sata ports. Just found it for $270 on eBay w/o shipping, so unless you NEED sas ports that’s what I’d get
can we add 50-60tb hdd also this ? also can anyone share with me ram brand/model please?
Yes you can add more than 60TB to it and this is my RAM
a.co/d/ecViBDU
how much is 4TB 3DS ECC RDIMM, DDR4-2933MHz???
4 TB?! Well, you'll need 16 x 256GB ECC RAM, lets say single 256GB ECC RAM stick is $800, that'll be $12,800 for 4TB RAM
What watch is that?
Franck Muller Yachting
I know this is unrelated to computer both
Someone gave me a watch very similar to the one you have on this video
I broke the band and would like to know more about the watch
It’s got what I believe to be a m on the background
If any info or website could you please help
It's Franck Muller Yachting
Do adobe rendering test's ect gaming !!
Thanks for the suggestion, will try in future videos, don't have an Adobe subscription though, will see what I can do
W-3175X
That's a $500 CPU, but definitely a more powerful one and should work with this motherboard as well.
It won't work. Intel stopped allowing workstation chips to work on server boards. Only the W-21xx and 22xx line did. And why would you want a CPU that only supports one socket on a dual socket board?
(Xeon E5 2698 V3 ) x2
+
(Motherboard x99 dual cpu )
:)
I have showcased that option as well on my channel ruclips.net/video/IcnOQK1S4z8/видео.html
an i9 14900k or similar modern high end processor would beat this in multithreading perf and yet be cheaper and use less power.
Well, I wish, but an i9 won't beat this score.
@@TechnicallyUnsure It would. Because you got "Intel confidential" version of 8180. They run slower than official version. lga3647 is too old really.
That's not what I am using in the video, I switched to the other CPU (Xeon Gold 6148) and I have CPU-Z score and best i9 does barely half of that
@ I usually go by passmark. [Dual CPU] Intel Xeon Gold 6148 is lower than i9.
But the 14900K barely has any PCIe lanes since it's a mainstream consumer CPU. It's made for people that only have a single GPU and some M.2 NVMe SSDs