🇬🇧 Proxmox Virtual Environment | Kllisre X99 D8 and Xeon E5-2640 V3 with Turbo Boost Unlock

Поделиться
HTML-код
  • Опубликовано: 27 окт 2024

Комментарии • 105

  • @patrickregis1
    @patrickregis1 4 года назад +7

    Soon my X99 twin will be there, and thanks to you will FULL power. Great you use Proxmox !

  • @stiggy2k9
    @stiggy2k9 4 года назад +7

    Hi. Firstly, love your videos.
    I'm somewhat of a virtualization expert, with many years of professional and personal experience. You were likely encountering a configuration error causing such a large drop off in performance. Few tips:
    1) pin vCPUs to physical CPUs in a topographically accurate manner.
    2) enable huge pages and pre-allocate the memory for the virtual machine at server bootup or shortly after.
    3) you've got something weird happening with your unlocked results. Make sure you're using the "performance" cpu governor in Proxmax/Linux.
    As a result, you're coming to the wrong conclusion with regards to the viability of a gaming VM under KVM/Linux. In an ideal config, the reality is this: You lose about 10-20% on CPU and maybe 2-3% GPU by virtualizing. Not amazing of course, but very tolerable if you have good reasons.
    Very happy to assist with any of these steps if you need. You make great content, keep it up!

    • @Miyconst
      @Miyconst  4 года назад

      Thank you for the support and extra information. I would really appreciate if you could tell me in practical steps, what I shall configure in Proxmox to achieve what you suggest.

    • @stiggy2k9
      @stiggy2k9 4 года назад +2

      @@Miyconst I've never used Proxmox specifically, but here's an optimal libvirt XML section for your 8 core 16 thread:
      14
      1









      You should also have:

      Proxmax is just Linux underneath so wiki.archlinux.org/index.php/PCI_passthrough_via_OVMF#Static_huge_pages should get you started with static hugepages.
      Proxmox CPU governer can be looked at here:
      www.reddit.com/r/homelab/comments/bltm26/proxmox_power_usagemanagement_still_no_cpu_scaling/
      Apparently they use performance governor by default, but there's definitely something fishy going on here. When doing testing within the VM, if you run "cat /proc/cpuinfo |grep MHz" using SSH, does it should show all cores at 3.4Ghz?

    • @Miyconst
      @Miyconst  4 года назад +2

      @@stiggy2k9 Thanks man, I will follow your suggestions if/when I will be investigating Proxmox setup again.

  • @MichaelSteinmeyer
    @MichaelSteinmeyer 4 года назад +2

    Thank you very much for addressing my question regarding PCIe bifurcation! 4x4 NVMe cards are now as low as USD$30, so it's becoming an interesting feature, even if you don't use RAID, it means having space for up to 4 drives PCIe 3x4 in just one graphics card slot. And still, you can setup software RAID in Windows and Linux(as long as it's for secondary drives). Keep up with the good work!!

  • @amdrebataglia
    @amdrebataglia 4 года назад +5

    Awesome content as always, keep it up
    Another motherboard I can recommend

  • @renanwillian4006
    @renanwillian4006 4 года назад +4

    Isso foi muito bom, eu estava procurando um outro software alternativo e esse parece ser bom para o que eu preciso.
    Não sei se é possível, mas seria bom ter mais testes com outros jogos.

  • @krisweber256
    @krisweber256 4 года назад +1

    Man! You don't even know how long time I've waited for tests like this!
    Just interesting, how test results changes if you use dual-cpu motherboards and 2678v3? I'm looking on Huanan dual-cpu LGA-2011-3 motherboards with DDR4 support (as manager said me - they must come in june-july) for my home workstation. Native windows is not an option because I hate windows and using that OS as gaming platform only.
    Performance issues - is the software problem, because software in 99% not optimized for virtualization, especially games. For more performance in tests you need to try some tunes in your host system and in your VM. Actually I don't know what to do in Proxmox (using it for virtualization in my server room), but for home tasks (games) I recommend use standard Linux distro with qemu/kvm installation. I'm using Ubuntu 1804 now.
    Try to tune, hope it helps...
    1) enable hugepages on host and VM
    2) enable CPU-locks in host and CPU-pinning in VM (1to1 for locked CPUs)
    3) disable balooning device in VM
    4) disable VT-d coherency on host (if it possible on chineese mobos)
    5) tune NUMA nodes for VM use (do not disable it)
    For my system that tunes doesn't works because it ancient - Westmere CPUs on Lenovo ThinkStation C30. I've found what Sandy Bridge and earlier CPUs not recommended for passthrough, but Haswell... Look, if you could do it - it will be cool.
    In any case - thanks a lot for that video! I'm happy what I don't need to reinstall my system and switch my shiny Ubuntu to stinky windows-shit[10] (:

    • @Miyconst
      @Miyconst  4 года назад +1

      Thank you for the tips, if/when I get my dual socket motherboard with E5-2678 V3, I will see if I can dedicate a few more days into this topic.

  • @cscthebest
    @cscthebest 4 года назад

    TQ FOR THIS VIDEO !!! been waiting so long

  • @GanryuMVP
    @GanryuMVP 4 года назад

    That's really weird getting such large performance differences with passthrough. I run plain KVM passthrough and the performance difference is within a few percent. I wonder what proxmox is doing poorly or if it's some strange interaction with such a high end GPU.
    Anyway as always you are the man when it comes to high end setups without high end budgets :) Keep it up.

    • @Miyconst
      @Miyconst  4 года назад

      I am a virtualization newbie, thus I might have screwed something up with the Proxmox VM settings, but with my limited knowledge, I was not able to find something better.

    • @GanryuMVP
      @GanryuMVP 4 года назад

      @@Miyconst You don't have to be perfect. You learn and we learn with you. Very few others are doing controlled testing on such unusual but practical hardware.

  • @h4X0r99221
    @h4X0r99221 4 года назад

    This enables really cheap home server, as long as you are willing to take the risk on the longetivity of the hardware. Great video!

    • @Miyconst
      @Miyconst  4 года назад

      Longevity and security :)

  • @Adam130694
    @Adam130694 4 года назад +1

    Not my cup of coffee, but nice to hear from you anyway.

  • @guisantiagoreis
    @guisantiagoreis Год назад

    Irmão, estou a anos tentando fazer o pci gpu funcionar e com sua ajuda "Lock Chipset= disable" funcionou para mim. Muito obrigado mesmo!

  • @equintar
    @equintar 4 года назад +1

    First of all, thank you very much for your videos.
    I've always thought using this "budget builds" for virtualization, so this is the VIDEO I was expecting.
    Can I ask you a question? In order to manage the machine, considering it has not a remote management system like IMM, iLO, DRAC, etc., do you know if it is possible to power it on with WOL feature? And, as you have other X99 motherboards, could you recomend one over the others?
    P.D.: Sorry for my english.

    • @Miyconst
      @Miyconst  4 года назад

      Sorry to disappoint, but I don't know if the remote power on option works on these boards. I will check it when / if I have a chance. From the Chinese X99 boards, my favorite is Kllisre /JingSha X99 D8, but Huananzhi X99-TF / X99-F8 / X99-8M are also decent options.

    • @equintar
      @equintar 4 года назад

      @@Miyconst I've saw your video about Huananzhi X99-TF, and the best of this motherboard is the possibility of using DDR3 ECC memory (cheaper and accessible for me).
      But I don't know if the integrated ethernet card works when system is powered off. This is the WOL function indicator, at least without entering in BIOS.
      I've bought a Kllisre x79 combo, and I'm only missing the WOL function... Not the few SATA III, errors on CPU sensors or other errors. I'm happy with this Combo, but... Need to improve (or waste my money ;) )
      Thank you very much.

    • @Miyconst
      @Miyconst  4 года назад +1

      @@equintar Than you for the clarification, if I have a chance, I will validate the WOL feature.

  • @lowrysm
    @lowrysm 4 года назад

    I love these videos and have been waiting for a Proxmox one. I've got an order from Ali I'm waiting on for this specific purpose.
    I just wanted to say I currently run a Windows VM with Proxmox on a stock X5675 with an AMD RX 590 and 8GB DDR3 RAM. It's actually just an old 2009 Mac Pro. I'm able to run most games at 1440p,60+FPS. For example, I'm able to play DOOM Eternal with Ultra Nightmare graphics no problem.
    I suggest using VirtIO block or SCSI for the drive bus instead of IDE with RAW image on lvm-thin. I'm not sure why you didn't set CPU as "host" or set the CPU units like that. I'd also follow the other person's comment about CPU pinning and huge pages. You can also use this in the VM's config to split cores into threads.
    args: -smp 14,sockets=1,cores=7,threads=2
    My new build will be a E5-2620v3, GTX 1070 MINI OC, and 8GB DDR4 RAM on a M-ATX board. I'm excited to see how it will perform versus the Mac Pro. If it works well I'll upgrade to a 2640.

    • @Miyconst
      @Miyconst  4 года назад +1

      A few answers: CPU was not set to "host", because with "host" option the memory speed was degrading to not acceptable levels, the CPU units value was set to maximum possible. The rest - you are probably right, it's just a matter of a better configuration. Still, the good thing is that PCI-E/USB pass-through is working on Kllisre / JingSha X99 D8.

    • @lowrysm
      @lowrysm 4 года назад

      ​@@Miyconst Confirming passthrough works is really awesome. That was my biggest worry when I placed my order. After seeing this video I'm even more excited. Hopefully it works on the D4 too. Keep up the awesome work!

  • @omgg4031
    @omgg4031 4 года назад

    Hey, nice reviews you have here, subbed!
    What would you recommend for a budget server to use with proxmox and docker?

    • @Miyconst
      @Miyconst  4 года назад +1

      E5-2678 V3 and JingSha X99-D8.

  • @patrickregis1
    @patrickregis1 4 года назад

    I confirm, Kllisre / JingSha X99 D8 are the same, Jingsha are built by SZMZ manufacturer.

  • @DetNaetsYT
    @DetNaetsYT 4 года назад

    thanks my friend

  • @burddan6551
    @burddan6551 2 года назад

    I have a gtx 1060 (primary) and a gt 710 (secondary) but my x99 mr9a motherboard only boots into the second, is there any way to boot into the primary? I didn't find anything related in the bios

    • @Miyconst
      @Miyconst  2 года назад +1

      Unfortunately, there are no settings to pick primary / secondary GPU, the motherboard picks one on its own.

  • @Tavito_de_ARG
    @Tavito_de_ARG 4 года назад

    Hi Miyconst.. Thanks again for all your reviews ... are you planning to test VMware vSphere Hypervisor? It's free... Thanks again

    • @Miyconst
      @Miyconst  4 года назад

      Hi Gustavo. No, I don't have such plans, at least not at the moment. The point of this video was to validate if PCI-E / USB passthrough works on this Chinese board. As video shows - it does work.

  • @jzenman
    @jzenman 4 года назад

    I read on a forum a guy said he's modded his E5 v4 to all turbo boost. He says it can be done. You should make some videos showing us how to mod the bios for a v4 Xeon. You keep saying it can't be done with v4 but I've heard others say it can.

    • @Miyconst
      @Miyconst  4 года назад

      Please post links to the forum.

  • @emanuelebianchi5889
    @emanuelebianchi5889 2 года назад

    Hi, Miyconst I am back! How are you? I have question for you! I am some days that I am working on new CPU that I received as gift. It is the first time that I work on ES CPU "QEY6 2.2GHz". I added the microcode fot the CPU on the bios file. I tried multiple version of the microcode always the same result: Stuck on loading windows screen for a few seconds (windows 10 spinning circle work) and than blue screen. Could you give me same help? Do you have some experieces about these tipes of cpus? Could be a bios setting? Thank you in advance.

    • @Miyconst
      @Miyconst  2 года назад

      Hi there. I don't think I can provide any help with this little information about the issue. Please join discord and start with providing your entire system specs.

  • @elpedriyo686
    @elpedriyo686 3 года назад

    Hey Konstantin, quick question. I am trying to passthrough GPU in huanazhi F8 without any luck, the VM just hangs up when trying to boot. Did you modify the stock bios or something? I have tried to follow multiple guides without any luck. Also I see huananzhi F8 has not ECC enabled, do you have any bios for that?
    Thanks

    • @Miyconst
      @Miyconst  3 года назад

      Hi there. I have used the stock BIOS with no modifications. In your case I can suggest to try BIOS from iEngineer.

    • @elpedriyo686
      @elpedriyo686 3 года назад

      Will that bios unblock de ECC memory option?

    • @Miyconst
      @Miyconst  3 года назад

      @@elpedriyo686 no, there won't be any explicit "ECC" option in the BIOS, but the ECC mode may work out of the box.

    • @elpedriyo686
      @elpedriyo686 3 года назад

      @@Miyconst Linux is complaining while booting stating it is not active, as well, as memtest is also reporting so :(

    • @Miyconst
      @Miyconst  3 года назад

      @@elpedriyo686 then I am out of ideas, sorry Pedro, I don't have the motherboard any more to validate.

  • @AtentoCC
    @AtentoCC 2 года назад

    Could you please tell me how to enable iommu in these Chinese motherboards? I have a huananzhi f8, but there are many options in bios.

    • @Miyconst
      @Miyconst  2 года назад +1

      You just need to enable VT-X and VT-D in the BIOS, it should already be enabled by default.

  • @fistfull95
    @fistfull95 3 года назад

    I would like to use this motherboard with 1 or 2 Xeon E5-2650L low power CPU(s), do you know if they are compatible? The AliExpress page says 6 core CPU, but this is a 12 core CPU. Thanks!

    • @Miyconst
      @Miyconst  3 года назад +1

      Yes, JingSha X99-D8 is 100% compatible with E5-2650L V3.

    • @fistfull95
      @fistfull95 3 года назад

      @@Miyconst Thank you very much for your reply. Time to start ordering parts! :)

  • @murdercom998
    @murdercom998 4 года назад

    Hey I ordered MACHINIST X99 dual and a single e5 4627 v4 QS, I plan to order another one when I have more cash. Recently I noticed that mobo claims to only support v3 cpus but other sellers of the same board claim its supports v3 and v4. Is it safe to assume it will work. Also was wondering why the aliexpress sellers are saying the 4627 v4 is a QS if it was a QS it should be marked QKSZ not SR2SN. I believe. Slightly worried I fucked up but owell live ya learn

    • @Miyconst
      @Miyconst  4 года назад

      There are a few qualification samples which are identical to the final version, thus are marked with SR__ ID, but are still QS chips, even though they are identical to the final retail variant. It is safe to buy such CPUs, but sometimes dishonest AliExpress sellers remark CPU with a different ID. As far as I know, this particular CPU E5-4627 V4 QS SR2SN works on the Chinese X99 boards, and I think it is also going to work on the Machinist / Kllisre X99 Dual socket board.

    • @murdercom998
      @murdercom998 4 года назад

      @@Miyconst thanks for quick response trying to get questions out of aliexpress sellers can be difficult. Ill let ya know if everything goes smooth. Love your channel :)

  • @abdallahhesham87
    @abdallahhesham87 4 года назад

    Idk what to say.... keep it up i guess

  • @Adam130694
    @Adam130694 3 месяца назад

    Have you checked that bifurcation feature?

    • @Miyconst
      @Miyconst  3 месяца назад

      It's such an old video, I don't remember, sorry.

  • @giovannigatto1974
    @giovannigatto1974 4 года назад

    and vmware esxi 7? it's free for 60 days to try it. i'm waiting for a dual xeon test on virtual enviroment. thanks.

  • @jlxjalanlinux2240
    @jlxjalanlinux2240 3 года назад

    Does huanan x99-tf can fully working with pcie passthrough ?

    • @Miyconst
      @Miyconst  3 года назад +1

      I have not tested this feature on X99-TF, but it should be supported.

  • @semsontse9513
    @semsontse9513 3 года назад

    Thanks for this excellent video. If this mobo is still with you, can you share a copy of its IOMMU grouping?

    • @Miyconst
      @Miyconst  3 года назад

      I still have the motherboard in my main PC. Tell me what to execute and I will share the results. I am on Windows 🙂.

  • @daemonkisure2952
    @daemonkisure2952 4 года назад

    How can I flash the huananzhi x99-f8 bios in the killesre x99 d8? And another questions if is no too much problems: 1.how much can I undervolt the e5 2678 v3 and how can I undervolt(can be with Intel tuning extreme?), 2. How can I improve the CPU and rams(I will buy kllisre rams). 3- how much can I undervolt the huananzhi rtx 2060 and how can I improve that GPU without risk the life time of the component?, I'm so sorry for this questions bro, I just want to improve all I can my upcoming pc haha, because I want to play AAA he's and stream :D

    • @Miyconst
      @Miyconst  4 года назад +1

      1. To flash X99-F8 BIOS you have to use FPT tool, it can be done straight from the Windows. Before flashing you have to disable BIOS lock in the BIOS settings.
      2. There is no definite value for undervolting CPUs, some can hold -100mv others crash at -50mv, but E5-2678 V3 are usually able to hold -70mv to -100mv, while -50mv is considered safe for all E5-2678 V3.
      3. You don't have to do anything with Huananzhi RTX 2060, it's good as is, but you can use MSI Afterburner to increase the clock speed to 150-250 MHz, depends on how good GPU you get.

    • @daemonkisure2952
      @daemonkisure2952 4 года назад +1

      @@Miyconst thanks so much bro ;D

  • @Alex-oq8yg
    @Alex-oq8yg 4 года назад

    Hey I got a jingsha x99-d8 which looks the same as the kllisre, so is it just a rebrand?

    • @Miyconst
      @Miyconst  4 года назад

      Yes. JingSha / Kllisre X99 D8 is the same board under two names.

    • @Alex-oq8yg
      @Alex-oq8yg 4 года назад

      @@Miyconst ok the thing is that I bought some fans and connected them to the pwm connector on the mainboard and I know the mainboard only got 2 temperature sensors and 3 which are not in use and show unrealistic numbers like 120°C.
      The PWM fans think now that my mainboard is on fire because they detect the faulty sensors and blast on 100%.
      Do you know if there is an option in bios to fix it or a software for fan speed?

    • @Miyconst
      @Miyconst  4 года назад

      @@Alex-oq8yg Did you setup the PWM values in the BIOS? JingSha X99 D8 motherboard controls PWM fans according to the CPU temperature, but the default speed curve is almost the same as 100% all the time.

    • @Alex-oq8yg
      @Alex-oq8yg 4 года назад

      @@Miyconst I looked in the bios but I couldn't find where

    • @Miyconst
      @Miyconst  4 года назад

      @@Alex-oq8yg It should be in the Hardware Monitor or Smart Fan section.

  • @lucas.tadeu021
    @lucas.tadeu021 4 года назад

    i m planing to buy one dual x99 and one 2678 v3 and 1x32gb ecc, i will use for virtualization server, and if its really good, i will use in my maind rig for games. is that a good setup?
    and for cost x benefit is better use a full ddr3 mobo?

    • @Miyconst
      @Miyconst  4 года назад

      This sounds like a really bad setup. Virtualization Performance really suffers from poor memory speed, and one stick of 32 GB will be a severe bottleneck. Huananzhi X99-TF + Xeon E5-2678 V3 + 4 * 8 GB DDR3-1600 will provide way better performance results. For games, dual socket solutions are a big no go.

    • @lucas.tadeu021
      @lucas.tadeu021 4 года назад

      @@Miyconst hunn, i think about 32gb ddr3 because they are cheap, and i want to virtualize for basic use, mostly will be a vm of holepi with docker, and the most others will be just to mess around to learn, the currency here is so high(or low?) due to covid,(brazil) so dollar now is expensive, and i think about future upgrades on the system

    • @Miyconst
      @Miyconst  4 года назад

      @@lucas.tadeu021 In this case you will be just fine, when you need extra performance - just throw in some extra memory sticks.

    • @semediputra6697
      @semediputra6697 4 года назад

      Can 1 proccesor work on dual x99 ? I saw on commenting on dual x99 mobo
      That the mobo will not work until you put 2 proccesor on that
      If you put 1 it will not work

    • @semediputra6697
      @semediputra6697 4 года назад

      @@lucas.tadeu021have you already try ?

  • @dakata2416
    @dakata2416 4 года назад

    Are you planing to test it with FreeNAS VMs?

    • @Miyconst
      @Miyconst  4 года назад +1

      Not at the moment.

  • @johnathanwee6334
    @johnathanwee6334 3 года назад

    Hi, can you share your bios settings to enable IOMMU , GPU and USB passthrough for windows 10 vm in Proxmox?

    • @Miyconst
      @Miyconst  3 года назад

      Sorry, I can't, because the video is very old and I no longer have the exact BIOS settings.

    • @johnathanwee6334
      @johnathanwee6334 3 года назад

      @@Miyconst I understand. I have trouble getting proxmox to enable passthrough. Would remember which particular setting in the bios enables IOMMU?

    • @Miyconst
      @Miyconst  3 года назад

      I am really sorry, but I don't have any more info than what's available in the video. I followed the official Proxmox guide and it just worked.

  • @ChrisYx511
    @ChrisYx511 4 года назад

    Hey, does virtualization also work on the Huananzhi X99-F8 ?

    • @Miyconst
      @Miyconst  4 года назад

      Yes, as far as I know, but I didn't do this detailed test on the Huananzhi board.

    • @ChrisYx511
      @ChrisYx511 4 года назад

      Miyconst ok, thanks!

  • @patrickregis1
    @patrickregis1 4 года назад +1

    When you measure the FPS of racing games, I think you'd better dedicate the 1080 video card to the VM.
    It implies a second VGA card dedicated to Proxmox.
    Some ressources :
    pve.proxmox.com/wiki/Pci_passthrough#Intel_CPU
    blog.quindorian.org/2018/03/building-a-2u-amd-ryzen-server-proxmox-gpu-passthrough.html/
    Your videos are just Great, thanks.

    • @Miyconst
      @Miyconst  4 года назад +1

      That's exactly what I did. RTX 2080 Ti was dedicated to the VM through PCI-E pass through, while another GPU (GT 710) was used by Proxmox.

    • @patrickregis1
      @patrickregis1 4 года назад

      @@Miyconst the FPS variation is very strange.
      As soon as I get mine (it landed in my country yesterday) I give it a try, and I'll tell you. (100% Refund 8-) )

  • @Moon_Goose
    @Moon_Goose 3 года назад

    Would some be so kind to test bifurcation on this board please.

    • @Miyconst
      @Miyconst  3 года назад

      It works on Huananzhi X99-TF motherboard, which makes me believe that it works on this board as well.

    • @Moon_Goose
      @Moon_Goose 3 года назад

      @@Miyconst thank you for the info. What bifurcation did you test? X8x4x4?

    • @Miyconst
      @Miyconst  3 года назад

      @@Moon_Goose I have tested X4X4X4X4 as I have an NVMe expansion card for 4 SSDs.

    • @Moon_Goose
      @Moon_Goose 3 года назад

      @@Miyconst Thank you so much!

  • @warrax111
    @warrax111 4 года назад

    What is that CPU cooler at 7:04

    • @Miyconst
      @Miyconst  4 года назад +1

      Cooler Master Hyper 212 Evo.

  • @catistix
    @catistix 4 года назад

    Please do one with E5 2678 v3!

    • @Miyconst
      @Miyconst  4 года назад

      Do what? :)

    • @catistix
      @catistix 4 года назад

      @@Miyconst proxmox build with addition of power consumption

    • @Miyconst
      @Miyconst  4 года назад

      @@catistix Sorry, I still don't understand.

    • @catistix
      @catistix 4 года назад

      @@Miyconst please do a version of this video with e5-2678 v3. In Addition, as proxmox are usually for virtualization use and typically on 24/7, please add in a power consumption comparison as well.

    • @Miyconst
      @Miyconst  4 года назад

      @@catistix Thank you for the explanation, but I don't understand what is the point of testing the same things with E5-2678 V3? It's almost the same CPU as E5-2640 V3, just a few more cores. The results will be almost identical.