I've been running proxmox on my gaming pc for awhile now (Ryzen 5700G). There is no noticeable performance drop on a Windows VM and everything works as intended. With that setup I have plenty of room for my experiments and extra services I host at home. I am a web developer and always had to choose between windows or ubuntu (dual boot). Now I can run both, so no downtimes anymore. And everything is in its isolated secure scope in LXC container or on a VM. With ansible playbooks and terraform it becomes even more powerful system. Love it.
Someone should really do a full end-to-end tutorial on a multi-system Proxmox machine that's low-noise, dual-gpu for both Win/Hacintosh whilst automating everything to endgame standard operating environment that's bespoke (or can be made to) via ansible playbooks. At least I think it should be to introduce everyone back into putting the "Personal" back into Person Computing.
Glad to hear that the 5700G is a good proxmox CPU ... Because in December after the new chips drop mine is going into (yet another) server :) (which will have to keep up with some quite beefy tasks that a 7th gen i7 is currently almost getting overwhelmed with - typical usage is 80% - noctua saves the day sanity-wise.
Год назад+16
Nice video! I have been using virtual Windows 10 on a daily basis for over a year now with passed-through NVidia GPU, one Ethernet port, whole USB-C PCIe card and some chipsets for USB ports and Bluetooth connectivity. It's really amazing to have about 50 VMs created and ready to turn on while several of these are running all the time. So, the main thing you are achieving this way is to have several systems on one CPU, one set of RAM inside one case with one power supply. This setup (in my case based on Proxmox, with VMware I cannot achieve proper GPU passthrough as well as one of PCIe devices...) works that well, you can forget that you are working on VM.
thanks for the video! as someone saving up to replace an old 4th gen intel desktop that i'm using to run proxmox and a few vms. this setup is miles better than paying ebay for another antique and likely will wait a few more months to upgrade using this guide.
You could say, I use my system as a Virtualbox virtual machine server, but not as a file server, since I'm the only PC user at home. The hardware did cost new $349 and it is a Ryzen 3 2200G; 16GB DDR4 (3000MHz); ASRock B450 HDV Rel 4.0; 512Gb SP nvme-SSD (3400/2300MB/s). I bought locally the new xTech midi-tower and power-supply combo for ~$35. The system has some left-over disks (1TB and 500GB with around 9 power-on years) and a 128GB sata-SSD. The Host OS is a minimal install of Ubuntu 22.04 LTS with OpenZFS 2.1.4. All VMs run from OpenZFS. The main VM run from the nvme-SSD and the others run from 2 striped 500GB partitions supported by a 105GB sata-SSD cache (L2ARC). The last 500GB partition has a 15GB SSD cache. The last 5+3 GB is used for 2 ZILs caches for synchronous writes. I maximized the memory cache (L1ARC) to 4GB, but currently I only use it for the HDDs, the performance gain for the nvme-SSD is max 20%, so Linux boot times of ~10 to 12 seconds instead of ~8 to10 seconds. I have 6 main VMs, - Xubuntu 22.04 LTS for all communication apps (email; whatsapp; messenger; etc). - An encrypted Ubuntu 16.04 ESM for banking and Paypall with the latest stable snaps of Firefox and LibreOffice. - Ububtu Studio 20.04 LTS for multi media. - Ubuntu 22.04 LTS for experiments and try-outs of apps. - Windows XP Home as jukebox to play the wma copies of my LPs and CDs with WoW and TrueBass effects :) - Windows 11 Pro, just in case. I can run 2 modern Windows releases and 4 Linux releases at the same time. I'm a collector, so I have all Ubuntu LTS releases from 2004 to 2022 and all Windows releases from 1987 (Windows 1.04) to 2022 (Windows 11 Pro), including the NT releases from the nineties. My oldest VM is Windows XP home installed and activated in March 2010, somewhat later I installed the netbook version of Ubuntu 10.04 LTS in a VM. My old refurbished 1TB WD Black HDD (9 power-on years and 8 months) start to develop problems, I have since 2 weeks 4 sectors in the "current pending bad sector list" and ZFS puts occasionally the partition in degraded mode, while stating that no data has been lost. I don't like modern disk firmware, in case of doubt declare a bad sector, don't introduce this gray area of suspected but maybe stil usable. I have 2 backups. so I don't panic, but the firmware designers are idiots and play with their client's data security. I have to buy a new disk soon.
Hi! Great video! I use an x570 Mobo + 5900x CPU + 2 nvme +32gb of ddr4 and a 3090. It is now my main server, but my most powerful one. In one nvme I have a bare metal win11 for gaming(I want to use full resources) and in the other nvme I have proxmox with many Linux vm's for testing. Some of them have the 3090 passthrough(to use with ML). I also use an app(in Android) to start/shutdown the VM's, and I have a laptop that I ssh to them too
I almost bought that motherboard for my new ProxMox build for it's ECC support but was weary of older chipset so I went with ASRock X570 TAICHI AM4 which supports it. It's not a "server" motherboard but it's got what I needed it for.
You are a generous soul and amazing for making such detailed videos.. You've made me commit and get my own homelab hardware and already started on my proxmox journey and I frequent your channel nearly everyday to learn more.. Keep up the great work
Just built a ryzen 5 3600X Asus B550 truenas/Nextcloud server with 16TB of nvme storage and room for hard drives later. Had the old processor laying around and glad to put it to use!
@@RaidOwl yeah, its a lot of nvme storage in an asus Hyper card, but the cost was similar to sata drives so why not! Also just installed 128 gigs of ram for that sweet zfs cache haha
I stumbled upon your video and tbh it solved two problems I was having. I have a PowerEdge T350 I've been using for DevOps work and some AI/ML projects but needed a dedicated GPU but unfortunately the server doesn't support one. Also, I love ChimeraOS to play some steam games with the ability to have a console like experience. I think this will solve all of my problems here so I can pass through the GPU for deploying Local LLM's while also playing any pc games I'm interested in as well. Thank you
I recall seeing your live stream while building on this exact server motherboard at the same time. I picked up a used 3700X for the extra threads while staying at a lower TDP. The RAM in my build was the most expensive since they're 32GB sticks, but the build needed it since it's also running TrueNAS. I'd love to drop a graphics card in there, but with a dedicated gaming PC, I don't know what I'd gain from it, other than gaming from afar I guess? Or while at work :D Compared this to the X5704DU but the price was too good to pass up for what it can do. This board is so versatile I'm expecting it to be in production in my lab for quite some time. Great find!
Probably would use a 3700x or a 5700/5800 so I could have access to 8-12 threads for the gaming VM and still have TONs of overhead. OR run x99. But I am definitely not most people. The average gamer is more likely to have 1st, 2nd or 3rd gen ryzen 6 core "spare" or to upgrade from. I still need to find a purpose for that 3900XT I found for cheap...
Great video! I've done this with UnRAID using a Ryzen 7 3700X and RX 5700 XT setup. The cool thing was since I was converting my existing gaming PC I just passed through the NVMe Windows was installed on into a VM and booted it up without issue. If I needed to boot into Windows bare metal I still had that option as well.
@@MIDNITE69 I don't believe so. If I'm not mistaken it uses QEMU/KVM just like Proxmox. I'd assume when you create a VM you would just passthrough the entire disk the Windows install is on. This is what I followed for UnRAID: ruclips.net/video/fnIn6GnA87c/видео.html I don't see why it can't translate over to Proxmox. The only thing to keep in mind is making sure to change VM UUID in the template like he did towards the end or there may be weird Windows activation issues that arise.
Using a Ryzen 5 PRO 5650G (integrated gfx WITH ECC) myself on a X570 I AORUS PRO WIFI with 32gb 3200mhz ECC, LSISAS2208 in a Fractal node 803 running TrueNas Scale. 4 hardddisk and 2 m.2 ssd 128gb sata for boot, and 512gb for download storage. Takes about 55w or so.. idle. gonna try putting the 5650 on 45w mode and see what that does. using it as NAS and Qbittorrect and firefox syncserver.
Nice project, maybe you can start your Win VM with a smarthome integration, like home-assistant-> integration-> proxmoxve, and say : Siri, Alexa, Google -- start gaming VM. maybe........
This is really interesting and I'd be interested in doing it. However I would be reluctant to have my box next to me since I would be annoyed by the noise of the spinning hard drives next to me. Either I'd have to run cables from my system to my desk, or figure out how to access my desktop via a thin client.
I am using Asus A520M-e with ryzen3700x and ecc memory.I have installed true nas scale and i am trying to install a vm on it. The hardware works The motherboard is cheap and it accepts ECC memory
Depending on what you want to play this is a great solution, Long as nothing is using anti-cheat you will be fine. But there is always option of running it bare metal on linux and building out everything on the host os including gaming on linux. But I'm not even brave enough to think about trying to do that. Also if you built it out enough you could have 2 gaming VMs so if you had a friend over at some point you'd only need the one machine to game with them.
I’m thinking of creating a hybrid system like this but with the new Ryzen AI HX 300 series so that I can begin fooling around with LLM. I’m a newbie to DIY hardware so it’ll be a fun project. If anyone has advice or suggestions, I welcome it.
Better choice: Ryzen 4000 (Zen2) or 5000 (Zen3) PRO G series CPUs. You can buy them in many places. Not only those CPUs have an iGPU and support ECC at the same time, they have monolithic design which lowers IDLE power.
I've wanted to build exactly something like this for some time - but finding unbuffered/unregistered ECC memory anywhere here in Europe has been pretty much impossible.
How do you deal with the video out situation without the onboard graphics? For example on my unraid server I have an old GTX1050 for transcoding, and access the media server side of things (the *arrs and jellyfin) via a browser from my laptop. Presumably with X570 (instead of the ancient haswell era board and cpu my unraid runs on) and a 3600 I could put a second gfx card in to pass through to a gaming VM? Also are there any pros to running a Linux gaming VM like Nobara (which I currently run bare metal) or ChimeraOS as opposed to Windows? I was just wondering / hoping whether a Linux gaming focused VM would be make more efficient use of resources and generally play nicer within Proxmox?
yes have done something similar with a 5950x / w ecc / truenas scale / nas / x570 mobo etc etc - haven't sorted out sound on linux vms, but i can get sound working w/ win10 vm through remmina
i have i7-8700k@4.5 32gb ram running win11 pro and im using hyper-v for 2 virtual machines. 1st = homeassistant 2nd = docker with portainer. and second machine is TrueNas scale on which jellyfin is installed. i have a plan to move NAS to the 1st machine for power saving reasons.
nice video, I'm going to use my old Ryzen 2700 for a server in a old 2012 chassis I got from my grandpa it has 8 drive bays and I'm going to get a cheap X570 board to run it, already have power supply and gpus so just need a board and some ecc ram 😊
Great video, I have a ryzen 5600g + a rx6600 but i want to use it like that as a homes server/pc gaming. For using it as a NAS I can add 4 HDD/SSD would you recomend that all of the drives be of the same capacity?
I recently read that in order to virtualize TrueNAS, it requires you to pass through your entire storage controller to the VM (thus leaving you with no controller to boot from). Does this motherboard enable you to pass through individual SATA ports? Do you boot from USB? Just wondering how that works.
Thank you SO much for this video. It seems like the younger generation have forgotten the important of ECC memory, servers, virtualisation and especially the combination. This is what I have always wanted! Thanks again!
@Raid Owl What ECC memory are you using? And how do you confirm that it is actually working as ECC? I have an old Dell PowerEdge server and the PSU fan is starting to make noise. Either, I replace the fan or the whole PSU or replace the server. I have a few AMD CPUs sitting around, 1700x, another 8 core but don't remember the name and 3900x. I'm running free nas on the box right now. I really want something with low power. I don't really know what I want to do.
Question: So can you explain more about how exactly you are accessing the windows VM? From another PC through RDP or proxymox web or do you have a display connected to the machine directly and you can directly put whatever is on the screen?
The slightly upsetting thing is I don't need a GPU in my server, but the Ryzen APUs don't support ECC. Edit: wait, the motherboard has graphics on it? That changes everything!
I do single-gpu passthrough on kvm on linux on my desktop pc, that way i have access to the normal desktop(for coding and web browsing etc) and power the system off at night, tbh it works for me though yeah, its a lil more finicky and def. AC software strikes again, ruining the experience("jenshin impact"(lel) only runs with sum tweaks on kvm and win11 does not like those very much, had sucess at a time before but can't again, only win10 for sum reason), but i just pretty much got rid of all that, try out sum other stuff and its the way to force to work more and play games less.
ive been trying to find a high end nas build. that would be a great video idea. like somewhere around 1-2k. theres no videos on youtube for this. i was thinking maybe an asrock motherboard, intel motherboard, high ram, and. something that can run multiple 4k plex streams.
I use that motherboard with a ryzen 7 3700x for my truenas core server. My only problem is with fan management and details of the components installed (ram cpu hba etc) on the IPMI webpage…..
But how about power consumption? Wouldnt running a low-power server 24/7 combined with a desktop for 8 hours a day be much less power compared to this setup? (Even with the windows VM only on for 8 hours)
It seems most people who build low power homeservers use Intel processors, so I am really interested, how low this system can go, if you take out the gpu? I am planning to get a ryzen as server upgrade, but I am worried by the power efficiency in idle. Great video!
Also share the same concern, I guess it's an ECC trade off vs idle power. A lot of the lower Intel's don't seem to have the same ECC support but I could be wrong!
it's a strange loop when one decides to put a NAS on their daily driver. (you'd have to be a 24/7 gamer, truly dedicated to the cause of gaming and serving the home 😂). UNLIMITED POWER!!
I wish IPMI was available on desktop gaming motherboards. A lot of us use gaming motherboards for home servers running hyper visors, media servers, truenas etc.
Would it be cool if you could divide up the CCXs, and dedicate one CCX to a VM running your main OS, and then carve up the other to use for all the hypervisors? Wouldn't this help with reducing latencies across the inifinity fabric bus? Maybe next gen CPUs will support this? I mean, AMD is already building iGPUs into their processors, which is important for this exact sort of setup. In fact, this would probably make more sense on an older Intel system, since you would have the iGPU left over to run Proxmox on, or for having a second hypervisor so you can have access to the Proxmox interface by simply pressing a button on your KVM from Level1Techs (not sponsored).
I've not tried it myself but using VFIO you can pin CPU cores to the host, and you can identify which cores are which per CCX. Been planning to try this on my 5900X setup but life is far far too busy as of late lol
This was a great video, and very informative. But I am still a little confused. Does this box serve the VM to another device? Before the trolls start tearing me apart, I am very much a noob regarding this type of setup and don't really know where to start. This video was recommended, so any help would be greatly appreciated. I would like to use something like this to repurpose an old Dell 8700. But I understand there will be significant limitations with the build.
Nobody is gonna tear you apart my man. The VM is running on the server but you can use something like VNC to access the desktop over the network from any computer you’d like. Feel free to join the Discord if you have questions. Nobody will make you feel bad for being new to all this.
@@RaidOwl Thanks for making me feel welcome to the channel. I will look at joining the Discord channel because I am sure I will need help along the way. I still don't know if I should repurpose the old Dell 8700, or scrap it and start over with something that has more expansion capabilities and the ability to utilize ECC RAM.
I wish I had known about the ASRock X470D4U motherboard befiore I bought the Gigabyte X570 Auros Pro, it has more server features I'm using when playing with multiple VM's do you have a ryzen 9 3950x? just to test the idle power usage compared to the Ryzen 3600? want to replace my old HP ML350p gen8 with dual 6-core cpus
How do you play on the proxmox machine? Through the webui or via parsec? Proxmox runs headless and only has a flashing terminal so, you need 2 machines minimum for your ALL-IN-ONE setup no? So ALL-IN-TWO?
i would have my main desktop running as a file server except modern m/b do not have a full complement of 16x pcie sockets, i have systems with 2 gpus 1 for linux and the other for windows vm and another system for storage ( 2 sas hba using the only physical x16 slots on that m.b) but no space for gpu in that box!
Nice. Im thinking having a low TDP. New to this, i was looking into the intel xeon e processor e-2378G. Not sure on the board to pair it with. Needing for 18 drive 20tb each for storage raid, plex, learning lab environment for school and work. This is for 10 year build. Help? Thanks.
micro center is selling the 3600 for only 90 in my area. its a nice deal but my isp blocked my ports so I cant really use any servers. (I already have a tricked out gaming rig so Id use this for a server more than anything lol)
@@RaidOwl for some reason that dosen't work. I have my stuff on portainer and I tried to make a wordpress site. but it just wouldnt work properly. Does the use of a free domain interfere with that? (spelling is hard)
I wanted to build something similar to this. I have my gaming PC and my server. I also have a spare graphics card. I wanted to run Windows in a VM with the graphics card 24/7 just for regular office work, programming, etc. But first Windows didn't accept the graphics card and second my power consumption raised from 23W to like 70W. That would still be an improvement to my gaming PC, but I don't use the VM 24/7 anyway. So it would just be a waste of power. Does anybody know how to solve this issue? Or use the iGPU of my i7-6700? It should theoretically be possible but it didn't work for me...
for light office work, I'd personally just get a cheap NUC, run Windows either bare metal or put Proxmox on it if you want more granular control of backing up your SOE. And leave it running, switch to it via Remote Desktop or PiKVM from your main desktop.
So stupid question... Do you pass through the video card to the windows VM and the monitor it's connected to just comes up as that VM? Also I have a 1600 sitting around but I've heard there's issues with ecc and first gen Ryzen, I might have to look into this solution to upgrade from the optiplex lol.
Yep, when you pass through the card you can plug it in to a monitor and assuming you also passed a keyboard and mouse through it’ll be like using a regular pc.
Wholy shit ! Thanks for replaying. I have alot of questions for you !. Let's start our with this one. Can I just hook up my monitor to my gpu while the vm is running to get a direct input ? Can I also do the same with my keyboard and mouse, and just pass those to the windows vm in proxmox ? Or does everything have to be streamed to another pc ?!!? I currently have an old PC as my promox server. It has a gtx 1060 in it. The motherboard has tons of USB 3.0 slots. So if what I'm asking works. That's sick ! Please answer my question 😀😀😀😀😀😀@@RaidOwl
I would consider myself fairly advanced in networking and programming but I know nothing about graphics cards/setups for gaming. Does anyone have a recommendation for setup that would be ideal for running the newest Microsoft flight simulator?
@@adminquest I did extensive research on this to make sure I wasn't going to waste my money on ECC if it's not going to support it. I was looking at various models of the Ryzen CPUs trying to get 100% answer on ECC support. Turns out it's a marketing thing with the "Pro" line when in fact all current line Ryzen CPU do have ECC. It boils down to the motherboard support for it. Keep in mind workstation motherboard with ECC may be working BUT it may NOT report errors to the OS correctly. It's not the CPU it's the way motherboard manufacture write the drivers to provide ECC status to the OS. I've spent alot of time trying to find the real truth about ECC support on regular motherboards. It's a grey area for non-server motherboards.
In order for ECC to work it has to have required modules in UEFI firmware. So even though processors state to be ready for it, support is per board in each case and up to manufacturer. Intel is a lot clearer and uniform in case of firmwares in that regard.
im running this setup but im using windows 10 as main os and a webserver with a bunch of docker instance. I have a intel i7 6th cpu it is enough for a webserver only ?
If just you can tell me that I can play Black Desert Online with video passthrouth I will build that system right now!!!! That's the only thing holding me to ditch windows forever... I'm just one game away from 100% Linux
I get the point with anticheat blocking virtualized gaming, being able to read raw memory and CPU instructions from the hypervisor is a thing. But that's some serious, hardcore gamer crack level cheating and there's got to be a better way to prevent that. 🤣
I've been running proxmox on my gaming pc for awhile now (Ryzen 5700G). There is no noticeable performance drop on a Windows VM and everything works as intended. With that setup I have plenty of room for my experiments and extra services I host at home. I am a web developer and always had to choose between windows or ubuntu (dual boot). Now I can run both, so no downtimes anymore. And everything is in its isolated secure scope in LXC container or on a VM. With ansible playbooks and terraform it becomes even more powerful system. Love it.
Someone should really do a full end-to-end tutorial on a multi-system Proxmox machine that's low-noise, dual-gpu for both Win/Hacintosh whilst automating everything to endgame standard operating environment that's bespoke (or can be made to) via ansible playbooks. At least I think it should be to introduce everyone back into putting the "Personal" back into Person Computing.
Glad to hear that the 5700G is a good proxmox CPU ... Because in December after the new chips drop mine is going into (yet another) server :) (which will have to keep up with some quite beefy tasks that a 7th gen i7 is currently almost getting overwhelmed with - typical usage is 80% - noctua saves the day sanity-wise.
Nice video! I have been using virtual Windows 10 on a daily basis for over a year now with passed-through NVidia GPU, one Ethernet port, whole USB-C PCIe card and some chipsets for USB ports and Bluetooth connectivity. It's really amazing to have about 50 VMs created and ready to turn on while several of these are running all the time. So, the main thing you are achieving this way is to have several systems on one CPU, one set of RAM inside one case with one power supply. This setup (in my case based on Proxmox, with VMware I cannot achieve proper GPU passthrough as well as one of PCIe devices...) works that well, you can forget that you are working on VM.
Now this is MY kind of video. I've had a couple iterations of something similar. Busy af right now but I'll catch up tonight.
thanks for the video! as someone saving up to replace an old 4th gen intel desktop that i'm using to run proxmox and a few vms. this setup is miles better than paying ebay for another antique and likely will wait a few more months to upgrade using this guide.
Get an X99 based Dell Precision
You could say, I use my system as a Virtualbox virtual machine server, but not as a file server, since I'm the only PC user at home. The hardware did cost new $349 and it is a Ryzen 3 2200G; 16GB DDR4 (3000MHz); ASRock B450 HDV Rel 4.0; 512Gb SP nvme-SSD (3400/2300MB/s). I bought locally the new xTech midi-tower and power-supply combo for ~$35. The system has some left-over disks (1TB and 500GB with around 9 power-on years) and a 128GB sata-SSD.
The Host OS is a minimal install of Ubuntu 22.04 LTS with OpenZFS 2.1.4. All VMs run from OpenZFS. The main VM run from the nvme-SSD and the others run from 2 striped 500GB partitions supported by a 105GB sata-SSD cache (L2ARC). The last 500GB partition has a 15GB SSD cache. The last 5+3 GB is used for 2 ZILs caches for synchronous writes. I maximized the memory cache (L1ARC) to 4GB, but currently I only use it for the HDDs, the performance gain for the nvme-SSD is max 20%, so Linux boot times of ~10 to 12 seconds instead of ~8 to10 seconds.
I have 6 main VMs,
- Xubuntu 22.04 LTS for all communication apps (email; whatsapp; messenger; etc).
- An encrypted Ubuntu 16.04 ESM for banking and Paypall with the latest stable snaps of Firefox and LibreOffice.
- Ububtu Studio 20.04 LTS for multi media.
- Ubuntu 22.04 LTS for experiments and try-outs of apps.
- Windows XP Home as jukebox to play the wma copies of my LPs and CDs with WoW and TrueBass effects :)
- Windows 11 Pro, just in case.
I can run 2 modern Windows releases and 4 Linux releases at the same time.
I'm a collector, so I have all Ubuntu LTS releases from 2004 to 2022 and all Windows releases from 1987 (Windows 1.04) to 2022 (Windows 11 Pro), including the NT releases from the nineties. My oldest VM is Windows XP home installed and activated in March 2010, somewhat later I installed the netbook version of Ubuntu 10.04 LTS in a VM.
My old refurbished 1TB WD Black HDD (9 power-on years and 8 months) start to develop problems, I have since 2 weeks 4 sectors in the "current pending bad sector list" and ZFS puts occasionally the partition in degraded mode, while stating that no data has been lost. I don't like modern disk firmware, in case of doubt declare a bad sector, don't introduce this gray area of suspected but maybe stil usable. I have 2 backups. so I don't panic, but the firmware designers are idiots and play with their client's data security. I have to buy a new disk soon.
Hi! Great video! I use an x570 Mobo + 5900x CPU + 2 nvme +32gb of ddr4 and a 3090. It is now my main server, but my most powerful one. In one nvme I have a bare metal win11 for gaming(I want to use full resources) and in the other nvme I have proxmox with many Linux vm's for testing. Some of them have the 3090 passthrough(to use with ML). I also use an app(in Android) to start/shutdown the VM's, and I have a laptop that I ssh to them too
Literally have a server built with these exact parts. Works great!
You gained 10k subs last night! Good for you brother!
Hahaha I wish I could do that
I almost bought that motherboard for my new ProxMox build for it's ECC support but was weary of older chipset so I went with ASRock X570 TAICHI AM4 which supports it. It's not a "server" motherboard but it's got what I needed it for.
There is an x570 version of this board
Did this with a used workstation, now works great as my main pc. Thanks a lot!
Exactly what I've been wanting to create - thank you.
You are a generous soul and amazing for making such detailed videos.. You've made me commit and get my own homelab hardware and already started on my proxmox journey and I frequent your channel nearly everyday to learn more.. Keep up the great work
Just built a ryzen 5 3600X Asus B550 truenas/Nextcloud server with 16TB of nvme storage and room for hard drives later. Had the old processor laying around and glad to put it to use!
Yeah I’d say that’s a good use!
@@RaidOwl yeah, its a lot of nvme storage in an asus Hyper card, but the cost was similar to sata drives so why not! Also just installed 128 gigs of ram for that sweet zfs cache haha
I stumbled upon your video and tbh it solved two problems I was having. I have a PowerEdge T350 I've been using for DevOps work and some AI/ML projects but needed a dedicated GPU but unfortunately the server doesn't support one. Also, I love ChimeraOS to play some steam games with the ability to have a console like experience. I think this will solve all of my problems here so I can pass through the GPU for deploying Local LLM's while also playing any pc games I'm interested in as well. Thank you
I recall seeing your live stream while building on this exact server motherboard at the same time. I picked up a used 3700X for the extra threads while staying at a lower TDP. The RAM in my build was the most expensive since they're 32GB sticks, but the build needed it since it's also running TrueNAS. I'd love to drop a graphics card in there, but with a dedicated gaming PC, I don't know what I'd gain from it, other than gaming from afar I guess? Or while at work :D
Compared this to the X5704DU but the price was too good to pass up for what it can do. This board is so versatile I'm expecting it to be in production in my lab for quite some time. Great find!
Heck yeah! It's one of the few times where I can strongly recommend a setup to someone cuz of how versatile it is.
Probably would use a 3700x or a 5700/5800 so I could have access to 8-12 threads for the gaming VM and still have TONs of overhead. OR run x99. But I am definitely not most people. The average gamer is more likely to have 1st, 2nd or 3rd gen ryzen 6 core "spare" or to upgrade from. I still need to find a purpose for that 3900XT I found for cheap...
Great video!
I've done this with UnRAID using a Ryzen 7 3700X and RX 5700 XT setup.
The cool thing was since I was converting my existing gaming PC I just passed through the NVMe Windows was installed on into a VM and booted it up without issue. If I needed to boot into Windows bare metal I still had that option as well.
Wait WUT? Is using an existing Windows install drive in a VM something unique to UnRAID?
@@MIDNITE69 I don't believe so. If I'm not mistaken it uses QEMU/KVM just like Proxmox. I'd assume when you create a VM you would just passthrough the entire disk the Windows install is on.
This is what I followed for UnRAID: ruclips.net/video/fnIn6GnA87c/видео.html
I don't see why it can't translate over to Proxmox. The only thing to keep in mind is making sure to change VM UUID in the template like he did towards the end or there may be weird Windows activation issues that arise.
Using a Ryzen 5 PRO 5650G (integrated gfx WITH ECC) myself
on a X570 I AORUS PRO WIFI with 32gb 3200mhz ECC, LSISAS2208
in a Fractal node 803 running TrueNas Scale. 4 hardddisk and 2 m.2 ssd 128gb sata for boot, and 512gb for download storage.
Takes about 55w or so.. idle. gonna try putting the 5650 on 45w mode and see what that does. using it as NAS and Qbittorrect and firefox syncserver.
Nice project, maybe you can start your Win VM with a smarthome integration, like home-assistant-> integration-> proxmoxve, and say : Siri, Alexa, Google -- start gaming VM. maybe........
That motherboard is like $400. That is huge just for 2x 6TB of atorage.
are you still using proxmox system as your main PC or have you upgraded/changed your mind?
Having an all in 1 proxmox sounds like a fun project
Yep still rocking Proxmox
This is really interesting and I'd be interested in doing it. However I would be reluctant to have my box next to me since I would be annoyed by the noise of the spinning hard drives next to me. Either I'd have to run cables from my system to my desk, or figure out how to access my desktop via a thin client.
lol I feel that...I'm a noise snob for my desktop systems
I am using Asus A520M-e with ryzen3700x and ecc memory.I have installed true nas scale and i am trying to install a vm on it. The hardware works The motherboard is cheap and it accepts ECC memory
Kingston 16GB DDR4 3200MT/s ECC Module KTH-PL432E/16G Server Memory@@point8250
Depending on what you want to play this is a great solution, Long as nothing is using anti-cheat you will be fine. But there is always option of running it bare metal on linux and building out everything on the host os including gaming on linux. But I'm not even brave enough to think about trying to do that. Also if you built it out enough you could have 2 gaming VMs so if you had a friend over at some point you'd only need the one machine to game with them.
I’m thinking of creating a hybrid system like this but with the new Ryzen AI HX 300 series so that I can begin fooling around with LLM. I’m a newbie to DIY hardware so it’ll be a fun project. If anyone has advice or suggestions, I welcome it.
2 years on, worth it still?
I never thought of using Windows VM for games 😮 mindblown right now, but it totally makes sense 😂
Better choice: Ryzen 4000 (Zen2) or 5000 (Zen3) PRO G series CPUs. You can buy them in many places. Not only those CPUs have an iGPU and support ECC at the same time, they have monolithic design which lowers IDLE power.
If the EU can legally force Apple to switch to USB-C. Why can’t we force manufacturers to make ecc a legal standard?
I've wanted to build exactly something like this for some time - but finding unbuffered/unregistered ECC memory anywhere here in Europe has been pretty much impossible.
For servers it is recommended to have buffered RAM.
I found a single 8GB stick for just 3$
But nothing else, ever
How do you deal with the video out situation without the onboard graphics? For example on my unraid server I have an old GTX1050 for transcoding, and access the media server side of things (the *arrs and jellyfin) via a browser from my laptop. Presumably with X570 (instead of the ancient haswell era board and cpu my unraid runs on) and a 3600 I could put a second gfx card in to pass through to a gaming VM?
Also are there any pros to running a Linux gaming VM like Nobara (which I currently run bare metal) or ChimeraOS as opposed to Windows? I was just wondering / hoping whether a Linux gaming focused VM would be make more efficient use of resources and generally play nicer within Proxmox?
Just bought the Proxsy app because of this video. Had no idea I could control my vm’s with an app! It’s currently $3 btw.
Also, this is not an ad 😂
ServerCAT on iOS is pretty cool too (bit pricier though). You can parse code/snippets to 'anything' if you're comfortable with CL.
Dang, 3 months later... that board is 468.86 used on Amazon. No new ones. There's a D4U2-2T for 494.00 and a X570D4U for 397.00. It is what it is...
yes have done something similar with a 5950x / w ecc / truenas scale / nas / x570 mobo etc etc - haven't sorted out sound on linux vms, but i can get sound working w/ win10 vm through remmina
gpu?
@@denirodarkqwerty a rtx 3050 and a 730 for now (i've got two other pcs with a 3090 and a 6900xt so don't really need anything too OP in there)
It would be great if you showed from 0 to 100% installation and configuration of parameters, working in the console on the host, etc.
No RGB is a deal breaker lol! Especially on a server!
It’s cool, but the mobo price keeps it unrealistic compared to other home lab options.
i have i7-8700k@4.5 32gb ram running win11 pro and im using hyper-v for 2 virtual machines. 1st = homeassistant 2nd = docker with portainer. and second machine is TrueNas scale on which jellyfin is installed. i have a plan to move NAS to the 1st machine for power saving reasons.
Great video & info! What are other Ryzen CPU options?
Great Idea, and as always a great video
Very cool build, I've heard running TrueNAS in Proxmox could be problematic, did you encounter any issues?
I built a proxmox server with ryzen 9 5950x 96gb ram 2 gpus passed thru with win11 and linux, truenas scale vm for nas and game on win11
nice video, I'm going to use my old Ryzen 2700 for a server in a old 2012 chassis I got from my grandpa it has 8 drive bays and I'm going to get a cheap X570 board to run it, already have power supply and gpus so just need a board and some ecc ram 😊
Great video, I have a ryzen 5600g + a rx6600 but i want to use it like that as a homes server/pc gaming. For using it as a NAS I can add 4 HDD/SSD would you recomend that all of the drives be of the same capacity?
I recently read that in order to virtualize TrueNAS, it requires you to pass through your entire storage controller to the VM (thus leaving you with no controller to boot from). Does this motherboard enable you to pass through individual SATA ports? Do you boot from USB? Just wondering how that works.
On December I am switching my son's cpu Ryzen 5 to a 9 I was wondering what to do whit the CPU now I got a better idea. Thanks
You asked I subbed great vid!
Thank you SO much for this video. It seems like the younger generation have forgotten the important of ECC memory, servers, virtualisation and especially the combination. This is what I have always wanted! Thanks again!
It's all about gaming sadly. Oversaturating their brains with dopamine
if you want to upgrade this build, get a 5600g! WAY less power draw, and MORE performance!
the build would no longer be ECC compatible ?
@Raid Owl What ECC memory are you using? And how do you confirm that it is actually working as ECC? I have an old Dell PowerEdge server and the PSU fan is starting to make noise. Either, I replace the fan or the whole PSU or replace the server. I have a few AMD CPUs sitting around, 1700x, another 8 core but don't remember the name and 3900x. I'm running free nas on the box right now. I really want something with low power. I don't really know what I want to do.
If the power usage of your server part is high, it would be wiser to have split systems. What is the idle power here?
Question:
So can you explain more about how exactly you are accessing the windows VM? From another PC through RDP or proxymox web or do you have a display connected to the machine directly and you can directly put whatever is on the screen?
Display connected directly to the GPU. Basically acts as a regular pc.
The slightly upsetting thing is I don't need a GPU in my server, but the Ryzen APUs don't support ECC.
Edit: wait, the motherboard has graphics on it? That changes everything!
I do single-gpu passthrough on kvm on linux on my desktop pc, that way i have access to the normal desktop(for coding and web browsing etc) and power the system off at night, tbh it works for me though yeah, its a lil more finicky and def. AC software strikes again, ruining the experience("jenshin impact"(lel) only runs with sum tweaks on kvm and win11 does not like those very much, had sucess at a time before but can't again, only win10 for sum reason), but i just pretty much got rid of all that, try out sum other stuff and its the way to force to work more and play games less.
ive been trying to find a high end nas build. that would be a great video idea. like somewhere around 1-2k. theres no videos on youtube for this. i was thinking maybe an asrock motherboard, intel motherboard, high ram, and. something that can run multiple 4k plex streams.
I use that motherboard with a ryzen 7 3700x for my truenas core server. My only problem is with fan management and details of the components installed (ram cpu hba etc) on the IPMI webpage…..
But how about power consumption? Wouldnt running a low-power server 24/7 combined with a desktop for 8 hours a day be much less power compared to this setup? (Even with the windows VM only on for 8 hours)
Of course it would
The case reminds me of one from System76 (the maker of pop os)
It seems most people who build low power homeservers use Intel processors, so I am really interested, how low this system can go, if you take out the gpu? I am planning to get a ryzen as server upgrade, but I am worried by the power efficiency in idle. Great video!
Also share the same concern, I guess it's an ECC trade off vs idle power. A lot of the lower Intel's don't seem to have the same ECC support but I could be wrong!
Didn't know consumer Ryzens support ECC
it's a strange loop when one decides to put a NAS on their daily driver. (you'd have to be a 24/7 gamer, truly dedicated to the cause of gaming and serving the home 😂). UNLIMITED POWER!!
I wish IPMI was available on desktop gaming motherboards. A lot of us use gaming motherboards for home servers running hyper visors, media servers, truenas etc.
Would it be cool if you could divide up the CCXs, and dedicate one CCX to a VM running your main OS, and then carve up the other to use for all the hypervisors? Wouldn't this help with reducing latencies across the inifinity fabric bus? Maybe next gen CPUs will support this? I mean, AMD is already building iGPUs into their processors, which is important for this exact sort of setup. In fact, this would probably make more sense on an older Intel system, since you would have the iGPU left over to run Proxmox on, or for having a second hypervisor so you can have access to the Proxmox interface by simply pressing a button on your KVM from Level1Techs (not sponsored).
I've not tried it myself but using VFIO you can pin CPU cores to the host, and you can identify which cores are which per CCX. Been planning to try this on my 5900X setup but life is far far too busy as of late lol
This was a great video, and very informative. But I am still a little confused. Does this box serve the VM to another device?
Before the trolls start tearing me apart, I am very much a noob regarding this type of setup and don't really know where to start. This video was recommended, so any help would be greatly appreciated.
I would like to use something like this to repurpose an old Dell 8700. But I understand there will be significant limitations with the build.
Nobody is gonna tear you apart my man. The VM is running on the server but you can use something like VNC to access the desktop over the network from any computer you’d like.
Feel free to join the Discord if you have questions. Nobody will make you feel bad for being new to all this.
@@RaidOwl Thanks for making me feel welcome to the channel. I will look at joining the Discord channel because I am sure I will need help along the way. I still don't know if I should repurpose the old Dell 8700, or scrap it and start over with something that has more expansion capabilities and the ability to utilize ECC RAM.
Start with what you already have. If you find yourself needing something more robust then just cross that bridge when you get there.
How about a redundant ATX PSU that doesn’t break the bank? Anything out there?
I don't see anyone using the IPMI on this board
I wish I had known about the ASRock X470D4U motherboard befiore I bought the Gigabyte X570 Auros Pro, it has more server features I'm using when playing with multiple VM's do you have a ryzen 9 3950x? just to test the idle power usage compared to the Ryzen 3600? want to replace my old HP ML350p gen8 with dual 6-core cpus
How do you play on the proxmox machine? Through the webui or via parsec? Proxmox runs headless and only has a flashing terminal so, you need 2 machines minimum for your ALL-IN-ONE setup no? So ALL-IN-TWO?
Wonder if that IN WIN BR24 would work well on y TR 3960X? I wish they made a 360 version.
Where and how do you find/compare/shop for workstation mainboards like that?
i would have my main desktop running as a file server except modern m/b do not have a full complement of 16x pcie sockets, i have systems with 2 gpus 1 for linux and the other for windows vm and another system for storage ( 2 sas hba using the only physical x16 slots on that m.b) but no space for gpu in that box!
Nice. Im thinking having a low TDP. New to this, i was looking into the intel xeon e processor e-2378G. Not sure on the board to pair it with. Needing for 18 drive 20tb each for storage raid, plex, learning lab environment for school and work. This is for 10 year build. Help? Thanks.
hello,sir. please tell me what about power consumption idle\under gaming load?
Can AMD Ryzen 5600 processor work on B450 and A520 motherboards?
OK why do you need all the VMs if you can just ReFS the storage?
Just build Ryzen 7000 server, those CpUs have iGPU
micro center is selling the 3600 for only 90 in my area. its a nice deal but my isp blocked my ports so I cant really use any servers. (I already have a tricked out gaming rig so Id use this for a server more than anything lol)
Check my Cloudflare Tunnel video. You can host stuff without forwarding ports
@@RaidOwl for some reason that dosen't work. I have my stuff on portainer and I tried to make a wordpress site. but it just wouldnt work properly. Does the use of a free domain interfere with that? (spelling is hard)
Yeah there’s a list of domains Cloudflare will proxy.
@@RaidOwl let me try to do it again with a xyz domain, ill let you know if it works!
I wanted to build something similar to this. I have my gaming PC and my server. I also have a spare graphics card. I wanted to run Windows in a VM with the graphics card 24/7 just for regular office work, programming, etc. But first Windows didn't accept the graphics card and second my power consumption raised from 23W to like 70W. That would still be an improvement to my gaming PC, but I don't use the VM 24/7 anyway. So it would just be a waste of power. Does anybody know how to solve this issue? Or use the iGPU of my i7-6700? It should theoretically be possible but it didn't work for me...
Check out Craft Computing for pcie passthrough guides
for light office work, I'd personally just get a cheap NUC, run Windows either bare metal or put Proxmox on it if you want more granular control of backing up your SOE. And leave it running, switch to it via Remote Desktop or PiKVM from your main desktop.
So stupid question... Do you pass through the video card to the windows VM and the monitor it's connected to just comes up as that VM? Also I have a 1600 sitting around but I've heard there's issues with ecc and first gen Ryzen, I might have to look into this solution to upgrade from the optiplex lol.
Yep, when you pass through the card you can plug it in to a monitor and assuming you also passed a keyboard and mouse through it’ll be like using a regular pc.
@@RaidOwl sweet!
What is the power usage at idle?
Is 1330 MHz clock speed on RAM enough for games?
My question is, how do you stream your steam games from that PC ?
Parsec
Wholy shit ! Thanks for replaying.
I have alot of questions for you !. Let's start our with this one.
Can I just hook up my monitor to my gpu while the vm is running to get a direct input ?
Can I also do the same with my keyboard and mouse, and just pass those to the windows vm in proxmox ?
Or does everything have to be streamed to another pc ?!!?
I currently have an old PC as my promox server. It has a gtx 1060 in it. The motherboard has tons of USB 3.0 slots. So if what I'm asking works. That's sick ! Please answer my question 😀😀😀😀😀😀@@RaidOwl
Also, ive seen that people pair this board with just 32gb of ram ! Is it possible to do 64gb or more ? @@RaidOwl
Yep if you pass the GPU through to the VM as well as a usb hub/port then you can use it just like a regular pc.
One last question. Why would somebody choose this board over a standard am4 motherboard ? @@RaidOwl
How much power is this consuming 24/7?
I would consider myself fairly advanced in networking and programming but I know nothing about graphics cards/setups for gaming. Does anyone have a recommendation for setup that would be ideal for running the newest Microsoft flight simulator?
rtx 3080 or better
I'm just fighting my TrueNAS Scale box....its decided it wants to shut down on its own after 10 min....
ECC support is only with Processors with PRO technologies, or I missed something? I don't know much about AMD processors.
It supported by nearly all Ryzen chips. en.wikichip.org/wiki/amd/ryzen_5/3600#Memory_controller
Almost all of them have it. It's up to the motherboard manufacture to support it.
The requirement about PRO technology is from the X470D4U spec from the manufacturer's website. This is what confused me.
@@adminquest I did extensive research on this to make sure I wasn't going to waste my money on ECC if it's not going to support it. I was looking at various models of the Ryzen CPUs trying to get 100% answer on ECC support. Turns out it's a marketing thing with the "Pro" line when in fact all current line Ryzen CPU do have ECC. It boils down to the motherboard support for it. Keep in mind workstation motherboard with ECC may be working BUT it may NOT report errors to the OS correctly. It's not the CPU it's the way motherboard manufacture write the drivers to provide ECC status to the OS.
I've spent alot of time trying to find the real truth about ECC support on regular motherboards. It's a grey area for non-server motherboards.
In order for ECC to work it has to have required modules in UEFI firmware.
So even though processors state to be ready for it, support is per board in each case and up to manufacturer.
Intel is a lot clearer and uniform in case of firmwares in that regard.
Original title is "An actual HYBRID GAMING PC/HOME SERVER/NAS - Ryzen with ECC & IPMI???". Why changed it?
For views. It’s good to change the title sometimes
i tried doing this with e5 2690v3 + dual gtx 1080's (one for dedicated vm, the other for everything else),, could never get it to work lol
11:06 Whaaaatttt biiiiishh???? 😱😱🤯
You make me spend 2.99. Now I banish you. 🤴🏻💸💸💸
Now do AM5.
im running this setup but im using windows 10 as main os and a webserver with a bunch of docker instance. I have a intel i7 6th cpu it is enough for a webserver only ?
For simple website hosting yeah. It just depends on how much stuff you’re serving
thank you for the reply im really inspired on your videos to push my personal projects
If just you can tell me that I can play Black Desert Online with video passthrouth I will build that system right now!!!! That's the only thing holding me to ditch windows forever... I'm just one game away from 100% Linux
I get the point with anticheat blocking virtualized gaming, being able to read raw memory and CPU instructions from the hypervisor is a thing. But that's some serious, hardcore gamer crack level cheating and there's got to be a better way to prevent that. 🤣
Yeah lol unfortunately if your main game blocks virtualization then you’re just gonna have to use windows as your main OS.
Apropos of nothing, you do have a nice face.
Thanks!
Unfortunately, I can't use this board with my server setup. The only option i have is ITX in my 10 inch rack. Hopefully i don't *Need ECC ram...
Four thumbs up❤
yutz