"Do not check the primary GPU..." MY GOD! I have been struggling to get my GRID K1 and Tesla M40s working and just couldn't figure it out in PVE5, 6 and 7. Now I can finally ditch Server 2012 for the host OS. YOU ARE AWESOME!!!!
@@CraftComputing right at the "but" I thought "it'd be funny as hell if he... Omg he did it!". I laughed so hard I choked on what beer didn't go flying
You are really making me prioritize building my server/workshop room before any other home improvement project. My NAS will not be happy sitting next to my desk for too much longer. Now I need get my v-machine box up and running....
I was just starting to mess with my virtualisation monster when I got the notification for this video: windows server running on Unraid aiming to get GPU-P working so I could get rid of my dedicated Hyper-V machine. I listed my two M40’s on eBay yesterday because I didn’t have the time to figure out the display issues, this gives me fresh hope. Wish me luck!
This couldn't have come at a better time... I was just looking at using K80s (plus an older Threadripper) to run VMs for gaming for the family. I was unaware of the requirement that one VM of the two to not be running. Thanks so much for the heads up! It definitely decreases the interest level in using them (except for in the VM I'm going to be running for video streaming and gaming at once, but may look at different options for everyone else). I'm also going to second the community-driven FOSS Moonlight program. I find it to be better than Parsec at home and on par or slightly better over the internet.
very cool. this is the exact sort of solution i was just looking into so my kids could play real pc games. honestly been thinking of setting my whole house up like this would save a lot of space we have 8 machines running here and i would love to consolidate that all into one rack.
For everyone who wanna use this setup to run large language models, use type host in the cpu settings. Otherwise it can not use the shared gpu memory...
Love it! Next phase, seeing how lean can you go on the client device. Thin client? Zero client? RPi?? Probably just minimum or recommended system requirements for Parsec I would think...
This Channel made me switch from desktop hardware to enterprise system. So cheap for so much performance with raid dual and quad socket cpu configurations and more
It is cool but it doesn't support gpu virtualisation so you are limited to the count of gpu's you have. PCI passthrough is enabled on 30 series too. So you can also use them. They don't have to be headless, actually if they have hdmi ports it is better. Just plug them into monitors, passthrough usb ports to add keyboard, mouse etc to the virtual machines, then viola, you have multiple gaming computers running on a single server. Also using hdmi ports will remove the parsec's blurry gaming experience. It will be just like a physical computer. No additional configuration is needed! Just plug it and it works! Yet, a lot of games won't support virtual machines especially those with anti-cheat systems. They don't like to be run in virtual machines. Including CS:GO, valorant, LoL etc. Some games will just crash, in that case change you cpu type to host and enable Intel VMX or AMD SVM! Some games will really suffer from limited ram performance. I could hardly get 40fps on cyberpunk on my 3090 (normally it would get around 60-70). Also enabling pci passthrough will disable memory balooning. Which makes the virtual machines use the full amount of memory they have. So if you have headless gpus, I HIGHLY recommend using gpu-p on Hyper-V. This allows you to use memory balooning system of Hyper-V. However with this method, you can run multiple cryptocurrency mining OSes on each gpu flawlessly. I highly recommend proxmox for that particular use case.
There are so many little clever tricks in this video it's admirable. Using a virtual display driver to force vnc to use another display driver so when noVNC shows up a blank screen the primary display adapter will be pushed through tightVNCs server. Then using the policy editor to force the screen on at each boot. THEN streaming a DirectX devices draw calls remotely with couch play software to fill in the gaps. All while benchmarking the second GPU on the same PCB in an adjacent VM, love it.
@@II_superluminal_II error 31 doesn't mean much without a lot of context. A few things suggest it's a permissions issue like the installer wasn't ran as administrator. It depends on what executable returned the error so that the error number corresponds to the appropriate lookup table.
@@CraftComputing for a couple months when I had no monitor for my 1060, I used Steam Link to use my (now dead) MacBook Pro as a monitor for gaming, and I had no video output connected at all. No headless adapter, no usbmidd, none of the ports had anything connected at all. Parsec on the other hand, did not work, because it needs a video output device or monitor.
I have an Nvidia tesla M40 in my machine. With a 980ti heatsink and fans on it for cooling. A little modding was needed but works great! the Pcb's are almost identical.
You can skip the usbmmidd step on NV cards by adding the registry binary key DevicesConnected to 01 00 02 00 under Computer\HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\Video\{some number}\0000. Upon reboot you can enable a fake VGA output. Works on my grid K2 also with some gpo tweaks you can use RDP shadowing instead of vnc
@@CraftComputing Just updated my display driver from 392 to 465 and this registry trick stopped working :( - but on the plus side I have nvenc/nvdec now and those work headless.
Spacedesk looks to be the answer to the problems getting an output from my Tesla m40 on my guests. Parsec worked fine on the host OS as described here but couldn’t grab the screen on the VMs. My windows 10 hyper-v box sits on proxmox so I have nested virtualisation happening too, this isn’t wholly crazy as I think it’s the most effective way to have two graphics cards working with paravirtualisation. Now I have an excuse to buy a thread ripper and less guilt towards the imaginary funds set aside for three computers for the children. Thanks for setting me on this path Jeff!
Fyi... Depending on which pve you're using or if you're using grub or systemd boot... zfs on root may also affect... But instead of /etc/default/grub You may have to edit /etc/kernel/cmdline And instead of update-grub You may have to issue proxmox-boot-tool refresh OR pve-efiboot-tool refresh Depends on the version of pve - Depends if grub or systemd was the BL - Depends if using UEFI Unsure which is affecting the process - however if your wondering why your passthrough is not working follow what Jeff is doing - if it didn't work - try the other variations - one will work.
as someone looking to upgrade the kiddo setups from ancient Dell boxes, could you recommend a decent ebay server box to get started with one of these? appreciate all the content and guides! this is becoming my favorite channel after LTT :-D
So I just followed this tutorial(though I'm using manjaro and a tesla m40) and IT WORKS! One issue, just like you, is cooling I have a 3d printed adapter for a server fan and at 12V it's deafeningly loud 5V is just fine for minor games but it just isn't enough for most the games I'm trying to play. So, my plan is to modify a dead RX 480 blower that is much quieter even at 12V and I would be able to run the fan on a motherboard header instead. Hope this works!
This guide is not only useful with Proxmox on a server passing a Tesla M40 to Windows VM (which your information here helped me set up, works fine), I also dualboot to just Windows 10 on the baremetal Poweredge R720 server for testing, and your setup with Parsec and the virtual display driver (I used usbmmidd_v2 instead of V1), is also useful there! For example, on bare-metal Windows 10, if I use Parsec to just watch the 'hardware' Matrox built in graphics on the server, at 1080p (with the registry adjusted to unlock 1080p on that ancient Matrox built in card), I get 30ms encode in Parsec (not great) But if I use Parsec to instead watch the virtual fake display like you have setup here, the encode actually kicks in on the Tesla GPU and the Encode latency time is down to 1-3ms or so (10x better). Basically tl;dr your guide here is helpful not just for Proxmox but also even for just running bare metal Windows 10 on one of these headless servers and trying to get good latency in Cyperpunk 2077 remotely using a Tesla M40.
Or you could use the iGPU with LookingGlass for a dualheaded machine, no need to do anything remotely off another machine just use your desktop machine :)
I bought some Tesla M40's a long time ago and stuck them in my Dell R720XD's and have been trying to get them to work like this for quite some time! Jeff you rock! P.s. I use Hyper-V and this process works great with DDA
I’m having trouble getting this to work with hyper-v using paravirtulisation on windows 10 21H1. Any experience getting this working or might I be better downgrading and going with DDA?
Nope you can't reason with a cat for not cuddling. Food => Gather. Homeless => Long fur Warmth => Long fur, arguable. No cuddles => No excuse No treats => Umm, convinced, lol. (but still annoyed.)
All you need is the virtual display driver. This will make it think there is a display connected to the GPU. That is all you need to to get Steam streaming to work.
I tried partitioning a Titan X Pascal inside a Windows VM using Hyper V for nested virtualization but it performed so bad its unusable. I'm guessing nested virtualization cause a lot of io wait and therefore laggyness. Was testing on an i7 5820K + Asus X99 Deluxe U3.1.
I'm trying this with a Tesla P4 but I can't switch from TCC to WDDM with the Quadro drivers. Is it possible to do this with a P4 without the GRiD license?
At least nVidia mining GPUs have NVENC disabled in their firmware, making streaming difficult. AMD mining cards would be great contenders for this though.
I've tried Parsec and didn't like it and wouldn't give me the performance I wanted, tried Moonlight instead and only requirement for the VM would be to install Geforce Experience and setup the Shield section to add games. Got Moonlight installed on my X900H 65" and added a logitech wireless gamepad to the tv and now I don't even need a Rpi to run a software like parsec. You should look into this also, you can also multiple machines like Parsec does.
I was trying exactly this last week then Craft Computing just jumps in and releases that video. Perfect timing man! :) However I'd like to ask if you had any issues with the M40? I have one and the Nvidia Drivers under windows are throwing Error 12 on me: "This device cannot find enough free resources that it can use. (Code 12)" Have you seen this before? I'm running a Dell R730 Server with a M40 GPU.
Code 12 is usually a resource issue with PCIe or memory space. Because of the 24GB of VRAM, they don't play well with some motherboards. They should be OK in the R730 though.
@@CraftComputing Hey Jeff. Thanks for the comment. Have you tried your M40 under proxmox and the same Windows VM ? I tried to change the card to a different slot in the motherboard but still no dice...
I do wonder if the old arctic cooling kit for the GTX690 would fit the K80...it was made with two discrete coolers for each gpu chip and used stick on ram sinks.
Been trying to follow along but....Where did the usbmmidd folder suddenly appear from?? i didnt see any previous install for this?? Its not on my system?? How did you get this or where do i find it??
What is the longest single sentence, involving computers/software, you can make using mostly abbreviations ? (contest) (it should be spoken as a single sentence, not seperate sentences stringed together.) (the primary score is for the amount of abbreviations.)
Exactly the video I need, I'm looking for a GPU to use with VMs. Need Windows for college, and there's a course with OpenGL, that should go much better with my VM able to use a whole GPU. I don't have a huge amount of PSU capacity headroom, though while it's idle(which it would be when I'm not hammering it in my VM, and I'll mostly be not be hammering my main GPU at the same time) it should be OK. Being able to use enterprise cards might open up options, though I'm currently leaning to an RX6400 for cost reasons.
Hi Jeff. I have a Tesla k80 with 24GB of ddr5 ram. And I’m running esxi. Do you think I might be able to replicate your setup with this GPU. I want to use it for some data science and ml training and of course gaming. But gaming is a must
I wonder if you can comment on the following question? If I run headless GPUs inside a GPU server (Gigabyte) to do Compute (BOINC/F@H), and I then access Ubuntu desktop via IPMI (iKVM) will it work? There are some reports that you just get a blank screen as the BMC display cannot output if dedicated GPUs are installed; although these are mainly about Supermicro servers. I have searched Google high and low but cannot seem to find a definite answer on this. Your opinion on this would be most helpful.
Hopefully I can get a response, I've done everything in the tutorial, but I'm still met with a black screen in parsec. Remoting in with RDP or VNC shows encoding activity for the gpu when I attempt to connect with parsec, but still black display. Generic PNP monitor is selected, and I've disabled the VGA display from ESXi
When parsec program is closed on client side does virtual monitor work 1080p in background not returning to 1024x768? so far i'm using teamviewer it works sometimes. I want to use camera stream 24/7 via OBS it has to go through the camera app without rtsp url
I love the idea of never telling your kids about where the performance comes from, letting them figure out that their computers suck, and should get a job to buy a better one.
Jeff, do you know if i could passthrough the primary gpu (my only gpu)? Or will this only work for multi-gpu setup? My system doesnt have a built-in video card and i have a headless gpu.
Hey jeff! I've been trying to get this to work with my tesla T4s. I have single gpu passthrough working beautifully, but anytime I try to pass more than 1 gpu in (2 tesla T4 to windows for tensorflow) it kicks the bucket. Any clue how I can get this to work?
Hi great video !!!! in your opinion tesla M40 to be used with proxmox windows vm does need Above4G decode enabled?? my mainboard don'have this feature. Many thanks!
What cpu or cpus were you running? and what allocation of cores for each machine? im running 2x 2650v2's w/128gb ram in my server currently and would love this as an option! just wondering if i would need an upgrade to get similar performance. currently im giving each gaming machine 8 threads and using antique amd graphics on both and they struggle to say the least. As always enjoying the content watching closely and learning a ton! thanks for all you do!
It doesn't really matter. They will only use the amount of cpu they are using at the time. So it wouldn't be too bad to give each of the machines half of available cores. But when it comes to memory, you need to be a little picky as enabling pci passthrough will disable memory balooning.
I think I'm going to steal this idea for a virtualized design infrastructure on vmware. CAD should run fine if GTA V can do what I saw in your video :-) I have a dl380g8 in which I can slot a couple of these cards and have 4 vms fully accelerated
Thx. For the update. This is really an interesting setup, Can you elaborate the network issues with Linux VMs? I have an ubuntu vm running on proxmox with PCIs passthrough without any problems? (Or I just don't see them)
This is like the peak of the mountain of troubleshooting!
I can't tell you how satisfying it is to see such a clean and functional set up.
"Do not check the primary GPU..."
MY GOD! I have been struggling to get my GRID K1 and Tesla M40s working and just couldn't figure it out in PVE5, 6 and 7. Now I can finally ditch Server 2012 for the host OS.
YOU ARE AWESOME!!!!
"but this is craft computing annnd I'm Jeff" 😂 😂 😂
I know I'm about, son.
@@CraftComputing right at the "but" I thought "it'd be funny as hell if he... Omg he did it!". I laughed so hard I choked on what beer didn't go flying
The man, not a myth, but a legend
I know I'll never be doing any of this but the nerd in me loves these videos!
Same here. I do an ebay search every time even though I have a Rx 6800XT in my gaming PC.
Yeah, actual facts
It seems you've been pretty busy on your conquest
Really enjoying your content !
Tesla cards aside, Jeff is without a doubt stepping up his beer game!
I will never do any of this, but it's so interesting to see you tinker :) You and Level1Techs are doing to great work in these niche areas of PC land.
Glad I could help you with the usbmmidd driver. :D
It was a putting 2+2+2 together with everything else that made this happen :-)
You are really making me prioritize building my server/workshop room before any other home improvement project. My NAS will not be happy sitting next to my desk for too much longer. Now I need get my v-machine box up and running....
I was just starting to mess with my virtualisation monster when I got the notification for this video: windows server running on Unraid aiming to get GPU-P working so I could get rid of my dedicated Hyper-V machine. I listed my two M40’s on eBay yesterday because I didn’t have the time to figure out the display issues, this gives me fresh hope.
Wish me luck!
Still contemplating about setting up a proper home lab, but for the time being, I just watch and learn from your shenanigans, and I just love it!
I'm going to try this setup. Thanks for the video, I've been looking into how to do this for a while now
I pass through an old XFX 7550 Ghost single slot to a VM. It's a fun toy and Mesa drivers are so much better these days.
This couldn't have come at a better time... I was just looking at using K80s (plus an older Threadripper) to run VMs for gaming for the family. I was unaware of the requirement that one VM of the two to not be running. Thanks so much for the heads up! It definitely decreases the interest level in using them (except for in the VM I'm going to be running for video streaming and gaming at once, but may look at different options for everyone else). I'm also going to second the community-driven FOSS Moonlight program. I find it to be better than Parsec at home and on par or slightly better over the internet.
very cool. this is the exact sort of solution i was just looking into so my kids could play real pc games. honestly been thinking of setting my whole house up like this would save a lot of space we have 8 machines running here and i would love to consolidate that all into one rack.
Could this work with a Tesla P4? Thank you
For everyone who wanna use this setup to run large language models, use type host in the cpu settings. Otherwise it can not use the shared gpu memory...
Setting cpu to host also makes the vm run faster since you aren't emulating a specific cpu model
It is midnight but a new video is a new video
Lot of work to make this video. Great job sir
Love it! Next phase, seeing how lean can you go on the client device. Thin client? Zero client? RPi?? Probably just minimum or recommended system requirements for Parsec I would think...
No way. I was just wondering about this earlier today. Look at Twitter, I tagged you in a tweet about this earlier 😂
This Channel made me switch from desktop hardware to enterprise system. So cheap for so much performance with raid dual and quad socket cpu configurations and more
Thank you Jeff, Great video as always
Wow, what a journey, let's do this ! Going to add Garuda gaming distro as well.
It is cool but it doesn't support gpu virtualisation so you are limited to the count of gpu's you have. PCI passthrough is enabled on 30 series too. So you can also use them. They don't have to be headless, actually if they have hdmi ports it is better. Just plug them into monitors, passthrough usb ports to add keyboard, mouse etc to the virtual machines, then viola, you have multiple gaming computers running on a single server.
Also using hdmi ports will remove the parsec's blurry gaming experience. It will be just like a physical computer. No additional configuration is needed! Just plug it and it works!
Yet, a lot of games won't support virtual machines especially those with anti-cheat systems. They don't like to be run in virtual machines. Including CS:GO, valorant, LoL etc.
Some games will just crash, in that case change you cpu type to host and enable Intel VMX or AMD SVM!
Some games will really suffer from limited ram performance. I could hardly get 40fps on cyberpunk on my 3090 (normally it would get around 60-70).
Also enabling pci passthrough will disable memory balooning. Which makes the virtual machines use the full amount of memory they have.
So if you have headless gpus, I HIGHLY recommend using gpu-p on Hyper-V.
This allows you to use memory balooning system of Hyper-V.
However with this method, you can run multiple cryptocurrency mining OSes on each gpu flawlessly. I highly recommend proxmox for that particular use case.
0:12 What a beautiful cat❤
There are so many little clever tricks in this video it's admirable. Using a virtual display driver to force vnc to use another display driver so when noVNC shows up a blank screen the primary display adapter will be pushed through tightVNCs server. Then using the policy editor to force the screen on at each boot. THEN streaming a DirectX devices draw calls remotely with couch play software to fill in the gaps. All while benchmarking the second GPU on the same PCB in an adjacent VM, love it.
you seem to know alot about servers lol, why wont the virutal display driver run on my machine? The driver has a error 31
@@II_superluminal_II error 31 doesn't mean much without a lot of context. A few things suggest it's a permissions issue like the installer wasn't ran as administrator. It depends on what executable returned the error so that the error number corresponds to the appropriate lookup table.
I’m so irritated I didn’t find this channel sooner been trying to do this kind of stuff and looking for tutorials for so long and now I have them thnx
The madman did it!
I wonder if this will work just as effective as Steam’s own “Steam Link”, if you pass a gpu via a VM and launch Steam itself inside of it.
You could use Steam link instead of Parsec for streaming, but the USBMMIDD setup would still be required to emulate a monitor.
@@CraftComputing for a couple months when I had no monitor for my 1060, I used Steam Link to use my (now dead) MacBook Pro as a monitor for gaming, and I had no video output connected at all. No headless adapter, no usbmidd, none of the ports had anything connected at all. Parsec on the other hand, did not work, because it needs a video output device or monitor.
I have an Nvidia tesla M40 in my machine. With a 980ti heatsink and fans on it for cooling. A little modding was needed but works great! the Pcb's are almost identical.
Awesome method! The way to survive scalperpocalypse!
This video has answered so many questions thank you.
You can skip the usbmmidd step on NV cards by adding the registry binary key DevicesConnected to 01 00 02 00 under Computer\HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\Video\{some number}\0000. Upon reboot you can enable a fake VGA output. Works on my grid K2
also with some gpo tweaks you can use RDP shadowing instead of vnc
Iiiinteresting... I'll have to give that a shot. That might open up some more resolution options as well. Thanks for the tip!
@@CraftComputing Just updated my display driver from 392 to 465 and this registry trick stopped working :( - but on the plus side I have nvenc/nvdec now and those work headless.
@@jfarre20 what grid driver did you use all the ones i tried had trouble with incompatibility in new games
@@jaredhemley9175 I primarily use it for video decoding in EMBY. I'm not sure if games work very well on this old card. I've used drivers 392 and 465
@@jfarre20 where did you find those drivers the newest I could find on advanced driver search for win 10 64bit is 367 (370.41)
Spacedesk looks to be the answer to the problems getting an output from my Tesla m40 on my guests. Parsec worked fine on the host OS as described here but couldn’t grab the screen on the VMs.
My windows 10 hyper-v box sits on proxmox so I have nested virtualisation happening too, this isn’t wholly crazy as I think it’s the most effective way to have two graphics cards working with paravirtualisation.
Now I have an excuse to buy a thread ripper and less guilt towards the imaginary funds set aside for three computers for the children.
Thanks for setting me on this path Jeff!
I came here to learn about GPU passthrough but I'm just staring at the cat.
Fyi...
Depending on which pve you're using or if you're using grub or systemd boot... zfs on root may also affect...
But instead of /etc/default/grub
You may have to edit /etc/kernel/cmdline
And instead of update-grub
You may have to issue proxmox-boot-tool refresh OR pve-efiboot-tool refresh
Depends on the version of pve -
Depends if grub or systemd was the BL -
Depends if using UEFI
Unsure which is affecting the process - however if your wondering why your passthrough is not working follow what Jeff is doing - if it didn't work - try the other variations - one will work.
as someone looking to upgrade the kiddo setups from ancient Dell boxes, could you recommend a decent ebay server box to get started with one of these? appreciate all the content and guides! this is becoming my favorite channel after LTT :-D
After LTT? Pft.... 😉
Dell R720s include PCIe power most of the time, and make great 2U servers with airflow to support these cards.
@@CraftComputing He meant favorite after BmB
@@CraftComputing thanks for the rec! i'll have to tweet you the current setup while I gameplan the upgrade with your videos
LTT is a clown child that knows almost nothing, his entire corp is affiliate links and shills. Kids watch LTT
So I just followed this tutorial(though I'm using manjaro and a tesla m40) and IT WORKS! One issue, just like you, is cooling I have a 3d printed adapter for a server fan and at 12V it's deafeningly loud 5V is just fine for minor games but it just isn't enough for most the games I'm trying to play. So, my plan is to modify a dead RX 480 blower that is much quieter even at 12V and I would be able to run the fan on a motherboard header instead. Hope this works!
Excellent find. Thank you.
Parsec is amazing I use it for my Windows and Bigsur vm's on my Unraid server. Great video btw
Bigsur VM’s? On Unraid
Oh Parsec released support for MacOS fairly recently it seems, crazy. Thnx for the heads up
This guide is not only useful with Proxmox on a server passing a Tesla M40 to Windows VM (which your information here helped me set up, works fine), I also dualboot to just Windows 10 on the baremetal Poweredge R720 server for testing, and your setup with Parsec and the virtual display driver (I used usbmmidd_v2 instead of V1), is also useful there!
For example, on bare-metal Windows 10, if I use Parsec to just watch the 'hardware' Matrox built in graphics on the server, at 1080p (with the registry adjusted to unlock 1080p on that ancient Matrox built in card), I get 30ms encode in Parsec (not great)
But if I use Parsec to instead watch the virtual fake display like you have setup here, the encode actually kicks in on the Tesla GPU and the Encode latency time is down to 1-3ms or so (10x better).
Basically tl;dr your guide here is helpful not just for Proxmox but also even for just running bare metal Windows 10 on one of these headless servers and trying to get good latency in Cyperpunk 2077 remotely using a Tesla M40.
Thank you so much for this amazing guide!!
Or you could use the iGPU with LookingGlass for a dualheaded machine, no need to do anything remotely off another machine just use your desktop machine :)
Was considering this scenario, indeed seems like a great usecase
This is pretty cool. Looks pretty good for running remotely on a VM, on a Proxmox server
I bought some Tesla M40's a long time ago and stuck them in my Dell R720XD's and have been trying to get them to work like this for quite some time! Jeff you rock! P.s. I use Hyper-V and this process works great with DDA
I’m having trouble getting this to work with hyper-v using paravirtulisation on windows 10 21H1. Any experience getting this working or might I be better downgrading and going with DDA?
@@brianbuckleygray994 I'm using windows server, so I don't have GPU-P yet. If you can deal with only having 1 VM being able to use the GPU, use DDA
@@MikeWillTech thanks for that, if all else fails I can dedicate a card per VM, it’s more the number of computers I want to get under control.
Thank you, I was able to get more performance from my K10 converted to Grid K2. I also got the K80 working and it's not great but not Bad.
0:22 Cat:"I hate being ignored when set to max floof."
Nope you can't reason with a cat for not cuddling.
Food => Gather.
Homeless => Long fur
Warmth => Long fur, arguable.
No cuddles => No excuse
No treats => Umm, convinced, lol.
(but still annoyed.)
Yes I read cats like books.
I also greet animals more than their owners.
I'll guess it's leveraging Looking Glass?
Edit: it was not
Magnificent work :)
Great stuff. By the way, I use your glass of beer as the progress bar :)
All you need is the virtual display driver. This will make it think there is a display connected to the GPU. That is all you need to to get Steam streaming to work.
Incorrect. If your gpu isn't configured correctly you will get less then 1fps in your games
OHHH This need more IT knowledge that i thought :D
This methode works to for an rtx 2060 👌🏼 thanks man 😁
I think you should try cooling the Tesla cards, at least the single gpu cards with one of the Arctic GPU coolers or an Kraken G12 AIO setup.
He has in a previous video slapped a giant blower fan on one side
I tried partitioning a Titan X Pascal inside a Windows VM using Hyper V for nested virtualization but it performed so bad its unusable. I'm guessing nested virtualization cause a lot of io wait and therefore laggyness. Was testing on an i7 5820K + Asus X99 Deluxe U3.1.
Thank you for making this video. I hope to use steam and a steam link device. Wish me luck!
May try this for gaming lounge
I have a problem when watching this video, I'm more interested in watching the cat 🐈 :)
I'm trying this with a Tesla P4 but I can't switch from TCC to WDDM with the Quadro drivers. Is it possible to do this with a P4 without the GRiD license?
Wow this is cool maybe one of my future hobby project
And here I am in Unraid happy I don't have to jump through so many hoops to do the same thing lol
Oué mec tout marche comme presenté je te kiff
fooking life saver mate
This is a great option for people who can´t buy any GPUs at the moment
Hi, could this work with ESXI 7 or will you still be limited by being forced to use Nvidia Grid to allocate the 2 GPUs on the K80?
This is a good idea for those mining GPUs without any outputs
At least nVidia mining GPUs have NVENC disabled in their firmware, making streaming difficult. AMD mining cards would be great contenders for this though.
Pro-tip - just use a virtual display in parsec, to run at any size. no registry keys needed
Tried this with a Tesla P4 but I can't switch from TCC to WDDM. Does this only work with older cards?
I've tried Parsec and didn't like it and wouldn't give me the performance I wanted, tried Moonlight instead and only requirement for the VM would be to install Geforce Experience and setup the Shield section to add games. Got Moonlight installed on my X900H 65" and added a logitech wireless gamepad to the tv and now I don't even need a Rpi to run a software like parsec. You should look into this also, you can also multiple machines like Parsec does.
sunshine moonlight obliterates parsec
I was trying exactly this last week then Craft Computing just jumps in and releases that video. Perfect timing man! :)
However I'd like to ask if you had any issues with the M40? I have one and the Nvidia Drivers under windows are throwing Error 12 on me: "This device cannot find enough free resources that it can use. (Code 12)"
Have you seen this before? I'm running a Dell R730 Server with a M40 GPU.
Code 12 is usually a resource issue with PCIe or memory space. Because of the 24GB of VRAM, they don't play well with some motherboards. They should be OK in the R730 though.
@@CraftComputing Hey Jeff. Thanks for the comment. Have you tried your M40 under proxmox and the same Windows VM ? I tried to change the card to a different slot in the motherboard but still no dice...
I do wonder if the old arctic cooling kit for the GTX690 would fit the K80...it was made with two discrete coolers for each gpu chip and used stick on ram sinks.
just to make you aware jeff it works with any gpu not just headless, i followed your guide but i was using a gtx 970 and it works exactly the same.
Been trying to follow along but....Where did the usbmmidd folder suddenly appear from?? i didnt see any previous install for this?? Its not on my system?? How did you get this or where do i find it??
I'm having this issue too.
ohhhhhhh C: is where Jeff extracted usbmmidd ....maybe...
Great Video, today i ordert a Nvidia K80 for my Dell PowerEdge R730. Hopefully the graphics card will run as well as your solution under VMWare ESXI 7
Thanks Jeff!!!!
What is the longest single sentence, involving computers/software,
you can make using mostly abbreviations ? (contest)
(it should be spoken as a single sentence,
not seperate sentences stringed together.)
(the primary score is for the amount of abbreviations.)
Exactly the video I need, I'm looking for a GPU to use with VMs. Need Windows for college, and there's a course with OpenGL, that should go much better with my VM able to use a whole GPU.
I don't have a huge amount of PSU capacity headroom, though while it's idle(which it would be when I'm not hammering it in my VM, and I'll mostly be not be hammering my main GPU at the same time) it should be OK.
Being able to use enterprise cards might open up options, though I'm currently leaning to an RX6400 for cost reasons.
Hi Jeff. I have a Tesla k80 with 24GB of ddr5 ram. And I’m running esxi. Do you think I might be able to replicate your setup with this GPU. I want to use it for some data science and ml training and of course gaming. But gaming is a must
I wonder if you can comment on the following question? If I run headless GPUs inside a GPU server (Gigabyte) to do Compute (BOINC/F@H), and I then access Ubuntu desktop via IPMI (iKVM) will it work? There are some reports that you just get a blank screen as the BMC display cannot output if dedicated GPUs are installed; although these are mainly about Supermicro servers. I have searched Google high and low but cannot seem to find a definite answer on this. Your opinion on this would be most helpful.
how many cans of them beers you went thru before you figured all that settings out Jeff ? :)
Hmm, I see you cut out the part that got Franklin to the hospital....... 😂😂
Shhhh, you see nothing.....
Hopefully I can get a response, I've done everything in the tutorial, but I'm still met with a black screen in parsec. Remoting in with RDP or VNC shows encoding activity for the gpu when I attempt to connect with parsec, but still black display. Generic PNP monitor is selected, and I've disabled the VGA display from ESXi
Amazing video!!! There actualy is a waterblock for the tesla k80 on aliexpress.
Yep, because it shares the same PCB as the Titan Z card :-)
When parsec program is closed on client side does virtual monitor work 1080p in background not returning to 1024x768? so far i'm using teamviewer it works sometimes. I want to use camera stream 24/7 via OBS it has to go through the camera app without rtsp url
I love the idea of never telling your kids about where the performance comes from, letting them figure out that their computers suck, and should get a job to buy a better one.
I have to try this now.
I've been needing this. thank you! would this work with quadro cards as well?
Jeff, do you know if i could passthrough the primary gpu (my only gpu)? Or will this only work for multi-gpu setup? My system doesnt have a built-in video card and i have a headless gpu.
I do some of this in bare linux but with a consumer card. That way I don't lose any performance. Just use a desktop KVM and switch monitor ports.
Hey! I know that brewery. My wife used to live across the street.
Nice! Have you tried this with a Linux VM with Steam or Lutris?
could you do one native and have the other running in hyperv like the other video?
Yes, that should work just fine.
Pet the damn cat!
I DID!!!!
Gosh! I shouldve done this before!
Hey jeff! I've been trying to get this to work with my tesla T4s. I have single gpu passthrough working beautifully, but anytime I try to pass more than 1 gpu in (2 tesla T4 to windows for tensorflow) it kicks the bucket.
Any clue how I can get this to work?
Hi great video !!!! in your opinion tesla M40 to be used with proxmox windows vm does need Above4G decode enabled?? my mainboard don'have this feature. Many thanks!
What cpu or cpus were you running? and what allocation of cores for each machine? im running 2x 2650v2's w/128gb ram in my server currently and would love this as an option! just wondering if i would need an upgrade to get similar performance. currently im giving each gaming machine 8 threads and using antique amd graphics on both and they struggle to say the least. As always enjoying the content watching closely and learning a ton! thanks for all you do!
It doesn't really matter. They will only use the amount of cpu they are using at the time. So it wouldn't be too bad to give each of the machines half of available cores. But when it comes to memory, you need to be a little picky as enabling pci passthrough will disable memory balooning.
I think I'm going to steal this idea for a virtualized design infrastructure on vmware. CAD should run fine if GTA V can do what I saw in your video :-)
I have a dl380g8 in which I can slot a couple of these cards and have 4 vms fully accelerated
That should absolutely work. Plus with 12GB of VRAM each, you'll be loaded for bear when it comes to CAD. Good luck!
Thx. For the update.
This is really an interesting setup,
Can you elaborate the network issues with Linux VMs? I have an ubuntu vm running on proxmox with PCIs passthrough without any problems? (Or I just don't see them)