Enjoyed this video. I always like when you show your servers and show what maintenance you are doing. Haven't watched as much in a while, busy, but love your channel. Always fun.
@My PlayHouse - 1KW per hour. Jesus. You need more Solar Power Morton, really. Or as @MGD9000 say run a power cable to all neighbours and tell them it is for a good thing, haha. Good video. Right now i'm boosting a Lenovo M900 SFF to the max of hardware in the housing. It is like a devils machine. All possible hardware which is mentioned in the Lenovo Hardware Specs. Lots of extra hardware. I needed a bigger power supply and i found it which fits perfectly in there.
I was thinking as you were struggling. Isn't that a 8 pin, to 6+2 , to 8 pin.... Why... Single cable. I've a few cables like that. For all sorts. I always end up not remembering where I've put them, but I have a new box called ""the build box" which has all the stuff needed to do builds.
It looks like the power consumption is the limiting factor of the GPUs' performance. If there's a way to undervolt them slightly you should get more performance/watt.
K80 design was licensed to Dell, etc,... who build special cases where the card-cooling was included in the case instead of being part of the card (active external cooling, you could say). If you put it into an unlicensed case, you need to build a custom cooling system for the K80 first. Normal airflow wont do it. Some people just thermo-tape some fans on it - but you need a lot of extra space for that. PCI-extensions and external holding systems are what I see on working unlicensed builds. You are running an uncooled K80 in your rack - better check your fire-insurance-policy ;-)
Hi Morten, I am having some trouble with my K80, GPU clock is not boosting and GPU-Z is reporting Boost Clock as 562MHz, but in your video it shows 824MHz, only difference is BIOS versions. Can this be an issue? Mine are 80.21.1F.00.07 and 80.21.1F.00.08 and is bothering me quite a lot because performance per watt is way worse this way, power consumption is around 200W total with 200-300K PPDs per GPU (depends of job)
After some more digging around i am 99% sure this is GPU BIOS related but have absolutely no idea what to do with it. For some reason older bios that i found on techpowerup.com database boost clock is 823.5MHz and have 27 frequency steppings available but mine has only 3, (Idle, perfcap(?) and base clock), everything else is the same. I also recently added to another graphics card, and even after that there is no power capping on K80 according to GPU-Z , only thermal throttling on M2000 (its sitting next to K80 :) drive.google.com/file/d/1uxb-N4rnsWRSmj5TZ8nNwlbBtLcHnU4-/view?usp=sharing
I hate to say it but I bought a HP DL380P Gen8 of Bargin Hardware about 3 weeks ago and I used your promo code. I know you love Lenovo servers but they didn't have any in stock for for right price.
Yeah, you're right, got my power bill a couple of weeks ago. Hmmmm not unexpected, but I always say....if you don't like it then don't do it. So if I want to run servers, then that's what you pay. Or only run them on a weekend. Depends on what you want to do, use as a home lab and tinker or just make use of what they're made for.
Thanks for the video Morten. Which cable did you use eventually? Was it the one that came with the card? Which Indian hack did you do? I got a K80 recently but I had to use an EPS12V I had with my ATX corsair power supply and I m not sure if it could draw full 300w. The cable that came with the card did not fit into my power supply.
hey, was wondering if it is viable to use consumer GPUs in servers. Newer generation quadros are expensive and older generation ones are loud, power hungry and underperforming.
I have used a few different GPUs in my servers, while they aren't good for Folding@Home or video rendering, they provide a good graphics support if you are running a hypervisor such as Proxmox, XCPng or VMware. I've used the Asus HD5700, NVidia K4000 and the P2000, if I remember correctly. But as long as you have the right PCI slots should work fine.
I looked also at buying the ESC4000 at BH, competitive pricing which is great including shipping cost. It has a few quirky things as Morten mentioned but still a good option for computing loads. Unfortunately life has got in the way and looks like that opportunity will slip away.
@@MyPlayHouse The adaptor is pointeless It depends on your cable and pin quality but pci express 8 pin can deliver a maximum of 540W in theory before it is a fire risk The adaptor has unknown wire gauge and unknown pin quality
@@MyPlayHouse No, really, go and check your position in the Folding@Home league table. You are set to gain position 100 in 6 days, and will continue to descend down the table after that. This is worth video? I did message you on FB Messenger, but no one appears to be home.
Hi Morten, nice video, very useful, but I would like to ask you, how do two Nvidia Tesla K80 cards go together. I know that they cannot work in SLI and that the typical memory is divided by a maximum of 12 GB... if I install two identical cards on a PC, with an AMD EPYC processor, to be able to create renders, what happens? Is the work divided between the two video cards and the processor? Do I need to change the software? Thanks for the attention.
@@MyPlayHouse ok, so the tasks are divided, in the sense that the processors work according to the task divided between them I guess, not that one goes or doesn't go right? How does it work regarding the use of memory? Does only one card work in memory and the other doesn't or do they share the weight? Thank you
3:31 To make money since I wouldn't be surprised is they are the only one who sell their highly proprietary cables for their systems and really hope you loose several of them since they are most likely ridiculous expensive for no reason what so ever.
Hi ! Morten, I am thinking to get a Nvidia K20x for a HP Proliant 5580 G7 to get faster CPU and faster Card Graphics for four monitors. It is good idea ? Thanks very much !
@@MyPlayHouse maybe more, it is for trading, I had many Pc but by the time motherboard finished broken however any server works 24hours for a lot years, servers are beast, never stop. How can I get better cpus processing?? I Was thinking about Nvidia tesla k20x.
I read that QuickSpecs HP IO Accelerator for ProLiant 580 G7 servers could making faster CPU and Graphics my server DL580 Prolian has RAM 500GB and Iwas thinking in (HP 320GB SLC PCIe ioDrive Duo) or (HP 640GB MLC PCIe ioDrive Duo) in case of not to be useful a Nvidia K20X for the same duty of getting better CPU and graphics, how is de best option ? thanks very much !
@@MyPlayHouse thanks very much!! HP DL580 G7 is very old server, With adapter pcie 2.0 and nvme Evo 960 I supose, have you done That before? Have you any video about? Will server works faster With a tesla 20kx? Or it only works faster With softwares it takes parallel programmimg cuda?
HI Morten, you should not wear a grounding cable on your wrist when you working on a Server that is on a power line. I really hope you removed the Power Cord on the Server.
So you did a summary of the system. For the 1000 watts it isn't all that efficient. I have one computer with a gigabyte 1660 ti and it does about 1.3 million points per day and probably uses 300-400W. Anyways, I have that computer folding on your team now. Let's see if we can go top 100.
Enjoyed this video. I always like when you show your servers and show what maintenance you are doing. Haven't watched as much in a while, busy, but love your channel. Always fun.
Hi Poe Lemic
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
wo this realy loud, wiiiiiiwwwiiiiiiiwwiiiii , good u moved the k80's over have a fine weekend !!!
It is still really loud, but a way nicer loud...
Great video! Those cards are looking soo great
Yes,, they sure look cool :-)
Is that a new pair of glasses? They look great!
It is just cheap-ish reading glasses,, brok the last ones :-/
I really enjoyed your video. You sir are the best.
Hi magdcs
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
@My PlayHouse - 1KW per hour. Jesus. You need more Solar Power Morton, really. Or as @MGD9000 say run a power cable to all neighbours and tell them it is for a good thing, haha. Good video. Right now i'm boosting a Lenovo M900 SFF to the max of hardware in the housing. It is like a devils machine. All possible hardware which is mentioned in the Lenovo Hardware Specs. Lots of extra hardware. I needed a bigger power supply and i found it which fits perfectly in there.
I do not run all you see all the time,, I ran this until it had completed :-)
Run a power cord to your neighbors house... If he gets pissed, tell him to Have A Nice Day
Ahh you have to be on good terms with your neighbors..
Hi Morten!
I think the card cable is meant to be passed through the side indent of the back bracket. This way the air flow is not restricted.
I did not see that there was many options for doing it differently.
I was thinking as you were struggling. Isn't that a 8 pin, to 6+2 , to 8 pin.... Why... Single cable.
I've a few cables like that. For all sorts. I always end up not remembering where I've put them, but I have a new box called ""the build box" which has all the stuff needed to do builds.
I was not having much luck with connectors that day.
Morten: Electricity in Denmark is too expensive to do BitCoin mining
Also Morten: Let’s run folding @ home 😉
I’m just joking, love the video’s!
Well yarh,, it is better financially to buy bitcoin,, the stuff we do on folding@home,, can not just be bought elsewhere.
would love to see that server loaded with 4 k80s for 8gpu cores POWERRR
Not sure it has enough power for that,, and I do not have more cards :-)
It looks like the power consumption is the limiting factor of the GPUs' performance. If there's a way to undervolt them slightly you should get more performance/watt.
Hi eDoc2020
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
You can see in GPU-z under PerfCap reason it says Pwr this means the card is being throttled by power limitations.
okay,, I did not know that.
good performance :)
Hi Gábor Molnár
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
I am running 1660 cards for folding... at least 1 million PPD per card x 6 cards doing 6.5 - 7.5 million per day average
Hi Soniclab
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
@@MyPlayHouse I see playhouse I click
don't hate the small screws...at least you got a screw!
It would not have taken long, to have made a toolless solution. :-/
Go Team Morten! 📈 I’m moving up thru the team ranks slowly but surely (#65).
You will soon be in top 10% :-)
K80 design was licensed to Dell, etc,... who build special cases where the card-cooling was included in the case instead of being part of the card (active external cooling, you could say). If you put it into an unlicensed case, you need to build a custom cooling system for the K80 first. Normal airflow wont do it. Some people just thermo-tape some fans on it - but you need a lot of extra space for that. PCI-extensions and external holding systems are what I see on working unlicensed builds. You are running an uncooled K80 in your rack - better check your fire-insurance-policy ;-)
No,, This server is made for GPU's and they are well cooled.
Hi dear.
What is mother board to working with two or more tesla k80 ir m40 até the sabe time and the sabe Motherboard?
Sorry,, you will have to google that on your own,, I do not know.
Can I get a link for the Ninja cord with CPU on one end and GPU on the other please? (The one you used in the end rather than the slpit adapter)
I had to make the Ninja cable myself,, you can get a link to the video : ruclips.net/video/wKg8_ba-3-0/видео.html
Would it benefit if you had a refrigeration unit feeding the server room to keep it cooler?
Yes,, but I use the warm air to help heating my house,, it´s better when it is a little warm.
Hi Morten, I am having some trouble with my K80, GPU clock is not boosting and GPU-Z is reporting Boost Clock as 562MHz, but in your video it shows 824MHz, only difference is BIOS versions. Can this be an issue? Mine are 80.21.1F.00.07 and 80.21.1F.00.08 and is bothering me quite a lot because performance per watt is way worse this way, power consumption is around 200W total with 200-300K PPDs per GPU (depends of job)
Could this be because it is not getting enough power,, and it slows down,, to still do something.
After some more digging around i am 99% sure this is GPU BIOS related but have absolutely no idea what to do with it. For some reason older bios that i found on techpowerup.com database boost clock is 823.5MHz and have 27 frequency steppings available but mine has only 3, (Idle, perfcap(?) and base clock), everything else is the same. I also recently added to another graphics card, and even after that there is no power capping on K80 according to GPU-Z , only thermal throttling on M2000 (its sitting next to K80 :) drive.google.com/file/d/1uxb-N4rnsWRSmj5TZ8nNwlbBtLcHnU4-/view?usp=sharing
I hate to say it but I bought a HP DL380P Gen8 of Bargin Hardware about 3 weeks ago and I used your promo code. I know you love Lenovo servers but they didn't have any in stock for for right price.
DL 380P G8....nice!
I have also noticed that,, I would much rather promote some IBM/Lenovo's :-)
@@MyPlayHouse one day I will get a Lenovo server, i have all ready got there laptops. Lenovo surely must be loving you 🙂
Folding@home numbers are better but the power bill numbers is really bad.
Yeah, you're right, got my power bill a couple of weeks ago. Hmmmm not unexpected, but I always say....if you don't like it then don't do it. So if I want to run servers, then that's what you pay. Or only run them on a weekend. Depends on what you want to do, use as a home lab and tinker or just make use of what they're made for.
I am not running this one,, it is to hungry!
This Sounds like Perserverance Rover on the Mars :D
Exactly, Perseverance Rover noise is also, a cooling
@@the_mister_magister CPU cooling fans Haha... :D
@@DIYwithBatteries well… basically… yeah
Hi DIY with Batteries
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
It sounded like the lenovo sr650 was squealing it's head off
It does not sound nice..
Thanks for the video Morten. Which cable did you use eventually? Was it the one that came with the card? Which Indian hack did you do? I got a K80 recently but I had to use an EPS12V I had with my ATX corsair power supply and I m not sure if it could draw full 300w. The cable that came with the card did not fit into my power supply.
Have a look at this video,, that is the other cable I used. : ruclips.net/video/wKg8_ba-3-0/видео.html
Thanks. It is indeed a ninja hack!! I'm still wondering how you managed to get it to work with the yellow/black wires flipped sides!
For more pleasure :)
Hi Matias M.
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
hey, was wondering if it is viable to use consumer GPUs in servers. Newer generation quadros are expensive and older generation ones are loud, power hungry and underperforming.
I have used a few different GPUs in my servers, while they aren't good for Folding@Home or video rendering, they provide a good graphics support if you are running a hypervisor such as Proxmox, XCPng or VMware.
I've used the Asus HD5700, NVidia K4000 and the P2000, if I remember correctly. But as long as you have the right PCI slots should work fine.
There is computing jobs/tasks that GPU's does 10-20 times faster than even the fastest CPU.
@@MyPlayHouse I know, but my question was whether it's worth buying consumer GPUs as a cheaper alternative
Considered this for GPUs but grabbed something else from BH, making use of your code - something a little more efficient.
I looked also at buying the ESC4000 at BH, competitive pricing which is great including shipping cost. It has a few quirky things as Morten mentioned but still a good option for computing loads. Unfortunately life has got in the way and looks like that opportunity will slip away.
I thought it was cool that it could do 4 big GPU´s or even 8 small ones.. that would be a fun test.
That cable with the adapter, hmm, messy and seems needlessly large.
Yes,, it is not the best solution.
@@MyPlayHouse The adaptor is pointeless
It depends on your cable and pin quality but pci express 8 pin can deliver a maximum of 540W in theory before it is a fire risk
The adaptor has unknown wire gauge and unknown pin quality
Check out your position in the league table. 101 now. Nearly into top 100!!
Hi Dave Sawyer
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
@@MyPlayHouse No, really, go and check your position in the Folding@Home league table. You are set to gain position 100 in 6 days, and will continue to descend down the table after that. This is worth video?
I did message you on FB Messenger, but no one appears to be home.
@@davesawyer497 I checked it yesterday :-) Thank You..
It seems on the lenovo, the air buffle was not doing good job, have you tried without it?
I do not always try to use the right type of GPU´s ,, for servers.
Im feeling like using old servers are power consuming at present. shifting to new ryzen and 3000 seris GPUs, is it good move to take.
The Two GPU's was the most power hungry part of this :-)
What is the motherboard used in the video? Anyone know??
It is an ASUS Server,, and the model comes with that motherboard.
I thought my Dell R810 in the bedroom was loud :) My wife was very unhappy....
Well and you know what they say : Happy Wife, happy life!! :-)
Hi Morten, nice video, very useful, but I would like to ask you, how do two Nvidia Tesla K80 cards go together. I know that they cannot work in SLI and that the typical memory is divided by a maximum of 12 GB... if I install two identical cards on a PC, with an AMD EPYC processor, to be able to create renders, what happens? Is the work divided between the two video cards and the processor? Do I need to change the software?
Thanks for the attention.
I had them working on folding at home,, they did not work together,, but divided the tasks.
@@MyPlayHouse ok, so the tasks are divided, in the sense that the processors work according to the task divided between them I guess, not that one goes or doesn't go right? How does it work regarding the use of memory? Does only one card work in memory and the other doesn't or do they share the weight?
Thank you
Is there a firmware/BIOS hack to increase the speed of the K80?
I do not know,, but there is usually not many options for OC enterprise stuff like that.
3:31 To make money since I wouldn't be surprised is they are the only one who sell their highly proprietary cables for their systems and really hope you loose several of them since they are most likely ridiculous expensive for no reason what so ever.
I think the 8-pin EPS 12v will be used, for GPU with bigger power needs,, so might become more normal.
good video
Hi MikkelSV
Thank You very much! glad you liked the video :-)
Thank you for watching! :-)
Hi ! Morten, I am thinking to get a Nvidia K20x for a HP Proliant 5580 G7 to get faster CPU and faster Card Graphics for four monitors. It is good idea ? Thanks very much !
Four monitors on a Server,, why?
@@MyPlayHouse maybe more, it is for trading, I had many Pc but by the time motherboard finished broken however any server works 24hours for a lot years, servers are beast, never stop.
How can I get better cpus processing?? I Was thinking about Nvidia tesla k20x.
I need help how do I install an operating system on my server
Hi Mickey and Dusstin dunlap
Thank You very much! I have done a lot of videos on installing OS's on servers :-)
Thank you for watching! :-)
I read that QuickSpecs HP IO Accelerator for ProLiant 580 G7 servers could making faster CPU and Graphics my server DL580 Prolian has RAM 500GB and Iwas thinking in (HP 320GB SLC PCIe ioDrive Duo) or (HP 640GB MLC PCIe ioDrive Duo) in case of not to be useful a Nvidia K20X for the same duty of getting better CPU and graphics, how is de best option ?
thanks very much !
If you can get those iodrives at a good prices, fine,, but new NVMe disks are also pretty good now.
@@MyPlayHouse thanks very much!! HP DL580 G7 is very old server, With adapter pcie 2.0 and nvme Evo 960 I supose, have you done That before? Have you any video about?
Will server works faster With a tesla 20kx? Or it only works faster With softwares it takes parallel programmimg cuda?
HI Morten, you should not wear a grounding cable on your wrist when you working on a Server that is on a power line. I really hope you removed the Power Cord on the Server.
Well this works well, and the racks has there own ground connection, just outside.
It can kill you, if you touch a live wire with your other hand. Don’t wear the grounding cable, if you want to stay alive.
So you did a summary of the system. For the 1000 watts it isn't all that efficient. I have one computer with a gigabyte 1660 ti and it does about 1.3 million points per day and probably uses 300-400W. Anyways, I have that computer folding on your team now. Let's see if we can go top 100.
Yes,, those Nvidia Tesla K80 was more powerful back in 2014 when they were new.
Forgive me for asking. What is Folding?
Folding@Home is thing, where you add your computer power to help find cures for diseases.
@@MyPlayHouse oh nice. That is very admirable.
1kw / hr? Yikes!
Yeah makes sense, considering 600W of that is just the GPUs. 😉
I am not going to be running this all the time. I do now have that kind of money.