Chia 2.0 Hardware Primer - GPU Plotting, Chia Farm Storage, Workstations and Servers
HTML-код
- Опубликовано: 8 июл 2024
- digitalspaceport.com/chia-plo...
Lets take a look at my architecture for Chia GPU farming and GPU plotting. You may think of this as Hard Drive Mining or Chia Mining if you are new to #Chia, but we usually call it farming 🌱 I take you through the server racks that I run, show you how to cable up JBODs, Review several common Workstations that provide ample DDR3 or DDR4 dimm options for the cheapest price possible and show you a few basics that you will need to use to plan out how your chia farming goes.
FEATURED WORKSTATIONS
HP Z440 geni.us/HP-Z440
HP Z420 geni.us/HPZ420
Dell T7910 geni.us/Dell-T7910
👇CHIA PLOTTING + FARMING HARDWARE (#ad)👇
GPU - RTX 3060 geni.us/3060GPU
Tesla P4 geni.us/TeslaP4
NVIDIA A4000 geni.us/A4000GPU
DISK STORAGE SHELF (JBOD)
Netapp ds4246 geni.us/netapp_4246_caddies
Netapp ds4243 geni.us/netapp-ds4243-wCaddy
QSFP to 8088 (SAS Cable needed for 4246 & 4243) geni.us/mCZCP
RAM
DDR4 RAM geni.us/DDR4_ECC_8x32GB
SERVER
Dell r720 geni.us/OAJ7Fl
Dell r720xd geni.us/5wG9n6
Dell t620 geni.us/dell_t620_256gb
SERVER RAILS
APC Server Rails geni.us/APC-SERVER-RAILS
RACK
StarTech 42U Rack geni.us/42u_Rack
WORKSTATION
HP Z440 geni.us/HP-Z440
HP Z420 geni.us/HPZ420
HBA
LSI 9207-8e geni.us/LSI-9207-8e
Be sure to 👍✅Subscribe✅👍 for more content like this!
Join this channel to get Store discounts + more perks www.youtube.com/@digitalspace...
Shop our Store (receive 3% or 5% off unlimited items w/channel membership) shop.digitalspaceport.com/
Please share this video to help spread the word and drop a comment below with your thoughts or questions. Thanks for watching!
☕Buy me a coffee www.buymeacoffee.com/gospaceport
🔴Patreon / digitalspaceport
🛒Shop
Check out Shop.DigitalSpaceport.com for great deals on hardware.
DSP Website
🌐 digitalspaceport.com
Chapters
0:00 Chia GPU Plotting
0:34 Dell T620 GPU Layout
2:19 Dell R720XD Storage Headend
3:24 Storage Layout
4:25 40Gbit Networking
5:48 Chia GPU Plotting Workstation
11:05 Good Workstations
13:14 NetApp DS4246 Cabling and Tips
#chia #chiafarming #gpu
Disclaimers: This is not financial advice. Do your own research to make informed decisions about how you mine, farm, invest in and/or trade cryptocurrencies.
*****
When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.
*****
******
As an Amazon Associate I earn from qualifying purchases.
****** 
Наука
I just figured out WHAT I like about CHIA farming... YOUR setup is like a f'ing drag racer... You built one of the most badass computer setups I've EVER seen! Your channel is going to blow up if you keep posting content like this!
Awesome tutorials and walk-throughs! Really helping build my confidence for the next steps up!
Thanks man and welcome to the channel. Excited to see your setup grow.
great video, a lots of information, but finally I can find all info in 1 video, rather then check a few. More like this please. I need to watch a few time to digest everything. Regards
Thanks I wanted to cover the HW big before I start doing videos on the storage setup, ubuntu install and config, and then benchmarking each of these systems. These all tie together.
woah!!! awesome info man and really nice setup.
Great knowledge dump, dense with valuable content! Great material for a hardware noob - may have to rewatch at half speed 🤣
I tried to cover a huge swatch of the possibilities here in this video. We will be breaking down each one of these as a seperate video review for the hardware in addition to some updated Ubuntu and Windows guides.
Waiting on a T7910 to be delivered shortly. Excellent video
T7910 is a hell of a beast! Congrats on picking up a killer machine.
great video
very cool server and the top speed of ploting
🔥
Holy shnikey's Batman!!! You've been busy. That is very impressive. Very impressive indeed sir. You are really ready for the next phase. I need to get my game straight watching this video.
That 3 number is on the horizon and scaleout with this architecture looks capable to hit mid 20s range in this configuration. Not that I can get there fast, but its good to have goals.
Do you have a model number for the sas hba? Can't find it on your webpage article.
This is great, but I’m curious about how you setup truenas as plotstorage. Or did I miss something?
That is a whole seperate video I am working on here. Ubuntu plotting video also in works. Very Soon.
Great info from the very beginning! Starting to think about moving from my Dell r620 to t620 because of gpus. 256 to 512 ddr3 maybe and 1 gpu for plotting plus 1 for decompression. With my half pb farm I don't need super duper fast plotting. Yet.😅
If you are staying sub 1PB and doing say C7, a passive cooled Tesla P4 is a very decent card to handle the decompression. Also they do not need to have a power connector aside from the bus.
Hello and thanks for yet another informative video. To what size do you expect the P4 to handle, lets say C5, C6 plots?
C5 or C6 at 512 filter size and K32 probably 5 and 3 PB respective. For sure a P4 can hit 1PB at K32 C7.
So.. Mr Digital spaceport, how much hardware do you need in your homelab?? Digital Spaceport: YES
yes
This was an awesome and very informative video! Thank you so much. Do you have a video on how you connected TrueNas, Proxmox and Chia? How you set it up and how you add drives to Chia? I plot on separate machines and would like to just plug the drives into the JBOD already plotted. Again thank you so much for this video. It answered a lot of my questions.
Just dropped a video today covering all the steps and details. Hope it answers your questions
This is waaaay beyond my knowledge base and financial ability. Impressive but would like to see some content for us little farmers.
What is your budget build you have in mind? I am working on a Z420 video here and those are silly cheap to hit 256GB ram. Also do know you can get by with partial ram plotting (down to 64GB) as well if you already have I/O like nvme/ssd/raid0 spinners hanging around. Each one of these systems will have a video associated with it and benchmarking.
@DigitalSpaceport I built.my plotter farm back in May 2021. Ryzen 5900x, x2 2tb gen 4 nvme drives for temporary plot, 64gb of ddr4 3600mhz ram and currently have 7 14tb drives. I guess what I was asking for earlier is there ways to optimize my plotting rig? Are nvme ssd's even needed anymore with mad max now? That kind of stuff that I just haven't been on top of really.
So the two iOM6 are needed? Or does‘t it work with one also?
works with 1 just fine
🔥🔥🔥🔥🔥
Que buen video genio. Consulta, las GPUs sirven para plotear y farmear, o solo para crear plot?
Hey. Is there anyway I can use an Alveo u50 FPGA to create plots? If not, could it be utilized for anything? It has a QSFP port.
not that I am aware of but you should send that over to me so I can check it out 😂🤣💚
Stupid question: can i fill the netapp aswell over the RJ45 plugs on the IOM6? Or diesn‘t they work only as managment plugs?
I guess its only 1Gbps then.
You cannot use the RJ-45 ports on the back of the netapp. Those are for their proprietary management engine. SAS only connections.
@@DigitalSpaceport I see, thx man. End the end a head is needed so or so.
Quick question about Proxmox vs. ESXi...I had an issue recently where I was running my Chia plotter as a VM in ESXi (v6.7 I think) and had an issue with ramdisk write speed. While operating as a VM and using the 'dd' command to test writes to a ram disk, I was only getting about 800 MB/s. I pulled my hair out for days...until ArigornStrider suggested I go bare metal. I did and ram speeds went up 3x to around 2,500 MB/s (DDR3 1333 MHz). From that I was able to deduce that the extra layer added in the VM/ESXi was the culprit. My not-so-quick question to you is, have you tested the write speed to the ram in Proxmox? I ask because I would still love to use virtualization but not at the expense of ram speed.
Love the content as always!!! Thanks for all your help!!!
I tested gpu plotting in a Ubuntu 22.04 VM in the latest Proxmox and saw what looked like very close to the same plot times. I also run the 5.19 kern in my proxmox. I cant speak much to how ESX does memory handling, but in Proxmox if you use quem-guest-agent and set the ram allocation to a static # and disable balloon it is very performant.
@@DigitalSpaceport I'll definitely give that a try. Thanks for the info.
Kind of a shame I am not interested in the whole Chia thing. I have a few pallets of similar machines sitting idle waiting for a new home. Cool setup you have though. So weird seeing a T620 rack mounted, but also cool.
I do love that T620 but at 5U it eats up a rack. I like the rolling casters myself.
Would love to see how you use TrueNAS for your plots! Do you use a ZFS disk pool and then go with Machinaris for farming? If you are using ZFS how many vdevs and what RaidZ level are you using? Your videos are so helpful man! Pretty soon I’m looking to setup a 500TB Chia farm myself, I’ve got about 50TB as of now so definitely going big!
Yeah using fewer machines is a great concept. Machinaris is amazing software as well. I hope the video out today got your questions answered!
I hope there is a TrueNas video in the future. I plan to buy a jbod soon so maybe I should go the TrueNAS route. In my current setup i physically rotate my drives 3 at a time from farmer to plotter. I've been raid0 in' the 3 drives with btrfs to keep up with gigahorse plotter. I feel like I'm taking a risk with the raid0 3 disk arrays but if it doesn't work out I'll replot when the chia team releases their farmer
Check this evening. Im wrapping up the editing on a 6! yes 6 video series that takes a person on every stinking step of the process. I might also composite it all into a single mega video, but its gonna be huge. Worked the past week on this.
I also recommend checking out Lenovo ThinkStation P620. Its AMD Threadripper Pro which I was using a 64C/128T for Chia CPU plotting, but now will use it for GPU plotting with 40XX (4090 might be overkill)...but the ThinkStation P620 is PCIe4.0 which is awesome.
I really want to just fomo into a P620, but they do lock the chips. I have the AMD EPYC here to build also so will get a taste of that sweet PCIe4 plotting speeds on the 3080ti.
@@DigitalSpaceport I managed to get a 65 second plot with dual 3090s with 512gb and dual epycs but it slows down to 80-101 seconds after the second plot.
Can you plot with 2 different gpus or do they need to match?
Video on this editing it right now. Tonight my man your questions answered with details.
All very nice, but how much energy do you consume? I had to turn off my JBOD because they consumed 750W x 24 HD each, paying $ 0.35 x 1kw with chia at $ 40 you're at a loss
each 60 bay jbod is 2.2 amps at 245VAC loaded with disks so ~540 watts. This is the main reason you have to balance size and cost with HDDs. TCO depends on density, but 35c is not great. I guess you had 6-8TB drives?
Nice setup. System is growing larger everyday. How many pib do you have now?
3 and hopeful to fill more jbod ser
@@DigitalSpaceport Awesome. Would love to see you in the top 100 leaderboard list on Space pool
I'm over on spacefarmer.io now. They have been proactive making sure Gigahorse works for their pool, plus user specified fee and adjustable diff work nice for me.
How many C7/C8 plots do you think the Tesla P4 can handle for harvester? I was thinking of putting one in a 1U server hosting a 60-bay enclosure. I may need to get a larger box, such as the HP Z420/Z440 to act as a harvester node for the 60-bay as it can hold larger and more powerful GPU's, what do you think?
Im over here getting these stats for the C8 level right now
@@DigitalSpaceport C8's for the Tesla P4? Dude, you rock. I got one of these in yesterday, but since you can't farm on them I don't know any way to test them on compressed chia plots. Im also going to try and daisy-chain the 60 drive enclosures, I found the correct cable type.
I've come across a Dell T7610 with Dual E5-2670v2. 10 cores each so 40 total with Hyper Threading. They are of course DDR3 but I did get a good deal on 256GB of RAM. I plan to toss in one of my 3060Ti FEs and was curious how well you think this will perform as far as plotting? Do you think it would be a huge performance gain to find a system with v3/v4 processors and DDR4? Worth the cost? Also I have a 1.92TB Intel P3600 for temp plot storage for offloading to HDDs.
I didnt know about the T7910 but that looks like a great option. You ONLY see a huge benefit from DDR4 if you have PCIe4 system (pretty much Threadripper, EPYC or ICELAKE+ to hit 256GB ram). You will hit ~210 second plots. There is 0 reason to go DDR4/v3/v4 if its just a plotter as their is no v3/v4 PCIe4 systems. That P3600 is a beast and will work out killer.
@@DigitalSpaceport Gotcha thanks
Nice setup =) Would be overkill for my 2 sqM server-room though, plus adding 10gbe ethernet would cost as much as expanding my farm with 20%, plus using pcie-x4-slots I need for HBA's etc, so 1gbps it stay🤣
Don't forget you can direct-connect 10G from your plotter to your disk array head and skip the purchase of a expensive switch
bonding can work really well also even with 1Gbe and direct connect is an easy win with 10/40Gbe gear also.
Looks awesome, but i guess it will never pay off :( fun to rich ppl
Ikr 😞 I got 5.6 XCH after two years mining. Just got 1/4 investment back.😢
@@leo-zb2ui better would be just buying xch for that money, soon halving and you will earn half
@@leo-zb2ui Hi Leo, I'm just starting to mine this. I suppose if the chia price went to $100 or more a coin in the next market, that would change things. It would be great to go to all time highs! Good luck.
That is a guess indeed but stay tuned for the actual numbers which dont point to your statement being accurate at all. A person DOES NOT need all of these things to have a Chia Farm. This is a primer video that covered almost all of the various hardware a person could use to get started.
If you overpaid for hard drives, like over 10$/TB, there is indeed a very long horizon to return your investment on those. At least hard drives can run for a long time with little electric if you did overspend on them.
I hate to ask this - but I struggle with this every month: Why not liquidate ALL of this, take the $30k you'd unwind from this setup and then just buy the XCH?
I need to do a video on this question. Way to much to type it all out and a super common Q.
Yes... this would be the second dumpest way to invest 30k 😂
After watching your poltting gears, I give up my plotting. Small fish never catch up big whale's mass.
This is a weird take on it. I have 3PB of storage here. This is a decent amount but I for sure am not a whale.
This isn't what I think of when I hear the word "primer".
It was hard to pick a word here
Nice resume on servers, I will hire you someday when I finally need one, but overkill for anyone looking to home GPU plot. If you want to appeal to the GPU mining community who are looking to deploy GPUs, you might want to study what hardware GPU miners use. Hint: We use open air systems not 150lb servers that are a waste of money, space, have no resale value, and sound like police sirens. This space is drastically missing the link from the GPU to the Chia community and steering them towards buying 20 year old junk servers instead of using the hardware they currently have. I think you missed the memo that servers are no longer needed for Chia with the advent of GPU plotting.
"If you want to appeal to the GPU mining community who are looking to deploy GPUs" - Im good with them doing whatever they want. This is not an appeal to them.
"We use open air systems not 150lb servers that are a waste of money, space, have no resale value, and sound like police sirens" - You need to have a full pcie 16x slot connected at PCIe3/4 negotiated rates. Risers wont work here. 1 good GPU is all that a normal farmer needs to replot if they are cool waiting. Also I had ~70 GPUs in the past. GPU mining tech simply is not well suited for large scale chia farming.
"This space is drastically missing the link from the GPU to the Chia community and steering them towards buying 20 year old junk servers instead of using the hardware they currently have." - A PCIe3 workstation or server with 256GB ram is the cheapest way to roll. Just the facts man.
"I think you missed the memo that servers are no longer needed for Chia with the advent of GPU plotting." - Did you see the entire part on workstations? My operations also have amazing efficiency per watt so you might want to hold off on presenting your opinion as fact unless you have numbers that back that up. I will be presenting numbers on the efficiency of my operations very soon.