@@SysDeskDev, It says now "Missing an argument for parameter 'MaxLookUpSeconds'. Specify a parameter of type 'System.Double' and try again." sorry I'm new to this.
@@rozelmerano5163 No worries, the default MaxLookUpSeconds is 5, so you can actually leave off that parameter if you don't want to change it. If you do want to change it then you will have give it a number of seconds you want, for instance 2. Or 10.
Thank you for taking the time to make this video as well as writing the code! As a beginner in Chia Farming I've been needing this info. This is a great way to monitor everything!
Thank you for the introduction. There were some hoops to get this working. Needed to add the repository as trusted also needed to allow the running of script (Powershell win 10) Then it was smooth sailing, might want to add some instructions about it on the git (there are a lot of us that are very new to powershell) Again thanks for the content and function.
Yes, I really need to update the readme on the github to make it more clear for those who are new to powershell. I am glad you were able to figure it out. I did put a video out going over some of the hoops, but it should be right there on the Github as you mention. I hope to get around to it soon.
Once again dude, your videos are so informative and valuable. Thank you, thank you. I used to go in my log file every while to search for these proof times and now no need anymore, this will save me so much time and effort.
I just got into chia mining two weeks ago, learned a lot from your videos as no knowledge of powershell, got your "PSCHIA" installed and used it for delay time calculation, hope that I can catch up with powershell so I can use other great tools that you made, really hope you can made a windows GUI version of it, but still really appreciate all the time and efforts!!!
Thank you for putting time to this, I would love to follow on it but I'm super new to powershell and don't know my way around it, so if you could please make a tutorial for people like me it would be great xD And again thank you for sharing your efforts and trying to help others
I am very thankful for your video! Thanks to you I was able to verify that it isn't my time to verify that is my non-winning, it's just my luck! I wasn't able to get the Install Module part to work, I'll have to rewatch for the 20th time, but I'm sure I'll get it. I appreciate the time you take to share your knowledge!
Thank you, refreshing and on point presentations. Been doing things the hard way, so glad to have found your resources, best to date. your Integrity comes through. Great work!!
really nicly done we this is a great tool for having an oversight over your system because till now it was hard to figure out whats even happening with the miner really well done!
Looks like you've got more responses than the video length, good going. Two things I need to know 1. does your tool improves the performance. 2. have you scored any chia? Thanks.
My tool only finds possible issues, it will not try to fix anything. I found chia in the first couple weeks of mainnet, but nothing in a long time. I have a very small farm - around 10 TB.
another excellent video. My list of commands to check chia keeps on growing. I did switch to swar chia plot manager. It seems to do exactly what I want even though plots seem to stall out on me randomly. EligiblePlots BestTime WorstTime AvgTime FilterRatio ChallengesPerMinute 935 0.003 1.22471 0.03295 0.00199 -6.57296
Thanks for the content. I just found out with your video that i am getting some slow plots that are in a NAS... between 5 to 6 seconds. Is there any way to improve the performance while still using the NAS that i have?
Firstly, you are the reason why I started with Chia......Excellent work and excellent presentation!!! In regards to the heat map, how you can Identify which plots exactly are orange or red in order to take actions?
as of right now there nothing to show which plot is causing the slow lookup time, but I will see if I can implement that in the future. Thank you so much for the kind words.
Wow ! So thankful about this content. I am not only I am learning about Chia but also learning quite a few tricks on powershell. :-D I found out that I have a horrible lookup range best being < 0.5 sec but worse is > 16 secs. Scary I know. Any idea why this could happen ? I have WD Gold 10tb drives hooked to a LSI SAS 9211-8i card ?
Thanks for all the videos man, really helping out the crowd here. Would you perhaps be able to make a video on getting the Full node farmer to register all the plots of the harvester to show as part of total plots? Read on github something about changing hostnames on harvester allows node to add those plots to total count but have no idea on how to go about it? I'm pretty sure everyone needs this info Cheers
Great tool, thanks for putting this out there. I'm personally using a bunch of external drives (yeah I know it isn't ideal but I couldn't bring myself to pay over $0.03 per GB on internal drives). Anyways my average times for all my plots is less than 0.1 seconds. I only had a couple flukes that were like 19 seconds but plots were probably being copied to that drive at the time. If anyone else is using external drives on windows I recommend changing the power settings both in the power plan settings and the device manager so windows doesn't power off the drives when idle. If you don't, the seek times are horrible since the drive has to kick on again when it receives a request.
Thanks for the tip. I turned it off in power options, how do you do it aswell under device manager? I too have some external drives, do you need to do this for usb, or does just doing it for hdd work ok?
@@anthonylee6252 In device manager, under "Universal Serial Bus controllers" you should find "USB Mass Storage Device". Open each one and you'll see a "Power Management" tab and then you just uncheck the box labeled "Allow the computer to turn off this device to save power". I personally am using a separate Intel NUC PC for my external farm drives so I also unchecked that in every USB hub as well. There's no real reason to leave it checked. Better safe than sorry.
Just got to the pc, I had 9 USB Hub showing, which I guess is one per slot on the 9 slot hub and no mass storage device, was able to adjust power settings as you said for each hub slot. Thanks again!
First off, thank you so much for this video tutorial! I have verified that my setup is working perfectly. 1 Question, on the PowerShell title bar, at the end, what does RGB mean? I notice the number keeps changing.
from the script it seems to determine 'live' (in the title bar) which lookup time it is currently 'reading' ... at the end it will show the color corresponding to your sensitivity scale $RGB = [math]::Round((255 * $harvesterActivity.LookUpTime * $Sensitivity) / 5) am I Right @NotAnotherTech Channel ?
Yet another great utility! Thank you so much for doing all this! Any possibility of making the heat map show a flashing block or something that really stands out on the off change you win a block in one of them?
I wish that was possible, and it technically might be, but the results would be undesirable since you would have to rewrite the entire buffer every flash. Another option would to be make it a different color like blue or something. Powershell is incredibly versatile, but it does have limitations. I will look into adding a found proof color in the future if I find time. Thank you for watching and the nice comment, I really appreciate it.
I had the same exact thought! I am switching to a 2.5G network, hoping this may help. My looking up times used to be way under a seconds, but after few thousand of plots, it's over a second now
Hey there Great video and I have the great green screen. Have a few red and orange spots is the an easy way to find out why they are red and delete if possible. Or to find out if it's one Drive not working properly. Thanks again
Any suggestions how to fix below error ? Great video and tool, thank you ! PS C:\Windows\system32> Start-ChiaHarvesterWatcher Start-ChiaHarvesterWatcher : The 'Start-ChiaHarvesterWatcher' command was found in the module 'PSChiaPlotter', but the module could not be loaded. For more information, run 'Import-Module PSChiaPlotter'. At line:1 char:1 + Start-ChiaHarvesterWatcher + ~~~~~~~~~~~~~~~~~~~~~~~~~~ + CategoryInfo : ObjectNotFound: (Start-ChiaHarvesterWatcher:String) [], CommandNotFoundException + FullyQualifiedErrorId : CouldNotAutoloadMatchingModule
Fixed by running a command > set-ExecutionPolicy -ExecutionPolicy RemoteSigned as shown in the previous video on this channel. Thanks for the great info and tools!
Love your video and your tool is way better than chia harvester graph!!! -is there any way to get this running on Linux (raspbian x64) ? - btw. What does the RGB count mean?
thanks for the great tutorial. but what are the possible issues that can make the lookup time more than 5 seconds? is it only an internet connection? what would be the slowest internet (ping and download rate) that can run this without trouble?
@@SlothTechTV no i am not talking about plotting , i mean when the logs shows that after plots pass the filter, time is over 5 seconds , how can we fix it to be from 2 to 5 seconds ?or better less than 2 seconds ? Thanks
That is interesting... so the challenges per minute is calculated by subtracting the first activity log from the last one and dividing the total minutes past between those two by the total number of activity logs. Not sure how the value cold be negative from this.
my question is this, the less than 2 seconds is just validating the time and that we are in fact farming efficiently, I monitor this pretty often just to make sure as well.
yeah everything under 2 seconds is golden based on what I read. Even if you have some that are above 2 seconds but still under 5 seconds than it should be okay but it is worth keeping a closer eye on it. What tool do you use to monitor the lookup times, I know there are quite a few out there already that are pretty good.
How can I tell ChiaHarvesterActivity to look into a different folder? Just wondering how can I check logs stored in different destinations other than mainnet\log
This was definitely eye-opening. My best is .796, worst is 579.29. Average about 1.3. I'm thinking this is when one of my harvesters is writing a plot to the NAS. Since all my harvesters write plots to the same place, they can create a bottleneck. Since the full node is also reading the NAS folder, is there a way to keep the harvesters from doing lookups and just let the full node do lookups by itself?
Thanks for the great video. But the command get-chiaharvesteractivity -summary is showing 3000+ plots... I have less than 300 ??? Have I been added to a pool against my will ? I see a lot of this "node.mempool_manager" in the log files ???
Hi thanks for your videos. I am looking at the log of my pc and I found many errors that do not appear in the CHIA GUI. Could you help me decipher these errors, I have no idea what it could be. 2021-06-01T05:14:05.282 full_node full_node_server : WARNING Invalid handshake with peer. Maybe the peer is running old software. 2021-06-01T04:51:10.258 full_node full_node_server : ERROR Exception: Failed to fetch block 367216 from None, timed out , closing connection None. Traceback (most recent call last): ValueError: Failed to fetch block 364742 from None, timed out 2021-05-30T21:04:36.259 full_node full_node_server : WARNING Banning 51.15.216.154 for 10 seconds I have many of these errors thanks for the help
Thanks for the tutorial. I just closed my GUI and delete the debug.log file as I need to add one more external hard disk (full with plots) to my farming pc. When I restarted the GUI, I found my new debug file only 2kb and not updating by far. Do I have to give it sometime for updating?
My look up times are typically OK at best, and sometimes absolutely atrocious ocean. Is there any way you could do a video on how to improve look up times, ideally dealing on windows systems
Hi, this is great. Do you have a tutorial on how to set up a harvester machine? I have tried using the one in the Chia Official wiki but can't seem to get it to work. Initially i thought a workaround to set network folders to have my full node access my other computers would do the trick. But seeing how the limitations you pointed does point to this being a flawed idea, now I need to figure out how to do this properly. Can you point me in the right direction?
I do have videos on setting up harvesters for both Ubuntu and Windows. They are my first videos on Chia, so they might not be the best but they seem to be helpful for others to get their harvesters setup.
I believe the log file might spit out a warning for those drives based on another comment. I was unaware of this when creating the tool but I can definitely add logging this info in a future update.
Great video yet again! One question for you, why don't you add Chia location to your env variables in windows advanced settings. would make things a little easier.
I actually do have the chia directory added to my $ENV:Path variable using my profile script, so the step I showed in this video wasn't really necessary for me. I wanted to make the video self-contained which is why I didn't go into adding the the path to your env variable. This is a script I shared in a previous video to do it once that will persist for future updates though. $addToProfile = ' $chiapath = (get-item "$env:LOCALAPPDATA\Chia-Blockchain\app* esources\app.asar.unpacked\daemon\").fullname $env:Path = $env:Path + "; $chiapath" ' Add-Content -Path $profile.CurrentUserAllHosts -Value $addToProfile
@@SysDeskDev Ok I figured that was the intent, just wanted to make sure if anyone else was curious and didn't want to type out the chia.exe directory everytime that they knew this was the option.
You can run Get-Command -Module PSChiaPlotter. I haven't written much help for each command and there parameters (need more hours in the day). However, you can run, get-help start-chiaharvesterwatcher, to get a list of the parameters you can use.
The RGB value is scaled from 0 - 255. Closer to 0 will be greener and closer to 255 will be red. I plan on changing that part to last lookup time instead of RGB since that value doesn't really provide anything. I had the RGB there for my testing and didn't remove it.
HI been using this tool for a while and again I love it. Unfortunately it just stopped working for me, powershell will just hang and not do anything. The same on both my computers. Is it possibly a windows update thing or something with powershell itself? Any ideas are appreciated. Again great stuff I've subscribed with notifications on. You're other video with how to start the harvester with task scheduler also made life a whole lot easier!!
Hi there, excelent video! I've got No lines saying: x plots were eligible for farming .... Is there any problem with my farming? It says synced and farming on the GUI.... Thanks!!!
Did you set your logging level to INFO? These lines will only be created if you change the logging level to INFO, after doing that it does require to restart any chia services.
Thanks to your excellent tutorial on the Linux harvester setup, I'm running a Linux VM off my Nas for plots that I've stored there. As it's setup cli and reporting to the main farmer, how to I get debug logging info from the harvester - no GUI is running. Thanks so much for your great content.
hey man, is there a way to tell if i'm seeing the correct amount of challenges per minute on my plots from the logs? i was checking the problems that @Sloth Tech TV has had and i'm afraid i've got the same issue but i'm not sure how to verify that my harvester is working as intended. most of the times i see 0/159 plots passing filter, sporadically anything between 1 to 5
The content of this video seem to be excellent, I am having issues with timing responding to challenges, way over 5 seconds, problem is that have no idea how to use powershell, I tried following you along and its impossible, I hope you do something more "user friendly" for people like me without that deeper knowledge on CLI or Powershell as stated before. Thank you..
@@SysDeskDev Thank you for making these videos. My lookup times around 6-7 seconds on my harvester. Do you have advice or suggestions on what may be done to improve this time? Thank you.
Thanks for this wonderful informative video, I checked my log and found few challenges response time is more then 5 second. So, I guess now the obvious question is how can I keep the response below 5 seconds.. Please share if there is any solution. Thank you.
Some other comments have pointed out that you can change the disk's sleep time to never in device manager settings. If you are using a NAS you will need to check your internal network (network adapters, cables, switches, etc.)
you can monitor your log file in powershell too, just to see how things are going. Open powershell Change directory to chia log folder (eg cd C:\Users\Administrator\.chia\mainnet\log) or add the full path to the next line and run Get-Content debug.log -Wait -Tail 10 Use Control+C to terminate.
Great scripts! Is there any way to identify the drive that the slow look ups happened on? I've been experimenting with cloud drives but suspect theyr'e the source of my slow look ups :)
I believe there is a way to find which plot files are giving the slow look up times. I will have to review log files and see if I can integrate that into the script somehow.
@@SysDeskDev It would be a great addition. Help to narrow it down to a bad disk possibly. I'm also wondering what happens to these lookup times when stage 5 is occurring and it's copying a plot.
I get an error when using 'Start-ChiaHarvesterWatcher'. When I then type 'Set-ExecutionPolicy-ExecutionPolicy RemoteSigned' I do also get an error. So what can I do to run this? Thank you.
Hi NotAnotherTech Channel, None of my 230TB of plots are showing up in the farm in the GUI at all! and i cant figure out why! I even reset and resynced(for 2 days). it all happened after an unplanned power outage, but i dont know where to look to solve this issue. any help is greatly appreciated!
Does chiaharvesterwatcher command interferes with current pooling of my system? because as I started it it's loading those green boxes very slow comparing to what you have shown us in this video where it fills up pretty fast.
It depends how many logs your current log file, if it just cycle through a new log file it will only show a few to begin with. Log files are cycled through, so your might be fresh and have few logs to begin with.
Hey, this is working great but I have one question. How do you get to type again after running the harvester watcher, mines stuck and nothing I press will let me type more for other commands. Thank you!
So unfortunately you won't be able to type anything in the same powershell window as the Start-ChiaHarvesterWatcher once it starts running. If you do want that command to stop running you can hit ctl+c to end the command and then you can start typing again.
Start-ChiaHarvesterWatcher : The 'Start-ChiaHarvesterWatcher' command was found in the module 'PSChiaPlotter', but the module could not be loaded. For more information, run 'Import-Module PSChiaPlotter' I keep getting this error?
Sweet! - Trying it out in my home lab worked fine. However, in our big setup, with multiple harvesters connected to a farmer, I keep getting a powershell error: "Attempts were made to divide by zero " on line 484-char 17... Cant really see what going wrong here.
So looking over the script the only point I think that dividing by zero might happen is when it calculates the FilterRatio property... where it divides the eligible plots by total plots. So if any log lines have total plots at 0 then this error might occur. I think I might add couple lines to check if total plots equals 0.
@@SysDeskDev Yeah, that would make sense as this machine is only a farmer (dedicated farmer), so it has no plots on itself. And it is only when we started to scale ours up that we ran into problems we didn't know existed. Appreciate your work!
I have 162 PLOTS for now connected to Harvester and Plots passed filter is x/162 where x=1,2,3.. But in your case why the plots passed filter values are different?
Eligible plots = 11202, best time = .05687, worst time = 6..04684, Avg time = .36775, challenge per min = 6.406............. Is it safe to assume USB drives attacked to a USB hub will slow the lookup speeds?
That is a good question and I can say that it does not slow down at all ...IF... you enable write caching on each drive and the hub from the device manager, you enable this on each drive and then reboot. I have 2, 10 USB 3.0 hubs connected to my harvester and all are external HDDs, before enabling caching my best time was at 0.9 ish seconds and worst was around 12 full seconds :( Now my best time is 0.07809 seconds and my worst time is at 1.44 seconds, my watcher is all green now. Good Luck!
@@alejandrocordero3779 thanks...I will give that a try. I have another question....recently in windows I maxed out all my driver letters so I have since started to mount my remaining drives into a folder of another drive.....Does that in any way slow lookup speeds?
Hi!, I execute command: Start-ChiaHarvesterWatcher but nothing happens, it just stays there thinking, black PowerShell screen. What could be the issue?. Also, commando: Get-ChiaHarvesterActivity -DebugLogFilePath 'C:\Users\MyUser\.chia\mainnet\log\debug.log' do nothing as well. Thx
So.... any suggestions what to do if the time is way higher than 5 secs? I don't have a NAS, but a fairly new computer with SATA3 HDDs and 12 core Ryzen, so it shouldn't be a problem... but it is in my case
Thank you for your nice work! I can run Start-ChiaHarvesterWatcher with no issue but I can't make parameters work. It says: Start-ChiaHarvesterWatcher -Sensitivity A parameter cannot be found that matches parameter name Same with -Summary I already updated module with no fix Thank you
I am sorry, I recently updated the module and replaced that parameter with MaxLookUpSeconds since I made more intuitive sense. Also try out DarkMode that I just added as well.
I have also just installed chia on another PC (hopefully temporarily) and added all 230TB of plots, but only 31TB is showing up in the Farm overview? any idea how to check what is going wrong please?
So the default scale is is 0-5 as you said, and the sensitivity will basically times the end value be X amount. So if you do 2, then you effectively are dividing the default value of 5 by 2 which would result in a scale of 0 - 2.5.
I believe this should work on Linux, at least it did on my test on my Ubuntu machine. You will need to install Powershell 7 on the Linux system though.
Hi, I'm using powershell 7, and the output of the chiaharvestor doesn't output properly, it outputs like [48;2;59;255;0m just an example of one output, anyway to fix this?
Thanks for your tools and informations. My best time is 0,01351 and my worst time 496,65803. Worst time because of added network drive, which is already in use by move some plots to.
@@SysDeskDev I have plots on a second machine where my plots will be copied to after plotted. On the remote machine there is a dedicated harvester. But the farming folder where farmed on both the full node and the remote harvester. After plotting the directory is automatically added on full node. Which is annoying.
I'm a bit confused with the numbers it puts out ^^' My best time is 0.002 but my worst is 21,8 x.x (maybe cuz of copying or sth?) I got 0.05 on avg. soooo i don't have 2 worry to much right? Ow and thx alot for your vids btw! they are helping me alot!
So you can use it on Linux if you install powershell 7 on the system. However you might need to modify the powershell code a little for it to work properly. I have not done any testing on Linux with this module, but I might work on making it more compatible in the future. Right now my main focus is working on the GUI version of PSChiaPlotter however.
I have some on my cloud storage that are betwern 5 and 6 seconds why is this bad if the time lord grants you 28 seconds? That should still be enough or?
@@AdventureBert EDIT: Answered my own question in the comments below. Set log level to INFO in the config file. Original post: There was an option to enable it when installing? This is installing the chia blockchain right? I also do not see any time information.
@@evez19 username\.chia\mainnet\config\config.yaml find and change Log_level: INFO to match that. Restart GUI and after its running it should show the log properly.
The -Sensitivity parameter has been changed to -MaxLookUpSeconds, also there is now dark mode if you use the -DarkMode parameter.
Hi! Every time I code the Sensitivity it says a parameter cannot be found, any advise please.
@@rozelmerano5163 I changed the parameter from -Sensitivity to -MaxLookUpSeconds. Just replace -Sensitivity with -MaxLookUpSeconds.
@@SysDeskDev, It says now "Missing an argument for parameter 'MaxLookUpSeconds'. Specify a parameter of type
'System.Double' and try again." sorry I'm new to this.
@@rozelmerano5163 No worries, the default MaxLookUpSeconds is 5, so you can actually leave off that parameter if you don't want to change it. If you do want to change it then you will have give it a number of seconds you want, for instance 2. Or 10.
@@SysDeskDev thanks!!
This is a great tutorial btw -- I'm going to be sharing it on my channel ty for taking the time to put it together!
Thank you so much! I really appreciate that.
@@SysDeskDev found this video from Sloth's channel, really great stuff and TY both for making it.
Thank you for taking the time to make this video as well as writing the code! As a beginner in Chia Farming I've been needing this info. This is a great way to monitor everything!
Thank you for the introduction.
There were some hoops to get this working.
Needed to add the repository as trusted
also needed to allow the running of script (Powershell win 10)
Then it was smooth sailing, might want to add some instructions about it on the git (there are a lot of us that are very new to powershell)
Again thanks for the content and function.
Yes, I really need to update the readme on the github to make it more clear for those who are new to powershell. I am glad you were able to figure it out. I did put a video out going over some of the hoops, but it should be right there on the Github as you mention. I hope to get around to it soon.
Once again dude, your videos are so informative and valuable. Thank you, thank you. I used to go in my log file every while to search for these proof times and now no need anymore, this will save me so much time and effort.
Thank you so much, I am so happy you find this tool useful.
I just got into chia mining two weeks ago, learned a lot from your videos as no knowledge of powershell, got your "PSCHIA" installed and used it for delay time calculation, hope that I can catch up with powershell so I can use other great tools that you made, really hope you can made a windows GUI version of it, but still really appreciate all the time and efforts!!!
Thank you for putting time to this, I would love to follow on it but I'm super new to powershell and don't know my way around it, so if you could please make a tutorial for people like me it would be great xD
And again thank you for sharing your efforts and trying to help others
I am very thankful for your video! Thanks to you I was able to verify that it isn't my time to verify that is my non-winning, it's just my luck! I wasn't able to get the Install Module part to work, I'll have to rewatch for the 20th time, but I'm sure I'll get it.
I appreciate the time you take to share your knowledge!
I’m only learning new stuff with your vids, thank you 🙏
Happy to hear that!
Thank you, refreshing and on point presentations. Been doing things the hard way, so glad to have found your resources, best to date. your Integrity comes through. Great work!!
really nicly done we this is a great tool for having an oversight over your system because till now it was hard to figure out whats even happening with the miner really well done!
Great video. I read when I've got blue, I've found a proof. Does it mean I found a block too?
Good advice (I think/hope?). Finding that most of my lookups are also
Hey man great stuff.
BTW have you found a way to get the heatmap to also show result from harvesters?
Need this as well
Looks like you've got more responses than the video length, good going. Two things I need to know 1. does your tool improves the performance. 2. have you scored any chia? Thanks.
My tool only finds possible issues, it will not try to fix anything. I found chia in the first couple weeks of mainnet, but nothing in a long time. I have a very small farm - around 10 TB.
another excellent video. My list of commands to check chia keeps on growing. I did switch to swar chia plot manager. It seems to do exactly what I want even though plots seem to stall out on me randomly.
EligiblePlots BestTime WorstTime AvgTime FilterRatio ChallengesPerMinute
935 0.003 1.22471 0.03295 0.00199 -6.57296
This is such a useful tool! Thank you for this update.
Thank you!
Great video. I will do something like that for linux. Thank you so much for the valuable information you providing !!
Thanks for the content. I just found out with your video that i am getting some slow plots that are in a NAS... between 5 to 6 seconds. Is there any way to improve the performance while still using the NAS that i have?
Firstly, you are the reason why I started with Chia......Excellent work and excellent presentation!!!
In regards to the heat map, how you can Identify which plots exactly are orange or red in order to take actions?
as of right now there nothing to show which plot is causing the slow lookup time, but I will see if I can implement that in the future. Thank you so much for the kind words.
@@SysDeskDev Thank you for your prompt reply and thank you again for the tools that you are providing to all chia community!!!
Great Sharing. Maybe you can add the policy update into your description too,
Thank you for explaining things in terms an admin can understand.
Glad it was helpful!
Thank you for you hard work to create this very helpful script. I will be using it often.
Wow ! So thankful about this content. I am not only I am learning about Chia but also learning quite a few tricks on powershell. :-D
I found out that I have a horrible lookup range best being < 0.5 sec but worse is > 16 secs. Scary I know. Any idea why this could happen ? I have WD Gold 10tb drives hooked to a LSI SAS 9211-8i card ?
Thanks for all the videos man, really helping out the crowd here.
Would you perhaps be able to make a video on getting the Full node farmer to register all the plots of the harvester to show as part of total plots?
Read on github something about changing hostnames on harvester allows node to add those plots to total count but have no idea on how to go about it?
I'm pretty sure everyone needs this info
Cheers
Great tool, thanks for putting this out there. I'm personally using a bunch of external drives (yeah I know it isn't ideal but I couldn't bring myself to pay over $0.03 per GB on internal drives). Anyways my average times for all my plots is less than 0.1 seconds. I only had a couple flukes that were like 19 seconds but plots were probably being copied to that drive at the time. If anyone else is using external drives on windows I recommend changing the power settings both in the power plan settings and the device manager so windows doesn't power off the drives when idle. If you don't, the seek times are horrible since the drive has to kick on again when it receives a request.
That is a great recommendation, I wish I would have included it in the video!
Thanks for the tip. I turned it off in power options, how do you do it aswell under device manager? I too have some external drives, do you need to do this for usb, or does just doing it for hdd work ok?
@@anthonylee6252 In device manager, under "Universal Serial Bus controllers" you should find "USB Mass Storage Device". Open each one and you'll see a "Power Management" tab and then you just uncheck the box labeled "Allow the computer to turn off this device to save power". I personally am using a separate Intel NUC PC for my external farm drives so I also unchecked that in every USB hub as well. There's no real reason to leave it checked. Better safe than sorry.
@@jonamac brilliant. Thankyou!
Just got to the pc, I had 9 USB Hub showing, which I guess is one per slot on the 9 slot hub and no mass storage device, was able to adjust power settings as you said for each hub slot. Thanks again!
First off, thank you so much for this video tutorial! I have verified that my setup is working perfectly. 1 Question, on the PowerShell title bar, at the end, what does RGB mean? I notice the number keeps changing.
from the script it seems to determine 'live' (in the title bar) which lookup time it is currently 'reading' ... at the end it will show the color corresponding to your sensitivity scale
$RGB = [math]::Round((255 * $harvesterActivity.LookUpTime * $Sensitivity) / 5)
am I Right @NotAnotherTech Channel ?
Great tool. Thanks for this! What does blue blocks mean in the heatmap? I have a bunch of those throughout.
They are proofs found, most likely they are all pool proofs which are partial proofs for generating points, not full proofs for winning blocks.
Great tool. Thanks! My challenges per minute are negative 6.5 for some reason otherwise all looks normal.
Awesome tool and content, thanks a lot and hope that you`ll go on with those cool tech videos. Cheers and good luck.
Yet another great utility! Thank you so much for doing all this! Any possibility of making the heat map show a flashing block or something that really stands out on the off change you win a block in one of them?
I wish that was possible, and it technically might be, but the results would be undesirable since you would have to rewrite the entire buffer every flash. Another option would to be make it a different color like blue or something. Powershell is incredibly versatile, but it does have limitations. I will look into adding a found proof color in the future if I find time. Thank you for watching and the nice comment, I really appreciate it.
Nice clean video again! Is there also a way to speed up the times ? I mean is the time also dependable on the harvester system itself?
I think one way it to set your HDD to never sleep in the power setting or in device manager.
hey great video! One follow up question is: what happens after I identified the lookup time is too slow? Any thought on how to optimize it ? Thanks!
I had the same exact thought! I am switching to a 2.5G network, hoping this may help. My looking up times used to be way under a seconds, but after few thousand of plots, it's over a second now
Hey there
Great video and I have the great green screen. Have a few red and orange spots is the an easy way to find out why they are red and delete if possible. Or to find out if it's one Drive not working properly. Thanks again
Any suggestions how to fix below error ? Great video and tool, thank you !
PS C:\Windows\system32> Start-ChiaHarvesterWatcher
Start-ChiaHarvesterWatcher : The 'Start-ChiaHarvesterWatcher' command was found in the module 'PSChiaPlotter', but the
module could not be loaded. For more information, run 'Import-Module PSChiaPlotter'.
At line:1 char:1
+ Start-ChiaHarvesterWatcher
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : ObjectNotFound: (Start-ChiaHarvesterWatcher:String) [], CommandNotFoundException
+ FullyQualifiedErrorId : CouldNotAutoloadMatchingModule
Fixed by running a command > set-ExecutionPolicy -ExecutionPolicy RemoteSigned as shown in the previous video on this channel. Thanks for the great info and tools!
Love your video and your tool is way better than chia harvester graph!!!
-is there any way to get this running on Linux (raspbian x64) ?
- btw. What does the RGB count mean?
thanks for the great tutorial. but what are the possible issues that can make the lookup time more than 5 seconds? is it only an internet connection? what would be the slowest internet (ping and download rate) that can run this without trouble?
but how can we speed up the slow plots ? it depends on what ? internet speed or hard drive speed or what ?
thanks
I made a video about this -- plotting is hard. Its a slow process in general.
@@SlothTechTV no i am not talking about plotting , i mean when the logs shows that after plots pass the filter, time is over 5 seconds , how can we fix it to be from 2 to 5 seconds ?or better less than 2 seconds ?
Thanks
Thank you for this video!
In the -Summary under column ChallengesPerMinute I get negative values?
That is interesting... so the challenges per minute is calculated by subtracting the first activity log from the last one and dividing the total minutes past between those two by the total number of activity logs. Not sure how the value cold be negative from this.
Very well put and explained. Thanks for the work!
Glad you enjoyed it!
Thank you for the great video. Are there any methods you know that can be used to reduce the lookup times that are more than 5 seconds?
I have heard changing the power state of the drives to be always awake helps. Better network connection if your dries are on a NAS.
How did you make the command line work at (09:05)? I need to start a new PS window, because it won't let me type.
Ctrl + C
mine sweeper...love it!
It does look like mine sweeper XD haha
my question is this, the less than 2 seconds is just validating the time and that we are in fact farming efficiently, I monitor this pretty often just to make sure as well.
yeah everything under 2 seconds is golden based on what I read. Even if you have some that are above 2 seconds but still under 5 seconds than it should be okay but it is worth keeping a closer eye on it. What tool do you use to monitor the lookup times, I know there are quite a few out there already that are pretty good.
Hi Poor Investor :D It's me your subsciber :) have you tried the above mine sweeper trick?
I am learning a lot with your videos. Awesome workd
I am happy to hear that! Thank you!
How can I tell ChiaHarvesterActivity to look into a different folder? Just wondering how can I check logs stored in different destinations other than mainnet\log
This was definitely eye-opening. My best is .796, worst is 579.29. Average about 1.3. I'm thinking this is when one of my harvesters is writing a plot to the NAS. Since all my harvesters write plots to the same place, they can create a bottleneck. Since the full node is also reading the NAS folder, is there a way to keep the harvesters from doing lookups and just let the full node do lookups by itself?
Great walkthrough and code. Thank you so much!
Glad you enjoyed it!
Thanks for the great video.
But the command get-chiaharvesteractivity -summary is showing 3000+ plots... I have less than 300 ???
Have I been added to a pool against my will ?
I see a lot of this "node.mempool_manager" in the log files ???
Glad you liked it!
Hi thanks for your videos. I am looking at the log of my pc and I found many errors that do not appear in the CHIA GUI. Could you help me decipher these errors, I have no idea what it could be.
2021-06-01T05:14:05.282 full_node full_node_server : WARNING Invalid handshake with peer. Maybe the peer is running old software.
2021-06-01T04:51:10.258 full_node full_node_server : ERROR Exception: Failed to fetch block 367216 from None, timed out , closing connection None. Traceback (most recent call last):
ValueError: Failed to fetch block 364742 from None, timed out
2021-05-30T21:04:36.259 full_node full_node_server : WARNING Banning 51.15.216.154 for 10 seconds
I have many of these errors
thanks for the help
Thanks for the tutorial. I just closed my GUI and delete the debug.log file as I need to add one more external hard disk (full with plots) to my farming pc. When I restarted the GUI, I found my new debug file only 2kb and not updating by far. Do I have to give it sometime for updating?
My look up times are typically OK at best, and sometimes absolutely atrocious ocean. Is there any way you could do a video on how to improve look up times, ideally dealing on windows systems
Hi, this is great. Do you have a tutorial on how to set up a harvester machine? I have tried using the one in the Chia Official wiki but can't seem to get it to work. Initially i thought a workaround to set network folders to have my full node access my other computers would do the trick. But seeing how the limitations you pointed does point to this being a flawed idea, now I need to figure out how to do this properly. Can you point me in the right direction?
I do have videos on setting up harvesters for both Ubuntu and Windows. They are my first videos on Chia, so they might not be the best but they seem to be helpful for others to get their harvesters setup.
Thank you for all your hard work! You're amazing!
Wow, thank you!
Very interesting! Do you know if there’s a way to identify which drives are generating those longer times?
I believe the log file might spit out a warning for those drives based on another comment. I was unaware of this when creating the tool but I can definitely add logging this info in a future update.
@@SysDeskDev that would be a great addition to the tool! Thanks! And great job btw!
Great video yet again! One question for you, why don't you add Chia location to your env variables in windows advanced settings. would make things a little easier.
I actually do have the chia directory added to my $ENV:Path variable using my profile script, so the step I showed in this video wasn't really necessary for me. I wanted to make the video self-contained which is why I didn't go into adding the the path to your env variable. This is a script I shared in a previous video to do it once that will persist for future updates though.
$addToProfile = '
$chiapath = (get-item "$env:LOCALAPPDATA\Chia-Blockchain\app*
esources\app.asar.unpacked\daemon\").fullname
$env:Path = $env:Path + "; $chiapath"
'
Add-Content -Path $profile.CurrentUserAllHosts -Value $addToProfile
@@SysDeskDev Ok I figured that was the intent, just wanted to make sure if anyone else was curious and didn't want to type out the chia.exe directory everytime that they knew this was the option.
Cool stuff, wondering where to find a complete list of tools in the package and list of options?
You can run Get-Command -Module PSChiaPlotter. I haven't written much help for each command and there parameters (need more hours in the day). However, you can run, get-help start-chiaharvesterwatcher, to get a list of the parameters you can use.
I always watch it. Thank you.
Thank you too
What RGB (at window title) means in Start-ChiaHarvesterWatcher ?
The RGB value is scaled from 0 - 255. Closer to 0 will be greener and closer to 255 will be red. I plan on changing that part to last lookup time instead of RGB since that value doesn't really provide anything. I had the RGB there for my testing and didn't remove it.
works like a charm, thank you for sharing this
Great to hear!
HI been using this tool for a while and again I love it. Unfortunately it just stopped working for me, powershell will just hang and not do anything. The same on both my computers. Is it possibly a windows update thing or something with powershell itself? Any ideas are appreciated. Again great stuff I've subscribed with notifications on. You're other video with how to start the harvester with task scheduler also made life a whole lot easier!!
Hi there, excelent video!
I've got No lines saying: x plots were eligible for farming .... Is there any problem with my farming? It says synced and farming on the GUI....
Thanks!!!
Did you set your logging level to INFO? These lines will only be created if you change the logging level to INFO, after doing that it does require to restart any chia services.
@@SysDeskDev Yeah, this was the problem. Thank you!
If its running slow, is there some video you can do to show what we can do to fix?
How did you brought GitHub:\> ? Instead of c:\>
me too - I dont have this GitHub:\>
@@andreila install GitHub. It will work after that
Thanks to your excellent tutorial on the Linux harvester setup, I'm running a Linux VM off my Nas for plots that I've stored there. As it's setup cli and reporting to the main farmer, how to I get debug logging info from the harvester - no GUI is running. Thanks so much for your great content.
Go to ~/chia-blockchain/venv/bin then type ./chia configure -log-level DEBUG
hey man, is there a way to tell if i'm seeing the correct amount of challenges per minute on my plots from the logs? i was checking the problems that
@Sloth Tech TV has had and i'm afraid i've got the same issue but i'm not sure how to verify that my harvester is working as intended. most of the times i see 0/159 plots passing filter, sporadically anything between 1 to 5
Just wanted to say thanks for your work!
I appreciate that!
The content of this video seem to be excellent, I am having issues with timing responding to challenges, way over 5 seconds, problem is that have no idea how to use powershell, I tried following you along and its impossible, I hope you do something more "user friendly" for people like me without that deeper knowledge on CLI or Powershell as stated before. Thank you..
I am sorry that couldn't walk you through powershell. If you let me know which step you got stuck on I can try to help.
@@SysDeskDev Thank you for making these videos. My lookup times around 6-7 seconds on my harvester. Do you have advice or suggestions on what may be done to improve this time? Thank you.
Thanks for this wonderful informative video, I checked my log and found few challenges response time is more then 5 second. So, I guess now the obvious question is how can I keep the response below 5 seconds.. Please share if there is any solution. Thank you.
Thats the problem, you can maybe see the problem but you cant solve it.
Some other comments have pointed out that you can change the disk's sleep time to never in device manager settings. If you are using a NAS you will need to check your internal network (network adapters, cables, switches, etc.)
you can monitor your log file in powershell too, just to see how things are going.
Open powershell
Change directory to chia log folder (eg cd C:\Users\Administrator\.chia\mainnet\log) or add the full path to the next line and run
Get-Content debug.log -Wait -Tail 10
Use Control+C to terminate.
For sure! This is the method I use to get the data for the output of this function. This function just presents it in my digestible manner.
@@SysDeskDev do you know how to limit the powershell screen output to only lines that has certain text in it, like "Time:"?
Extremely useful! Thank you!
Glad it was helpful!
Great scripts! Is there any way to identify the drive that the slow look ups happened on? I've been experimenting with cloud drives but suspect theyr'e the source of my slow look ups :)
I believe there is a way to find which plot files are giving the slow look up times. I will have to review log files and see if I can integrate that into the script somehow.
@@SysDeskDev It would be a great addition. Help to narrow it down to a bad disk possibly. I'm also wondering what happens to these lookup times when stage 5 is occurring and it's copying a plot.
I get an error when using 'Start-ChiaHarvesterWatcher'. When I then type 'Set-ExecutionPolicy-ExecutionPolicy RemoteSigned' I do also get an error. So what can I do to run this? Thank you.
Could you please make another video for introducing the Chia plots Graph? thxxx
Hi NotAnotherTech Channel, None of my 230TB of plots are showing up in the farm in the GUI at all! and i cant figure out why! I even reset and resynced(for 2 days). it all happened after an unplanned power outage, but i dont know where to look to solve this issue. any help is greatly appreciated!
Does chiaharvesterwatcher command interferes with current pooling of my system? because as I started it it's loading those green boxes very slow comparing to what you have shown us in this video where it fills up pretty fast.
It depends how many logs your current log file, if it just cycle through a new log file it will only show a few to begin with. Log files are cycled through, so your might be fresh and have few logs to begin with.
Hey, this is working great but I have one question. How do you get to type again after running the harvester watcher, mines stuck and nothing I press will let me type more for other commands. Thank you!
So unfortunately you won't be able to type anything in the same powershell window as the Start-ChiaHarvesterWatcher once it starts running. If you do want that command to stop running you can hit ctl+c to end the command and then you can start typing again.
@@SysDeskDev Thank you for the explantion!
Start-ChiaHarvesterWatcher : The 'Start-ChiaHarvesterWatcher' command was found in the module 'PSChiaPlotter', but the
module could not be loaded. For more information, run 'Import-Module PSChiaPlotter'
I keep getting this error?
Run, Set-ExecutionPolicy -ExecutionPolicy RemoteSigned
@@SysDeskDev Do you know what "size of mempool: 4 spend"
Means?
Or "It took 0.0 to pre-validate transaction"
Thanks a lot
@@SysDeskDev Fixed it, thanks buddy
Sweet! - Trying it out in my home lab worked fine. However, in our big setup, with multiple harvesters connected to a farmer, I keep getting a powershell error: "Attempts were made to divide by zero " on line 484-char 17... Cant really see what going wrong here.
So looking over the script the only point I think that dividing by zero might happen is when it calculates the FilterRatio property... where it divides the eligible plots by total plots. So if any log lines have total plots at 0 then this error might occur. I think I might add couple lines to check if total plots equals 0.
@@SysDeskDev Yeah, that would make sense as this machine is only a farmer (dedicated farmer), so it has no plots on itself. And it is only when we started to scale ours up that we ran into problems we didn't know existed. Appreciate your work!
I have 162 PLOTS for now connected to Harvester and Plots passed filter is x/162 where x=1,2,3..
But in your case why the plots passed filter values are different?
If you have sufficient ram 300Gb is there any benefit in runing a ramdisk to speed up plotting?
Get-ChiaHarvesterActivity not recognized as a command/function? should i install something else?
Did you already install/update the PSChiaPlotter module? Can you do Import-Module -Name PSChiaPlotter?
@@SysDeskDev Thanks! i updated and it's working now
@@SysDeskDev I get the about_Execution_Policies error
(I found your other comment and now it's fixed. Thank you again!)
Eligible plots = 11202,
best time = .05687,
worst time = 6..04684,
Avg time = .36775,
challenge per min = 6.406.............
Is it safe to assume USB drives attacked to a USB hub will slow the lookup speeds?
That is a good question and I can say that it does not slow down at all ...IF... you enable write caching on each drive and the hub from the device manager, you enable this on each drive and then reboot. I have 2, 10 USB 3.0 hubs connected to my harvester and all are external HDDs, before enabling caching my best time was at 0.9 ish seconds and worst was around 12 full seconds :(
Now my best time is 0.07809 seconds and my worst time is at 1.44 seconds, my watcher is all green now. Good Luck!
@@alejandrocordero3779 thanks...I will give that a try. I have another question....recently in windows I maxed out all my driver letters so I have since started to mount my remaining drives into a folder of another drive.....Does that in any way slow lookup speeds?
Hi!, I execute command: Start-ChiaHarvesterWatcher but nothing happens, it just stays there thinking, black PowerShell screen. What could be the issue?. Also, commando: Get-ChiaHarvesterActivity -DebugLogFilePath 'C:\Users\MyUser\.chia\mainnet\log\debug.log' do nothing as well. Thx
So.... any suggestions what to do if the time is way higher than 5 secs? I don't have a NAS, but a fairly new computer with SATA3 HDDs and 12 core Ryzen, so it shouldn't be a problem... but it is in my case
Thank you good video! Real men 🚀
Appreciate that
Thank you for your nice work!
I can run Start-ChiaHarvesterWatcher with no issue but I can't make parameters work.
It says:
Start-ChiaHarvesterWatcher -Sensitivity
A parameter cannot be found that matches parameter name
Same with -Summary
I already updated module with no fix
Thank you
I am sorry, I recently updated the module and replaced that parameter with MaxLookUpSeconds since I made more intuitive sense. Also try out DarkMode that I just added as well.
Finally I used -MaxLookUpSeconds and -NoWalls, everything ok
Hi 👋🏻 I appreciate your work
Can you help me with this issue
"Cannot connect to host - ssl:
I have also just installed chia on another PC (hopefully temporarily) and added all 230TB of plots, but only 31TB is showing up in the Farm overview? any idea how to check what is going wrong please?
Hey! Great tutorial! Any way to use this tool on a Mac? Thanks!
If you install Powershell 7, then this particular command "should" work on Mac. But I have not tested it out.
i dont see im my taskmanager a TIMELORD.exe like the fullnode.exe or farmer.exe ? is it ok? or timelord must be ON ?
What can I do if my lookup Times are over 5 second all hdds connected via sata 😱
Hello , We need speed checker for the new farmers ( flax , rosechain , chaingreen , spare ) if you please :)
How does the sensitivity work? Is that value the divider for the default 0-5sec?
So the default scale is is 0-5 as you said, and the sensitivity will basically times the end value be X amount. So if you do 2, then you effectively are dividing the default value of 5 by 2 which would result in a scale of 0 - 2.5.
How would you go about monitoring this with Linux? What adaptations are necessary?
I believe this should work on Linux, at least it did on my test on my Ubuntu machine. You will need to install Powershell 7 on the Linux system though.
Hi, I'm using powershell 7, and the output of the chiaharvestor doesn't output properly, it outputs like [48;2;59;255;0m just an example of one output, anyway to fix this?
Thanks for your tools and informations. My best time is 0,01351 and my worst time 496,65803. Worst time because of added network drive, which is already in use by move some plots to.
Do do you have some of plots on network drives rather than on the harvester machine itself? I had that setup when I first started.
@@SysDeskDev I have plots on a second machine where my plots will be copied to after plotted. On the remote machine there is a dedicated harvester. But the farming folder where farmed on both the full node and the remote harvester. After plotting the directory is automatically added on full node. Which is annoying.
Okay, I missed to add the -x [exclude final dir] to my plotting script
I'm a bit confused with the numbers it puts out ^^'
My best time is 0.002 but my worst is 21,8 x.x (maybe cuz of copying or sth?)
I got 0.05 on avg. soooo i don't have 2 worry to much right?
Ow and thx alot for your vids btw! they are helping me alot!
Great video man. Really appreciate it. Any chance to make PSChiaPlotter to install in Linux?
So you can use it on Linux if you install powershell 7 on the system. However you might need to modify the powershell code a little for it to work properly. I have not done any testing on Linux with this module, but I might work on making it more compatible in the future. Right now my main focus is working on the GUI version of PSChiaPlotter however.
@@SysDeskDev Thank you very much Sir.
I have some on my cloud storage that are betwern 5 and 6 seconds why is this bad if the time lord grants you 28 seconds? That should still be enough or?
I won 2 on Monday after 2 weeks plotting right around 580 mark. My .chia log doesn't show any of the time information, any ideas?
Nm when I reinstalled I didn't enable it duh.
@@AdventureBert EDIT: Answered my own question in the comments below. Set log level to INFO in the config file. Original post: There was an option to enable it when installing? This is installing the chia blockchain right? I also do not see any time information.
@@evez19 username\.chia\mainnet\config\config.yaml find and change Log_level: INFO to match that. Restart GUI and after its running it should show the log properly.
@@AdventureBert What is change?