Linux Version of Cosmic Clarity Sharpen and Denoise compiled!!! The stand alone is up and running. I still have to fully vet the script interface with PixInsight but that shouldn't stop anyone from using the standalone! Site: www.setiastro.com/cosmic-clarity Drive: drive.google.com/drive/folders/1hB2qeMF7YQH1-Vr81udvNfd_NB6RKBT0?usp=drive_link
Fantastic, Frank. I've got some data that I'm going to try it on, in just a couple hours. This is amazing and what's more your entire suite of scripts is making a huge impact in Astro imaging and in the right way! Thank you.
@@dennysturcotte3736 if you didnt see my other posts on it. I have been in communocations with the developers of siril. The ability to integrate mine with siril is not there yet. They let me access a super pre build of a future version to play with, but until that is released we cant integrate it. The future looks amazing though for siril being able to directly incorporate the python code for my programs into siril, it just wont be that soon
Hola Frank: Ya lo probé y realmente es muy bueno. Te agradezco por semejante trabajo. Es uno de los mejores script para PixInsight. Mi prueba en Eta Carinae Nebula OSC es indistinguible de BlurXTerminator Trial. Saludos desde Buenos Aires y buenos cielos. Rodolfo
This is fantastic! Tried it out on all levels (0.1-0.9) on stand alone. Very happy with the denoise quality. I didn't see the difference between the different intensity levels, but I tested on Ha and Oiii luminance only tifs. When I tried it on a png I did notice the different results (maybe I'm imagining it). I even tried running it through Cosmic Clarity first at a strength of "1", then ran it through denoise. Doing this actually improved the result, but the result was the same from 0.1 -0.9. Tiffs are 32 bit saved from Siril. Edit: just saw your update, I'll try that. Edit Edit : Worked!
I am working with the siril developers, right now siril has now way of incorporating any 3rd party software, or even calling on 3rd party software. They do have a far future version they are working on to allow this, but for now you cant
Hii!! Thank you so much. You are making it possible for us to use great tools while keeping our astro on a budget. Though I don't know what I'm doing wrong but I can't make CosmicClarity-Denoise to work on my RGB images on Full denoise. The only workaround i found is to separate the 3 channels, run a luminance-only denoise on each one and then recombine RGB channels again. If there's anything I should know, please tell me. Massive thanks again!!
You shouldnt need to do that. Are you in pixinsight using the script or standalone? It is really important that you either use 32bit floating point tiffs or png
@@setiv2 I'm using the standalone version, and I'm using 32bit float point RGB images. I'm exporting them from GIMP (I really keep things cheap), maybe there's a setting I'm using when exporting the image?
Maybe. Let me export one from gimp and see if i can replicate it. What is it doing? Does the output look all weird or did it throw an error? You can always email me at frank@setiastro.com too
Ok so gimp only can export as 16bit. You should install and process in Sirl . It is free and designed for astroimaging. That has no problem exporting as 32bit as well
@@setiv2 Okay!! so GIMP is lying when it says that its working in 32bits?? Normally I use Siril, I was just doing a couple of steps in gimp prior to the Denoise. Thanks again
Thank you very much for making a Linux compatible version. Look forward to using in the near future. Is there any special code needed to install on Linux Mint?
Hi, after downloading Cosmic Clarity for Linux, unzipping and checking I have the most recent model files nothing then happens when I click on either exe file for sharpening and denoising. I have added my images into the input folder for the software to work with. I'm new to Linux BTW. Hope you wil be able help. Cheers.
I've been testing the denoiser today. I get mixed. Somtimes NXT is a smidge better, sometimes Cosmic. NXT seems to handle lower levels of information a bit better. But I bet with a little more development you'll be about on par. BTW, NXT also works in Affinity Photo. Probably in PhotoShop, too, but I am not sure.
@@SKYST0RY for a freebie tool i cant complain at its current state. I know there are some other free options too, i think it does better or on par with them as well. I made mine specifically trained on mono data since deepsnr cant work with mono data and I wanted a good alternative for mono data. I am not done improving the models either. Once I get real time satellite trail removal up and running it will be model improvement time for all of them.
@@setiv2 The pace which you do this is amazing. No complaints on my part. People have been asking me to test your tools so I thought I'd give them a trial run today since it's been raining and raining and raining, and I don't have any new data to work with. They really are impressive. I keep trying to figure out why sometimes RC Astro gives better results and sometimes Cosmic Clarity gives better results. I can't seem to find a common thread. You probably have thoughts on that.
@SKYST0RY probably comes down to not only a difference in training data but the architecture of the neural nets used too. Just like graxpert denoise, deepsnr, etc sometimes one does better than the other. Me personally i try them all and use the best for my image. Like gradient removal, usually ADBE is the best but sometimes graxpert if better. Use the tool the works the best. The more we have the better.
@@setiv2 Thank you. Everyone has been asking me to try out Cosmic Clarity so I just completed a video on it. Your work is very close to becoming a new standard of excellence, I think.
@SKYST0RY looking forward to watching it! The creator of siril just sent me a note too that they are able to start integrating my scripting into siril as well. So the future is bright for a whole chunk of the community out there!
anyone else having problems with Malwarebite trashing the 2 files? its blocking AI files in the folder and now they are gone out of pixinsight script menu ....
Great stuff. Would love to see a PI+Linux version tough. I'm a Java dev first and foremost and only dabble in Python occasionally, but I do have packaging experience on Linux and daily drive it as my main OS.
Linux Version of Cosmic Clarity Sharpen and Denoise compiled!!! The stand alone is up and running. I still have to fully vet the script interface with PixInsight but that shouldn't stop anyone from using the standalone! Site: www.setiastro.com/cosmic-clarity Drive: drive.google.com/drive/folders/1hB2qeMF7YQH1-Vr81udvNfd_NB6RKBT0?usp=drive_link
Hi, and thank you for your amazing work on these tools. I am using the standalone version and everything works without errors however the denoising strength setting does not seem to impact the denoising level, I thought the denoising was too much at 0.7 so tried at various levels from 0.1 to 0.9 and all seem to produce the same very smooth possibly overly denoised output. I am testing on a 32 bit colour tiff, any thoughts?
ok thanks for the feedback. it was missing out of the recompile portion of the code. it is fixed now. please download the latest program drive.google.com/drive/folders/1mmUFuClcdBtj_IRjPwS8aVu1gomhVlG_?usp=drive_link
One more comment. I noticed that when I run images through Cosmic Clarity I get an odd 5 pixel border around the final result. It's like it's ignoring a 5 pixel frame during the process.
Not sure what you mean. You added the cosmic clarity repository to pixonsight and it didnt show up in scripts->seti astro? If not go to scripts->feature scripts->add. Then navigate to c:/program files/pixinsight/src/scripts and click Select Folder. PI should then relook through the folder and add any it missed
So for PixInsight there is the repository. That installs the script to interface with the CosmicClarity program. You still need to download the mac version of cosmicclarity. Then the first time you run Cosmic Clarity from within PI use the wrench icon to tell the script where you have the cosmic clarity folder
I say yes to use GPU but I the monitor window always says "Using device: cpu" and the Windows 11 Task Manager indicates very little GPU utilization. Is that normal?
Error, both non Linear and Linear "Failed to delete denoised file: D:/Install/_Billed redigering/Astro/Cosmic Clarity - AI Based Sharpening and Denoising\output\masterLight_BIN_1_4144x2822_EXPOSURE_60_00s_FILTER_NoFilter_RGB_integration_denoised.tif"
Is your windows set up to handle path names that long? There may be an error there if you haven't updated your registry to accomodate paths that long. you can also just try putting the cosmicclarity folder directly in D: and not within all those subfolders.
Scripting in siril is extremely basic. I do not believe this can be interfaced, but if any hat makes scripts iin siril wants to try I am more than willing to assist them
Oh really? I heard that 0.8-0.9 drop shrink should be used while drizzling so I was doing just that blindly. Are there any drawbacks to the setting you mentioned?
That is a crazy aggressive drop shrink. You are doing more harm than good unless you have A LOT of data to drizzle. And deepsnr still wont denoise anything mono
@@blufferblue1599 The only two drawbacks I can think of the top of my head is that if you don't have enough dithered subs (that is less than ~60 or so) you'll end up with "dry" pixels, that is black dots all throughout the image and there's a slight decrease in SNR. Which, in my opinion, you shouldn't care about since when you're drizzling you're not going after the SNR anyway, but rather after the resolution and detail, which if you don't set your dropshrink low enough, doesn't increase all that much.
@@setiv2 Not at all. If you're drizzling 2x and set the dropshrink to something like 0.9 you almost won't notice the additional resolution, ever after deconvolution. In fact, 0.3-0.4 DS is commonly recommended for 1x drizzling with OSC cameras if one wants to use DeepSNR.
Works with anything that can save a 32bit tiff or png. Just export your image to the input folder. Run the program, it will save the processed image in the output folder. Re open that in siril
I do this as a hobby and I am not in software design. Adding learning a 3rd operating system is going to take me time, not to mention installing a 3rd operatint system. I am more than happy to help and share my python code if someone with linux wants to generate the executable from them
@@setiv2 I know, it was more a general question to all the viewers. It is great, can you put the python code to some place, where someone could reach and try to port it to linux? I could also give a try, though I am at a very novice level in Python.
Linux Version of Cosmic Clarity Sharpen and Denoise compiled!!! The stand alone is up and running. I still have to fully vet the script interface with PixInsight but that shouldn't stop anyone from using the standalone! Site: www.setiastro.com/cosmic-clarity Drive: drive.google.com/drive/folders/1hB2qeMF7YQH1-Vr81udvNfd_NB6RKBT0?usp=drive_link
All were useless, losing so many faint details in the process. That said, some noise is actually useful, it gives our brain the chance to its process and feel some detail patterns. Just compare old camera images like Nokia images with today’s washed out cell phone camera images.
Linux Version of Cosmic Clarity Sharpen and Denoise compiled!!! The stand alone is up and running. I still have to fully vet the script interface with PixInsight but that shouldn't stop anyone from using the standalone!
Site: www.setiastro.com/cosmic-clarity
Drive: drive.google.com/drive/folders/1hB2qeMF7YQH1-Vr81udvNfd_NB6RKBT0?usp=drive_link
Wow, many thanks! I made a Docker container with Ubuntu 24.04 base image, and it works. Thanks!
Unfortunately, denoise is not working on Linux standalone:
./SetiAstroCosmicClarity -denoise
usage: SetiAstroCosmicClarity [-h] [--sharpening_mode {Stellar Only,Non-Stellar Only,Both}]
[--nonstellar_strength NONSTELLAR_STRENGTH]
[--stellar_amount STELLAR_AMOUNT] [--disable_gpu]
SetiAstroCosmicClarity: error: unrecognized arguments: -denoise
@@Steve-bv7cm looks like you typed in denoise in the argument. Yyou should only be typing full or luminance
Ohhhh you are on sharpening not denoise.
Denoise is the program labelled setiastrocosmicclarity_denoise
Thank you so much, you are doing a huge service for the community by offering such a powerful tool for free. Just absolutely incredible.
Just wow! Thanks for all your doing for the astronomical community.
Fantastic, Frank. I've got some data that I'm going to try it on, in just a couple hours. This is amazing and what's more your entire suite of scripts is making a huge impact in Astro imaging and in the right way! Thank you.
Thanks very much for your work. I will be including this in my workflow.
THANKS , im going to try it right now!
Thanks again Frank. Amazing work.
Integration into Siril would be the icing on the cake for those of us without PI.
I need to figure that out. I dont even know how to do an stf in siril so I better get up to speed lol
I too would love to see that. Thanks for the SW Frank.
@@dennysturcotte3736 if you didnt see my other posts on it. I have been in communocations with the developers of siril. The ability to integrate mine with siril is not there yet. They let me access a super pre build of a future version to play with, but until that is released we cant integrate it. The future looks amazing though for siril being able to directly incorporate the python code for my programs into siril, it just wont be that soon
Just tried this on my M2 Max apple silicon machine, runs super fast! Amazing :D Thank you for this
Looks great Frank. Looking forward to giving it a try.
Hola Frank: Ya lo probé y realmente es muy bueno. Te agradezco por semejante trabajo. Es uno de los mejores script para PixInsight. Mi prueba en Eta Carinae Nebula OSC es indistinguible de BlurXTerminator Trial.
Saludos desde Buenos Aires y buenos cielos.
Rodolfo
Sweet! I look forward to using it after work.
May God bless you for your hard work!
This is fantastic! Tried it out on all levels (0.1-0.9) on stand alone. Very happy with the denoise quality. I didn't see the difference between the different intensity levels, but I tested on Ha and Oiii luminance only tifs. When I tried it on a png I did notice the different results (maybe I'm imagining it).
I even tried running it through Cosmic Clarity first at a strength of "1", then ran it through denoise. Doing this actually improved the result, but the result was the same from 0.1 -0.9. Tiffs are 32 bit saved from Siril.
Edit: just saw your update, I'll try that.
Edit Edit : Worked!
Thank you.
Another fantastic tool. Brilliant.
A very nice tool. Helps me a lot with my start. Would be nice to have it in Siril. Are there plans for that?
I am working with the siril developers, right now siril has now way of incorporating any 3rd party software, or even calling on 3rd party software. They do have a far future version they are working on to allow this, but for now you cant
@@setiv2 But StarNet++ is working in Siril, too and that is a 3rd party software or not?
@@setiv2 But StarNet++ is also working with Siril and it is a 3rd party software.
Amazing work !
Thanks so much!
Hii!! Thank you so much. You are making it possible for us to use great tools while keeping our astro on a budget. Though I don't know what I'm doing wrong but I can't make CosmicClarity-Denoise to work on my RGB images on Full denoise. The only workaround i found is to separate the 3 channels, run a luminance-only denoise on each one and then recombine RGB channels again. If there's anything I should know, please tell me. Massive thanks again!!
You shouldnt need to do that. Are you in pixinsight using the script or standalone? It is really important that you either use 32bit floating point tiffs or png
@@setiv2 I'm using the standalone version, and I'm using 32bit float point RGB images. I'm exporting them from GIMP (I really keep things cheap), maybe there's a setting I'm using when exporting the image?
Maybe. Let me export one from gimp and see if i can replicate it. What is it doing? Does the output look all weird or did it throw an error? You can always email me at frank@setiastro.com too
Ok so gimp only can export as 16bit. You should install and process in Sirl . It is free and designed for astroimaging. That has no problem exporting as 32bit as well
@@setiv2 Okay!! so GIMP is lying when it says that its working in 32bits?? Normally I use Siril, I was just doing a couple of steps in gimp prior to the Denoise. Thanks again
Good job.
Thank you very much for making a Linux compatible version. Look forward to using in the near future. Is there any special code needed to install on Linux Mint?
I dont believe you need anything special.
Hi, after downloading Cosmic Clarity for Linux, unzipping and checking I have the most recent model files nothing then happens when I click on either exe file for sharpening and denoising. I have added my images into the input folder for the software to work with. I'm new to Linux BTW. Hope you wil be able help. Cheers.
thank you! it's excellent!
I've been testing the denoiser today. I get mixed. Somtimes NXT is a smidge better, sometimes Cosmic. NXT seems to handle lower levels of information a bit better. But I bet with a little more development you'll be about on par. BTW, NXT also works in Affinity Photo. Probably in PhotoShop, too, but I am not sure.
@@SKYST0RY for a freebie tool i cant complain at its current state. I know there are some other free options too, i think it does better or on par with them as well. I made mine specifically trained on mono data since deepsnr cant work with mono data and I wanted a good alternative for mono data. I am not done improving the models either. Once I get real time satellite trail removal up and running it will be model improvement time for all of them.
@@setiv2 The pace which you do this is amazing. No complaints on my part. People have been asking me to test your tools so I thought I'd give them a trial run today since it's been raining and raining and raining, and I don't have any new data to work with. They really are impressive. I keep trying to figure out why sometimes RC Astro gives better results and sometimes Cosmic Clarity gives better results. I can't seem to find a common thread. You probably have thoughts on that.
@SKYST0RY probably comes down to not only a difference in training data but the architecture of the neural nets used too. Just like graxpert denoise, deepsnr, etc sometimes one does better than the other. Me personally i try them all and use the best for my image. Like gradient removal, usually ADBE is the best but sometimes graxpert if better. Use the tool the works the best. The more we have the better.
@@setiv2 Thank you. Everyone has been asking me to try out Cosmic Clarity so I just completed a video on it. Your work is very close to becoming a new standard of excellence, I think.
@SKYST0RY looking forward to watching it! The creator of siril just sent me a note too that they are able to start integrating my scripting into siril as well. So the future is bright for a whole chunk of the community out there!
anyone else having problems with Malwarebite trashing the 2 files? its blocking AI files in the folder and now they are gone out of pixinsight script menu ....
Great stuff. Would love to see a PI+Linux version tough. I'm a Java dev first and foremost and only dabble in Python occasionally, but I do have packaging experience on Linux and daily drive it as my main OS.
I just installed ubuntu on a virtual machine. I will give it a go but if I run into issues I will for sure be asking the community for guidance
Linux Version of Cosmic Clarity Sharpen and Denoise compiled!!! The stand alone is up and running. I still have to fully vet the script interface with PixInsight but that shouldn't stop anyone from using the standalone!
Site: www.setiastro.com/cosmic-clarity
Drive: drive.google.com/drive/folders/1hB2qeMF7YQH1-Vr81udvNfd_NB6RKBT0?usp=drive_link
Hi, and thank you for your amazing work on these tools. I am using the standalone version and everything works without errors however the denoising strength setting does not seem to impact the denoising level, I thought the denoising was too much at 0.7 so tried at various levels from 0.1 to 0.9 and all seem to produce the same very smooth possibly overly denoised output. I am testing on a 32 bit colour tiff, any thoughts?
It should be blending the original image and denoised images together. If it isnt let me know what operating system you are on and i will look at that
@@setiv2 Thanks for the quick response, I'm using Windows 11, denoised images look the same regardless of strength setting
ok thanks for the feedback. it was missing out of the recompile portion of the code. it is fixed now. please download the latest program drive.google.com/drive/folders/1mmUFuClcdBtj_IRjPwS8aVu1gomhVlG_?usp=drive_link
ok thanks for the feedback. it was missing out of the recompile portion of the code. it is fixed now. please download the latest program
@@setiv2 Thanks for sorting, downloaded and tested and all working as expected with great results
One more comment. I noticed that when I run images through Cosmic Clarity I get an odd 5 pixel border around the final result. It's like it's ignoring a 5 pixel frame during the process.
Get the newest version. Yes it was specifically doing that for over lap and stitching and the outer border is now fixed
Wow, you really are on a roll here, how do yoj]u churn them out so fast..kudos to you..👏🏻👏🏻
I think I am running to the end of game changers lol. Need to figure out how to get all this on linux now for that group :)
@@setiv2 Yet another amazing script, congrats! If you're looking for another game changer, 'What's in my sky tonight' 🙊
Oh the bane of excel, calculating local sidereal time. We do need that in something better!!
@@setiv2 I hope so
Awesome!!
Is there a preference as to the order these tools are used? Sharpen then denoise, or denoise, then sharpen?
Sharpen then denoise
Ty for this. Any chance siril could integrate this like they are with graxpert?
If anyone is willing to do it I have no problem collaborating with them
@@setiv2 would be a fantastic addition, thanks
Cool looking tool. For some reason, the URL does not seem to add the script to your typical area for me. Any suggestions?
Not sure what you mean. You added the cosmic clarity repository to pixonsight and it didnt show up in scripts->seti astro? If not go to scripts->feature scripts->add. Then navigate to c:/program files/pixinsight/src/scripts and click Select Folder. PI should then relook through the folder and add any it missed
For a mac do you have a repository version?
So for PixInsight there is the repository. That installs the script to interface with the CosmicClarity program. You still need to download the mac version of cosmicclarity. Then the first time you run Cosmic Clarity from within PI use the wrench icon to tell the script where you have the cosmic clarity folder
Question. Would this be effective in removing "walking noise"?
I didnt train it on walking noise, but give it a try, cant hurt! Let me know how it goes
@@setiv2 It didn't completely remove it, but it did make a big difference. Thanks for your efforts.
I say yes to use GPU but I the monitor window always says "Using device: cpu" and the Windows 11 Task Manager indicates very little GPU utilization. Is that normal?
You need CUDA acceleration. What gpu do you have? Have you installed cuda acceleration for it?
@@setiv2 HP Pavilion laptop says Intel Iris Xe Graphics. Maybe CUDA is only for NVIDIA?
@brianklein9744 correct only nvidia is for cuda. Your laptop has integrated graphics as well. Cant be used for neural net acceleration
@@setiv2 Thanks for the clarification. I'll just have be more patient while it processes!
Error, both non Linear and Linear "Failed to delete denoised file: D:/Install/_Billed redigering/Astro/Cosmic Clarity - AI Based Sharpening and Denoising\output\masterLight_BIN_1_4144x2822_EXPOSURE_60_00s_FILTER_NoFilter_RGB_integration_denoised.tif"
Is your windows set up to handle path names that long? There may be an error there if you haven't updated your registry to accomodate paths that long. you can also just try putting the cosmicclarity folder directly in D: and not within all those subfolders.
What about integration with Siril?
Scripting in siril is extremely basic. I do not believe this can be interfaced, but if any hat makes scripts iin siril wants to try I am more than willing to assist them
I have a problem with this plugin. The sharpen works great, while the Denoise makes me crash pixinsight.
Try running denoise in standalone to make sure it is working for you
@@setiv2 I put the image in the input folder, but I have nothing in output.
Can you take a screenshot of the terminal?
@@setiv2 yes
@@setiv2 Where should I post it?
Hey seti, DeepSNR does work on 2x drizzled images WITH the right drop shrink (0.4-0.5) with a grid size of 12 which are my 2x drizzle settings
Oh really? I heard that 0.8-0.9 drop shrink should be used while drizzling so I was doing just that blindly. Are there any drawbacks to the setting you mentioned?
That is a crazy aggressive drop shrink. You are doing more harm than good unless you have A LOT of data to drizzle. And deepsnr still wont denoise anything mono
@@blufferblue1599 The only two drawbacks I can think of the top of my head is that if you don't have enough dithered subs (that is less than ~60 or so) you'll end up with "dry" pixels, that is black dots all throughout the image and there's a slight decrease in SNR. Which, in my opinion, you shouldn't care about since when you're drizzling you're not going after the SNR anyway, but rather after the resolution and detail, which if you don't set your dropshrink low enough, doesn't increase all that much.
@@setiv2 Not at all. If you're drizzling 2x and set the dropshrink to something like 0.9 you almost won't notice the additional resolution, ever after deconvolution. In fact, 0.3-0.4 DS is commonly recommended for 1x drizzling with OSC cameras if one wants to use DeepSNR.
1x is different than 2x for deepsnr in my experience. I will try an aggressive drop shrink of 0.3 and see how it fairs
Does it work on Siril ?
Works with anything that can save a 32bit tiff or png. Just export your image to the input folder. Run the program, it will save the processed image in the output folder. Re open that in siril
in pixi no longer works!
What do you mean? Shoot me an email.
Could someone please make a linux version?
I do this as a hobby and I am not in software design. Adding learning a 3rd operating system is going to take me time, not to mention installing a 3rd operatint system. I am more than happy to help and share my python code if someone with linux wants to generate the executable from them
@@setiv2 I know, it was more a general question to all the viewers. It is great, can you put the python code to some place, where someone could reach and try to port it to linux? I could also give a try, though I am at a very novice level in Python.
Linux Version of Cosmic Clarity Sharpen and Denoise compiled!!! The stand alone is up and running. I still have to fully vet the script interface with PixInsight but that shouldn't stop anyone from using the standalone!
Site: www.setiastro.com/cosmic-clarity
Drive: drive.google.com/drive/folders/1hB2qeMF7YQH1-Vr81udvNfd_NB6RKBT0?usp=drive_link
All were useless, losing so many faint details in the process. That said, some noise is actually useful, it gives our brain the chance to its process and feel some detail patterns. Just compare old camera images like Nokia images with today’s washed out cell phone camera images.
Not sure what you mean by all were useless. There is a strength slider. It is also best to use this on linear data.