Unraid 6.12 - All the new features including ZFS and much more
HTML-код
- Опубликовано: 16 май 2023
- This video takes a deep dive into Unraid 6.12. It looks at creating various Zpools. Importing existing zpools from other systems such as TrueNAS. And alot of other 'quality of life' improvements.
Please, if you can and want to support the channel and donate you can do so by Paypal here goo.gl/dw6MLW or check my patreon page / spaceinvaderone
Bitcoin donations 3LMxDzcwPdjXQmmeBPzfvUgjYFDTqDAgQF
----------------------------------------------------------------------------------------------------------------
Need a VPN?
PIA is popular with Unraid users as its easy to setup with various vpn download containers - www.privateinternetaccess.com...
Torguard is also an excellent VPN again with both openvpn and wireguard protocls supported.
Get 50% off for life using code spaceinvaderone torguard.net/aff.php?aff=6005
----------------------------------------------------------------------------------------------------------------
Need a cheap windows 10 license for around $10
consogame.com/software/window...
----------------------------------------------------------------------------------------------------------------
Need to buy something from amazon? Then please use my link to help the channel :)
USA - amzn.to/3kCikfU
UK - amzn.to/2UsYb1f
USA link - USB HDD Docking station amzn.to/3v754WG
UK Link - USB HDD Docking station amzn.to/3hLenYp
HighPoint RocketStor 6414S amzn.to/3fiXv9s USA
Mini SAS 26-Pin SFF-8088 Male to Mini SAS 26-Pin SFF-8088
amzn.to/2V4x9kT USA
amzn.to/3xfkxEl UK
----------------------------------------------------------------------------------------------------------------
A big thankyou to Limetechnology for all the great work that they put into always improving Unraid OS. Наука
If possible I'd love to see a tutorial/process on migrating a server from xfs to zfs.
indeed !!! that would be great
The only thing a i see is someone in my situation to make this is possible to to take my 24 drives and buy 12 more at most that equals the total capacity of my current array once that is done I would then repurpose the largest of my current drives back as ZFS start coping over the data to ZFS from one disk in the xfs array then bind that disk to the zpool
I hope there will be some magic CLI wizardry to convert existing arrays over if it's possible
yes :) +1
After some quick googling, I don't think it's possible to convert an XFS file system to a z pool in ZFS so we might be SOL and have to migrate as much data as possible off our array to free up discs to use for a new z pool. I'm wondering though if we can expand the pool after it's been created like we can with our standard XFS array?
@@fisty7921 that's what I thought and why I went unraid over truenas years ago
I would love to see a performance comparison between ZFS and Encrypted ZFS. Also, maybe ZFS VS the other file system types.
Great video as usual thanks for making it! Just about to go down the NVME route in addition to my SSD pool, I really like what you have done so defiantly looking forward to you expanding on that.
I'm so glad I watched this video when it came out. It saved me today when I updated and my VMs no longer would boot because I needed to import my ZFS dataset as a new pool using UNRAID's interface.
You're the best!! I like that you explain all the options in detail! Thank you!
Thanks a lot for your views of the next version a lot of relevant comments. Thanks again from south of France
Thank you so much for this video! I was trying to read the Release Notes, but my ADHD made that practically impossible, so I really appreciate this thorough explanation of all the changes and what they mean
Nice job Ed. The only place to know what’s coming up on unRaid. Will be installing asap. Thanks as ever.
Very excited for the next video. Snapshots for appdata sounds awesome!
Would also love something showing how to utilize zfs send as mentioned to backup an unprotected cache to the array.
I would like to know what this ZFS send is also.
I've been waiting for ever for this video lol. I'm so glad and thankful you did it. I understand why you wanted to wait until this version was almost done. I want to install this version on my production machines so bad, but I'm being patient lol.
i'd like to see a video on different zfs caching: ARC/L2ARC then ZIL/SLOG, etc. and a practical demonstration of how much it performs compared to not using them including the cost to implement them.
Been binging many of your videos as I migrate from a Synology NAS to Unraid. Would love to see an updated Plex setup. I used most of your share naming for setup of my Unraid. Thanks for being a great recourse.
Thanks for this video and all the others you do!!!! Love it!
I would love a video on using zfs snapshots to backup appdata.
Been trying rc5 for a while. I'm grateful we dont have to use workarounds and mount zfs pools in undue places just to have shares using them
+1 for having the ability to have the secondary storage be able to be another pool. Would love to have that!
Thanks for all your videos I'm a newbie and you help me a lot.
Thanks for the video! It got me started with a raidz1 pool consisting of nvme drives :-)
Great stuff thanks Ed!
Brilliant as usual!
Great video as always Ed! Thanks for always sharing with us!' 😎💖👍JP
Thanks - what may be important for zpool -> this is same energy unefficiency as traditional raidsets, all disks are online or none. One of the reasons to use unraid as movieserver, very energy efficient
Great video. Thx a lot. Looking forward to the snapshot video ;)
Doing the work of the people here! Thank you for this video!
Great video and I plan on upgrading when it drops. As several folks mentioned, it would be great to get your thoughts on how to upgrade from XFS to ZFS. Ideally, it would be as simple as hitting one button and letting the system take care of the conversion. Probably not that easy though. LOL!!!
20:42 For people that won't bother with zfs arrays, but want to use single zfs disks within UNRAID arrays, do we have any detailed info compared to xfs and btrf in matters like speed, reliability, deduplication, space overhead? Maybe there is a point switching all disks in an existing array (one by one obviously) to other FS?
Well, 6.12.0 RC 6 is out. So more testing before it’s fully released. I will probably skip this version and go to 6.13 depending on what features are released then. Great video like always.
I have watched quiet a few videos from you. and i was like okay i guess it is time to subscribe
Great. Thanks For your video
Your welcome. Thanks for watching
I tested Truenas Scale for 3 months. As soon as I learned about Unraid 6.12 rc5, i transitioned from Truenas Scale to unraid and using unraid's zfs. I never look back. Unraid's zfs doesn't have all features like the zfs in truenas, but it has most of them and get the job done
And the Unraid community is so much more welcoming!!
If I just wanted a file share system I would use TrueNAS core it actually is very good with that. And you most likely wouldnt need much help to keep that going and use it.
But I want my servers to do more. And the TrueNAS members most are really rude and not very helpful.
But I agree there is some really cool ZFS features that unraid does not have that is in TrueNAS. But unraid was made for a different purpose. Its primary design is to be able to make an array and add any size disk. Also sense the main array is not a raid pool you really don't get much benefit of using a HBA card for the main array. But yeah if your looking for a NAS that is based as a file share system TrueNAS and Xisystems really have done a good job with that.
But I really like unraid setting up dockers and VM's is so much easier and the forum members are really helpful. I haven't seen anyone flame/judge you about your hardware choices. If anything most help you with smart alternative choices. I had hope's TrueNAS Scale would have been almost as good as unraid and been enough to switch. I was almost ready to give it a go and try to switch. But after I started loading up my spare box to get ready to do it. I soon stopped and realized why I stop using FreeNas or TurnNAS now. The forum members there at TrueNAS/XiSystems are just not helpful and judge your hardware choices. they focus so much on that part that they think thats the only thing that could be causing your issues. I switched to unraid love the forums/ Member's at unraid. And we all thank this guy here for his helpful videos.
Totally agree on all the points you made.
@@AM93000 ditto. The agressive and unwelcoming community is what prevented me to go with TrueNAS. I'm a happy bunny with UNRAID ever since. And now that is has ZFS too, it's a bliss
Looking forward to seeing videos about snapshots with ZFS. Ideally, Ed touches on ZFS for the array as well as to why you should/ shouldn't use it there (I like the idea of ZFS and snapshots, but what are the downsides besides not being able to mix the drives?). As always, great videos!
Of you use zfs formatted drives for array you can mix sizes and the parity will work as normal as they are independent and not in a zpool
@@39zack I was actually thinking of doing that instead too. But I wanted to use my snap shots like windows shadow copies. and if you had your array like that you couldnt get the that to works because each disk would have its own snapshots. and your snap shot naming wouldnt match in away that you could pass the Samba info to see it like shadow copies. If I was the only one using my shares I wouldnt care. But I do have a wife and kid that really dont know much about the server side of things. and the wife could care less about learning. The Kid though I could force feed and make them learn.
Great video as always! Do you happen to know if drives in the main array that are formatted with ZFS are able to spin down normally like they are when formatted with XFS?
Excellent content as always - any chance of a urbackup guide? I think I remember you using that in the past?
I've been waiting a year for this day!!!!!
I've even prepped and bought 6 sata 4tb ssd's to move my array to. less power. less space!
Nice vid thanks
thank, youre the best!
Thanks for watching Arch :)
A helpful video challenging the open issues with ZFS import would be great for existing Unraid ZFS zraid users. In the video, several issues were mentioned.
I currently have two pools totaling over 120TB, and they are working flawlessly. However, one concern is that according to the release notes, starting from version 6.12, Unraid cannot import or create pools that begin with an uppercase letter. In the video, SpaceInvader imported a lowercase "battlestar" zpool from TrueNAS, but when he created a new 4x8TB lowercase pool called "battlestar," the OS automatically renamed it with an uppercase "Battlestar."? It seems that when importing pools, you may need to rename them due to various restrictions and then did the restriction itself?
Another warning pop-up mentioned that ZFS support will be introduced gradually over multiple releases. So, even when version 6.12 is live, it might be wise for users with critical data to wait for additional releases. 6.11 with two add-ons brings tons of power, and this feels limited. I also understand its first release but have valid concerns that others share.
What about the missing support for datasets and options per dataset? Importing in version 6.12 seems to bring significant changes to pool setup and management. Importing pools should not require creating a new pool and selecting the correct drives, as the data already exists in version 6.11 and works fine. I'm uncertain about how this upgrade will go and would appreciate a video demonstrating the import of existing unraid 6.11 pools starting with capital letters and other challenges, so we can see how to navigate troublesome upgrades.
There are also some cool features, such as scheduled auto scrub and improved setup convenience. I can see the vision for new pool creation, minus missing data sets and other missing options. However, we need a simpler method for importing existing pools, it feels like a creation vs an import and no information about the advanced options set on the pool.
Cant wait to try this
Yeah its great. A really big release. loads of cool stuff!!
@@SpaceinvaderOne You’re responsible for about 90% of the cool stuff my two unraid servers do lol
Glad the videos are useful. Thanks for watching Warren :)
Thanks for the great intro. I'd love to hear more about support for ARC and L2ARC on Unraid. Does 6.12 support them out of the box? Is it a planned future feature?
Good Video Ed you always cover something I don't always notice.
I would like to see something out to help me either migrate over to another server or something to help me setup a new ZFS array in my current box and move my main array to that. But I'm not sure I got the power and space to setup an extra 4 Drives I was going to move to. Either for me to setup another server and move over it it.
Would love to see (as someone else said) a way to convert btrfs to zfs cache pool. My example is that I have 3 4tb ssd's for cache and would love to convert that to zfs for the added storage.
You can't convert. You need to copy/move off the data, remove the cache pool and create it again as zfs then copy data back
Thanks again, great tutorial. I have not been able to get my plugin's to get past "checking for updates" for a long time now. Any thoughts?
Please do some more videos on how your build is going. I am looking at doing something similar.
HI - Thanks for this great video! It would be great if you demonstrate how to create a VM of a RASPBERRY PI !!
can't wait for the stable version
I ordered a few new disks to migrate one of my servers to native zfs.
I also noticed there’s an option for VM management. Can’t recall exactly what it is.
Hope you can make a video for moving to zfs from xfs, and a video for your retronas docker lol
Could you do an video someday about why you would use ZFS on single drives in array? :D
Hi, great video as always. I'm running Version: 6.12.0-rc6 but I dont see the option to organise the tiles in the Dashboard? Is there a setting I have to enable?
@spaceinvaderone
Hoping you can answer if someone like me that has two cache pools can set the mover settings on a share so its works for
I currently have appdata as my ssd cache and vms too.
I have a second cache pool strictly for transcodes/downloads and uploads that mover moves to all the other shares on the array
Will i be able to see both chache pools in the new primary ans secondsry storage?
The background music reminds me of Blinx: The time sweeper OG xbox game 🙃
19:54 Also compress old data when they are updated (like editing a file)?
Also probably if you move things around individual disks of the array (like UNBALANCE or manually), will compress them.
Right?
I tried to find it by skipping through some, but couldn't. How is WAL and disk spin up/down? Does it work better than TrueNAS Scale?
Awesome video as always! I ran into one problem. I wanted to import an existing pool that had a trailing number (zmnt2) . Unraid complains with "Use only lowercase with no special characters or leading/trailing digits" What should I do??
Thx for your excellent vids/tutorials! - Is it possible to add another drive to an existing ZFS RAIDZ pool? I have a current pool with 3x 4TB SSDs and want to add a fourth SSD of the same type. I know that I can add another slot to the pool and assign the corresponding drive to it. But does this work really that way? Or should I delete the pool and create a new one with all four drives (I don't have too much data on it yet)? Thanks!
Maybe I am just old school but in my mind RC means new features are blocked and all focus is put on stability of existing features. This is why I always wait for a point release or two after a major release since there are bugs that are not caught during the RC phase due to late breaking features being added.
This worked for me, the only doubt I still have is how to configure the /downloads share, it is in a cache disk but is it supposed to have primary storage and secondary storage or just primary and let the apps that downloaded move them?
Any advantage to using single drive zfs on an array over xfs or btrfs? Would you recommend it?
Is it possible to expand the zfs pool by adding a new vdev like truenas
So if the zfs array hits that 90% and you want to expand the array by adding another disk or two, can you add another and assuming the array then rebuilds / restripes the parity? Similar to XFS where if its full, you can add another slot and add another drive.
What’s the difference between the current unRAID storage type vs zfs?
I’m just finishing setting up my first unraid server using your tutorial’s. Super helpful thank you! But should i have waited for 6.12? Or will it be easy to update when it comes out? Edit: lol first topic of the video is updating the server. Should’ve watched the video first i guess. 😂
Hi Bradiego, No problems to update to 6.12 from the current Unraid :)
9:40 Was the issue fixed that Docker xontainers dont remember their order? Upon a server restart, i usually have to redo my order, because it is completely messed up. Nextcloud, Jellyfin, etc. would start up way before the Reverse Peoxy, for example, being completely useless until it reached the RP three minutes later.
Can I just change the primary storage of a share to something else ? e.g. from one pool to another ? Will it still find the files located on the old share primary storage or would I have to move things manually via something like krusader ?
Hi there, I'm new to Unraid and have just setup my first rig, I used some of your older videos and setup my shares for Downloads (cache > array), Movies & TV Shows (array), only using mover on the downloads folder. Unfortunately radar moves the movies to the movies share while still on the cache and since mover isn't turned on for movies I am finding the movies stay on the cache instead of moving over to the array, is there anyway I can prevent this from happening?
My array has 6 total drives in an XFS Raid-6, would it be possible to change the file system for all of the drives over to ZFS? Or do I need to buy new drives to temporarily house the data while the file system gets changed? A guide on migrating an existing array to ZFS would be much appreciated!
How full is the array? If you have lots of room, use the unbalance plugin to remove data from some of the drives and then remove them from the xfs array, then create a new array on those drives and migrate your data to the new array. It takes a while but it can be done as long as you have space. Keep in mind that zfs arrays need tons of RAM and you must always maintain a level of free space. If you sit on the edge you will have issues.
@@joe_ferreira All 4 of the data drives are at ~50% full. I could shuffle things around but it sounds like a lot of faffing about. I was hoping there would be an easier way to go about it.
26:09 please could we have a video of setting this up? I understand to format a drive to zfs and add to array. Then a drive in a pool to zfs. I want to do backup/protect appdata and also domain and system
Hey Space Invader One, any chance you'd be doing a how-to for PhotoPrism?
in the new kernel your suppose to beable to use intel arc can you conform please
Also - when I go to the update page it says that I'm up to date and I'm on 6.11. do I have to CLI the force update to 6.12?
is there a way I can pull truenas zfs pulls into unriad without having to reformat?
Question: One of the reasons I went with an Unraid server rather than Freenas was that my hard drives were mostly WD Red SMR drives, which do not play nicely with ZFS . Has this issue been addressed in version 6.12 of Unraid?
nice stargate names 🙂
I think the comments at 19:14 are really pivotal if you're making a net-new build for a total migration without use of old hardware.
Almost every enterprise grade storage system has you build an array first and then assign the disks of that array to 1 or more pools. I created mien thinking this and ended up with 4 ZFS disks and 1 Parity that were all individual Zpools. Maybe a good feature add to allow users to do it the more methodical way...Disk then file system and pool
What does the move button do on the shares browser now?
I dont get why I must have a sperate array drive as well as running a zfs (in my case runnibg 6 x 4T raidz2) inorder to run unraid. Obviously I would prefer to run my ZFS pool as "the unraid array" maybe im wrong and have a bad setting?
I created a ZFS pool in Unraid using your tutorial. I would love it if you would show me how to migrate that to Unraid 6.12
I must have misunderstood something. you said that in the main unraid you moved 4 disks which were in truenas. that is, without doing any configuration on the disks, you simply inserted disks from another system. so the files weren't lost? so if there are vms, they were not lost either?
Thank you for your service! These videos are very helpful and useful - and at times even a bit entertaining :D
I'm curious if there will be a way to assign ARC, LOG (+mirror), "special (metadata)" (and maybe a spare drive) to specific drives outside of the zfs array.
Also I'm curious about activating Dedup and the Snapshots management. For the later I'm looking forward to your next video!
Again: Thank you for your content and take care!
for importing zpools, can you 'auto import' a raid z2 like you did the z1 pool even though there is no zfs choice beyond raidz1 in unraid atm? ie, can you create a zpool with a higher raid (2,3,etc) outside unraid and then import it to get past the limit of raidz1 in unraid?
This is a good question dude, also see my detailed post that I dropped on this video too. It adds on to what you are saying . We def need a video about importing advanced setups like ours. I have a 120TB across two Z2 and there is issues with pool names, mine start with capital letters. ZFS support is also split across multiple OS updates too, we might have to wait.
BTW - Any options I have set up are from watching SpaceInvader LOL =0 He rocks!
You cannot add disks to ZFS after a pool is created, correct? The drives must spin all the time in the pool, they cannot be spun down? Lose two drives lose all of the pool in Z1 right? Love the compression! Is there a downside to using LUKS encryption vs ZFS?
I'm going to setup a new server - so should i use zfs for all my Array Devices?
It looks like duplication to me having 3 array’s (Unraid array, cache array and ZFS array) 2 makes much more sense, even 1 array if it’s high speed. Will Unraid support just 1 array of ZFS disks?
I only have limited Sata connections and disks are expensive! 😅
I’d be interested to see how you architect/ design a new server making the most of ZFS. HDD and SSD’s If needed.
Cool to see ZFS available on Unraid now. The amount of community Docker containers is unmatched compared to TrueNAS.
I am on the current unraid version 6.12.2 and i have the noVNC toggled on within the VM but when i try to copy/paste within the VM - the clip board within noVNC is blank. I also tried installing spice-guest-tools on the VM and with that being installed, everything works. But then when i shutdown the VM and start it up again, the copy/paste stops working. To get it working again, i have to restart the spice agent service and it will work until the next shutdown/power up.
Is there something i am doing wrong here? Thank you
Hey! Would you make a guide how to host Lemmy server on a home server? UNRAID or so?
Is the VM creation more stable. I had nothing but trouble in 6.11 for Windows vm's. Couldn't get them to work with GPU pass through for live not money. Linux was fine though.
Today I tried copy everything somewhere else and create a new ZFS pool, but in the mover I couldn't find the cache to zfs pool?
25:19 I may have to rewatch this video or investigate but does unraid zfs prefer spinning disks?
No doesn't matter just enable Autotrim and not disable it as in the video.
RC6 was released on May 17th, any differences between the two?
Is the ZFS full featured on this version? Does it support metadata devices, different subvolume settings etc? From your video I can see, that not through GUI, but perhaps on cli?
Yes, it does through a cli. Found an answer from official forums.
Could you do truenas scale to unraid. With pool import. I want to come back to unraid
Is it possible to increase the size of a zfs array by replacing all the drives or adding drives? I know it would be tedious, just curious if it's an option. Thanks!
You should be able to expand size of Zfs array but increasing size of all disks. I was at least able to do it with a mirrored special vdev. Just make sure the autoexpand setting is enabled
@@jameskurian6914 awesome, thanks!
Id like to see some real world full ssd array with SSD testing
Where do I find the FIO docker?
Is it worth changing from xfs to zfs?
how does the speed of zfs in unraid compare to traditional unraid array?
how the f can the zfs doubles the speed? explain in low-level terms pls
15:20 slide typo. Should be 3tb usable space?
Is your promethes_pool a zfs mirror or raidz?
why would you mix xfs and zfs?