Glad I saw this video - I was just about to set up a somewhat complex key management system to replicate to an offsite host, which I would prefer to keep encrypted in case of theft. This is much easier! Thanks devs, and thanks Tom!
Just spent the last 3 days rebuilding my backup server, and replicating my data after a day of testing with new encryption. So pleased to see that my results from my testing (with regards to keys, not enabling encryption in the replication task) marry up perfectly with your guide, meaning I haven't wasted my time! :D Can sleep easy now (only thing I would advise mentioning, DON'T "inherit" the key from the parent dataset on the backup server, otherwise this breaks it. Discovered this during my testing/experimenting.
Thanks for this video - very helpful. It would be great to see a follow-up to this one that explains options and approaches to setup TrueNAS 12 in the cloud and have encrypted replication occurring to a remote TrueNAS 12 instance.
Your channel is awesome. Thanks for all the info on TrueNAS/ZFS/hardware and setups. Keep up the good work. Also, your "CAT6" and "#I AM ROOT" T-shirt designs are great!
It took me a while to figure out what I was doing wrong... as of 7-31-2022 the bug is still there, I could not get into the system until I pasted the key in, the json file was not working correctly, I did not remember this from seeing the video a long time ago. wish they would fix it.... Thanks for the video---easy and great way to back things up and keep them backed up without having to do it manually !
Omfg thank you for explaining that unlock bug! It’s still a bug in the latest version as of the time of this comment. Thanks for the explanation of how the scale version of encryption works, totally makes sense!
7:23 Stumbled upon this video looking for an explanation for this checkbox :D did you explain it in some other video? or am I out of luck with this one?
I'm interested in an all-flash NAS but there is very little information on them out there. I want a fast and reliable set of 6-8 TB of storage. Synology has added F1 to their 21x series, which looks promising for maintenance. I haven't seen anything about SSD-aware features of TrueNAS. I know TRIM and SMART monitoring are available, which is nice, but it would also be nice to know if there are ways to selectively write more to certain disks of a vdev in zfs/TrueNAS. Could you do a video about SSD-aware features of TrueNAS?
Very good! Question: Will a replication task on FN v12 with source on other FN v11.3-U5 system work? Or does it have to be same FN version booth at source and destination?
Thx! I dont really understand this thing with the "snapshots". I try to backup my jellyfin and paperless / ix-applications stuff. I made these snapshots but they are not even 1MB big, while my jellyfin alone is about 200GB big. How can I restore the 200GB with my 1MB big Snapshot? I am very confused! (The snapshot lies on a different pool / harddrive)
Quick question; Is the entire pool data replicated or just the snapshots? Because the snapshots would be useless without the underlying initial pool data for referencing. Thanks appreciate your help
Seems to be a bug in the latest v13 of TrueNAS where manually running replication doesn't properly work recursively. Works fine if I let it run on the timer.
New to TrueNAS. Question, During the demo you delete some data, then re-run the task, but the task did not do anything because a new snapshot has not been created; doesn't the task running create the snapshot, or did I miss something. Thanks, Joe
If I wanted to replace an external hard drive (2x2TB mirrored) with a higher capacity one (2x4TB mirrored) - would I need to create a new pool and start a replication task to transfer the data over, or is there a better method?
i have a question for which i can not find and answer, please help. why i can not use a nas drive on other nas station even when i deleted the pool and dataset where it belonged? i lost my boot drive and i am left with five useless 4tb drives. thank you.
I assume people would like to upgrade from freenas to truenas, could you explain how to setup a sync in between and how encryption works with that ? (for example how to pull over an encrypted pool from frenas).
TrueNas should support KMIP or at least PKCS#11 to use external key Storage and hide Admins to see Keys about this solution. TrueNas would be perfect when Users can Store data encrypted with their own key without any possibility for the admin to see thair data.
Thank you for the video and steps. Can this replication process be extended off the same local network? Meaning, TrueNAS-A is at House-A, and TrueNAS-B is at House-B...different physical routers...requiring the replication process to take place over the internet. VPN Tunnel? Possible future tutorial for your subscribers? Thank you again. All of your videos are very informative.
I've seen you uncheck the read only box when restoring from the second server, but the dataset shows up as read only in your video. Is that a bug or did you record it again and forgot to uncheck that box?
@@LAWRENCESYSTEMS the answer seems to be no. I just did a replication from geli encryption disk level to unencrypted second truenas box and did not need to encryption key. Could clone and share without any key. Also no lock icon.
using this method on same machine to copy data to pull drives from old pool. Is this ok practice? any after steps before I distroy the original? True Nas Scale
I've been wondering how to unencrypt the replicated data. For being the new unified way to have fewer bugs by doing less coding, TrueNAS 12 has been extremely buggy for me and that is with waiting for the Release version to upgrade.
Mission critical is U1, not RELEASE stage. And it is only a 1st release for "new unified way", surely you did not expect it to be flawless. Although I had no issues at all.
@@Mr.Leeroy flawless no, but the number of critical bugs has been significant. I actually had more issues going from RELEASE to U1. To do that I had to delete CHAP from my iscsi configuration to get the service to even run and it cannot be added until the fix comes out in U3. I also ran into the bug that corrupts the AD password during upgrade to RELEASE. Having all your SMB shares broken is not insignificant either.
It would be very very helpful if You would make wideo about Truenas ISCSI failover and continuous replication to another Truenas as ISCSI backup repository. I mean whole ISCSI dataset > 1 to 1 > replicated everyday to second server. In case emergency You can attach backup iscsi repository in XCP.
"Don't mess with the encryption" yeah, because it doesn't work. I have encrypted dataset on source and I want to replicate it into encrypted dataset in destination. Impossible task.
⏱️ Timestamps ⏱️
0:00 Intro TrueNAS 12 ZFS Replication
1:37 Why Use ZFS Replication
2:24 Test TrueNAS Setup
3:25 Creating Replication Tasks
9:42 Managing ZFS Encryption Keys
18:44 Restoring ZFS Replication
Video on backing up TrueNAS 12 settings
ruclips.net/video/RmJMqacoPw4/видео.html
Links Referenced
www.ixsystems.com/blog/openzfs-keeps-your-data-safe/
arstechnica.com/information-technology/2020/05/zfs-101-understanding-zfs-storage-and-performance/
json import bug
jira.ixsystems.com/browse/NAS-109180
Glad I saw this video - I was just about to set up a somewhat complex key management system to replicate to an offsite host, which I would prefer to keep encrypted in case of theft. This is much easier! Thanks devs, and thanks Tom!
You need to do a video about zfs send and receive that's so cool!
I second that motion!
Absolutely!
Just spent the last 3 days rebuilding my backup server, and replicating my data after a day of testing with new encryption. So pleased to see that my results from my testing (with regards to keys, not enabling encryption in the replication task) marry up perfectly with your guide, meaning I haven't wasted my time! :D Can sleep easy now (only thing I would advise mentioning, DON'T "inherit" the key from the parent dataset on the backup server, otherwise this breaks it. Discovered this during my testing/experimenting.
Thanks for this video - very helpful. It would be great to see a follow-up to this one that explains options and approaches to setup TrueNAS 12 in the cloud and have encrypted replication occurring to a remote TrueNAS 12 instance.
Thanks for the help on this one, the encryption checkmark in the replication task was throwing me off, was the tip I needed to get this to work.
Your channel is awesome. Thanks for all the info on TrueNAS/ZFS/hardware and setups. Keep up the good work. Also, your "CAT6" and "#I AM ROOT" T-shirt designs are great!
Thank you :)
Thank you Matte for all your smart explanations. i started working with truenas in my business only because of you :)
Fantastic!
It took me a while to figure out what I was doing wrong... as of 7-31-2022 the bug is still there, I could not get into the system until I pasted the key in, the json file was not working correctly, I did not remember this from seeing the video a long time ago. wish they would fix it....
Thanks for the video---easy and great way to back things up and keep them backed up without having to do it manually !
Thanks for the tutorial. I was creating snapshots once per month, but replicating once a week. I could have lost some data.
Excellent video, clear, punctual and very well explained.
I have applied it in my work environment and it works 100%
Thanks Tom. This is a very valuable video.
Omfg thank you for explaining that unlock bug! It’s still a bug in the latest version as of the time of this comment. Thanks for the explanation of how the scale version of encryption works, totally makes sense!
7:23 Stumbled upon this video looking for an explanation for this checkbox :D did you explain it in some other video? or am I out of luck with this one?
Thanks!! i had to disable 2FA to make it work initially. Kept working after enableing it again.
How do I store my keys? What do you recommend? What is the best way? Where to store keys (usb, cloud)?
Good video Tom! Thanks for sharing it with us!💖👌👍😎JP
I'm interested in an all-flash NAS but there is very little information on them out there. I want a fast and reliable set of 6-8 TB of storage.
Synology has added F1 to their 21x series, which looks promising for maintenance. I haven't seen anything about SSD-aware features of TrueNAS. I know TRIM and SMART monitoring are available, which is nice, but it would also be nice to know if there are ways to selectively write more to certain disks of a vdev in zfs/TrueNAS. Could you do a video about SSD-aware features of TrueNAS?
Very good!
Question: Will a replication task on FN v12 with source on other FN v11.3-U5 system work? Or does it have to be same FN version booth at source and destination?
Thx! I dont really understand this thing with the "snapshots". I try to backup my jellyfin and paperless / ix-applications stuff. I made these snapshots but they are not even 1MB big, while my jellyfin alone is about 200GB big. How can I restore the 200GB with my 1MB big Snapshot? I am very confused! (The snapshot lies on a different pool / harddrive)
Quick question; Is the entire pool data replicated or just the snapshots? Because the snapshots would be useless without the underlying initial pool data for referencing. Thanks appreciate your help
Seems to be a bug in the latest v13 of TrueNAS where manually running replication doesn't properly work recursively. Works fine if I let it run on the timer.
New to TrueNAS. Question, During the demo you delete some data, then re-run the task, but the task did not do anything because a new snapshot has not been created; doesn't the task running create the snapshot, or did I miss something. Thanks, Joe
If I wanted to replace an external hard drive (2x2TB mirrored) with a higher capacity one (2x4TB mirrored) - would I need to create a new pool and start a replication task to transfer the data over, or is there a better method?
i have a question for which i can not find and answer, please help. why i can not use a nas drive on other nas station even when i deleted the pool and dataset where it belonged? i lost my boot drive and i am left with five useless 4tb drives. thank you.
thanks for the awesome video
I assume people would like to upgrade from freenas to truenas, could you explain how to setup a sync in between and how encryption works with that ?
(for example how to pull over an encrypted pool from frenas).
TrueNas should support KMIP or at least PKCS#11 to use external key Storage and hide Admins to see Keys about this solution. TrueNas would be perfect when Users can Store data encrypted with their own key without any possibility for the admin to see thair data.
Hi Tom, how do we replicate and overwrite a folder to a destination server, it says the folder already exists in the destination server, any ideas?
Is this still a bug in TrueNAS Scale? I get an error when trying to unlock using the json file but if I copy paste the key it unlocks the dataset.
Thank you for the video and steps. Can this replication process be extended off the same local network?
Meaning, TrueNAS-A is at House-A, and TrueNAS-B is at House-B...different physical routers...requiring the replication process to take place over the internet.
VPN Tunnel? Possible future tutorial for your subscribers? Thank you again. All of your videos are very informative.
This will work over a VPN as long as you have enough bandwidth to get the data over.
A quick question. If one is Restoring a lot of data (4TB) back into the original pool. Does one see files arriving with MC?
I never check until the process is complete
Good job Sir!
What ports need to be open on the target computer if the replication will go through the WAN?
You can do it all over SSH, but I recommend using a VPN.
What happens when live data is being written to both locations? How do you keep the datasets in sync?
Replication is not for syncing, use a tool such as syncthing for that
8th comment here!
Great informative video, Tom!
I've seen you uncheck the read only box when restoring from the second server, but the dataset shows up as read only in your video. Is that a bug or did you record it again and forgot to uncheck that box?
I don't recall
Can you do video for TrueNAS Scale Replication including setting up SSH connections?
On my to do list
Awesome video as usual.
If you have old geli disk level encryption, and you replicate to a different system that is not encrypted do you need to import the geli key?
Yes
@@LAWRENCESYSTEMS the answer seems to be no. I just did a replication from geli encryption disk level to unencrypted second truenas box and did not need to encryption key. Could clone and share without any key. Also no lock icon.
using this method on same machine to copy data to pull drives from old pool. Is this ok practice? any after steps before I distroy the original? True Nas Scale
Yes, you can use it to move data between pools on both Core and Scale.
the ssh connection is not going smoothly for me as it did for you
i get this error [EACCES] AuthenticationException('Authentication failed.')
me too
Me neither. Did you find a way to fix that? Please send link to solution if you did.
I've been wondering how to unencrypt the replicated data. For being the new unified way to have fewer bugs by doing less coding, TrueNAS 12 has been extremely buggy for me and that is with waiting for the Release version to upgrade.
Mission critical is U1, not RELEASE stage. And it is only a 1st release for "new unified way", surely you did not expect it to be flawless. Although I had no issues at all.
@@Mr.Leeroy flawless no, but the number of critical bugs has been significant. I actually had more issues going from RELEASE to U1. To do that I had to delete CHAP from my iscsi configuration to get the service to even run and it cannot be added until the fix comes out in U3. I also ran into the bug that corrupts the AD password during upgrade to RELEASE. Having all your SMB shares broken is not insignificant either.
It would be very very helpful if You would make wideo about Truenas ISCSI failover and continuous replication to another Truenas as ISCSI backup repository. I mean whole ISCSI dataset > 1 to 1 > replicated everyday to second server. In case emergency You can attach backup iscsi repository in XCP.
TrueNAS core does not support that.
@@LAWRENCESYSTEMS oh ok thanks for answer ^_^
sigh, the only downside of ZFS replication is needing to build a second system to receive the backups..
"Don't mess with the encryption" yeah, because it doesn't work. I have encrypted dataset on source and I want to replicate it into encrypted dataset in destination. Impossible task.
2nd :D
1st :)
What a joke. Your bug was closed as a Dupe of a bug that isn't visible to the public. Forget it, TrueNAS, I'd rather do it by hand.
How does this work when the user you are using uses OTP/MFA?
Because it's using SSH keys that does not matter.