Thanks for the reminder to export my config! It's been a while since I last exported it. Actually had to allow the app to be downloaded, Windows Security kept flagging it.
Great video! I see this question asked at least weekly on the forums/reddit. One additional step I take is to add a nightly cron job that exports the config, and then I copy that off to another system for safe keeping. Config changes don’t happen that often, and are well documented, but it’s nice to not have to remember to re-export the configs every day that I do have changes.
Man Im new to your channel, but man you rock, I enjoy your videos because you explain like a normal person and not like someone who has been using linux since 7 years old. Thanks I'm a programmer but still appreciate people explaining the way you do, I'm sticking to your channel for the long run, super helpful tips before setting up my TRUENAS.
Nice, needed that info simple and easy. I'll be soon moving my drives into a new NAS-type enclosure because my old desktop isn't cutting it anymore, and this answers how to do it if I can't (and probably won't) use the SATA TrueNAS is currently in.
I've had 2 nvme drives fail the exact same way. Very annoying that they die like that with no warning and it's the reason Im rebuildingmy homelab servers to have redundant boot drives. It is good that Truenas is fairly painless to recover so long as your config is backed up.
SATA SSDs are so cheap now that I just buy a pair of 256-512GB drives and make the boot pool a mirror. But it's good to know this is so straightforward. Thanks Tom.
Good info 👌 I'm planning to build the boot on a mirror anyway 😅 I have a question related to this topic: can you create a task that automatically saves the config file into a backup storage of your choosing? Like a USB drive or even an external server through rsync or anything similar?
You can: settings>advanced>cron jobs. The following will export your config and keys, then you can run some other process to copy it to another system: tar cf /mnt///`hostname -s`-`date +%Y%m%d%H%M%S`.tar -C /data/ freenas-v1.db pwenc_secret Replacing and with your preferred location.
Nice demo video. One thing I'd like to know is - how did the original disk fail and how did it present? I ask because I noticed the pool showed in an exported state. I am not a ZFS expert, but I thought exporting a pool took manual effort (or at least, done explicitly by the OS). Did the drive fail but the system was still running enough for you to gracefully export the pool or shutdown the system? Or was this catastrophic?
My experience with consumer NVME in my desktops made me not trust them at all and sure as hell never use them for boot drives in a server. Dual consumer SATA SSD is a far better choice, you don't need NVME speeds on TrueNAS for boot anyway. I've been running consumer SSDs as boot drives in all my servers for almost 10 years with no issues, in that time I've had 2 die. SSDs usually don't give any indication there gonna die, sometimes they do like causing crashes but in my experience one day there working, next there dead. If people really want NVME boot then something like the Micron 7400 PRO is a much better choice and the 480GB costs stuff all.
I've heard from other sources that many people consider ECC RAM to be "required" for ZFS. What are your thoughts on that, and are you running ECC RAM in your build?
Is there a command line option to export the config? Possibly via Ansible? I'm hoping to automate this process. Is the config restorable from a remote resource like S3?
Hi! Tks for advice but I don't believe I did any back up on truenas scale and I get the message "Minimal BASH - Like line editing is suported. For the first wort, Tab lists possible command completion...." Is there any possiblitity/solution to fix that ???
It’s nice how simple it is. Great video! I always backup the config as part of the update process. I keep the last 3 version. I store them on my NAS datapool but the 1st of every month take manual offline copies and store them in a safe location. Questions… 1) I started with freenas (truenas-core old school) running on a bootable USB stick, they were not great and seems risky so I moved to a spare WD raptor hdd instead (150gb 10k rpm sata1) much better and have no other use for these drives! Upgraded hardware last year and had to move from truenas-core to truenas-scale to support AMD AM5 correctly (advice from devs for modern hardware support). It warned during the update/migration that I should install on a SSD, is this really important or not? I don’t see the need for myself but I would consider an SSD/NVME for a log or other cache drive aiding hdds rather than waste that speed on just the OS boot drive. Or is worth moving anyway? 2) backups of the NAS config, any automated ways you would recommend / trust? (NAS to NAS? Cloud? USB? Or just manual do it?) 3) if you use an NVME drive for boot, is there a way to lock down say 20Gb for the OS and use anything spare for cache or other NAS services? (Can a mini pool be put on there? I ask because I see 1Tb drives cost about the same or less compared with 32-128gb drives!!! Feels wasteful.
1) using a USB is currently not the way to do it, but HDD or SSD is fine 2) there are some ways to automate it you can find in the TrueNAS forums, I just do it manually 3) There is no officially support ways, but there are ways you can find in the TrueNAS forums.
I recently had to upgrade one of my TrueNAS Core pools as it was at 79% usage. Replaced each one or four 8TB HDD with a 12TB at a time. After resilver process, on to the next drive. 4 days later all was well and I had more room. Now only 46% of space used.
One of the SSDs died in a mirrored boot pool on my main Truenas server. How do I replace the failed drive and get the new replacement drive back in the boot pool? Will Truenas automatically add the new drive to the boot pool?
Can i get the backup file from the pool i have to import and restore after importing the pool on a new system (core systems)? Its not encrypted. The backups ended up on the pool after my main pc crashed. Edit: i just tried it and im having the same lan configuration issues i was having with the system from a fresh install (cant update the network interfaces at all). I suppose im gonna have to look up how to set the whole thing up from scratch again.
@@LAWRENCESYSTEMS Oh, that's even better! So, you could theoretically import the pools on a completely different machine that is not even running TrueNAS (but maybe just Debian with openZFS or the like) and still have all ACLs preserved? Of course, in that case you would need to re-create the users and groups on that system or ideally, have all that in an LDAP already. 🤔
ok for some reason mine wont upload the file... urgghhh! .P.s. I imported the drive before doing that, could that be why? my apps arent showing and all my user credentials are missing ... Such a tough nut
you can fix that problem by putting anything else than WD. WD consumer are bad and that made me doubt even the datacenter disks. Although I never had a problem with WD datacenter one... But every single one of my 5 WD drives including the black one died. So I no longer buy WD and disks somehow don't die anymore :). Well not true. One (of 4) intel SSD died and was replaced in the warranty period.
this is the main reason when i see people say redundant drive for truenas i scoff at the thought of wasting drive slot for redundant drive when as long as you periodically export the config file you are golden. It would be different if you where in a setting where you had no access to your truenas system then redundant is cool and all but for most home users it is not necessary. Unless you are using your boot drive for storing apps then you might want to consider it but i use different pool of for that and it is redundant.
Thanks for the reminder to export my config! It's been a while since I last exported it. Actually had to allow the app to be downloaded, Windows Security kept flagging it.
Great video! I see this question asked at least weekly on the forums/reddit. One additional step I take is to add a nightly cron job that exports the config, and then I copy that off to another system for safe keeping. Config changes don’t happen that often, and are well documented, but it’s nice to not have to remember to re-export the configs every day that I do have changes.
That's a good idea!
How to do this? I am newbie
Man Im new to your channel, but man you rock, I enjoy your videos because you explain like a normal person and not like someone who has been using linux since 7 years old. Thanks I'm a programmer but still appreciate people explaining the way you do, I'm sticking to your channel for the long run, super helpful tips before setting up my TRUENAS.
Your videos are amazing. You have helped me setting up my first True nas sclae NAS and you have made it very easy. Thank you!!!
Glad to help!
Nice, needed that info simple and easy. I'll be soon moving my drives into a new NAS-type enclosure because my old desktop isn't cutting it anymore, and this answers how to do it if I can't (and probably won't) use the SATA TrueNAS is currently in.
Such a helpful how-to on TrueNas recovery readiness. You are a gold mine!
I've had 2 nvme drives fail the exact same way. Very annoying that they die like that with no warning and it's the reason Im rebuildingmy homelab servers to have redundant boot drives. It is good that Truenas is fairly painless to recover so long as your config is backed up.
nothing is made with quality as it was even a few years ago. I have lost 2 SSDs in the past 5 years.
SATA SSDs are so cheap now that I just buy a pair of 256-512GB drives and make the boot pool a mirror. But it's good to know this is so straightforward. Thanks Tom.
Perfect timing. My boot usb drive is failing. Thanks!
Good info 👌 I'm planning to build the boot on a mirror anyway 😅
I have a question related to this topic: can you create a task that automatically saves the config file into a backup storage of your choosing? Like a USB drive or even an external server through rsync or anything similar?
I never imagined that a video would be necessary for something so simple and fundamental. That why teaching to beginners is an hard task.
Does truecommand backup these configs and keys when you manage a truenas?
The best would be that the you could automate this config with keys export to preferred safe location with encryption.
You can: settings>advanced>cron jobs. The following will export your config and keys, then you can run some other process to copy it to another system:
tar cf /mnt///`hostname -s`-`date +%Y%m%d%H%M%S`.tar -C /data/ freenas-v1.db pwenc_secret
Replacing and with your preferred location.
Nice demo video. One thing I'd like to know is - how did the original disk fail and how did it present? I ask because I noticed the pool showed in an exported state. I am not a ZFS expert, but I thought exporting a pool took manual effort (or at least, done explicitly by the OS). Did the drive fail but the system was still running enough for you to gracefully export the pool or shutdown the system? Or was this catastrophic?
Nope, it did not fail graceful and exported is what TrueNAS shows when it can see a pool that has not been previously imported.
amazing and very informative video. Appreciate you help.
My experience with consumer NVME in my desktops made me not trust them at all and sure as hell never use them for boot drives in a server. Dual consumer SATA SSD is a far better choice, you don't need NVME speeds on TrueNAS for boot anyway. I've been running consumer SSDs as boot drives in all my servers for almost 10 years with no issues, in that time I've had 2 die.
SSDs usually don't give any indication there gonna die, sometimes they do like causing crashes but in my experience one day there working, next there dead.
If people really want NVME boot then something like the Micron 7400 PRO is a much better choice and the 480GB costs stuff all.
One more time great video, u are the best!!!
I've heard from other sources that many people consider ECC RAM to be "required" for ZFS. What are your thoughts on that, and are you running ECC RAM in your build?
Is there a command line option to export the config? Possibly via Ansible? I'm hoping to automate this process. Is the config restorable from a remote resource like S3?
Hi! Tks for advice but I don't believe I did any back up on truenas scale and I get the message "Minimal BASH - Like line editing is suported. For the first wort, Tab lists possible command completion...." Is there any possiblitity/solution to fix that ???
That looks quite similar to my system. I have 3 of the 4Bay components in mine.
It’s nice how simple it is. Great video!
I always backup the config as part of the update process. I keep the last 3 version. I store them on my NAS datapool but the 1st of every month take manual offline copies and store them in a safe location.
Questions…
1) I started with freenas (truenas-core old school) running on a bootable USB stick, they were not great and seems risky so I moved to a spare WD raptor hdd instead (150gb 10k rpm sata1) much better and have no other use for these drives! Upgraded hardware last year and had to move from truenas-core to truenas-scale to support AMD AM5 correctly (advice from devs for modern hardware support). It warned during the update/migration that I should install on a SSD, is this really important or not? I don’t see the need for myself but I would consider an SSD/NVME for a log or other cache drive aiding hdds rather than waste that speed on just the OS boot drive. Or is worth moving anyway?
2) backups of the NAS config, any automated ways you would recommend / trust? (NAS to NAS? Cloud? USB? Or just manual do it?)
3) if you use an NVME drive for boot, is there a way to lock down say 20Gb for the OS and use anything spare for cache or other NAS services? (Can a mini pool be put on there? I ask because I see 1Tb drives cost about the same or less compared with 32-128gb drives!!! Feels wasteful.
1) using a USB is currently not the way to do it, but HDD or SSD is fine
2) there are some ways to automate it you can find in the TrueNAS forums, I just do it manually
3) There is no officially support ways, but there are ways you can find in the TrueNAS forums.
I recently had to upgrade one of my TrueNAS Core pools as it was at 79% usage. Replaced each one or four 8TB HDD with a 12TB at a time. After resilver process, on to the next drive. 4 days later all was well and I had more room. Now only 46% of space used.
I need to do this , but unfortunately I have 8 drive Z2 arrays...
One of the SSDs died in a mirrored boot pool on my main Truenas server. How do I replace the failed drive and get the new replacement drive back in the boot pool? Will Truenas automatically add the new drive to the boot pool?
Can you automate the config/key backups?
Can i get the backup file from the pool i have to import and restore after importing the pool on a new system (core systems)? Its not encrypted. The backups ended up on the pool after my main pc crashed.
Edit: i just tried it and im having the same lan configuration issues i was having with the system from a fresh install (cant update the network interfaces at all). I suppose im gonna have to look up how to set the whole thing up from scratch again.
Why use a m.2(NVME) as a boot drive, not a SATA SSD?
Will this process also restore users/groups and NFS/samba shares including their permissions/ACLs? 🤔
Users. groups and shares are all in the boot drive restore, the ACL & Permissions are on the datasets.
@@LAWRENCESYSTEMS Oh, that's even better!
So, you could theoretically import the pools on a completely different machine that is not even running TrueNAS (but maybe just Debian with openZFS or the like) and still have all ACLs preserved? Of course, in that case you would need to re-create the users and groups on that system or ideally, have all that in an LDAP already. 🤔
Yes, if the id's line up you can move the ZFS pool.
Will applications like PleX also be backed up or will they have to be reinstalled?
Any way to set up a recurring back up of the config file?
There are no official ways, but it can be done.
@@LAWRENCESYSTEMS Would you be able to do a video on it? That would be very helpful! Thanks again for the great content.
Stupid question of the day... Shouldn't the TrueNas BOOT drive be 2 physical drives mirrored or Raid 1, so if one fails you have no loss or downtime?
It's not a bad idea if you have the budget for it.
Is truenas "eating" up the drives like proxmox does with extensive writing just running the system without much usage?
Not at all
NVMe drives are a blessing a curse. Stupid fast but they don’t last long.
ok for some reason mine wont upload the file... urgghhh! .P.s. I imported the drive before doing that, could that be why? my apps arent showing and all my user credentials are missing ... Such a tough nut
Am I correct in remembering that TrueNAS (Scale I think but could be Core) duplicates the config to the data pool every night?
It does not do this
@@LAWRENCESYSTEMS Oh, ok. Thanks for confirming.
Speaking of lost keys. What I do with dead NVME drives and processors is drill them in the corner and use them as keychains.
no backup - > no pity! ;)
I confess to having two identical m.2 drives in mirror on the motherboard.
you can fix that problem by putting anything else than WD. WD consumer are bad and that made me doubt even the datacenter disks. Although I never had a problem with WD datacenter one... But every single one of my 5 WD drives including the black one died. So I no longer buy WD and disks somehow don't die anymore :). Well not true. One (of 4) intel SSD died and was replaced in the warranty period.
this is the main reason when i see people say redundant drive for truenas i scoff at the thought of wasting drive slot for redundant drive when as long as you periodically export the config file you are golden. It would be different if you where in a setting where you had no access to your truenas system then redundant is cool and all but for most home users it is not necessary. Unless you are using your boot drive for storing apps then you might want to consider it but i use different pool of for that and it is redundant.
Cheap nvmes are expensive......