TrueNAS Backup To BackBlaze
HTML-код
- Опубликовано: 29 июн 2024
- lawrence.technology/truenas-t...
Connecting With Us
---------------------------------------------------
+ Hire Us For A Project: lawrencesystems.com/hire-us/
+ Tom Twitter 🐦 / tomlawrencetech
+ Our Web Site www.lawrencesystems.com/
+ Our Forums forums.lawrencesystems.com/
+ Instagram / lawrencesystems
+ Facebook / lawrencesystems
+ GitHub github.com/lawrencesystems/
+ Discord / discord
Lawrence Systems Shirts and Swag
---------------------------------------------------
►👕 lawrence.video/swag
AFFILIATES & REFERRAL LINKS
---------------------------------------------------
Amazon Affiliate Store
🛒 www.amazon.com/shop/lawrences...
UniFi Affiliate Link
🛒 store.ui.com?a_aid=LTS
All Of Our Affiliates that help us out and can get you discounts!
🛒 lawrencesystems.com/partners-...
Gear we use on Kit
🛒 kit.co/lawrencesystems
Use OfferCode LTSERVICES to get 5% off your order at
🛒 lawrence.video/techsupplydirect
Digital Ocean Offer Code
🛒 m.do.co/c/85de8d181725
HostiFi UniFi Cloud Hosting Service
🛒 hostifi.net/?via=lawrencesystems
Protect you privacy with a VPN from Private Internet Access
🛒 www.privateinternetaccess.com...
Patreon
💰 / lawrencesystems
help.backblaze.com/hc/en-us/a...
www.backblaze.com/b2/b2-trans...
github.com/Backblaze/B2_Comma...
⏱️ Timestamps ⏱️
0:00 TrueNAS BackBlaze Backups
0:56 Why Backblaze
3:03 Creating B2 Buckets
5:44 Creating API Keys For The Buckets
8:19 Creating TrueNAS Backup Task
12:09 Verifying Backups
13:40 Encrypting Backups
15:51 Restoing TrueNAS From BackBlaze
#TrueNAS #BackBlaze #Backup #Cloudbackup 
Наука
Most recent TrueNAS tutorials
lawrence.technology/truenas-tutorials/
help.backblaze.com/hc/en-us/articles/360037814594-B2-Pricing
www.backblaze.com/b2/b2-transactions-price.html
github.com/Backblaze/B2_Command_Line_Tool
⏱️ Timestamps ⏱️
0:00 TrueNAS BackBlaze Backups
0:56 Why Backblaze
3:03 Creating B2 Buckets
5:44 Creating API Keys For The Buckets
8:19 Creating TrueNAS Backup Task
12:09 Verifying Backups
13:40 Encrypting Backups
15:51 Restoing TrueNAS From BackBlaze
Just want to give a sincere thank you! Your UniFi, Pfsense, and TrueNAS videos help me understand networking security and best practices.
Wow, thank you!
Thank you Tom. I finally bit the bullet and set the encrypted backup up for a piece of mind. With this I'll have the original, a local copy on external hard disk, as well as Backblaze. I feel pretty good about my odds in the event of disaster at this point.
I have found that the --fast-list option is a requirement for my B2 backups. Otherwise you end up with tons of Class B (I think) calls, which eventually add up to real money. Using that option significantly reduces those calls and I always then end up under the free limit of those transactions each day.
(At least on the 11.x versions of FreeNAS. Maybe it's changed in v12?)
Nope, hasn't changed in 12. It's an rclone thing. Still using fastlist.
Happy New Year. I know its an old video, but i only followed up on it. Worked like a charm. Thanks.
Glad it helped
Good video. Always learn things from your vids
As usual, great video, Tom!
I literally just set this up last week for a client using wasabi! Could tutorial!
Perfect instructions!
8:36 they make it very easy and customizable to create cloud sync tasks. It’s pretty well developed.
Excellent, informative video. Appreciate the bookmarks. I can see how to schedule the job (start time), however any ideas of how I can stop the syncing at a certaint time? Use case is an install with limited upload speed, want to avoid uploading 8am-11pm. Goal is to have larger upload jobs spread out over multiple nights when they happen.
Digging the sriracha mug
I like Backblaze because of how easy it is. Just pop it on and TBs backed up good to go.
I use backblaze unlimited to back up my media server. I have never had a problem with. It just works. My only complaint is backblaze doesn't have a personal unlimited service that is compatible with linux. Their personal non business service not supporting linux, is the primary reason my media server runs on windows.
Thanks Tom for making this videos and a very interesting topic. Just one question maybe it is obvious for everyone but not for me sorry in advance ;-). Can you actually restore an encrypted file without having the TrueNAS that encrypted it in the first place or is this password and salt only relevant for the TrueNAS that encrypt/decrypt the files? I guess after seeing your video that you should be ok in case of disaster that the TrueNAS goes up in flames you can load the config incl. passwords etc. to another TrueNAS and restore from there right?
This is a good tutorial but if you are using BackBlaze be aware of their API costs. If you use Sync you can very quickly rack up some very large costs. I only have 2TB of data, the storage space costs nothing but I've just had a nasty surprise with API call charges.
backblaze is rock solid!!!
B2 RULES
Can't help but wonder if people only listen to the step by step and fail to listen to your words of wisdom.
Thanks!
Thank you!
Great Video as usual, I follow the video and setup a test of what will likely be my offsite backup. While I was running a disaster recovery test and loging all steps for the playbook on how to do it, I was haunted by question I can't test in my homelab as I don't have a spare server. I imagine the answer is of course you can, but if I setup encryption at the source (Truenas) can I recover files from B2 to a new instance of TrueNas? (Not sure how Truenas implemented the encryption buy I imagine they don't rely on Hardware nor will change from version to version so it will be backwards compatible, but I can't test it out.)
Online backup services is a great option for those who need offsite copies but once you get into 10s to 100s of terabytes, it can get expensive. Offsite replication via TrueNAS or SyncThing can be just as effective.
B2 with Veeam is the only way I've found to use the immutability feature so far. What is everyone else using?
B2 is cheaper than similar competitors but still isn't sensibly priced for the enthusiast-level consumer
10:38 the settings at the bottom such as exclusions and bandwidth scheduling, you can use chatgpt to generate those settings to your liking. No need to learn Rclone rules.
Great video Tom!
Is there any way to decrypt single file manually without truenas if i know both password and salt?
Been using Backblaze B2 for a few years, have about 22TB there. Wasabi is a good alternative at a tad more, but no transaction or egress fees..
$1300+ a year? Yikes!
@@TotallyNuss Best deal I can find. Have been toying with AWS or MS Cold storage, btu would be painful to retrieve.
This is all great... but in a hourly backup scenario, the data would still be exposed to ransom, right? Does BackBlaze has some policy for this?
I love using Crashplan Small Business. Their pricing is great and you have UNLIMITED backup space. That's right UNLIMITED. I don't have to pay extra for more storage.
You are wrong about sync and copy. If you chose copy, it will only push what's new, only the initial backup will take time.
As for sync, by default it'll remove files remotely (which is not what you want for backup)
For those of you visiting this years on, the above comment is correct, however if you enable file immutability on Backblazes's side, when your truenas system deletes the file, it will be kept as a file revision until the policy on backblazes's side removes it (you can set this for however many days you wish. I have it set to 90 days). This is critical to ensure that you aren't wasting costs on files that you genuninely want gone.
I personally intend on setting up a 2nd truenas system with cheap spinners to keep all files regardless of deletion status, so that I do not incur any cloud costs for keeping them.
Could you do a similar demo using TrueNAS scale and Backblaze B2
This seems a lot nicer than Unraid. I've got a bash script someone else made using Borg and Rclone which feels fragile
TrueNAS has has eome really nice intergrations.
@@LAWRENCESYSTEMS *got ?
@@christopherwilkinson215 fixed
Hi Tom, thanks for the video, but i have a question. Is it possible to backup just the latest snapshot
I'm trying this right now with some encrypted veeam backup jobs. It seems my TrueNAS sits and ponders large (300GB) files for quite some time before uploading them (guessing it's hashing the files to 96MB chunks prior to upload?). Is there a way to speed this up? I see snapshot as a feature, but the veeam backup runs once daily and I have it set to start pretty much after that job would complete. This is of course only for the initial sync job and probably only for the incremental fulls as well.
Great information. Does Backblaze still remove your files the backup if the source is not connected for a year? Or is there nowadays a delete never option?
They have different options now. The default unlimited is it'll go away after so much time inactivity.
What is the correct syntax to exclude a folder or file?
How to start cloud sync task using shell command?
👍👍
How about compression? Is it possible to compress before encrypting in order to trade cpu for bandwidth? Of course for compressible content (not video, jpg images etc. :) )
Not currently supported.
I’m curious about how you test your backups (a backup you can’t restore….). With hundreds of terabytes and a restore being all or nothing do you do a test restore at any stage?
The way I use this, it's already a backup of the backup. I backup my computers to my NAS, which then syncs it to Backblaze. The backup software I use verifies that all backups are valid and readable. Backblaze is there in case my house burns down.
@@VTOLfreak I treat my offsite backups the same way - things have gone really bad if I need it. What backup software are you using? I decided on Borgbackup to an offsite server that I own rather than using something like backblaze. I like the fact that I can selectively restore. I was wondering what sort of backup verification Truenas has or if the only way to test is to do a full restore.
@@scottmcnamara2458 I use Acronis True Image at home which also supports selective restore. In a corporate environment I would use Veeam or EMC Networker. By profession I'm a MSSQL DBA and some software like Idera SQL Safe allows you to live mount a database backup so you can pull out only the data you need instead of restoring the full backup. Most software can do this with files, not many can do the same trick with databases.
@@scottmcnamara2458 Try duplicaty for an offsite backup! Works perfectly and in restore case you can select which folder or file to restore.
great video! but if i get it well: the encryption is done on the backblaze side right ? so at some point they have our unencrypted data? is is possible to upload files to backblaze using a pipe ? so i could tar -ac /mnt/data | age -d my_public_key | backblaze-b2 upload-file BucketName - filename.tar.encrypted ? ( for now i can't pass a - parameter to say "hey read stdin for the file content" )
It is encrypted BEFORE going to Backblaze
@@LAWRENCESYSTEMS oh awesome ! that's make thing much easier then :) thank you for your answer ^^
Could you make a guide covering how to backup TrueNAS to AWS S3 Glacier Deep Archive?
To my knowledge it is not supported naively via the UI
Can you explain the Bandwidth Limit? can we make it transfer only during lets say 12am - 5am?
of course you can duh
For some reason when I use SYNC as the transfer mode in TrueNAS, I noticed that it backups everything again each time to B2. I just use COPY instead which performs more like a sync task. Could enabling encryption be causing it to perform this way?
Did you ever figure this out? I'm seeing that right now. the bucket is growing several times the size of the copy in TrueNAS.
@@cristhianulloa1649 I just set Transfer Mode to "Copy".
7:54 if you lose the app key and need to recover from this bucket, can’t you login to your BackBlaze account and just create a new key that has access to that bucket?
Yes you can! I already had a disaster recovery done with them, worked great!
Yes you can.
Great thank you! I already saved the app key into my password manager; but either way, I want learn how buckets work with backups. I use BackBlaze with my Synology and Hyperbackup. BackBlaze seems to have the best service-price-value for me.
Why a B2 Bucket instead the Backup Solution? The Backup Solution seems a LOT more cheaper.
What case is that in the thumbnail?
To me, backup is lacking on TrueNAS. There does not seem to be any versioning available. Sync only gets the last file copied but does not allow you to retrieve version n-X. I run Cloudberry (MSP360) from my workstation (painfully slow) to do backups so that I can retrieve previous versions of a file as well I have it configured to keep the last version of a file for 60 days to recover accidental deletion
You have to configure the versioning with ZFS and snapshots.
Which plan do you use? I question this, because I saw another video the other day, where the data where delete after a while. If this is happening that is not a good solution for a real backup. Thanks.
No plan, this is bucket storage not their "backup plan"
@@LAWRENCESYSTEMS Ah, ok. So, with a bucket you don't loose data after a periode of time? The lifetime / savetime is infinity?
@@IPD2001 yes because with B2 you pay for the specific amount of storage space you use. No more, no less. (As well as upload and download) So you could have decided you don’t need a bunch of data, deleted it off your local systems, and you’d still be paying for it unless you delete it from Backblaze. It stays there until you remove it.
The $X/month unlimited storage plans require you to plug in a drive periodically to prove you’ve still got the data. If you’ve decided to toss a drive full of data because you don’t want it anymore, they aren’t going to keep backing it up for you. That’s part of how they make it viable to offer unlimited storage plans.
And it's super expensive. My server would cost over a grand a year to keep backed up. Fine for business but I think most viewers of this channel are individual users so this suggestion makes no sense to me. Way beyond means.
5:11 how You manage Your encryption Sir? using cryptomator or something else?\
or maybe can You do YT Vids to explain that :D
thanks.
As I said int the video, I use the TrueNAS system for encyrption.
@@LAWRENCESYSTEMS i think i missed that explanation, :) thank you for Sir.
Have you been in the dead sea? :)
It seems if the backup is encrypted there is no way to identify (and therefore no way to restore) just a single file or small hand full of files. Is that correct?
Not from the TrueNAS UI
@@LAWRENCESYSTEMS Can you restore single files some other way?
I currently have no way to test this, but this Dec 2018 TrueNAS forum post suggests a way to locate the rclone config file being used by FreeNAS (at the time), and pointing a standalone rclone browser using that cfg at the remote backup, allowing you to see decrypted content and filenames.
The suggestion is to run "ps ax | grep rclone" while running a Free/TruNAS sync task. The result of that command will show you where the rclone cfg file FreeNAS is using is located.
The original poster of the question later says they were able to use this technique to view backed up encrypted content(which feels very much like a bit of a hack).
Here is a link to the post: www.truenas.com/community/threads/cloud-sync-restore-strategy.71989/
I looked at backblaze, but went with Wasabi. The cost is about the same but Wasabi has no egress charges.
Cost is not the same. Wasabi has a minimum charge. I have less than 1 TB going to wasabi (About 300 GB). My bill is $7 a month after base fee. My for Backblaze for that is about $1.80. There's also the minimum 90 day storage policy for deleted items. If you delete the data, you're charged for 90 days anyway.
@@akurenda1985 that is true
How can I upload TrueNas snapshots to backblaze
you don't
@@LAWRENCESYSTEMS do you not consider ZFS snapshots as part of your data?
@@JoeTaber They are but there is not a method to send them to Backblaze. You back them up to another ZFS pool.
Top question for this video: Where can I get one of those coffee mugs?
What if backblaze's hard drives are in a raid? ITS NOT REALLY A BACKUP THEN RIGHT?
LOL Im just playing. But really is it?
They have levels of redundancy but I consider data stored there as "One Location"
@@LAWRENCESYSTEMS I figured they have some kind storage array that could take multiple failures before losing anything. But I was just being a smart ass. I appreciate the reply.
anf for Zvol? I cannot backup
why word "remote encryption" not "client-side encryption" :-)
Do you need the salt?
Their privacy policy calls out that they can see file metadata (e.g. names, type, size), and that data is exempted from their privacy policy. It’s not exactly zero trust, and they don’t even attempt to explain what they do with this data. I’m not sold.
If you encrypted the data before it does not matter what they see :)
Encrypt before backing up.
Maybe I’m missing something. Do you mean I should create big monolithic archives (tarballs, say), and send them i stead of individual files?
As I said int the video, I use the TrueNAS system for encryption which encrypts the data before sending.
@@stevetaylorftw If you follow the steps to encrypt the data as shown in the video, all file metadata will be encrypted and Backblaze will not be able to see anything about your files (not the filename, not the filetype, the file sizes will be wrong). It doesn't really matter what their privacy policy says about metadata at this point because the only metadata Backblaze can see is useless garbled (encrypted) text.
Tom, a few words of caution, remember where your YT channel started and why people subscribed in the first place. Happening a lot where channels start moving into higher and higher end gear, products or ideals and guess what, negative responses follow and loss of subscription. Backblaze along with all the other companies selling high drive-count systems are very expensive regardless of your opinions. Complicated systems that are your business model and choice is fine but myself and I am sure many others watch for things that are achieveable in cost-effective ways. Same goes for the flood of channels doing bloody VLOG's of talking crap.
Now, I am not down-voting this post, its what you have seen as good content and for the narrow market using this product but as I have hinted, I have stopped watching in short time and asking myself why I subbed when I am closing the alerts and videos like this.
Does blackblaze sell systems? I thought they were just cloud storage.
Backblaze is one of the cheapest backup solution in the cloud...
First of all, this is a video which shows how easy is to backup a TrueNAS data on some cloud object based storage. You can pick S3 if you want, the method will be the same. Once we said that, you can agree (or not) that this can be something people can consider as an option. I am not sure if you are aware, but the S3 has one of the most reliable storage plans, you can have reasonably good pricing for the service you will get. Maybe your data is not valuable enough to spend 25$ per month for 2TB of storage in S3, some people will consider this pricing just fine for the protection the S3 is providing, and no, you cannot build a similar product for less sometimes you just need to pay the price because it is way cheaper than if you try to do it yourself
I backup 7TB for $8/mo. Backblaze has many options..
TureNAS / FreeNAS is a very popular topic with both homelabs & enterprise users, and still brings lots of subscribers. If you don't like TrueNAS storage and really inexpensive ways to back up then i am not sure why you would subscribe to my channel. ¯\_(ツ)_/¯