My ULTIMATE Custom Video Editing NAS (all SSD, 25GbE, TrueNAS Scale)
HTML-код
- Опубликовано: 26 июл 2024
- In this video, I will be going over the server I use to video edit for the channel, including the components and configuration settings I am using for my workflow.
Hire Me! www.spacerex.co/hire-me/?utm_...
Post on the Forums! forums.spacerex.co/
Server Components*:
SATA SSD's (old ones are discontinued) amzn.to/46LI4Qp
Links mentioned:
Why L2ARC is amazing on ZFS: • What is L2ARC for ZFS ...
My custom ZFS configs: forums.spacerex.co/t/my-truen...
Why Linux ZFS only uses 50% of ram by default: github.com/openzfs/zfs/commit...
#truenas #videoediting #nas
TOC
00:00 Overview of components
03:46 Why I am using TrueNAS SCALE
12:01: CPUs
13:03 Custom parameters for ZFS
17:45 Pool configuration and replication
20:36 Other configurations
24:22 Conclusion
*These are affiliate links, which means that if you purchase a product through one of them, I will receive a small commission (at no additional cost to you). Thank you for supporting my channel! 
Наука
Good video Rex, watching now !
Dude I really like your content. Keep up the great work!
Thanks man!
Your server is mind blowing. It’s like putting 1,500 hp in a daily driven car LOL. It was fun to hear about your setup.
Absolutely!
Even as a test bench it’s overkill lol
@SpaceRex yes, you should be able to write a little bash script with your ZFS sys changes and then use systemd to create a service that invokes that bash script.
Your videos keep getting more and more interesting to me Mr. Rex. I am really enjoying how you present everything and explain! I would only like to point out that even if SCALE is based on Linux and has Docker support, IX are using Kubernetes or K8 instead on SCALE, not dockers unfortunately.
I've never heard about forcing all metadata on ARC and it seems such an obvious thing to do, I would feel much more comfortable doing this than doing the special metadata vdev that Wendell suggested some time ago. Thank you so much :)
Also are you sure these HBA can pass the TRIM command to the SSD drives?
Thanks man!
When it comes TRIM to that is interesting, I always assumed they could just fine, and TRIM does work when I kick it off in SCALE
🔥🔥🔥🎆🎆🎆🙏🙏🙏🙏
the ARC tips for TrueNAS Scale are game changers
Thanks for the video. What’s the enclosure all your drives are in?
The issue you mentioned with the performance in your earlier setup, did you happen to check if Auto TRIM was on or off? I am planning to build an all SSD NAS storage server, and as per my research, the LSI Drivers are sometimes a hit or miss. Not having TRIM is probably the main reason for performance degradation if you write and delete data repeatedly.
Great Video, what is the Brand and Model of that Box/Server?
Thanks for the video. What is the power consumption on the wall?
Good vdo.
@SpaceRex - do you have an up-to-date location on servers, specs and tech that you use? I've been looking into a jbod, but slow to pull the trigger
Have you considered swapping the motherboard from the 2u case with the JBOD 3u? That would give you some more height for PCI slots, so you could get an external 16 port HBA, freeing up a PCI slot. You could also get a taller CPU cooler.
Can you use the TrueNAS SMB Share as the primary steam game library storage? Can you do a video with gaming performance using TrueNAS storage?
If I am running TrueNas Core, would I have to start over from scratch with my data and plex pools, or can I import those into scale?
This is awesome. Would love to learn more about the zfs limit and if there is an automated way to have it run and really utilise the ram. I feel like my 63gib out of 128 just sitting there is wasting away.
More so than anything I just need to figure out how to get the zfs parameters to persist through reboots
Curious what kind of r/w speeds you see on this config? Thanks
Is it possible to create a windows 11 virtual machine and use it to do video editing?
hey bro what HBAs are you using for this build?
For the video editing the two of you are doing, would you realistically notice a difference if this was 10gbe rather than the 25gbe?
So I have hit speeds over 10GbE in use, but honestly I dont think I would notice too much
Have you noticed bottlenecking issues with your raid setup in terms of editing/scrubbing with your raid setup? I'm looking to rebuild my TrueNAS server and I'm undecided between going with a 6 drive RAIDZ2 VDEV or a 3 mirrored VDEVs
So for a video editing sever with HDDs, mirrors should be better for scrubbing through a timeline due to the random reads, but if you have just one or two editors going at once you are unlikely to notice.
Overall for the pretty minimal storage cost between the two options (3 drives vs 2) I would probably do mirrors, as down the line you can replace two at a time with larger drives to get more space or just add two more drives
What read / write speed are you able to achieve with this setup?
Max that I was able to do was 1.8 GB/s in SMBv3 multi channel across 2x 10GbE connections to a single client
is there such thing as a thunderbolt 3 to 25gbe ethernet adapter for mac?
Yes there is, just only one company makes it, and its really expensive
@@SpaceRexWill Thanks for all yoru videos btw, I just subscribed. I have been watching a ton of your videos since I just bought a DS1522+. It's exciting stuff. Ended up pickign up 3 x 14TB Exos SATA HDD for $115 a piece off ebay..I'll do an extended smart test on all three several times in the first 30 days, to ensure they are healthy. I hope they dont' have too many hours.. he disclose it. But $115 each is so cheap:) will be a 28TB raid which is nice. I can add antoher 14TB later for 42 TB which is more than I think I'll ever use lol. I'll keep the last bay free i guess for easy cloning if I want to increase the HDD size of each drive later. (Have been tempted to build my own ZFS TrueNas raid, but it seems like the Synology really has a lot of functionality I can quickly use.. and my friend has Synology and will be nice for us to be able to backup each others sensitive data, securely over the internet.. in case there is a fire or ransomware at one of our homes.)
I am drooling over your server there. Would be fun to somehow buy one cheaply with a lot of drive bays, and make a truenas array with perhaps TrueNas scale so I cna do hypervisor stuff as well. I learned about hypervisor like 15 yeasr ago but never really had the hardware/setup to do it. Seems like fun.
This is a normal exploit. 📃 So it happened
Lovely video, but I would like to bring some observations to your attention: When you write the scripts for your video, make sure you have the target audience in mind. Someone interested in a ULTIMATE storage server probably knows about FreeBSD and TrueNAS. So to define in the same Video what Unix, ZFS, and all the other very basic things are is just padding the video length and making it harder for me to stay interested in watching the video - others might feel the same way. Consider splitting it into two videos instead. I'm reminded of software development books with "Advanced Techniques" or "Expert" in the title and then they start with defining what a computer is.
I think keeping one video and just adding a timestamp to skip the "FreeBSD vs Linux" and "TrueNAS vs TrueNAS scale" will be the easiest an most efficient. I personally subscribed for the general Synology videos and I am interested in "Ultimate Storage Server" even if I never build or need one. For me it was helpful to learn about freebsd and truenas vs. truenas scale in context of this server.
Its always hard finding the balance. For me I tend to try not to loose people, especially a video like this that is not really technical, but rather an explanation of what I have.
At the end of the day I figure people can just skip past the stuff they know, but people cant just learn the stuff that they dont know halfway through the video.
I actually appreciate that he explained it all because I’m not familiar with free BSD and such, but at the same time data storage is a hobby and I love learning about it, so this was a very informative video for me.
wrap your commands in a `sudo sh -c "" `&& lose the variables ::
sudo sh -c "echo 8589934592 > /sys/module/zfs/parameters/zfs_arc_meta_min"
originally came here to post this, but i dunno how nice this will play with scales updates ::
sudo sh -c "echo 'options zfs zfs_arc_max=$((100*2**30))
options zfs zfs_arc_min=$((30*2**30))
options zfs zfs_arc_meta_min=$((8*2**30))' > /etc/modprobe.d/zfs.conf" && sudo update-initramfs -u -k all
no exponents in dash ::
sudo sh -c "echo $(( 1073741824 * 8 )) > /sys/module/zfs/parameters/zfs_arc_meta_min"
Will check it out! Thanks!