Thanks for this material. Your extra bits like the scrub parts and the symlinks make this a one stop to get going and know enough to go learn more if wanted.
What a refreshing take on the whole thing, fire and forget RAID. What drew me in was mainly that fact that SnapRAID should stress drives MUCH less than a traditional RAID. Plus the smaller scrubs means that even high latency SMR drives aren't as likely to stall the system. I really did wish there was a version of this that just ensured there were 2/3 copies of files, scattered around the file pool. So you wouldn't even have to worry about which are parity drives, and which aren't. So long as the amount of drives lost is below the the number of copies. And to recover all you had to do is just add a fresh drive to the pool. No extra setup.
Thanks for the walk-through. Excellent tutorial videos like always. I know that the concept of snapraid is kinda (similar to unraid with the exception of more room for extra parity disks for snapraid) but totally different than conventional "mdadm" software or hardware raid or even ZFS when it comes to (Write - Read) performance based on RAID level and configuration. One question though: Since you chose the snapraid policy (the most free space) and the 3 video files were copied into 3 different HDDs, have you tried to (copy-paste) or even use (rsync) service to see if ALL 3 files will be copied simultaneously to your desktop or to other backup server ? The reason why I'm asking is because I have 20+ HDDs of the same size, and a couple of 10Gb NICs and wondering if the (most free space) policy act same like other conventional raid levels when reading from multiple HDDs.
SnapRAID is just a nice and easy way to give multiple mismatched drives redundancy between them with a parity drive(s). Mergerfs is doing this part that you are asking about writing files and reading files spanned across multiple drives. Generally mergerfs will increase performance when reading from multiple drives instead of from a single drive, but... it will not be anywhere near as good as RAID performance. So for you having matching drives, I wouldn't concern myself with SnapRAID or mergerfs. Your setup sounds awesome! I would love 10Gb networking! If you have 20 matching drives you'd be best to be using ZFS RAID. Just don't create one big pool, have at least a separate backup pool to your data pool. You could still use a backup system like borg like I explain in a later video for your data but with ZFS you have the additional option of using ZFS snapshots and send them to that separate backup drive or pool instead of using a backup system like borg/restic. If you have a really big drive pool like you have, I would highly recommend ZFS over SnapRAID/mergerfs and even over btrfs... you'll have much better data integrity and performance that way. The only thing to consider is that ZFS does love RAM and so your server should have a high amount of RAM on it.
This is amazing work, thank you very much 🙏. As I finished this guide, I realised one of my drives was "BAD" in the S.M.A.R.T. check :(. Do you have a link to a guide/video on how to swap out a hard drive without losing data? I technically have nothing on it so won't be too upset if I break something, but it's a good opportunity to learn! I have 3x data drives (2tb (dead), 1tb, 1tb), and 1x parity drive (2tb). Planning to get a 3tb drive instead of the dead one. I assume I'd need to make sure any content is merged, then I can just pull out the affected drive, plug a new one in its place and ?change its mount so that the system thinks it's the same drive? But then my 3tb would be bigger than my parity. I'm a little lost 😅
Check this: www.snapraid.it/manual#4.4 You'll be after the information under section 4.4 Recovering. It's pretty straight forward, basically you change the config to point to the new drive instead, run snapraid fix and check and sync. But give that a read through in case I missed anything. And yeah, you want your parity to be equal the size of your largest data drive. Realistically, if you don't fill your data drives to max capacity you should be fine, but I would still recommend trying to keep your parity drive equal or larger than your biggest data drive.
Hi. Thanks for the video - can't wait to get Snapraid setup on my new OMV NAS. I have installed OMV on a Trigkey G5 mini-PC and I have a 4-bay Terramaster DAS connected by USB3. OMV sees the 4 drives from the Terramaster, but when I try and add a drive to Snapraid - it only sees the OMV install drive. From reading other posts on this video it seems that the 4 drives via USB (/dev/sda, /dev/sdb/, /dev/sdc/ /dev/sdd) should be able to be added to Snapraid. Any advice or pointers? I did take 1 drive and wiped it, created a EXT4 file system and rebooted the OMV once that was done - Snapraid still not seeing any of the USB3 drives. Thanks!
Good question. I'm covering multiple scenarios for beginners, so I explain different circumstances depending on what you might have for drive availability. If you have matching drive sizes then it would definitely be better to use a BTRFS RAID array or even ZFS if you have the RAM for it. If you have mismatched drives and are going to use SnapRAID then the extra complication and overhead of BTRFS isn't worth it. There is a lot of overlap, and SnapRAID is already taking care of many of the benefits that BTRFS provides. Of course, you can still use BTRFS with SnapRAID if you want, but I don't see much of a benefit to it.
I think maybe I misinterpreted your question because I didn't know that you could use mismatched drives with BTRFS without losing significant storage. It looks like that may be possible? If so that is also a very intriguing option for mismatched drives, and something that I want to get familiar with, so thank you for for your question.
@@Brainy1422 Hmm, interesting, you should be able to, EXT4 supports volumes over that but maybe the options are not set for it in the OMV GUI. In that case you would have to setup the filesystem manually. That is good to know, thanks for sharing.
First of all thank you very very much for your tutorials, they are a huge help! I have my 4 4TB SSD drives in my Pi5 radxa penta to hat setup. I'm gonna use my setup mainly for multimedia (movies and music) bulk storage. The OMV mergerfs, SnapRAID plugins are installed, I've also installed the miniDLNA plugin, Is this a good option to stream my stored music to my DLNA-enabled equipment? I have a Nvidea shield TV pro with Kodi installed as my media player and I'm using HIFI cast to stream my music to my AV receiver. Now it comes to properly configuring OMV. Which filesystem is best suited for my needs: BTRFS or EXT4? Raid 0 or single Raid is fine for me. 3 drives for bulk storage and 1 drive as a parity drive, 12 TB of bulk storage is more than enough. If you have any pointers or other tutorials that I can use, please do share. Cheers Erdinç
Nice! I don't use DLNA so I can't comment on it; I only use Samba shares to my Kodi clients. The downside with that is there is no transcoding, but on LAN that isn't a problem. It's really only a problem if you want to stream over WAN because then based on connection speeds it may require transcoding. Jellyfin is an extremely popular solution. For streaming music I use Airsonic and then on my phone the Ultrasonic client. Airsonic uses the Subsonic API so there are a lot of mobile and web clients for it. Another good option is mpd if you want to have a central music controller and speakers wired throughout your home. I've thought about doing it, but I found that I'm happy with just using bluetooth from my phone to my various speakers for now. As far as your drive config is concerned, I would prioritize a proper backup system over some type of RAID. RAID is not a backup... it's solves for uptime, not for backups. It solves for when a drive fails, you can keep running. Yeah, it provides redundancy for drive failure, but it's not properly backing up data. If you accidentally delete a file, that deletion is synced across all the drives, and there is no way to get it back... whereas a proper backup system will give you a way to restore those deleted files. So I would figure out how big you want your data pool, and then have a separate drive or pool just for backups and use a proper backup system like borg or restic. Or if you go with btrfs or zfs then you can take snapshots and send them to the seperate backup drive or pool. But one way or another, you should have a proper backup system. With that in place, then you can consider if you want or need some type of drive parity. And if you do then you can do that with btrfs, zfs, or even something like snapraid.
@@somedaysoon33 I have my old 6TB NAS ( Lacie NetworkSpaceMax) and 2 x 2TB external HD that I plan to use as backup/sync my media files. So backup in case of failure is covered I think. So you use Samba instead of DLNA, gonna dive in that matter also. Yes I want a central music controller with wired speakers, especially for my FLAC music files. I've played around with dsf music files (200MB for one track) :-) The sound is amazing, 200MB size of 1 track is a bit too much and a very hard to find a decent player for that kind of files. With my old NAS there was no option to install apps or media servers so I never got into Jellyfin, plex server and all the other stuff you've mentioned. I went with btrfs as file system. When I try to send a movie file 20 GB, the transfer speed wired or wifi is very very slow 5mb/s. I have several laptops and desktops, my shared folder is visible on all of them but only accessible on 1 laptop? I think the best thing to do for me is install TeamViewer and give you access :-) I'll dive into all the things you've mentioned above. Thank you so much for taking your time and reply with a decent answer to my question! You Rule!
@@erdincify Yeah that is slow! It could be either the drives writing slowly or your network is slow. You can test your network throughput between any machine and the server with a tool called iperf. If you have gigabit networking then you should be able to pull like 800-1000Mbps. You can test the drives with a tool like dd, but I would recommend searching for something like, "test drive performance from linux terminal" to get you the instructions.
@@somedaysoon33 Speeds up to 800-1000Mbps !?? Are you kidding me!? I live in Belgium, we still have dinosaurs as pets! Speedtest on my wired destop pulls max 140Mbps
I don't know if things have changed since you made this video but when I tried to setup SnapRAID it failed because it of a bad array. I had to go at setup an array.
Yeah, this video was created with OMV 6 and it has changed in OMV 7. I heard this from another commenter too, and I haven't upgraded yet, but they also mentioned that an array needs to be setup now.
Excellent tutorial! Thank You! I have a question: How can you replace disk when it is failed, or when you have new bigger disk? Can it be done from OMV GUI?
Thank you! Good question, you would just change the disc location in the config and then run fix then check then sync on it. Check out the official documentation, www.snapraid.it/manual and see the section labeled Recovering. You could do this process from within the OMV GUI, but personally I would be more comfortable doing it in the terminal, just to be safe, as it is more reliable that way. In the OMV GUI you would under the snapraid drives settings change the location for the failed drive to the new replacement drive location. Then do the fix, check, sync from the menu.
I want to install OMV on a mini pc that has a USB type C (10Gbit) connection to a usb c drive enclosure. The drive enclosure says it uses the JMS578 chip (supports UASP). Do you think it will work? I’ve recently heard about a ban from OMV regarding RAID on usb drive enclosures .. Thanks! Awesome tutorial!
I would think so, I use a Lenova M93P mini PC connected to a SY-ENC50104 with 4x8TB drives in it. I'm using SnapRAID on those drives over USB without any problems. But remember, SnapRAID isn't actually RAID but you could put your drives in a real RAID array with something like btrfs or zfs. I have not heard anything about OMV not supporting RAID over USB. Where did you see that?
@@somedaysoon33 Thanks for confirming! In a video from Techno Dad Life comparing NAS OSes FreeNAS, OMV and Unraid. A user said (3 months ago) that he uses OMV and likes it but "My only complaint is that OMV makes it impossible to set up a RAID on a USB connected drive enclosure. I wish they would just sternly caution against it, but allow us to have the option, in spite of their warning, if we choose to experiment." and he had to find alternative solutions using rsync. But if I can use SnapRAID (which is basically what Unraid is doing, right?) I am happy enough :D Thank you!
@@mrhoratiuI see, that appears to be true from what I searched just now. I didn't realize that so thank you for informing me. Yeah, SnapRAID gives you the same ability like UnRAID to use mix drive sizes and have parity. And SnapRAID works with USB drives. Thanks for commenting, :).
@@somedaysoon33 Awesome! Thanks man! Much appreciated! I don't want standard RAID because I will initially buy 2 drives and then over time I do not know exactly what drive I will buy again, so SnapRAID is the way to go :)
Does mergerfs work with plex and downloading torrents with transmission? Im making a server with 120 tb that will be used for plex, downloading through transmission, and backups.
Yeah, mergerfs is just a filesystem that allows you to combine multiple locations. And I know you didn't ask, but here are my $0.02, I would recommend jellyfin over Plex... Plex isn't really selfhosting as it relies on 3rd party licensing servers. Another reason to avoid them is that they spy on their users. Deluge would also be better than transmission in my opinion. Anyway, thanks for watching!
I can't get sync to work in snapraid. I'm using two 8TB disks. One for data and content and the other for content and parity. I copied all the data I want to store from a network PC to the data drive and I can see that it's on the drive in openmediavault.the sync terminal seems to think there is nothing on the data disk??
How are you running the sync? In the UI? With the omv-snapraid-diff script? Or directly? I would try to run a snapraid diff and then try sync again... the omv-snapraid-diff script should do that already, but you could try to do the diff then sync in the OMV UI too.
@@somedaysoon33thanks for responding. I was initiating the sync in the snapraid menu of OMV and then arrays and under the tools symbol. I’ll try running a diff and see what that does. Edit: this is the result of diff: Loading state from /srv/dev-disk-by-uuid-625e2e90-413c-4d3d-af2f-c4ad85053a96/snapraid.content... Comparing... WARNING! Ignoring mount point '/srv/dev-disk-by-uuid-625e2e90-413c-4d3d-af2f-c4ad85053a96/pinas' because it appears to be in a different device WARNING! Ignoring mount point '/srv/dev-disk-by-uuid-625e2e90-413c-4d3d-af2f-c4ad85053a96/backup' because it appears to be in a different device 0 equal 0 added 0 removed 0 updated 0 moved 0 copied 0 restored No differences END OF LINE If I go to the information of the array and look at disks this is the result, so I can’t figure out why it thinks it’s not mounted or something. 8:0 /dev/sda 0:47 /dev/sda disk1 8:16 /dev/sdb 0:43 /dev/sdb parity END OF LINE █
Are you using btrfs by chance? Those warnings seem strange, and when I searched them up I got results about SnapRAID not working well with btrfs unfortunately. Otherwise, I think I would delete the drives from SnapRAID, delete the content files, and try to re-add them. It won't delete your data. What is in your snapraid.conf config file? And what does the SnapRAID status output?
Hi! No, that's not a stupid question. You can combine an SSD and HHD with mergerfs... which one gets written to depends on your policy and/or how you reference it. It's okay to do it if you want that!
@@somedaysoon33 Thanks, I think tiered caching may better suit my need. I am looking for some caching method, as I have bunch of old (small) ssd laying around. And I don't want to us ZFS (due to limited ram and not flexible). I believe with my current setup (NVME SSD, SATA SSD, a CMR HDD, a enterprise server HDD; existing path, most free space), i will have some fluctuation when operating the file on the NAS.
@@haijiazhu3148 Nice, yeah, I know the mergerfs documentation mentions tiered caching and there are some example mover scripts in there but I've never tried it. It looks like it work good though, good luck!
Thank you for your awesome videos, helping me a lot! Somehow I am having 2 issues with this one here... first issue: I cant add drives to snapraid, if I dont define arrays first. In your video here you didnt have to do that? Did they change that recenlty? Second issue is with the cronjob / scheduled task. If I try to run it manually i get a very long error message. I already tried to reinstall snapraid, still happened... here it is: Failed to execute command 'export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin; export LANG=C.UTF-8; export LANGUAGE=; export SHELL=/bin/sh; sudo --shell --non-interactive --user='root' -- /var/lib/openmediavault/cron.d/userdefined-57e13a3c-5a94-11ec-8153-3f587eab8e1f 2>&1' with exit code '127': /bin/sh: 1: /var/lib/openmediavault/cron.d/userdefined-57e13a3c-5a94-11ec-8153-3f587eab8e1f: not found OMV\ExecException: Failed to execute command 'export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin; export LANG=C.UTF-8; export LANGUAGE=; export SHELL=/bin/sh; sudo --shell --non-interactive --user='root' -- /var/lib/openmediavault/cron.d/userdefined-57e13a3c-5a94-11ec-8153-3f587eab8e1f 2>&1' with exit code '127': /bin/sh: 1: /var/lib/openmediavault/cron.d/userdefined-57e13a3c-5a94-11ec-8153-3f587eab8e1f: not found in /usr/share/openmediavault/engined/rpc/cron.inc:198 Stack trace: #0 /usr/share/php/openmediavault/rpc/serviceabstract.inc(622): Engined\Rpc\Cron->Engined\Rpc\{closure}() #1 /usr/share/openmediavault/engined/rpc/cron.inc(176): OMV\Rpc\ServiceAbstract->execBgProc() #2 [internal function]: Engined\Rpc\Cron->execute() #3 /usr/share/php/openmediavault/rpc/serviceabstract.inc(122): call_user_func_array() #4 /usr/share/php/openmediavault/rpc/rpc.inc(86): OMV\Rpc\ServiceAbstract->callMethod() #5 /usr/sbin/omv-engined(544): OMV\Rpc\Rpc::call() #6 {main} Any idea what the issue might be? I followed your instructions here to the letter (of course with a bit of a different drive setup, i got 1 giant parity drive, 1 system-install-nvme and 3x 3TB datadrives, that i pooled up with mergerfs (want to use those for borg) - and have not added my real data drives yet.
I think I had the same error and saw later that there is a weird glitch and you have to run it firstly in the UI before the cronjob task will run successfully. Did you try the notation that I made in the description? "...after adding the drives and settings you need to click the wrench/screwdriver icon in the UI and Sync one time manually or the script will fail to run properly." Then after you do that the cronjob should run without errors. Hmm, what do you mean by defining the array to add the drive? I'm not sure because like you saw in the video, you should be able to add single drives to it.
@@somedaysoon33 My UI looks a bit different than yours... i saw in a later video (about healthcheck) that you ran a manual sync first then the cronjob started working. but I do not have that wrench icon and when i try to run a sync in the shell i get an error that i dont have a snapraid.conf file... i think my install is somehow broken... will try to reinstall and get back here :)
@@somedaysoon33 just checked, if i go to plugins and install snapraid, i got version 7.0.10 and it is really a bit different... you cant add disks unless you first create "arrays" and in the disks section there are no icons for the manual sync (that tool icon) and if i try to run a sync from the shell i get the error that there is no snapraid.conf file. so i am a bit stuck... i uninstalled and now i try to find your version of snapraid i suppose?
@@somedaysoon33 i just did some further testing, i created my own snapraid.conf file in /etc according to the documentation and with that i can run a sync. Sadly the omv conf files that are used in the omv schedule still dont work. So i guess im going to make my own batch file to stop all docker containers, run my own snapraid sync and the restart docker and use that in the scheduler...
Thanks for this material.
Your extra bits like the scrub parts and the symlinks make this a one stop to get going and know enough to go learn more if wanted.
What a refreshing take on the whole thing, fire and forget RAID.
What drew me in was mainly that fact that SnapRAID should stress drives MUCH less than a traditional RAID. Plus the smaller scrubs means that even high latency SMR drives aren't as likely to stall the system.
I really did wish there was a version of this that just ensured there were 2/3 copies of files, scattered around the file pool. So you wouldn't even have to worry about which are parity drives, and which aren't. So long as the amount of drives lost is below the the number of copies. And to recover all you had to do is just add a fresh drive to the pool. No extra setup.
Really great video and you have a great voice, instant like!
This was a great video, really clarified how these work and how relatively easy it is to setup.
does mergerFS boost read/write performance if you let it distribute small files across your drives when free space changes?
Good question. No, it will not boost performance like some RAID configs. It will work at the speed of the individual drives. Thanks for watching.
Thanks for the walk-through. Excellent tutorial videos like always.
I know that the concept of snapraid is kinda (similar to unraid with the exception of more room for extra parity disks for snapraid) but totally different than conventional "mdadm" software or hardware raid or even ZFS when it comes to (Write - Read) performance based on RAID level and configuration.
One question though:
Since you chose the snapraid policy (the most free space) and the 3 video files were copied into 3 different HDDs, have you tried to (copy-paste) or even use (rsync) service to see if ALL 3 files will be copied simultaneously to your desktop or to other backup server ?
The reason why I'm asking is because I have 20+ HDDs of the same size, and a couple of 10Gb NICs and wondering if the (most free space) policy act same like other conventional raid levels when reading from multiple HDDs.
SnapRAID is just a nice and easy way to give multiple mismatched drives redundancy between them with a parity drive(s). Mergerfs is doing this part that you are asking about writing files and reading files spanned across multiple drives. Generally mergerfs will increase performance when reading from multiple drives instead of from a single drive, but... it will not be anywhere near as good as RAID performance. So for you having matching drives, I wouldn't concern myself with SnapRAID or mergerfs. Your setup sounds awesome! I would love 10Gb networking! If you have 20 matching drives you'd be best to be using ZFS RAID. Just don't create one big pool, have at least a separate backup pool to your data pool. You could still use a backup system like borg like I explain in a later video for your data but with ZFS you have the additional option of using ZFS snapshots and send them to that separate backup drive or pool instead of using a backup system like borg/restic. If you have a really big drive pool like you have, I would highly recommend ZFS over SnapRAID/mergerfs and even over btrfs... you'll have much better data integrity and performance that way. The only thing to consider is that ZFS does love RAM and so your server should have a high amount of RAM on it.
@@somedaysoon33
Thanks for your reply.
Yeah, ZFS RAID is already on my radar list
This is amazing work, thank you very much 🙏.
As I finished this guide, I realised one of my drives was "BAD" in the S.M.A.R.T. check :(. Do you have a link to a guide/video on how to swap out a hard drive without losing data?
I technically have nothing on it so won't be too upset if I break something, but it's a good opportunity to learn!
I have 3x data drives (2tb (dead), 1tb, 1tb), and 1x parity drive (2tb).
Planning to get a 3tb drive instead of the dead one.
I assume I'd need to make sure any content is merged, then I can just pull out the affected drive, plug a new one in its place and ?change its mount so that the system thinks it's the same drive?
But then my 3tb would be bigger than my parity. I'm a little lost 😅
Check this: www.snapraid.it/manual#4.4
You'll be after the information under section 4.4 Recovering. It's pretty straight forward, basically you change the config to point to the new drive instead, run snapraid fix and check and sync. But give that a read through in case I missed anything.
And yeah, you want your parity to be equal the size of your largest data drive. Realistically, if you don't fill your data drives to max capacity you should be fine, but I would still recommend trying to keep your parity drive equal or larger than your biggest data drive.
You forgot the best part at the end...It's FREE
Hi. Thanks for the video - can't wait to get Snapraid setup on my new OMV NAS. I have installed OMV on a Trigkey G5 mini-PC and I have a 4-bay Terramaster DAS connected by USB3. OMV sees the 4 drives from the Terramaster, but when I try and add a drive to Snapraid - it only sees the OMV install drive. From reading other posts on this video it seems that the 4 drives via USB (/dev/sda, /dev/sdb/, /dev/sdc/ /dev/sdd) should be able to be added to Snapraid. Any advice or pointers? I did take 1 drive and wiped it, created a EXT4 file system and rebooted the OMV once that was done - Snapraid still not seeing any of the USB3 drives. Thanks!
Nevermind - I found that while I could see the drives, there were no file systems. I created the file systems and Snapraid sees the drives. Thanks
@@etsarse2 Awesome, sorry for the delayed response, busy enjoying the weather this time of year. Glad you figured it out, nice job!
Thanks for the explanation. Why are your file system not btrfs?
Good question. I'm covering multiple scenarios for beginners, so I explain different circumstances depending on what you might have for drive availability. If you have matching drive sizes then it would definitely be better to use a BTRFS RAID array or even ZFS if you have the RAM for it. If you have mismatched drives and are going to use SnapRAID then the extra complication and overhead of BTRFS isn't worth it. There is a lot of overlap, and SnapRAID is already taking care of many of the benefits that BTRFS provides. Of course, you can still use BTRFS with SnapRAID if you want, but I don't see much of a benefit to it.
I think maybe I misinterpreted your question because I didn't know that you could use mismatched drives with BTRFS without losing significant storage. It looks like that may be possible? If so that is also a very intriguing option for mismatched drives, and something that I want to get familiar with, so thank you for for your question.
@@somedaysoon33 One caveat I ran into. EXT4 wont work with drives 16TB or larger. I ran into this when I upgraded my array.
@@Brainy1422 Hmm, interesting, you should be able to, EXT4 supports volumes over that but maybe the options are not set for it in the OMV GUI. In that case you would have to setup the filesystem manually. That is good to know, thanks for sharing.
First of all thank you very very much for your tutorials, they are a huge help! I have my 4 4TB SSD drives in my Pi5 radxa penta to hat setup.
I'm gonna use my setup mainly for multimedia (movies and music) bulk storage.
The OMV mergerfs, SnapRAID plugins are installed, I've also installed the miniDLNA plugin, Is this a good option to stream my stored music to my DLNA-enabled equipment? I have a Nvidea shield TV pro with Kodi installed as my media player and I'm using HIFI cast to stream my music to my AV receiver.
Now it comes to properly configuring OMV.
Which filesystem is best suited for my needs: BTRFS or EXT4? Raid 0 or single Raid is fine for me. 3 drives for bulk storage and 1 drive as a parity drive, 12 TB of bulk storage is more than enough. If you have any pointers or other tutorials that I can use, please do share. Cheers Erdinç
Nice!
I don't use DLNA so I can't comment on it; I only use Samba shares to my Kodi clients. The downside with that is there is no transcoding, but on LAN that isn't a problem. It's really only a problem if you want to stream over WAN because then based on connection speeds it may require transcoding. Jellyfin is an extremely popular solution. For streaming music I use Airsonic and then on my phone the Ultrasonic client. Airsonic uses the Subsonic API so there are a lot of mobile and web clients for it. Another good option is mpd if you want to have a central music controller and speakers wired throughout your home. I've thought about doing it, but I found that I'm happy with just using bluetooth from my phone to my various speakers for now.
As far as your drive config is concerned, I would prioritize a proper backup system over some type of RAID. RAID is not a backup... it's solves for uptime, not for backups. It solves for when a drive fails, you can keep running. Yeah, it provides redundancy for drive failure, but it's not properly backing up data. If you accidentally delete a file, that deletion is synced across all the drives, and there is no way to get it back... whereas a proper backup system will give you a way to restore those deleted files.
So I would figure out how big you want your data pool, and then have a separate drive or pool just for backups and use a proper backup system like borg or restic. Or if you go with btrfs or zfs then you can take snapshots and send them to the seperate backup drive or pool. But one way or another, you should have a proper backup system. With that in place, then you can consider if you want or need some type of drive parity. And if you do then you can do that with btrfs, zfs, or even something like snapraid.
@@somedaysoon33 I have my old 6TB NAS ( Lacie NetworkSpaceMax) and 2 x 2TB external HD that I plan to use as backup/sync my media files. So backup in case of failure is covered I think. So you use Samba instead of DLNA, gonna dive in that matter also.
Yes I want a central music controller with wired speakers, especially for my FLAC music files. I've played around with dsf music files (200MB for one track) :-) The sound is amazing, 200MB size of 1 track is a bit too much and a very hard to find a decent player for that kind of files.
With my old NAS there was no option to install apps or media servers so I never got into Jellyfin, plex server and all the other stuff you've mentioned.
I went with btrfs as file system. When I try to send a movie file 20 GB, the transfer speed wired or wifi is very very slow 5mb/s. I have several laptops and desktops, my shared folder is visible on all of them but only accessible on 1 laptop?
I think the best thing to do for me is install TeamViewer and give you access :-)
I'll dive into all the things you've mentioned above.
Thank you so much for taking your time and reply with a decent answer to my question! You Rule!
@@erdincify Yeah that is slow! It could be either the drives writing slowly or your network is slow. You can test your network throughput between any machine and the server with a tool called iperf. If you have gigabit networking then you should be able to pull like 800-1000Mbps.
You can test the drives with a tool like dd, but I would recommend searching for something like, "test drive performance from linux terminal" to get you the instructions.
@@somedaysoon33 Speeds up to 800-1000Mbps !??
Are you kidding me!? I live in Belgium, we still have dinosaurs as pets!
Speedtest on my wired destop pulls max 140Mbps
I don't know if things have changed since you made this video but when I tried to setup SnapRAID it failed because it of a bad array. I had to go at setup an array.
Yeah, this video was created with OMV 6 and it has changed in OMV 7. I heard this from another commenter too, and I haven't upgraded yet, but they also mentioned that an array needs to be setup now.
Excellent tutorial! Thank You! I have a question: How can you replace disk when it is failed, or when you have new bigger disk? Can it be done from OMV GUI?
Thank you! Good question, you would just change the disc location in the config and then run fix then check then sync on it. Check out the official documentation, www.snapraid.it/manual and see the section labeled Recovering. You could do this process from within the OMV GUI, but personally I would be more comfortable doing it in the terminal, just to be safe, as it is more reliable that way. In the OMV GUI you would under the snapraid drives settings change the location for the failed drive to the new replacement drive location. Then do the fix, check, sync from the menu.
I got error when tried snapraid so I used Unraid
I want to install OMV on a mini pc that has a USB type C (10Gbit) connection to a usb c drive enclosure. The drive enclosure says it uses the JMS578 chip (supports UASP). Do you think it will work? I’ve recently heard about a ban from OMV regarding RAID on usb drive enclosures ..
Thanks! Awesome tutorial!
I would think so, I use a Lenova M93P mini PC connected to a SY-ENC50104 with 4x8TB drives in it. I'm using SnapRAID on those drives over USB without any problems. But remember, SnapRAID isn't actually RAID but you could put your drives in a real RAID array with something like btrfs or zfs. I have not heard anything about OMV not supporting RAID over USB. Where did you see that?
@@somedaysoon33 Thanks for confirming! In a video from Techno Dad Life comparing NAS OSes FreeNAS, OMV and Unraid. A user said (3 months ago) that he uses OMV and likes it but "My only complaint is that OMV makes it impossible to set up a RAID on a USB connected drive enclosure. I wish they would just sternly caution against it, but allow us to have the option, in spite of their warning, if we choose to experiment." and he had to find alternative solutions using rsync. But if I can use SnapRAID (which is basically what Unraid is doing, right?) I am happy enough :D Thank you!
Because of that, I searched for SnapRAID and found your channel :)
@@mrhoratiuI see, that appears to be true from what I searched just now. I didn't realize that so thank you for informing me. Yeah, SnapRAID gives you the same ability like UnRAID to use mix drive sizes and have parity. And SnapRAID works with USB drives. Thanks for commenting, :).
@@somedaysoon33 Awesome! Thanks man! Much appreciated! I don't want standard RAID because I will initially buy 2 drives and then over time I do not know exactly what drive I will buy again, so SnapRAID is the way to go :)
Does mergerfs work with plex and downloading torrents with transmission? Im making a server with 120 tb that will be used for plex, downloading through transmission, and backups.
Yeah, mergerfs is just a filesystem that allows you to combine multiple locations. And I know you didn't ask, but here are my $0.02, I would recommend jellyfin over Plex... Plex isn't really selfhosting as it relies on 3rd party licensing servers. Another reason to avoid them is that they spy on their users. Deluge would also be better than transmission in my opinion. Anyway, thanks for watching!
I can't get sync to work in snapraid. I'm using two 8TB disks. One for data and content and the other for content and parity. I copied all the data I want to store from a network PC to the data drive and I can see that it's on the drive in openmediavault.the sync terminal seems to think there is nothing on the data disk??
How are you running the sync? In the UI? With the omv-snapraid-diff script? Or directly? I would try to run a snapraid diff and then try sync again... the omv-snapraid-diff script should do that already, but you could try to do the diff then sync in the OMV UI too.
@@somedaysoon33thanks for responding. I was initiating the sync in the snapraid menu of OMV and then arrays and under the tools symbol. I’ll try running a diff and see what that does.
Edit: this is the result of diff:
Loading state from /srv/dev-disk-by-uuid-625e2e90-413c-4d3d-af2f-c4ad85053a96/snapraid.content...
Comparing...
WARNING! Ignoring mount point '/srv/dev-disk-by-uuid-625e2e90-413c-4d3d-af2f-c4ad85053a96/pinas' because it appears to be in a different device
WARNING! Ignoring mount point '/srv/dev-disk-by-uuid-625e2e90-413c-4d3d-af2f-c4ad85053a96/backup' because it appears to be in a different device
0 equal
0 added
0 removed
0 updated
0 moved
0 copied
0 restored
No differences
END OF LINE
If I go to the information of the array and look at disks this is the result, so I can’t figure out why it thinks it’s not mounted or something.
8:0 /dev/sda 0:47 /dev/sda disk1
8:16 /dev/sdb 0:43 /dev/sdb parity
END OF LINE
█
Are you using btrfs by chance? Those warnings seem strange, and when I searched them up I got results about SnapRAID not working well with btrfs unfortunately. Otherwise, I think I would delete the drives from SnapRAID, delete the content files, and try to re-add them. It won't delete your data. What is in your snapraid.conf config file? And what does the SnapRAID status output?
@@somedaysoon33I am! I’ll start over with ext4 and see how it goes. I appreciate your help.
It might be a stupid question. But is it a good idea if I combine SSD and hard disk using mergefs? Thanks!
Hi! No, that's not a stupid question. You can combine an SSD and HHD with mergerfs... which one gets written to depends on your policy and/or how you reference it. It's okay to do it if you want that!
@@somedaysoon33 Thanks, I think tiered caching may better suit my need. I am looking for some caching method, as I have bunch of old (small) ssd laying around. And I don't want to us ZFS (due to limited ram and not flexible). I believe with my current setup (NVME SSD, SATA SSD, a CMR HDD, a enterprise server HDD; existing path, most free space), i will have some fluctuation when operating the file on the NAS.
@@haijiazhu3148 Nice, yeah, I know the mergerfs documentation mentions tiered caching and there are some example mover scripts in there but I've never tried it. It looks like it work good though, good luck!
Great Video. Will be great if you can do a video on replacing the a disk when it failed.
@@ckwcfm Good suggestion, I will add that to my list, thanks!
Thank you for your awesome videos, helping me a lot! Somehow I am having 2 issues with this one here... first issue: I cant add drives to snapraid, if I dont define arrays first. In your video here you didnt have to do that? Did they change that recenlty? Second issue is with the cronjob / scheduled task. If I try to run it manually i get a very long error message. I already tried to reinstall snapraid, still happened... here it is: Failed to execute command 'export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin; export LANG=C.UTF-8; export LANGUAGE=; export SHELL=/bin/sh; sudo --shell --non-interactive --user='root' -- /var/lib/openmediavault/cron.d/userdefined-57e13a3c-5a94-11ec-8153-3f587eab8e1f 2>&1' with exit code '127': /bin/sh: 1: /var/lib/openmediavault/cron.d/userdefined-57e13a3c-5a94-11ec-8153-3f587eab8e1f: not found
OMV\ExecException: Failed to execute command 'export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin; export LANG=C.UTF-8; export LANGUAGE=; export SHELL=/bin/sh; sudo --shell --non-interactive --user='root' -- /var/lib/openmediavault/cron.d/userdefined-57e13a3c-5a94-11ec-8153-3f587eab8e1f 2>&1' with exit code '127': /bin/sh: 1: /var/lib/openmediavault/cron.d/userdefined-57e13a3c-5a94-11ec-8153-3f587eab8e1f: not found in /usr/share/openmediavault/engined/rpc/cron.inc:198
Stack trace:
#0 /usr/share/php/openmediavault/rpc/serviceabstract.inc(622): Engined\Rpc\Cron->Engined\Rpc\{closure}()
#1 /usr/share/openmediavault/engined/rpc/cron.inc(176): OMV\Rpc\ServiceAbstract->execBgProc()
#2 [internal function]: Engined\Rpc\Cron->execute()
#3 /usr/share/php/openmediavault/rpc/serviceabstract.inc(122): call_user_func_array()
#4 /usr/share/php/openmediavault/rpc/rpc.inc(86): OMV\Rpc\ServiceAbstract->callMethod()
#5 /usr/sbin/omv-engined(544): OMV\Rpc\Rpc::call()
#6 {main}
Any idea what the issue might be? I followed your instructions here to the letter (of course with a bit of a different drive setup, i got 1 giant parity drive, 1 system-install-nvme and 3x 3TB datadrives, that i pooled up with mergerfs (want to use those for borg) - and have not added my real data drives yet.
I think I had the same error and saw later that there is a weird glitch and you have to run it firstly in the UI before the cronjob task will run successfully. Did you try the notation that I made in the description? "...after adding the drives and settings you need to click the wrench/screwdriver icon in the UI and Sync one time manually or the script will fail to run properly." Then after you do that the cronjob should run without errors.
Hmm, what do you mean by defining the array to add the drive? I'm not sure because like you saw in the video, you should be able to add single drives to it.
@@somedaysoon33 My UI looks a bit different than yours... i saw in a later video (about healthcheck) that you ran a manual sync first then the cronjob started working. but I do not have that wrench icon and when i try to run a sync in the shell i get an error that i dont have a snapraid.conf file... i think my install is somehow broken... will try to reinstall and get back here :)
@@somedaysoon33 just checked, if i go to plugins and install snapraid, i got version 7.0.10 and it is really a bit different... you cant add disks unless you first create "arrays" and in the disks section there are no icons for the manual sync (that tool icon) and if i try to run a sync from the shell i get the error that there is no snapraid.conf file. so i am a bit stuck... i uninstalled and now i try to find your version of snapraid i suppose?
@@matyourin Interesting, I will update my system so I can see what changes were made to it.
@@somedaysoon33 i just did some further testing, i created my own snapraid.conf file in /etc according to the documentation and with that i can run a sync. Sadly the omv conf files that are used in the omv schedule still dont work. So i guess im going to make my own batch file to stop all docker containers, run my own snapraid sync and the restart docker and use that in the scheduler...