NIC Bonding for your NAS - 3/3
HTML-код
- Опубликовано: 8 фев 2025
- Final video on experimenting to see if you should bond the NICs on your NAS.
We are pulling data from four computers, two using 1Gb & the other two using 2.5Gb connections.
If you haven't seen the first two videos, you should check them out:
Part 1 - • Multiple NAS Ports - U...
Part 2 - • Even More NAS NIC Bond...
Great videos! A couple quick notes for you:
- You might want to go in and turn off the PoE++ on your UniFi switch for any ports that are not needing PoE (like to your NAS). That's a decent amount of power that could potentially fry your Non PoE equipment. I'm no pro on this, just what I personally do as a best practice / just in case measure.
- You can not create a "write-only" cache. It has to be read only or read/write. We are a small photo/video studio and we frequently dump 500+GB onto our NAS all at once. I added a read/write cache in hopes that uploading footage would first write to the NVMe drives real quick & then flush to the Raid 6 HDDs... but I never sat down & tested a before and after speed test to see if it worked that way & increased our speed... I may do that right now actually (see results below).
- What Raid config are your HDDs?
*My Read/write cache speed test results: Ok so I just went & tested this. We have a 12 bay Synology RS3618xs with Seagate Exos 18TB HDDs in Raid 6 + hotspare config, 64GB RAM, 10Gb SFP+ NIC, the Synology E10M20-T1 PCIe card with 2 very fast 4TBm.2 drives (7000MB/s), a brand new M4 Pro Mac, and a 10Gb to thunderbolt 3 adapter. The 10Gb nic = 1,250MB/s. The HDDs theoretically max out around 270MB/s because Raid 6 doesn't really bring any write speed gains. That is only about 20% of the network speed. But the NVME's should be more than capable of saturating the network speed, so if the network speed maxes out, I know it is only thanks to the SSD cache... I just dumped 37 files totaling 871GB in 14.5 minutes. Resource Monitor on the Synology & Activity Monitor on MacOS looked like I was roughly maxing out the network the entire time at around 1GB/s, volume/disk speed matched, 0 RAM utilization, and surprisingly the Xeon CPU spiked to like 40% - maybe due to Check Sum verification on the folder, no idea, it might be totally normal I was just surprised. But happy to see the SSDs 10000% help on a massive file footage dump for a Raid 6 HDD setup. Next I need to aggreggate the 4 x 10G SFP+ nic & do the same test from 4 computers & see what happens haha.
I have never turned off PoE, but it is certainly something to consider.
I think in the past with a Synology, you would have on M.2 for read, and one M.2 for write.....I see that isn't true anymore. I am making a torture test video now, 10,000 files, all of them 1KB in size. I think cache will show huge speed gains.
They are in RAID 6 config
Wow....871GB in less than 15 minutes, speed machine!! Please let me know what happens after you aggregate the 10G NICs. Let me know if you want to demo it on the channel, would be great content.
Looking forward to putting out the next video...should show a lot of what you mention.
Thanks for doing these real-world tests. So nice to see them.
Are there any other possible bottlenecks?:
- Speed of those drives?
- Bus they are on?
- Ram utilization?
You don’t have to do another video if you don’t want to. I’m just curious.
Great questions! RAM on the NAS is pretty low, but the Bus/Drive speed could be a limiting factor. The next video will include SSD Cache that will take a lot of the work from the drives. I expect the speed to go up even more.
It is real world, but the files I am transferring are very large, 1GB each. I will do a mix of large/medium/small files.
Could you do simultaneous read and write test before and after you add the cache? Thank for the video series, loved it!
I didn't even think about doing simultaneous read/write, great idea! I imagine that will slow down the transfers immensely without the cache, we will see.