A Cheap and Simple Storage Solution for Editors
HTML-код
- Опубликовано: 12 июл 2024
- Looking for affordable and straightforward storage solutions as a video editor? 🎥💾 You've come to the right place!
Our Editing Assets - VideoSauce.store
My Storage Solution:
Sabrent 2-Bay Hard Drive Enclosure (USB C)
amzn.to/3OfHcM2
Seagate 22TB Ironwolf Pro (Renewed)
amzn.to/426U0Kx
Seagate 22TB Ironwolf Pro (New)
amzn.to/3HsDM4K
Karen's Replicator: www.karenware.com/powertools/...
My Favorite Gear:
Camera - BMPCC 6K PRO
amzn.to/3Scx2No
Lens - Sigma 18-35 f1.8 (Canon EF)
amzn.to/42896iK
Boom Mic - Sennheiser MKE 600
amzn.to/47HCIER
Lights - Amaran 200x
amzn.to/47KNCdg
Large Softbox
amzn.to/49sJNdL
Drone - DJI Air 3
amzn.to/3tUTjrb
Camera Bag - amzn.to/495pumI
Large Lighting Gear Bag - amzn.to/3U9WN3w
Timecodes
0:00 - Intro
0:38 - My Old System
1:04 - Problems with My Old System
1:55 - Raids for Video Editing
3:41 - Storage Hardware
5:00 - Software Raid
5:34 - My Aha Moment
5:49 - My Storage Solution
7:13 - Cost Breakdown
8:08 - Results
9:21 - Conclusion
DISCLAIMERS & AFFILIATIONS
We are a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for us to earn fees by linking to Amazon.com and affiliated sites.
There is a good thread on Reddit where people gave me some feedback that could help others: www.reddit.com/r/editors/comments/1adwk9s/my_storage_solution_for_editing/
Well great. Let me help you. You're young, and its my generation that's built all this shyt. So, lets get started. I have never had more problems, and prolific issues than with a Seagate drive. Every single Seagate drive I have ever come in contact with, has failed. From the Compaq Presario 6gb from 1996, to just recently where every single Dell Workstation we bought that had a Seagate HD failed. Worse, when the Presario Seagate failed, I couldn't just go out and buy a different drive like a western digital, because those *GENUISES* over at Compaq would not allow the software restore to work on a non-native component. And even more worse the Drive failed shortly there after on the replacement. I put a lot of hate energy out there and Compaq closed it's doors in 2002. I would say more of my animosity was with Compaq than anyone else. It didn't help that they had "Q" from Star Trek introduce the machine once it was started the first time. Yeah, that really happened. ruclips.net/video/cKD9XAP_16k/видео.html
On the dell workstations, I never specified the drives during ordering because had I been given a choice it would be not to use Seagate. But our vendor did that "selection" work for us and within a couple of years had to replace every Seagate drive at the company.
So, what do I recommend? The only thing I buy, and use is Samsung SSD's. It doesn't matter which version. However, if your doing normal things any SSD will do. If you're doing editing, this is what I would recommend; If you have to use HD's due to costs, I recommend using them as a backup. And then recommend doing your work on a M2 or SSD. I am not going to recommend any specific models because each model has slight versions which effect performance and quality which can vary. I have even bought the same m2's from the same lot numbers based on bench tests and found there are still significant differences between actual performance and those tests.
Even more bizarre, against our IT vendors advice...I needed to fill our rack mount 10 bay NAS with drives. What did I get? Toshiba laptop drives! I cringed at this move. But this was done in 2013 and ALL of the drives are STILL operational. These drives are running Oracle, SQL Server, IIS, VMWARE instances etc. It's SQL and code development work supporting 2 departments. Would I recommend toshiba now? No, NOT without a thorough analysis. I looked at failure rates, speed, and everything I could before I made this CRINGE move to buy LAPTOP drives for our NAS. Nothing against Toshiba, my point being is that you have to hyper analyze each purchase...and can't box yourself in because on paper or discussion it seems like a bad idea. THE DRIVES are still working. We are talking about 3965 days of continuous operation, always on, and with a burden of daily network and drive traffic.
Don't forget that you're using a very propietary solution (the RAID enclosures). If the vendor goes out of business and your devices' circuitry gets fried, the data on the drives is at the mercy of finding repair parts. I had a friend whose Drobo was fried, and he fortunately was able to shell out $600 for an identical one on eBay, which worked to save his data. If it were me, I'd build a very standard Linux box with a ton of drive slots and do the RAID with mdadm (Linux Software Raid). You can always rebuild the array from the same drives on a totally different Linux system in a dire emergency. My $.02
Thank you for sharing your experience and advice! Sounds like it's definitely something to consider when using RAID enclosures.
This, except use ZFS which is more manageable and reliable than linux md, performant snapshots, etc.
Yeah, and you don't really need an expensive system to pull that off too. Just an old Vostro 420 half tower (~$60+SnH) and a cheap 5.25 to triple 3.5 hot swap bay (
@@KiraSlith If I didn't need some portability this may very well have been the best budget option!
@@VideoVo-Tech True, and what you did go with is practically tailor made to your use-case. Especially with a CFast slot right up front. Just filling in the gap in case someone decides to tackle this route.
I'm actually kinda jealous, photographers, videographers, and the like get all this lovely profession-tooled hardware. Where us CSEs, despite being the backbone of the computer industry, have to make do with hacking up random hardware targeted at other professions to fit our needs. 😭
I like the way you present.. your laying out the solution requirements, with calm clarity.. nice work.
Thanks so much! Glad you enjoyed.
Your video has been super helpful for me making a decision about my much needed storage system upgrade. Thank you for sharing!
This video is timely, as I just started looking into storage solutions for my old/current video projects. I still have a ton of research to do, but this was a step in the right direction! Subscribing - looking forward to more content from you!
I really appreciate it, more videos are incoming! I tried to find a solution for a few years actually but I could never make the NAS cost work and didn't want to get into a software raid.
Man. Where was this video 72 hours ago when I started rabbit holing here? You just answered all my questions and came up with a great solution. Happy new subscriber.
Great to hear!
Finally someone made a video on DASs (Direct Attached Storage).
I've been using these myself. I like all the RAID being handled by the DAS itself, that way I'm not computer dependant, and can just take the DAS whereever I want.
2 questions for you though.
1- You mentioned the fan can be loud. While I don't care about the noise too much, I AM worried about airflow, since, it doesn't look like there's a lot of ventaliation. Do you find the drives get warm or hot?
2- Is there any way, in Windows, that this DAS lets you see the health and temps of each indiviual drive, or does Windows just see this as a "H/W RAID" device, and not tell you much else?
I haven't noticed it getting very warm, and CrystalDiskInfo just showed it actually being cooler than my glyph external drives. Also, CrystalDiskInfo can see all four drives individually 👍
I love this video style!
Thanks!
I like the enclosure - but the drives here is Australia are $700-$1000 dollars each - so not really an option for me atm - I'll stick with my dual external drive combo (also gets coped over hourly) and Backblaze for off site backup (2 year plan is amazing value). But thanks for the time you took to put this video together - it is much appreciated and will be keeping an eye on getting some drives at a reasonable price thanks to those enclosures.
Hey Paul, thanks for the kind comment. The prices for hard drives are a bummer! I've seen videos where people buy external drives like Mybooks and take the hard drive out of it to get drives for less. I had to look it up but it's commonly referred to as "shucking" though it may require a decent amount of research to find out what drives you are getting. Yes, Backblaze is an insane value. Sounds like a solid setup, but I would love to hear back if you find a cost effective drive solution!
I'm in the same boat. I have 4 external USB drives with all my data and backups. NAS is too rich for my blood and I have my drives hooked up to a 2014 mac mini that asks like a home server of sorts. Great video and you just confirmed the conclusion I reached as well which is to get a multi drive DAS and use Carbon Copy Cloner to back it up locally.
That's great to hear! So many different ways to approach it, but it does seem like a lot of us are in the same boat!
For cold storage, you could theoretically go for a linear storage solution like using a tape drive and archival tape. You can get capacities of up to 45ish tb compressed on a single 100 dollar tape. The expensive part is the reader though. In my area, the tape drives are about 5,000 which is a lot more than most individuals would be willing to reasonably spend.
Hey Flynn, thanks for bringing this up! Very common cold storage solution that I haven't thought about in a while. I'm not sure I'd have enough to back up each year to offset the cost of an LTO Reader/Drive but others might. I will say though in my limited experience with LTO6, it seemed like video files don't really benefit from compression so I was realistically getting the uncompressed capacity out of the drive. But still, an LTO9 drive that's 18TB for $100 is a good deal.
I stopped using spindle drives five years ago when I built a NAS to back-up the UHD media my family watches. Once I started using the same server for Resolve I used the SAS backplane and two Samsung MZILG30THBLA.
Sounds fast!
Love the budget solution. Another thing to note is if you were to build a nas (which could have been done for about $100 more) you would have to upgrade networking to see fast speed. A 10 gig USB C cable is way cheaper than a 10 gig network. I will say, I think you would have liked the NVME Cache on something like TrueNAS
Good to know about the USB C to 10 gig cable! I like having some portability with this setup but I do think that one day I may outgrow it and do something like you suggested!
Dell T420 with all options used can go for around 300-400 eur. For that money you get 8x3.5" bays and 4x PCIe 3.0 slots. it support up to 384GB ram and max 2x10/20C/T cpu@3.4GHZ. Motherboard support for up to 2 graphics cards. You can use PCIe slot for some NVME drives for use as cash drives. It has 2 power supply for redundancy. Its SERVER pc but too old for todays standards so its cheep. With it you have to invest for start 60$ for Unraid and as you expand you will pay for OS total of 120$. Now why to unraid. Becuase its solution for all of your problems. It can be cold backup too since it support shutting down hdds. And you can buy 3 HDD for start and then expand later. If you go for their version of "raid" you are limmited to only largest hdd has to be for parity (protection). Rest of hdd can/must be equal or smaller then parity. You can have up to 2 HDD for parity (protection). When something is writing to your nas parity is calculated on the fly and is written to parity drives. Down side of this is speed limit of write to parity drive. You can go around this with cash drive which is counted separate and dont have protection unles you put 2 of them in "internal" raid. Other solution is ZFS. Wtih both ways you can set some drives just to go to sleep so for example for cold spare you can make folder that is not shared for protection and put it to sleep. It will stay in sleep till restart or something is accessing it. For start i would go for 8x8TB SAS used disk since they can be found for around 80$ piece. Later you can swap them for larger. Look at Unraid and you will love it for its simplicity and usability.
Sounds like a good DIY solution! How are these DIY servers connected to a workstation computer?
@@VideoVo-Tech They are connected over your network via Ethernet and use storage protocols like SMB, NFS or ISCSI.
This solution is just a DIY synology sever
I used that old VHS camcorder you have in the background when I was in college. Brings back memories.
Ha! That's awesome. I've only ever used it to make some VHS overlays to make footage look like VHS!
this video came at the right time as having multiple 8K cameras, 360, and drone footage from a single day of shooting really adds memory, not including proxies.
Glad to hear! What cameras are you shooting on?
No one's providing better content on youtube. Video quality and content quality through the roof. Learned so much!
Thanks! We're learning 😂
Brilliant video and well thought out. These DASes seem to make sense than the NAS boxes if you don't need the fancy software or humungous drive bays. They seem very expensive for what seem like relatively weak computers. With a DAS the files are there as you'd expect, you can use your own powerful PC, and the drives can be plug-n-played and there isn't any black box magic going on. Then if you need the files on another computer, or multiple people/devices need it - you can do a windows network share (samba) on the drive. So it technically makes the DAS a NAS.
My setup is an old laptop with a big hard external hard drive plugged in all day, then that is ethernet wired into the router. My working machine is hooked up as well by ethernet. Speeds are good enough for just me ~90 megabytes/second, Read/write. Or if using wifi, it's slightly lower. It could be higher if I figured out the bottlenecks as HDD does 250mb/s+ if directly connected.
If I want to access files on my phone, tablet or on another laptop I can use that. Or if I'm outside my network, I use Tailscale. That lets you access your drive like it's a local file share, it authenticates it like you're on a local network if you're away. Speeds are limited by your internet connection, 4G, or the internet speeds on both ends of the pipe - but that basically gives me a self-hosted cloud wherever I am from any authenticated device.
For backup I have some other external drives I do a manual sync with once a month or so. I use Freefilesync, which is a great piece of software, to mirror them. I keep one on a different part of the property. For the most valuable data I have multiple backups, on bits of cheap cloud storage and thumb drives, but for media libraries (films/tv etc.), most are easily replaceable so I'm not going to spend a fortune. And if worst case scenario happens and an astroid wipes out my house and I lose all my photos, I'll have bigger problems to deal with at that point.
In any case, thanks for the great video and I hope the above helps anyone whose thinking about doing a homecloud or janky NAS solution.
Thanks for the thoughtful reply! Good to know about Tailscale and Freefilesync. Sounds like a good DIY Setup!
For cold storage nothing beats tape. It has a guaranteed lifespan of 20 or 30 years. Hard drives have too many moving parts, the film wears out, they demagnetize over time, CDs and DVD are too small and they have their own longevity issues with oxidation etc. Long term guaranteed cold storage is done on tape. LTO-9 has a capacity of 18 TB native and 45 TB compressed. No, it isn't cheap. The good news is that the cost is in the setup. An LTO-9 tape with a 45 TB compressed capacity is only about $100 but the drive to write to it costs about $6,000. You can get LTO 9 in USB or Thunderbolt-3 unless you want to dump an extra $1000 on a fiber card or a SAS card. If you demand to use windows... then you can expect to spend another pile of money on software. But after all of that you can back up all of your video to tape at a pretty low cost on an industry standard, high quality, long term storage medium that has been in use since the 1960's. I have personally worked on tape drives in a production environment that were at least 30 years old. The tape drives themselves last a really long time and are a real workhorse. In 20 years you would want to migrate to a newer generation of tape anyway. Tape isn't forever but it's close.
I appreciate you taking the time to explain the advantages of tape for long-term storage!
I bought an HP Z420 workstation for $100, installed TrueNAS Core, installed 4 x WD 10 TB shucked drives (removed from USB enclosures, cheaper that way), added a cheap 10 Gbit SPF+ NIC from ebay, and a DAC cable. Later I installed 64 GB ram, and NVMe cache.
I'm not quite tech savvy enough to go the DIY server route but this sounds awesome!
Great video!
Thank you! Glad you enjoyed it.
Note on RAID 1 a properly implemented controller would read different blocks from different disks, so on reads it would give your greater speed, the writes would be the issue.
It's 2024 and I am very impressed by your innovative solution here. Great video! This is a great example how to be one of the ways that people create, maintain, and strengthen their social connections with your positive outlook. Kudos!
Thank you!! I don't think this is for everyone, but I think a lot of people are in the same shoes as me. Trying to avoid a NAS and finding a DAS solution that checks all of their boxes.
@@VideoVo-Tech Absolutely!
It's twice as expensive, but if you need a networked option, terramaster's f4-423 nas solution is pretty solid. It has 4 bays and can be configured though a decent web interface. If you don't want to use their software, it's just a mini pc at the end of the day - so you can replace it with linux or truenas.
Good info, Thanks!
Meanwhile, I just kept an "old" PC with a Core i7 2600 and its huge tower case. I put some big HDDs inside and it cost me almost nothing. For the backups, I make them manually by myself, twice a week if needed. It's more than enough for my needs and I'm not tied to any proprietary thingies of any sort.
Nice! Definitely a solid option but I needed something that wasn't connected via Ethernet and could be portable. How much space did you end up getting?
Nice update to 4K+ production thought.
For $10~ you can upgrade the fan with a variable speed and bigger blades and make that part silent if the cover is off or you create flow-thru. Add a double-layer of foam pre-filter to catch dust (cheapest - search air conditioner~)..
One thing that is vital is to manage the information so that you can find where you put things. These days you can do the following: create a thumnail video - something very small with decent resolution. At the same time you produce a verbatim text transcript. You assign a serial number. You ensure accurate metadata. And you assign long-term storage which gets preserved like you describe. That's not what I have - yet - but AI will make this "effortless" - maybe - soon.
I am planning to build a NAS from an old PC with TrueNAS (former FreeNAS) open source software. My cost would be for the hard drives only.
A lot of people have said DIY nas were the way to go so it looks like a great solution! Another way to get budget drives is to find external ones on sale and shuck the drives out of them. Apparently a lot of WD have good drives in them.
Thanks
👍
I'm a photographer and I'm using 2 OWC Thunderbay 4 enclosures in RAID 0 each. One is a Thunderbay 4 Mini, which is my faster of the two enclosures since I have 4 x 2.5" 2TB SSDs in it for my main storage of my RAWs. The second Thunderbay 4 has 4 x 3.5" 4TB HDDs which I use as backup of my other enclosure and I use CCC to clone it regularly.
The fans can get a bit loud, especially the bigger DAS since it has mechanical drives in it. Fortunately I have created my own home server out of an older MBP and I have it running out of my garage with the RAID drives attached to that. I have heard of people swapping out the fans for much quieter ones. On my main desk though, it is so nice to have a silent work space.
BTW, I bought the Thunderbay enclosures used on Craigslist for around $100 each. I do hope 2.5" SSDs keep increasing in capacity and dropping in price, because we're almost at the point where NVMe SSDs are almost matching 2.5" SSDs in price and capacity. At some point in the future I will have to get an NVMe RAID enclosure.
Sounds like a solid setup! I thought the same thing when looking for a 2.5" SSD for my laptop. It looks like those prices are steady and NVMEs keep getting better.
@@VideoVo-Tech right now on the low end 4TB NVMe and 2.5" SSDs are both around $200 each. Obviously NVMe are way faster, so when it comes time to upgrade my 8TB RAID drive, I'm hoping 2.5" SSDs drop in price and increase in capacity significantly to keep using them or I'll have to make the switch to an NVMe RAID enclosure. I'm hoping by the time i need more storage, a 4TB SSD can be had for ~$100
@@charminbaer2323 🤞🤞 I've got to keep a pretty large amount of footage online so it looks like it may be a while before SSD raid is in my future.
@@VideoVo-Tech I just saw a video of a 48TB SSD RAID (12 x 4TB NVMe) for $17.5K. yeah, hopefully by the time I need that much. storage, prices would be exponentially cheaper.
@@charminbaer2323 🥹🥹🥹
Similar issue here. I had a G-Raid drive with 2 - 20TB drives, one for files and one as a backup. I was getting to where there was no room for the drives to really work so I just added another (Sandisk Pro) G-RAID Mirror with 2-22TB drives. Both these are configured to RAID-0 for speed but they're still not fast, and one backs up to the other each night. So the two are not connected by a RAID setting. Now I have room to grow. If I edit videos, I move the files to NVMe drives. BackBlaze is the off site backup of choice. Thanks for the video.
Such a similar solution! What type of files/editing are you working with? This setup isn't as fast as an SSD but I haven't had any issues with the speed editing Black Magic Raw and Prores in Adobe Premiere and Davinci Resolve.
@@VideoVo-Tech My day job is in banking but my side business is sports photography. I have a lot of memory tied up in composite photos for banners, posters and such. I typically do not compress these or move them to other external storage. I play with some videos using Final Cut Pro but that work is minor so far. I guess if you were to call someone a digital hoarder, that'd be me. I have older PPT, Word and XL files that go way back. But they take up more space being listed on a directory than hard drive space that would be recoverable. That is, its hardly worth the time thinning them out.
@@zavoina I totally understand!
I'm not an editor, or at least not a heavy one, but I do have a homelab setup and it runs media servers as well as tons of Virtual machines but it only has 2TB of onboard storage between the 2 machines on the cluster. When I was considering what kind of storage solution to get, every resource was pointing me to a NAS. I ended up getting a DAS instead; a 8 bay USB enclosure supporting Raid. The reason I didn't get the NAS is because it made no sense given that I already have 2 different servers in my cluster. Why add another computer with enough memory to run its own virtual machines on a 1 gig Ethernet connection when I can just use a VM on one of the servers to manage my DAS and serve the files over a 5 gig local connection. The Nas solutions were just so much more expensive for something that was already sort of redundant in my setup.
Curious, which enclosure did you go with and did you go hardware raid or software?
@@VideoVo-Tech ended up getting the qnap tl-d800c. I think it uses sofware raid, though they do advertise it as a JBOD system, you can definitely put it in various raid configurations. Outside of the enclosure and the bays, there really is no internal hardware on this thing. I got a really good deal on it and it just exactly what I needed to so I can't complain.
All you need to do with a NAS such as Sinologist or QNap is to map it to your computer, that way it is seen as a drive and Backblaze will see it as one too. I’ve setup many clients like this with no issue.
Really great to know! Is this connection with the 10gig or USB?
RAID 10 and RAID 0+1 are NOT the same thing. 10 is striping a mirror, while 0+1 is mirroring a stripe. A graphic representation perhaps shows it best regarding disk failures (particularly multiple failures).
Yes, thank you!
6:17 you put 4 drives in a 2 drive unit? magic.
I didn't show the second drive, but I got two of these enclosures each with two drives in them.
@@VideoVo-Tech congrats on an over the top noisy setup
@@HowDidIGet3700Subs 🤘🎧🤘
@@VideoVo-Tech 💩
Why are u love hearting me?
It REALLY depends on what you're doing and how.
If you are editing on your local system, hence the need for direct attached storage (DAS) (rather than network attached storage (NAS)), then this probably works for you.
If you're editing on a remote system, and you are able to get almost the same performance (or better) vs. editing on your local machine -- then building a bigger server, and running everything off of that single server might be the better option for you.
I have a QNAP TS-453Be 4-bay NAS (which only has dual GbE ports). The newer versions have 2.5 GbE.
I also have two QNAP TS-832X 8-bay NAS as well (which comes with dual GbE ports and dual 10 GbE SFP+ ports).
That worked well for what it is, when I was using it.
Now I have 36-bay server, and all of the containers and VMs run off of that, and the virtio NIC in MacOS/Windows 10+/Linux -- "sees" it as a 10 GbE NIC; but I don't need 10 GbE switches, cables, nor actual, physical NICs.
In Windows 7, it "sees" the virtio NIC as a 100 Gbps NIC.
That's my "do everything" server.
And for the systems that support it, I also use virtio-fs to pass data between the VM host, which bypasses the network stack entirely, and therefore; works a lot better and a lot faster.
Like you said, different people have different needs, which drives different solutions.
Very well said everyone has a totally different list of boxes they need to check. The big server with VMs sounds insane! Later down the road this type of server could work well for me for the amount of space it could have. How many TBs?
@@VideoVo-Tech
I think that total raw capacity is something like 268 TB in 4x3/8x6/8x6/8x10/8x10 configuration.
The first 4x3 is in HW RAID6 (for the OS itself).
The second 8x6 is in its own raidz2 vdev/pool (for the VM/CT OS images). (I originally started with everything, all in one giant pool, but when the big pool was busy, the VM/CT OS started reporting issues when it was trying to read/write to the VM/CT OS disk image file. So I ended up splitting the pool back up and out.
The third, 4th, and 5th are raidz2 vdevs, in one big pool together for bulk storage.
That results in a usable capacity of 198 TB.
It sounds insane, but that actually ended up consuming about HALF as much power as I did vs. when I had the separate NAS systems, plus an older dual Xeon server that was running TrueNAS Core.
A LOT of tech RUclipsrs talk about how most homelabbers -- their systems tend to have relatively low load averages.
My big server (dual Xeon E5-2697A v4 (16-core/32-thread, 32-cores/64-threads total) has a nominal load average of 50 (as a result of it being a "do everything" server).
It does the work of like 23 CTs and 17 VMs, all in one box, and all within a 670 W power consumption/budget (which if I had separate systems, it would be consuming way more power, and wouldn't necessarily be as performant, overall).
I was looking at the cost of 10 GbE switches and they cost at least HALF of what I paid for the 36-bay server (off of eBay), whereas I can have the server do everything that it does, AND via virtio NIC -- run/use 10 GbE networking, but saved the money on the cost of deploying 10 GbE networking. So win-win.
@@ewenchan1239 super cool! It's fun to get creative and find these solutions that are a little off the beaten path but perfect for what we are doing 🤘
@@VideoVo-Tech
Yeah - the whole mass consolidation project that I went through late 2022/early 2023 was entirely and wholly centered around cutting power consumption.
Back then, between my 48-port GbE Netgear switch, QNAP 4-bay NAS, 2x QNAP 8-bay NASes, and my 12-bay TrueNAS dual Xeon server, it was consuming 1242 W nominal.
That was huge.
So the project (and research) was underway with the goal of cutting that power consumption by HALF.
It ran a three-way head-to-head competition between xcp-ng, TrueNAS, and Proxmox to find out which virtualisation platform would be BEST able to facilitate VM Host data transfers (since I found out that most of my systems were communicating regularly to the host server and/or between the NAS systems; and long story short - Proxmox won.
From there, there were experiments, first with VMs (migrating from Oracle VirtualBox to Proxmox), and then discovering that LXC containers can do what VMs do (as long as it was still running Linux), and was more efficienct with resource utilisation vs. "full fat" VMs.
And recently, I have been playing around (again) with sharing a GPU between multiple LXC containers, for GPU accelerated computing. (HPC CFD)
From there, it then became a project of "let's see how much stuff I can shove onto this single system?"
iSCSI initially worked, but then because of how busy the system and the drives became, that ended up getting split back out to my 4-bay QNAP NAS instead.
48-port GbE Netgear switch dropped down to a 16-port (+8 port) GbE switch (for physically separate network layers, because as far as I can tell, even a managed switch that can do VLANs, can't accept two separate uplink paths/sources).
And now, the whole system consumes about 670 W.
So yeah.
Fun stuff. LOTS of late nights, getting it all up and running.
#4:30 -- simply use the USB-A-Port as the NAS to use the drives as is?
It was hard to decipher online whether this is just an input for the NAS or not. I couldn't find a for sure answer that these can show up as a normal drive. Maybe I wasn't looking in the right place.
You absolutely can backup a Nas to Backblaze the cheap route without the premuim plan. That goes for QNAP and Synology
Good to know!
@solmonw6003, Would you describe how you do this? I'm using a Synology. @VideoVo-Tech, terrific video, thank you!
no, you can't with the unlimited plan, you need to pay more on the b2
I'd fill that with cat pictures. :)
Based on my calculations, 44TB would be about 4,400,000 cat photos 😂
You're almost at the point where LTO starts to make sense... First World Problems 😆
I really am! If I could find a good deal on a tape drive then it might be worth it.
Amazon has a cold storage solution called S3 Glacier . I've never used it myself but at $1/Mo per Terabyte might just fit the bill for you
Edited: I don't know where I got the $1Mo/TB figure from, apparent;y I'm dreaming. Still it might be cost effective. Sorry for the confusion.
It's always good to know different options! Maybe they had a cheap intro price and then raised it. Backblaze still seems to have a better value at $6/TB for their Business/Server cloud storage. Amazon's is like $26/TB 😢
@@VideoVo-Tech No, he's correct. AWS S3 Glacier Deep Archive is $1 per TB per month. There are several storage types on AWS S3, even different Glacier types. The one you want to look at is Glacier Deep Archive. The cost is - $0.00099 per GB). However aws S3's true costs can be complicated, so you need to be aware of potential charges if you need to restore or delete files before they are a certain age, etc. Honestly, over a 3-5 year period, the least expensive option for archiving your stuff is probably to just buy a cheap 2 bay NAS with enough storage and put it at a friend or family's house and setup a nightly process to copy files over to it :)
Oh snap, this is really good to know about Glacier. Although, I really like the idea of an off-site NAS because I don't like constantly adding to the monthly subscription list.
Where did you find them on sale for so cheap? I checked the price tracker and couldn't find it ever going that low.
Which item?
The Sabrent 2-Bay Hard Drive Enclosure (USB C)@@VideoVo-Tech
The Sabrent 2-Bay Hard Drive Enclosure (USB C). Sorry my bad.
@@_M317 they were on sale on Amazon at the end of the year last year. Links are all in the description!
If you need more space or a real RAID10 there's this Orico DAS, 5 drives, 80 GB total wich I'm considering for myself. I'ts only 225 euros
Looks like a good option! Let me know how it goes if you end up purchasing!
5:39 it has bad reviews - look at those stars
I've had good luck with Glyph drives in the past three years. I'm not sure about this enclosure though.
@@VideoVo-Tech advising people buy a badly rated device based on your “good luck with it” is why monetisation of content like yours is an evil thing
@HowDidIGet3700Subs if you keep watching, I actually don't advise buying this Glyph enclosure, but show how I built something similar for much cheaper. I don't even link to the glyph product.
@@VideoVo-Tech yeah right
@@VideoVo-Tech ... then what's the point in adding the glph rubbish into the video in the first place? why don't u put the info in one succinct video or even better a concise text blog post? oh that's right cos u wanna earn money by wasting peoples time unnecesarily
buy the 5 bay, no RAID!
Ping (commenting so I remember to come here later)
You can also just add this video to a playlist
We'll still be here when you need it!
I do raid 0
Did I hear this right? He is running a RAID 0 and then running a drive clone every night?
Correct, my main drive is The 2bay enclosure in Raid 0 for 2x read and 2x write speed. Then, I use Karen's duplicator to mirror it every hour or every night to another identical setup.
😥 Promo-SM
🥲
FBI.
Holland.
Musk or crew.
Tech leading to
video editing
voyeur porn.
noisy too.
The fan noise doesn't bother me.
@@VideoVo-Tech you aren't the only person in the world x
🥲
@@VideoVo-Tech don't be sad - it's a good thing, less lonely.
why are you love hearting my comments?
This is what you get when you have a non-computer person try to figure out raid
If you are considering this solution, please watch other videos, almost everything in this video is wrong
Buying recertified drives is stupid. The savings aren't worth the gamble.
It's not stupid if it works! Jokes aside, A lot of people feel the same way as you do. Nobody would really recommend this and that's why I said that I wasn't recommending it. But when building storage you can spend a lot of money minimizing risk down to zero and I was trying to be aware of the risk while also saving as much as I could. I may be less risk averse than others but have justified it to myself by having the standard "3-2-1" rule here in place with a local backup and backblaze.
I don't think permanent data loss is the actual problem, but the time and money spent recovering, especially if the storage infrastructure is for a business. That most certainly always exceeds the money "saved" by buying refurbished drives.
@@toseltreps1101I've been running used data center drives for ages, I bought a pile of 4tb hgst for like $15 a piece
You are 100% correct ... I would not be able to sleep at night knowing I put data on a used drive !
@4:30 what!??! seriously those are your reasons for NOT getting a nas? what a joke, stopped watching bye
Thanks for watching!
@@VideoVo-Tech now i feel like crap for commenting this.
i'm sorry bruh,
you just tryin'a do some vids here, my bad
Many errors
Much apology
wow noob
Complete noob