Woohoo! you guys are awesome. Thanks for sharing thoughts on your personal workflows, love it. Some additional thoughts from me, - People are asking about offsite. Yes, the field drive goes offsite once back at the studio. - I don't back up to the cloud, because my ISP in canada can't manage the TB/s I produce weekly. - It technically is still risky with only two copies for archive. That is a risk I am willing to take once a project is complete. (when the project is active there is technically 4 copies of the data) - the best long term backup is LTO (it basically records to tape, almost 0 chance of failure)
3 года назад+4
Don't really know if you have done it already, but I would absolutely loooove an update on your current media management setup!
@@Levi_Allen Do you or Caleb have videos that can talk to how RAID fits into the picture? My workflow is evolving beyond just a 5TB External SSD HD and trying to determine if investing in a RAID is necessary or if having a refined file management structure using Hedge / Carbon Copy can do the job. Still pretty new to this and having a difficult time finding a video on RAID tailored to independent filmmakers / RUclipsrs since most results talk shop with IT professionals at an enterprise level. I was made aware of my potential need for it after watching Peter McKinnon's video. ruclips.net/video/7RJCLGZvzUs/видео.html Thoughts?
I've been working in media for 8 years after starting my own company when leaving university. This is by far one of the most helpful videos to do with work flow i've come across in those 8 years. Have you thought about going through an import/export work flow process to show how to get the best quality from card > edit > export > Delivery ... that'd be super helpful! thanks!
pretty interested in your process for supplying download links to clients. typically i just either upload to dropbox and supply them with that link or upload to my site's ftp in a designated ClientName/Project/Video.mp4 location
Hi, Nice vid Levi. Thx. About managing client vid, do you know Frame.io ? I'm using it since a year now and it has changed my relation with my client in the best way. So easy to use. I love it.
Hey man, really dig your videos! Quick question: Is there any way you can start uploading in 4K (or at least 1440p), even if you shoot 1080p, just to get some extra bitrate out of YT? Thanks! keep it up :)
This could not have come at a better time. I was JUST researching best external drives for video production. I've reached the point that my current amateur system of backing up and editing is no longer functional. Love your channel and advice. Found you through your FCPX switching video. Thanks for sharing your work flow!
Hey Levi Your explanation of your backup tools was great. I ran a Mac Service business for 18 years. Nice to see a user with a methodical backup regime. I also use some of the same tools that you mention. Used Carbon Copy Cloner for years... great tool. My Raid box is a 4 bay Drobo (beyond raid). I have 2 of these with 16gb each at the moment. Started with 2x1tb drives in the Drobo... then just pop one out (live) and Drobo formats & re spreads the data to a newly inserted drive. Gradually Moved up to 4 x 4tb. It is so much easier to use than standard Raid. Will now try your Hedge backup sw as that looks useful. PS I have been following you since Pure Living FL. Just bought a Mavic Drone so your tips on moviemaking are helping me Cheers.... Trevor in West Australia (Formerly from Toronto)
Thank you for mentioning Hedge. I hadn't heard of it. Take a look at CrashPlan Pro. I've been using it for about 5 years. It's an affordable subscription-based cloud storage service with unlimited space. (I'm not affiliated with them other than as a customer.)
One thing I struggle with is excessive amounts of useless video, very often we have files where something is filmed in anticipation of something going to happen but it doesn't. Do you delete this stuff or keep every file?
If I know for sure it was a waste, I’ll delete it. Other than that, I keep everything. That way I don’t have to make the decision, it’s just easier at that stage to keep.
Wow. Very good info. But that is expensive. My projects are not that big so I use 4tb for archive. I’ve accidentally formatted wrong drive and had one just fail. If I was doing it your way I would have been saved.
I use blazeback up to another physical location on top of keeping 2 local copies. Gigbit internet helps it happen fast but I started the process when I had a slower ISP. I don't delete the SD cards until its in the cloud. For me a 1tb takes about a day. Its about a week at 100mbs so keep that in mind when planning how much media you need to have on hand for production.
I was going to mention cloud, but you stated Dropbox in the video. Online, maybe AWS? But like you posted when it's all said and done technically you have four copies! I think thank is enough. Especially at least one copy off-site. I tell ya I learn something new after every video. Still working towards getting a camera! lol. Thanks Levi, take care.
I use an almost identical workflow, and it has done me right for years! Follow this advice, and make clones! Simple rule you can enable is to ALWAYS buy hard drives in pairs. NEVER buy just a single hard drive. It's as simple as that, and you will always have a clone.
Watched this when it dropped 4 years ago (long before I was paid to make videos). Took a bunch of tips away from it back then. Just watched it again today as I'm at a place of stepping up my game. STILL a huge help. Thanks man!
What is your laptop specs and processor situation? I'm trying to figure out a way to edit video on a Macbook pro mid 2012 (AKA avoiding buying a laptop with a touch bar)
So I just learned that DaVinci Resolve has a built-in clone tool with checksum verification. It's free and is more flexible than Hedge, so you aren't locked into one workflow. Read how to use it here: www.rocketstock.com/blog/davinci-resolves-new-clone-tool-indispensable-dits/
Great stuff. Very helpful as I'm setting this up. Have you looked at using Amazon Glacier for your offsite archival at all? I'm currently using it on one of my NAS and its built into the OS natively. Very affordable per GB bc its meant for archival and the retrieval times aren't great. That said I've not had to retrieve anything quite yet so cant speak to that process personally.
Very organized! But maybe I do not understand something....you said you clone your edit drive media to "two separate hard drives in a raid" .... so there are two distinct copies? do you locate one drive off-site for safekeeping? Where do you keep your project edit data in case your edit site burns down? thanks
Dude we’ve got an old MacBook Pro and an old LaCie hard drive for storage. I feel like I need a full month long class on what to buy and how to use all of it. I’ll fly out to BC, what’s the charge for this soup to nuts class? Checks in the mail.
Backing up "daily" is an awful idea. Backup every hour or a when convenient. Why would you want to loose an hour or an important shot? Also don't put your laptop or kit near the edge of a boat. Water. Or a shock could launch the laptop or drive off the side into the boat and disconnect the drive. I'd be tempted to tape down the drives and put on a table inside under cover if doing DIT on a boat.
This is the best video! I have watched it multiple times and have started implementing the systems and practices and I'm loving it. Thank you for doing the heavy lifting so I didn't have to!
I did have a quick question. So it's better to edit the project and save the files to a different hard drive opposed to the one in the computer? If so why?
You did such a great job explaining about your work flow, so I have added it as a link on my site AdventuresOnBoats.com. Our site is aimed at persons interested in a cruising lifestyle and attempts to provide links to sites like yours to educate them with links on relevant cruising subjects. -johnny
Been getting increasingly worried about my commercial projects growing in production value (and, therefore, cost to them) but still using my half-assed media management workflow with limited backups etc. I can’t charge decent money and then lose/corrupt footage!!! Will be checking out Hedge and Carbon Copy asap 🤙🏼 thanks for the code!
You might want to consider Backblaze.com for your cloud based backups. Unlimited data for $60/yr. Assuming your ISP doesn't have data caps like mine (Comcast).
I know a wedding photographer (can’t stress enough how valuable the archived wedding photos are. Can’t recreate a wedding, right?), who got a request from a former client who wanted new prints of her entire wedding from some time ago because her copy was destroyed. He went to his computer to make copies and his computer failed. No problem, he has a back up, right? He went to his back up and found out that external drive no longer functions. No problem, he has secondary back up, right? Went to that and found THAT drive is also toast. Can you imagine, primary desktop fails. Then both physical external drives are gone as he hadn’t touched them in years. What are the chances?! He lost all of his work over the years and the bride never got her photos. Ouch.
Awesome walk through man! Funny that you posted this today. Just today I've been making plans for my next youtube video tutorial and it just happens to be my backup workflow. Mine is not nearly as sophisticated as yours (lacking some redundancy) but I hope folks can glean some stuff nonetheless. I find it super interesting to see how everyone goes through this process as it can be a pretty daunting task at first. Thanks for this.
I think "month - day - year" naming convention is not the best. This way 01-01-2019 goes before 12-31-2018. I use the system that many cameras use - year-month-day. This way 2019-01-01 goes after 2018-12-31. Otherwise very good advises.
I've seen a lot of videos, and most of youtubers are using RAID and that is simple not reliable, woking as a IT I user for all my media NAS Servers, at home and even when Im on the road, you just have to copy one time the file and the system itself will make a dal copy of your data. I think the problem is slim laptops, I use a Dell Alienware supporting up to 8TB for each drive, with raid 5 I loose I hard drive but all my media is fine. Try NAS Server and star looking for a new windows laptop with 3 drives at least, now you can get one for 1200 with a 1080 8gb Graphic card. My thought
You can't separate the drives in a raid for dual location back up. And it's challenging to scale it as the upfront costs are a larger investment. I've opted to use high-speed raids instead and am very happy. And then use external drives for the archive stage.
Dang... Love how you're so organized and have an awesome system going. Really helpful info! Timmmmmee to get a second back up hard drive. (Edit): The link for this one is broken "MY favourite Edit Raid (I have the 8tb model): left.ly/gstudio-raid"
Really useful - thanks! I have extensive knowledge of the IT side but am still a newbie to video where we're dealing with bit-sensitive, massive files. I really like your workflow and your mindful attitude to redundancy. This is the best grow-with-your-business workflow I've seen. Thanks again.
Another place to backup is off-site to Amazon AWS Glacier which costs just $0.004 per gigabyte per month. Dirt cheap insurance in case your RAID fails or house/Sprinter burns down or disks get stolen. If you have a Synology Disk station, you can do this automatically.
Holy hell.. I just download to an external hard drive, edit my project and then send it out to the client when Im finished.... I GOTTA UP MY GAME BEFORE AN ACCIDENT HAPPENS haha
Perfect! Haha Recently started to record in 4K and can only work on two video projects at a time on my 2015 MacBook Pro with a 500gb SSD. This is really helpful. Thank you! 😊
I use two or more card carriers. First one for empty cards, second for used. If I can afford it, I buy new cards for a new project. And they are different brands like Kingston for some SanDisk for others or different kind a sanDisk so it looks visually different. Personally I stay away from PNY cards - or maybe I was unlucky. But the only fail I've had was with a PNY. I had to reshoot an interview. I MISS LEXAR! After I get done filming, I'll rename the files in the card to something I can recognize so I know what it is when I import - HawaiiDay2 or ClaireInterview1 something like that.
By FAR, the best video on media workflow. I still have a question though. I have a new shiny MacBook, that is faster than my older iMac. I have been trying to figure out where the project and contents goes for fastest editing (budget for one external for media, and another one for backups). When I put my project and media on the MacBook, the editing is much faster (obviously) the problem is I only paid for a 500Gb hard drive, which fills extremely fast while editing/proxy/optimized, on the other hand when I place all of the contents on my external, it's much ssllloooowwwwwer editing. (obviously) My question is.. Is there a way to edit the project on my MacBook, while all the big files reside on my external... While I save for a RAID system.
Super helpful! Thanks Levi, I've been looking into changing my backup workflow for some time now! I would also be really interested in hearing about the client link, and maybe what you think of Google drive vs Dropbox vs frame.io etc
FYI about folder naming. So long as you group your project folders by year (e.g. 2017, 2018, 2019, etc.) naming the projects in the mm-dd-yyyy format will not cause you too many problems. In other words, you will have all the January (01) month folders mixed with ALL years. However, if you have them mixed up with multiple years, you may want to consider changing your naming method to yyyy-mm-dd so that all projects are sorted by name properly in chronological order. I used to date my folders like you do, but then changed when I started archiving all of my completed projects in one folder for ease of searching. All my folders were sorted by month, not year and I had to go back and change them (this wasn't just my video projects, but also ALL folders I dated this way and moved into a common archive folder. It will cost you some time now, but, IMO, will help you avoid problems down the road. PS. I noticed that you did have some folders in the yyyy-mm-dd format, though you also indicated that you now use mm-dd-yyyy. I'm curious as to the change (if it actually is one).
Very interesting and useful. What do you do if you want to go back to an archived project? Do you copy it back onto the edit raid? Then if you copy it back to the archive will you have 2 copies of it on there? Thanks Jacob.
let's see the other video on sending download links etc to your clients.. this makes me feel like such a nerd but man is it fun watching other people's workflows.
Good workflow demo. FWIW I've been using Hedge for about a year on commercial shoots backing up data from a range of cameras. The developer is actively engaged in the refinement of the product. The licensed version uses an advanced checksum algorithm that seems much faster than the usual MD5 algorithm. Definitely gets me off set earlier and thats always a plus after a long day. (I have no affiliation with the company other than being a user.)
Matttte!!! Thank you so much for this video!!! I've been looking to creat a work flow as I beginn in video making and editing and you are straight what my I needed. Your desk is sick!! Great job!! I'm carpenter and I also create custom furnitures!
I have a workflow with 2 raid setups as well. One is Raid 0 and the other is raid 1. The raid 0 array is all Samsung SSD's and both are thunderbolt for speed. I had to figure this out the hard way. I've definitely lost footage before. So when you finish a film do you keep a large master copy and then export/covert that file to whatever format you need?
Hey man, super duper quick question about your rig, what's the name of that Sony npf battery dock that you're running straight into the GH? Thanks heaps dude, love your work!
Fantastic video the best & most comprehensive backup & storage system I have ever seen. I am not a working professional videographer but have been shooting video for years & have struggled with how best to store all my own personal home videos memories for the future. For the 8 TB of videos stored in random drives all over the place this seems to be a great answer to my problem. Thanks Midland, Ontario, Canada
So, what I don't understand - because I've seen a few people do this - if you have an automatic backup going from your editing RAID to two other Backups, what happens when your editing RAID gets corrupted and Carbon Copy Cloner transfers the corrupted files onto your backups. Wouldn't that mess everything up? Thanks for your content, your channel is a great inspiration to me. Cheers, Killian
Carbon Copy has what’s called a safety net, it keeps previous versions and you can set how much of previous versions to keep. I don’t ever have files corrupt on a raid, it just normally has a drive fail, that’s to more common issue
Spinrite from GRC.com has been an essential too for verifying the safety of data on hard drives for me for over 25 years. With improvements, it is as useful today as it was over 20 years ago. Highly recommended!
GlueFactoryBJJ I haven't seen a website design that bad since the early 2000s. If it is any indication of their software design, I'd stay far far away. Also, Windows only.
Mark O'Russa - Yeah, the design sucks, but Steve Gibson is one of the best programmers and security experts I know of. His site epitomizes the phrase, "don't judge a book by its cover". As does his software. I guess that's what you get when you mainly program in assembly... Of course, you may not want to try it and that is up to you, but like I've said it is great software and has saved a few crashed drives for me both on the job and personally. BTW, you can also listen to Steve's podcast on the Security Now channel on RUclips. It is sponsored by TWIT TV.
Mark O'Russa That's because the website is from pre-2000, its function over form. Also do your research, it is not OS or format dependent, the software works at the bit level on the drive using underlying drive commands that are only exposed usually at a bios level. It could be an drive from an encrypted RAID array, it doesn't care and can do its job.
TheTechnoPilot - Yep! And Steve programmed his own web server, in assembly, which, if I remember correctly, is less than 1MB in size (not a typo). Of course, GRC.com runs off that server software, though that is not the reason it looks so dated. Oh, he also wrote the ecommerce software the site uses... in assembly. Heck, Spinrite is even used by some data recovery services as their first pass, depending on the type of damage to the drive. Anyway, next time you have a harddrive that is throwing errors, seems to randomly corrupt files, or even slowing down for no reason, it is worth the ~80 dollars to use it. Note that if Spinrite shows a bunch of errors, you should replace the drive even if it appears to be working normally again because the drive is probably failing, but Spinrite has made it work again so you can replace the drive. Especially if there are a bunch of S.M.A.R.T. errors. Spinrite also works on SSDs. Even, as you noted, those in raid arrays. I use it on every drive I put into service. It can take awhile to work on these multi terabyte drives (about 6 hours per terabyte) and must be run off a boot CD/DVD or USB stick. So you will have to dedicate an old PC to the task, but if you want to save a drive it can be priceless. Spinrite 6.1 will hopefully be released this year. It will be a free upgrade and will increase the testing speed to about 1TB per hour (repairs can take much longer). All "dot" releases are free. Spinrite 7 is not supposed to require you dedicate your PC to the process. Both updates have been waiting on Steve to finish his SQRL token based user authentication protocol/software. You can read about it on his site and on various Security Now podcasts. It is practically done now and will be available for almost every OS available, both server and client. I definitely hope it is rapidly adopted. Anyway, my $0.02 (or so)... Disclaimer: I don't have any financial interest in GRC, I'm just a big fan of their products. I have been using Spinrite since Spinrite II (v2). I still have the original 3.5" floppy disk. Darn I'm getting old...
Hey! Great video, and thanks so much for the in depth breakdown. Quick question - Are you using the Macbook only, or in conjunction with a desktop when you get back to the studio?
Great tutorial Levi. Thank you for sharing that. Question regarding the archival drives. Do you have two drives per project or keep adding projects to the archival drives until they’re full? If the later, how do you keep track of what projects are on what drives?
Oh yah thanks for reminding me to back my stuff up, I lost a lot of files a few months back when I updated to High Sierra my iMac would not reboot had to try and save some files and format the hard drive what a pain - Lesson Learned.
This video made me reevaluate my whole life lol! I was about to invest in more gear and toys, but I think I’m gonna invest in better memory storage because I don’t have a solid system! Good vid!
Woohoo! you guys are awesome. Thanks for sharing thoughts on your personal workflows, love it. Some additional thoughts from me,
- People are asking about offsite. Yes, the field drive goes offsite once back at the studio.
- I don't back up to the cloud, because my ISP in canada can't manage the TB/s I produce weekly.
- It technically is still risky with only two copies for archive. That is a risk I am willing to take once a project is complete. (when the project is active there is technically 4 copies of the data)
- the best long term backup is LTO (it basically records to tape, almost 0 chance of failure)
Don't really know if you have done it already, but I would absolutely loooove an update on your current media management setup!
Your open laptop on the sailboat stressed me out! Great video man.
Is your workflow much different? Two copies on import, edit off a raid, then two copies on archive?
Pretty similar yeah. Although now I send a third copy on a hard drive to my editor, Tim.
@@Levi_Allen Do you or Caleb have videos that can talk to how RAID fits into the picture? My workflow is evolving beyond just a 5TB External SSD HD and trying to determine if investing in a RAID is necessary or if having a refined file management structure using Hedge / Carbon Copy can do the job. Still pretty new to this and having a difficult time finding a video on RAID tailored to independent filmmakers / RUclipsrs since most results talk shop with IT professionals at an enterprise level. I was made aware of my potential need for it after watching Peter McKinnon's video. ruclips.net/video/7RJCLGZvzUs/видео.html
Thoughts?
interest for client link ....
I've been working in media for 8 years after starting my own company when leaving university. This is by far one of the most helpful videos to do with work flow i've come across in those 8 years. Have you thought about going through an import/export work flow process to show how to get the best quality from card > edit > export > Delivery ... that'd be super helpful! thanks!
pretty interested in your process for supplying download links to clients. typically i just either upload to dropbox and supply them with that link or upload to my site's ftp in a designated ClientName/Project/Video.mp4 location
Thanks for sharing! What's the min read/write external disk speed you need to edit 4k footage with your old iMac? Cheers from Squamish =D
Hi, Nice vid Levi. Thx. About managing client vid, do you know Frame.io ? I'm using it since a year now and it has changed my relation with my client in the best way. So easy to use. I love it.
Hey man, really dig your videos!
Quick question: Is there any way you can start uploading in 4K (or at least 1440p), even if you shoot 1080p, just to get some extra bitrate out of YT?
Thanks! keep it up :)
This file was 3840x1920 at a 2:1 ratio. Surprised it’s only showing up as 1080.
Ohh, I see it now. I guess it wasn't fully processed when I watched it :(
This could not have come at a better time. I was JUST researching best external drives for video production. I've reached the point that my current amateur system of backing up and editing is no longer functional. Love your channel and advice. Found you through your FCPX switching video. Thanks for sharing your work flow!
Very informative video! I would like to hear about your process for deliveries and archiving finished projects.
Hey Levi
Your explanation of your backup tools was great. I ran a Mac Service business for 18 years. Nice to see a user with a methodical backup regime. I also use some of the same tools that you mention. Used Carbon Copy Cloner for years... great tool. My Raid box is a 4 bay Drobo (beyond raid). I have 2 of these with 16gb each at the moment. Started with 2x1tb drives in the Drobo... then just pop one out (live) and Drobo formats & re spreads the data to a newly inserted drive. Gradually Moved up to 4 x 4tb. It is so much easier to use than standard Raid.
Will now try your Hedge backup sw as that looks useful.
PS I have been following you since Pure Living FL.
Just bought a Mavic Drone so your tips on moviemaking are helping me
Cheers.... Trevor in West Australia
(Formerly from Toronto)
Thank you for mentioning Hedge. I hadn't heard of it. Take a look at CrashPlan Pro. I've been using it for about 5 years. It's an affordable subscription-based cloud storage service with unlimited space. (I'm not affiliated with them other than as a customer.)
Dude. That was crazy well explaining. Not thought of using Hedge before, really cool. 👍
Ignorance is bliss and you just exploded my ignorant and cheap system. Damn you! Thank you!
🤯
The amount of work you're putting into these... Thank you!
One thing I struggle with is excessive amounts of useless video, very often we have files where something is filmed in anticipation of something going to happen but it doesn't. Do you delete this stuff or keep every file?
If I know for sure it was a waste, I’ll delete it. Other than that, I keep everything. That way I don’t have to make the decision, it’s just easier at that stage to keep.
Thank you very much for sharing this Levi!
Which video lens did you recommend for a interviews, sitting talking to the camera, never more than 2metres far. ? Thanks!!! ps.i have and GH5
Wow. Very good info. But that is expensive. My projects are not that big so I use 4tb for archive. I’ve accidentally formatted wrong drive and had one just fail. If I was doing it your way I would have been saved.
I use blazeback up to another physical location on top of keeping 2 local copies. Gigbit internet helps it happen fast but I started the process when I had a slower ISP. I don't delete the SD cards until its in the cloud. For me a 1tb takes about a day. Its about a week at 100mbs so keep that in mind when planning how much media you need to have on hand for production.
I was going to mention cloud, but you stated Dropbox in the video. Online, maybe AWS? But like you posted when it's all said and done technically you have four copies! I think thank is enough. Especially at least one copy off-site. I tell ya I learn something new after every video. Still working towards getting a camera! lol. Thanks Levi, take care.
I use an almost identical workflow, and it has done me right for years! Follow this advice, and make clones! Simple rule you can enable is to ALWAYS buy hard drives in pairs. NEVER buy just a single hard drive. It's as simple as that, and you will always have a clone.
Watched this when it dropped 4 years ago (long before I was paid to make videos). Took a bunch of tips away from it back then. Just watched it again today as I'm at a place of stepping up my game. STILL a huge help. Thanks man!
What is your laptop specs and processor situation? I'm trying to figure out a way to edit video on a Macbook pro mid 2012 (AKA avoiding buying a laptop with a touch bar)
So I just learned that DaVinci Resolve has a built-in clone tool with checksum verification. It's free and is more flexible than Hedge, so you aren't locked into one workflow.
Read how to use it here: www.rocketstock.com/blog/davinci-resolves-new-clone-tool-indispensable-dits/
Great stuff. Very helpful as I'm setting this up. Have you looked at using Amazon Glacier for your offsite archival at all? I'm currently using it on one of my NAS and its built into the OS natively. Very affordable per GB bc its meant for archival and the retrieval times aren't great. That said I've not had to retrieve anything quite yet so cant speak to that process personally.
Very organized! But maybe I do not understand something....you said you clone your edit drive media to "two separate hard drives in a raid" .... so there are two distinct copies? do you locate one drive off-site for safekeeping? Where do you keep your project edit data in case your edit site burns down? thanks
Dude we’ve got an old MacBook Pro and an old LaCie hard drive for storage. I feel like I need a full month long class on what to buy and how to use all of it. I’ll fly out to BC, what’s the charge for this soup to nuts class? Checks in the mail.
Backing up "daily" is an awful idea. Backup every hour or a when convenient. Why would you want to loose an hour or an important shot?
Also don't put your laptop or kit near the edge of a boat. Water. Or a shock could launch the laptop or drive off the side into the boat and disconnect the drive. I'd be tempted to tape down the drives and put on a table inside under cover if doing DIT on a boat.
No continuous naming with Sony. When will they realize this is a problem?
This is the best video! I have watched it multiple times and have started implementing the systems and practices and I'm loving it. Thank you for doing the heavy lifting so I didn't have to!
"And the client work that you use to pay for the other two things..."
Dude I laughed so hard at that. That's totally my life.
I did have a quick question. So it's better to edit the project and save the files to a different hard drive opposed to the one in the computer? If so why?
You did such a great job explaining about your work flow, so I have added it as a link on my site AdventuresOnBoats.com. Our site is aimed at persons interested in a cruising lifestyle and attempts to provide links to sites like yours to educate them with links on relevant cruising subjects.
-johnny
Been getting increasingly worried about my commercial projects growing in production value (and, therefore, cost to them) but still using my half-assed media management workflow with limited backups etc. I can’t charge decent money and then lose/corrupt footage!!! Will be checking out Hedge and Carbon Copy asap 🤙🏼 thanks for the code!
haha me too man!
You might want to consider Backblaze.com for your cloud based backups. Unlimited data for $60/yr. Assuming your ISP doesn't have data caps like mine (Comcast).
GlueFactoryBJJ ah nice one - I’ll check it out. I bought Hedge the other day so next step is additional storage.
Your MacBook Pro is a beast, are you currently still utilizing that MacBook Pro?
Hey, How is the Mediasonic Pro RAID enclosure?
Great video! I love the workflow videos. Great to look in to the organization of creativity! Subscribed after this one 👍🏼
interested in download links and how you share videos with clients! Vimeo or dropbox or google drive?
Do you keep all your drives in the same location (in your home/office)?
How is the workflow with WD passport? is this good enough to use as a working disc 💿 or its just for the storage?
Thank you for this
what's the best size hard drive for backup on set?
I know a wedding photographer (can’t stress enough how valuable the archived wedding photos are. Can’t recreate a wedding, right?), who got a request from a former client who wanted new prints of her entire wedding from some time ago because her copy was destroyed. He went to his computer to make copies and his computer failed. No problem, he has a back up, right? He went to his back up and found out that external drive no longer functions. No problem, he has secondary back up, right? Went to that and found THAT drive is also toast.
Can you imagine, primary desktop fails. Then both physical external drives are gone as he hadn’t touched them in years. What are the chances?! He lost all of his work over the years and the bride never got her photos. Ouch.
Yeah, physical drives fail pretty often if they are never spun up. It’s a good routine to check on their health over time.
Awesome, kindly do the video on how you create download link, thanks :)
Just broke my harddisk and lost very important files. Wish had this video a week earlier :')
Awesome walk through man! Funny that you posted this today. Just today I've been making plans for my next youtube video tutorial and it just happens to be my backup workflow. Mine is not nearly as sophisticated as yours (lacking some redundancy) but I hope folks can glean some stuff nonetheless. I find it super interesting to see how everyone goes through this process as it can be a pretty daunting task at first. Thanks for this.
Thanks for the comment Scott!
Hey! What computer have you been using?
Thank you for this. Needed this so much!!
I think "month - day - year" naming convention is not the best. This way 01-01-2019 goes before 12-31-2018. I use the system that many cameras use - year-month-day. This way 2019-01-01 goes after 2018-12-31. Otherwise very good advises.
Totally agree
I've seen a lot of videos, and most of youtubers are using RAID and that is simple not reliable, woking as a IT I user for all my media NAS Servers, at home and even when Im on the road, you just have to copy one time the file and the system itself will make a dal copy of your data.
I think the problem is slim laptops, I use a Dell Alienware supporting up to 8TB for each drive, with raid 5 I loose I hard drive but all my media is fine.
Try NAS Server and star looking for a new windows laptop with 3 drives at least, now you can get one for 1200 with a 1080 8gb Graphic card.
My thought
You can't separate the drives in a raid for dual location back up. And it's challenging to scale it as the upfront costs are a larger investment.
I've opted to use high-speed raids instead and am very happy. And then use external drives for the archive stage.
Does Carbon Copy do check sum verifications as well? I'm just trying to figure out why you need both CC and Hedge 🤔
CC does my drive backups, Hedge is for importing
this is super useful. been doing videos for work and stepping that up for personal stuff. This is one of those areas I need to get better at. thanks.
Dang... Love how you're so organized and have an awesome system going. Really helpful info! Timmmmmee to get a second back up hard drive.
(Edit): The link for this one is broken "MY favourite Edit Raid (I have the 8tb model): left.ly/gstudio-raid"
should be fixed now, thanks
Really useful - thanks! I have extensive knowledge of the IT side but am still a newbie to video where we're dealing with bit-sensitive, massive files. I really like your workflow and your mindful attitude to redundancy. This is the best grow-with-your-business workflow I've seen. Thanks again.
Awesome tips Levi! Love it. Thanks
Another place to backup is off-site to Amazon AWS Glacier which costs just $0.004 per gigabyte per month. Dirt cheap insurance in case your RAID fails or house/Sprinter burns down or disks get stolen. If you have a Synology Disk station, you can do this automatically.
ISP’s where I live aren’t fast enough unfortunately
Good info
Wait...I think I recognize the star of the new aputure MX commercial.
The most beautiful woman in the world? Yup. It’s my wife Janelle
I just notice that too lol , Introducing the Amaran MX + F7
Bloody hell im completely confused..... Hard drive on a hard drive.... you got an easy solution ..... old fogie confused.com....
This was Really Help Full...
Holy hell.. I just download to an external hard drive, edit my project and then send it out to the client when Im finished....
I GOTTA UP MY GAME BEFORE AN ACCIDENT HAPPENS haha
Is a program that used to transfer data on both hard drives on Windows if so is it free?
I wish I could give you a hug... thank you
Cool! Thanks
Does Hedge let you add Metadata? Eg. Tags
What is the name.of.the software?????
Perfect! Haha Recently started to record in 4K and can only work on two video projects at a time on my 2015 MacBook Pro with a 500gb SSD. This is really helpful. Thank you! 😊
I use two or more card carriers. First one for empty cards, second for used. If I can afford it, I buy new cards for a new project. And they are different brands like Kingston for some SanDisk for others or different kind a sanDisk so it looks visually different. Personally I stay away from PNY cards - or maybe I was unlucky. But the only fail I've had was with a PNY. I had to reshoot an interview. I MISS LEXAR!
After I get done filming, I'll rename the files in the card to something I can recognize so I know what it is when I import - HawaiiDay2 or ClaireInterview1 something like that.
By FAR, the best video on media workflow. I still have a question though. I have a new shiny MacBook, that is faster than my older iMac. I have been trying to figure out where the project and contents goes for fastest editing (budget for one external for media, and another one for backups). When I put my project and media on the MacBook, the editing is much faster (obviously) the problem is I only paid for a 500Gb hard drive, which fills extremely fast while editing/proxy/optimized, on the other hand when I place all of the contents on my external, it's much ssllloooowwwwwer editing. (obviously) My question is.. Is there a way to edit the project on my MacBook, while all the big files reside on my external... While I save for a RAID system.
I love your glasses plz links of the glasses
Super helpful! Thanks Levi, I've been looking into changing my backup workflow for some time now! I would also be really interested in hearing about the client link, and maybe what you think of Google drive vs Dropbox vs frame.io etc
FYI about folder naming. So long as you group your project folders by year (e.g. 2017, 2018, 2019, etc.) naming the projects in the mm-dd-yyyy format will not cause you too many problems. In other words, you will have all the January (01) month folders mixed with ALL years. However, if you have them mixed up with multiple years, you may want to consider changing your naming method to yyyy-mm-dd so that all projects are sorted by name properly in chronological order.
I used to date my folders like you do, but then changed when I started archiving all of my completed projects in one folder for ease of searching. All my folders were sorted by month, not year and I had to go back and change them (this wasn't just my video projects, but also ALL folders I dated this way and moved into a common archive folder. It will cost you some time now, but, IMO, will help you avoid problems down the road.
PS. I noticed that you did have some folders in the yyyy-mm-dd format, though you also indicated that you now use mm-dd-yyyy. I'm curious as to the change (if it actually is one).
Very interesting and useful. What do you do if you want to go back to an archived project? Do you copy it back onto the edit raid? Then if you copy it back to the archive will you have 2 copies of it on there?
Thanks Jacob.
YES how do you create download links for clients? I at times use G-Drive, also Dropbox but all a bit amateur feeling
let's see the other video on sending download links etc to your clients.. this makes me feel like such a nerd but man is it fun watching other people's workflows.
RIP Windows users
This guy knows what he's talking about. Legit workflow Levi!
I need a fancy server one day like you guys.
I still remember the early days when you had a raid corrupt in like 2012 and how scary that all was. 😱
Good workflow demo. FWIW I've been using Hedge for about a year on commercial shoots backing up data from a range of cameras. The developer is actively engaged in the refinement of the product. The licensed version uses an advanced checksum algorithm that seems much faster than the usual MD5 algorithm. Definitely gets me off set earlier and thats always a plus after a long day. (I have no affiliation with the company other than being a user.)
What about your editing workflow? And all the software you use for video and audio editing? A video on this would be awesome.
It's in the works, but might not be coming any time soon.
Matttte!!! Thank you so much for this video!!! I've been looking to creat a work flow as I beginn in video making and editing and you are straight what my
I needed. Your desk is sick!! Great job!! I'm carpenter and I also create custom furnitures!
So helpful! V reassuring to see others as OCD as me. When you import to FCPX, do you copy files to library or leave files in place?
I have a workflow with 2 raid setups as well. One is Raid 0 and the other is raid 1. The raid 0 array is all Samsung SSD's and both are thunderbolt for speed. I had to figure this out the hard way. I've definitely lost footage before. So when you finish a film do you keep a large master copy and then export/covert that file to whatever format you need?
Hey man, super duper quick question about your rig, what's the name of that Sony npf battery dock that you're running straight into the GH?
Thanks heaps dude, love your work!
Fantastic video the best & most comprehensive backup & storage system I have ever seen. I am not a working professional videographer but have been shooting video for years & have struggled with how best to store all my own personal home videos memories for the future. For the 8 TB of videos stored in random drives all over the place this seems to be a great answer to my problem. Thanks Midland, Ontario, Canada
So, what I don't understand - because I've seen a few people do this - if you have an automatic backup going from your editing RAID to two other Backups, what happens when your editing RAID gets corrupted and Carbon Copy Cloner transfers the corrupted files onto your backups. Wouldn't that mess everything up?
Thanks for your content, your channel is a great inspiration to me.
Cheers,
Killian
Carbon Copy has what’s called a safety net, it keeps previous versions and you can set how much of previous versions to keep.
I don’t ever have files corrupt on a raid, it just normally has a drive fail, that’s to more common issue
Thanks for your reply Levi, I appreciate it!
Spinrite from GRC.com has been an essential too for verifying the safety of data on hard drives for me for over 25 years. With improvements, it is as useful today as it was over 20 years ago. Highly recommended!
GlueFactoryBJJ I haven't seen a website design that bad since the early 2000s. If it is any indication of their software design, I'd stay far far away.
Also, Windows only.
Mark O'Russa - Yeah, the design sucks, but Steve Gibson is one of the best programmers and security experts I know of. His site epitomizes the phrase, "don't judge a book by its cover". As does his software. I guess that's what you get when you mainly program in assembly...
Of course, you may not want to try it and that is up to you, but like I've said it is great software and has saved a few crashed drives for me both on the job and personally.
BTW, you can also listen to Steve's podcast on the Security Now channel on RUclips. It is sponsored by TWIT TV.
Mark O'Russa That's because the website is from pre-2000, its function over form.
Also do your research, it is not OS or format dependent, the software works at the bit level on the drive using underlying drive commands that are only exposed usually at a bios level. It could be an drive from an encrypted RAID array, it doesn't care and can do its job.
TheTechnoPilot - Yep! And Steve programmed his own web server, in assembly, which, if I remember correctly, is less than 1MB in size (not a typo). Of course, GRC.com runs off that server software, though that is not the reason it looks so dated. Oh, he also wrote the ecommerce software the site uses... in assembly.
Heck, Spinrite is even used by some data recovery services as their first pass, depending on the type of damage to the drive.
Anyway, next time you have a harddrive that is throwing errors, seems to randomly corrupt files, or even slowing down for no reason, it is worth the ~80 dollars to use it. Note that if Spinrite shows a bunch of errors, you should replace the drive even if it appears to be working normally again because the drive is probably failing, but Spinrite has made it work again so you can replace the drive. Especially if there are a bunch of S.M.A.R.T. errors. Spinrite also works on SSDs. Even, as you noted, those in raid arrays.
I use it on every drive I put into service. It can take awhile to work on these multi terabyte drives (about 6 hours per terabyte) and must be run off a boot CD/DVD or USB stick. So you will have to dedicate an old PC to the task, but if you want to save a drive it can be priceless.
Spinrite 6.1 will hopefully be released this year. It will be a free upgrade and will increase the testing speed to about 1TB per hour (repairs can take much longer). All "dot" releases are free. Spinrite 7 is not supposed to require you dedicate your PC to the process.
Both updates have been waiting on Steve to finish his SQRL token based user authentication protocol/software. You can read about it on his site and on various Security Now podcasts. It is practically done now and will be available for almost every OS available, both server and client. I definitely hope it is rapidly adopted.
Anyway, my $0.02 (or so)...
Disclaimer: I don't have any financial interest in GRC, I'm just a big fan of their products. I have been using Spinrite since Spinrite II (v2). I still have the original 3.5" floppy disk. Darn I'm getting old...
Thanks Levi Awesome! Jus trevisited your "build a desk" video... Good stuff!
Hey! Great video, and thanks so much for the in depth breakdown. Quick question - Are you using the Macbook only, or in conjunction with a desktop when you get back to the studio?
Great tutorial Levi. Thank you for sharing that. Question regarding the archival drives. Do you have two drives per project or keep adding projects to the archival drives until they’re full? If the later, how do you keep track of what projects are on what drives?
Awesome! Thanks Levi for this very thorough walk-through.
HEDGE!! Whoa! I did't know you lose information when you transfer from an SD Card to Hard Drive?!?! Holeee Crow!! Thanks for this Levi!
I always find that backups work 100% of the time, it's the restore which generally falls over. 😭
Can you explain how the hourly backup works? Does it back up even when you’re working in the project, like editing in premier?
Love this!!! Thnks for breaking it down. Would love to see that client delivery process.
just re visited this one man super helpful thanks!
Oh Levi! Talk nerdy to me! Haha. Seriosly steller and beautiful video for a workflow vid.
Oh yah thanks for reminding me to back my stuff up, I lost a lot of files a few months back when I updated to High Sierra my iMac would not reboot had to try and save some files and format the hard drive what a pain - Lesson Learned.
Great video a lot of value! I would love to know more about your workflow for google drive and dropbox. Thanks for always sharing great content:)
This video made me reevaluate my whole life lol! I was about to invest in more gear and toys, but I think I’m gonna invest in better memory storage because I don’t have a solid system! Good vid!