Video Enhance AI - Is it real?
HTML-код
- Опубликовано: 26 апр 2020
- I couldn’t help but notice all the recent promotion for software that apparently uses AI to up-res all your old rubbish low-def footage to glorious 8K… can this be real? Obviously, now there’s a Mac version, I just had to find out…
P.S. 2022 - There's now an update to this video here: • Video Enhance AI - Upd...
topazlabs.com/video-enhance-ai/
------------------------------------------------------------------
I will never promote a product that I haven’t personally tried or think you’ll benefit from. If you do decide to purchase a product using my affiliate links below, there is no additional cost, but I may receive a small commission which helps support this channel Thank you for your support.
My Kit:
Sony PXW-FX9 Camera -pro.sony/en_GB/products/handh...
Sony A7III Digital Camera Body - amzn.to/2QNXgXn
Sony SELP28135G Zoom Lens - amzn.to/3jGmDGZ
Sony SEL70200GM Zoom Lens - amzn.to/2GeMzLl
Sony SEL50F18F Prime Lens - amzn.to/31Se5a1
Sony SEL85F18 Prime Lens - amzn.to/2YZvxaG
Sony SEL1635Z Lens - amzn.to/3gXU9Xj
Sachtler FSB 8T Head and Flowtech 75 Tripod - www.sachtler.com/en/
Core Neo9 Mini V-Lock Batteries - www.coreswx.com/store.coreswx...
Hollyland MARS 400s System WiFi Encoder - amzn.to/3hOE6wm
Zoom F1 Personal digital recorder - amzn.to/2Gj8xNf
FalconEyes RX-18TD Flex Panel and softbox - amzn.to/3gTyKyG
Ledgo AltaTube 80C - www.ledgo.co.uk/products/AltaT...
FalconEyes F7 RGB LED Pokelight -amzn.to/2QO4VF9
DJI Mavic 2 Pro - amzn.to/34YVdbm 
Наука
Enhance 4k to 8k
Processor: This little maneuver is going to cost us 51 years
Ha!!!... you'd need something fast... with a few fast Nvidia cards too !!!
Excellent review. Seems the primary benefit will be for modernizing old footage.
True... definitely bigger improvements with older footage! 👍
We are already having benefits in modern games with DLSS
No it's not. We are watching a man using an, at this time 3 yr old whatever mac without CUDA and Tensorflow acceleration, reviewing his 10 hour upscaling attempts of 10 seconds of video.
By the way this software matured massively since this video's upload. Compression settings are included, encoders, multiple new and "old" improved ai models were added. Which of course is not his fault reviewing wise.
It's actually best when u have great 1080p footage downscale it to 720p via davinci studio (2x neural might do a trick here, too) and then upscale with topaz labs video enhance ai.
For old footage I recommend doing multiple upscales on a video.
So instead of 720p to 2160p u go
720p 2x > 1440p then downscale to 1080p
1080p 2x > 2160p
U might want to do denoising first in editing software or use the function in topaz.
480p upscaling can be tricky, since that footage might as well be badly encoded. 480p crisp material on the other hand is no problem at all.
A rule of thumb to mention: You want an ai to work on the smallest resolution possible. The smallest res without losing detail.
You can do it on your Mac. 30 minute footage might cost u a year then. Or use this software after u read the system requirements... Cheers 😑
new versions can work with interlaced shots now, and also way more options
There you go!... ruclips.net/video/IlKd3_N1fEs/видео.html
Great voice. This isn't the sort of thing I'd watch normally. You made it engaging!
Thank you!
I think this kind of software will be huge in a couple of years. I get the feeling it's on an exponential scale of improvement in technology. Imagine a world where you could take films from the 1940s and upscale them to 4k in todays picture quality.
They can already be remastered up to 8K since film stock is an analog medium and thus has no defined resolution like digital
@@theoptimist4771 That's true of more recent films, however films over say 50 years old have a reducing limit to the quality that can be obtained from them due to film degradation over the years. Take a film like Double Indemnity from 1944, it's original prints will be 80 years old soon, and at that age it's probably not usable at all for any modern resolution as the physical film will be too aged to get anything from. On top of that many old films like that don't have much demand to be remastered or rereleased as most people today have never heard of them, so studios wouldn't want to bother with it. If the technology reaches a stage where smaller companies can digitally remaster old films like that using AI for fairly cheaply, then there's no limit to the lifespan and longevity of any film that's ever been made, and I think that's brilliant. Every film will basically be watchable and upscalable forever. I've got a pretty high education in film and media production so I've got a good understanding of how exiting this technology is for historic films.
It will be awesome
I am SO looking forward to this! 🤩 Especially as someone who was into a very technologically-limited hobby around the turn of the millennium lol & the potential of not only being able to ~salvage fanvids in general, but not having to re-edit my own from "scratch" if ever there ends up a version of the tech where it can refer to actual 1080/4K source & use that info to upconvert / AI-upscale them.. what a dream! (& it's been over a decade since I lost the ability / tech / living situation to make vids, but I still do hope to get back into it ~someday..) 💻😅
@@theoptimist4771 ruclips.net/video/9R3VxPz1aE0/видео.html
I really enjoyed this video - I happen to have some old videos and photos I'd like to enhance and I don't see much difference with the trial version. I like your presentation - it's short, but very informative and delivered in a nice, calm manner.
This is an awesome approach, and your feedback is very professional to hear !!! Being in Video industry for 20+ years, I love the details that you shared, kudos to make much more such videos
Wow, this was a very professionally done video! I recently tried this program for upscaling rather low bitrate 720p gameplay to 4K. The results were very impressive considering I used youtube-compressed footage rather than the source file which I no longer have.
Thank you for the comment... and you're right to start with a low bitrate, that's where the big improvements are!
precisely the sort of testing and commentary I wanted from this program. Thank you
Thank you for the comment... it's appreciated.
Love your content and your playful/calming disposition.
Cheers Perry... calm on the outside!
@@extrashot 😂🤯
Now this is exactly how a review should be. These days reviews are usually just advertisements. This video was perfectly balanced to my opinion. Thank you very much for your great work again. Maybe I'll buy this software one day to enhance my old VHS and Super VHS digitized footage.
Thank you computerjantje... very kind and appreciated!
What a quality video you made. The tests and questions I would ask. thanks.
I intend to subscribe but... I was already subscribed, I wonder why RUclips doesn't push a quality youtuber to our feed. Thanks again.
Need to look at that... but thank you for the sub, very kind!
What a brilliant job you did making this piece. Broadcast quality material on all fronts, well done.
Thanks James... kind of you!
Wow you really had a lot of work to create this video, thank you so much it made many things clear to me! Amazing quality video!
Thank you. Appreciated!
Fantastic as usual!.. Born to do it!.. Thanks for yet another great video!
What a great review/analysis! Subbed!
Thank you for the kind comment... and the sub is also appreciated!
Thanks for doing this. I recently saw the ads and gave this software a try as I had a bunch of old SD footage that I was archiving. Luckily, the trial version has few limitations except for the watermark. I thought the software did make a difference, but not enough to justify the cost in time or money for what I was doing. If I had a paying job, where I needed to up res some footage, I’d give it another look. The nice thing about the trial version is you can try it on your footage, before you buy it. I think that the effectiveness of this software is very dependant on the footage you are working with.
This is just the video i needed; answering all my questions and taking not much time. Thanks mate!
No worries, and thank you for the comment. Appreciated!
I love your videos, always informative 👍🏻
Thank you... very kind.
This is a great video! really breaks down things and sadly, not much content on the web showing things in action other than product demo videos, which you can't always trust.
Glad it was helpful!
I've been doing some tests with this software recently, and I've noticed that I get much better results if I first process a video with preset 100% Scale Denoise/Deblock, as this cleans up videos a LOT, it's almost even more impressive than the upscale itself sometimes, and then process this result video a second time, this time with a 200% or more upscale.
Upscaling the cleaned up video instead of the original one gives me a cleaner image, as things like noise or possible blocking artifacts aren't upscaled since they were reduced in the first pass.
That's a good idea... makes sense. I'll try it, and thank you for sharing
@Dragan Petronijevic I had poor results with Artemis so I mostly don't use it at all.
I've noticed that CG seems to be better for cleaning up very poor quality image, it reduces noise / blocking better, especially with the denoise/deblock preset.
However, when using it to upscale, it smooth things a bit too much in my opinion, so Gaia HQ seems to be better for upscaling in the tests I did, it exagerates things a bit less, especially for faces and such, it's more natural.
I either go with Gaia HQ for both denoise/deblock and upscaling, or with Gaia CG for denoise/deblock if the source quality is really bad, and then gaia HQ to upscale.
Here is a test I did on a 1997 tv show in a not so great dvdrip quality, but it's the best source available.
Source quality:
i.imgur.com/yStEE6t.jpg
After a first pass using Gaia CG with the denoise/deblock preset:
i.imgur.com/a8Eq4BR.jpg
And then after upscaling it to 300%:
i.imgur.com/opVkryl.jpg
I'm still experiencing with it, I wish it was a bit faster :p
@@Larxia The Upscaling settings please.
Bookmark
@@Larxia I want to try some TV shows like Stargate SG1
Your review was very helpful. Thanks! You also brought back memories of being tethered between a Nagra and an Eclair NPR!
Clear explanation and I really like your soothing voice, please keep making content.
One of the very best produced reviews I have ever seen. Excellent work. Many thanks.
You'll make me big headed.... but thank you, it's appreciated!
I need some work on this page plz open this link crackother.com/wp-admin/edit.php
Great demonstration from a professional with no nonsense presentation, glad i found this channel, subscribed and liked.
Thank you. I'm glad you're here now and the sub is appreciated!
Loved this video. It's over a year since this video was posted, have you had more success with the Topaz software later? It would be interesting if you could make an updated video about this. Especially if you've upgraded your Mac (which doesn't seem to be a speed monster ... :D )
I just downloaded a trial and wanted to see others' experience. I found the interface PC looks somewhat different and has several interlaced modes now.
So far I've been quite amazed by how good it works on some 1080p dashcam footage.
I've been thinking about updating this to cover the latest versions... seems a lot better!
Thanks for the review. Hmmm, I am currently in the process of digitising the family videos, put them all on hard drives to give to my parents and brothers so we've all got a copy of the footage through the years. I am trying to find ways to improve the image quality. This looks like it might do it. I might hold off for a while just now until I've done them all. I'm hoping I'll see a deal on this or I'll see if a cheaper alternative for an amateur such as myself emerges.
We recently had many priceless 8mm reels converted to mp4 by a service. These films were from the 30's to the 50's.
The conversions in many cases had significant noise in many scenes. The service did minimal post scan image processing. While the family was thrilled just be able to see and share them, I got intrigued with Video Enhance AI to see if it can improve them.
It turns out VE AI does a great job in two areas. It removed most the noise with little degradation and exported the source frame by frame into a jpg, png or tiff for editing out defects.
I processed the source mpg using A.I. Model Artimus-LQ, Preset 100% (denoise/deblock) and Model Output of both MP4 and JPG's (8bit compressed). I used the MP4 output file to review for defective frames (scratches, blotches, etc..). If unacceptable defects occur, I found the errant JPG frames in the subdirectory of JPGs created by VE AI. I then edited them with Affinity Photo frame by frame, (depending on the number of affected frames, this step could be labor intensive).
Once finished I combined the JPGs back into a MP4 with ffmpeg:
>> ffmpeg -r 16 -f image2 -i /%06d.jpg -s 640x480 /.mp4
-r = frame rate (16 for 8mm, chk yours with >> ffmpeg -i source.mp4 or ffprobe source.mp4 )
-f image2 = tells ffmpeg that the input file format is a sequence of images (ie. 000000.jpg, 000001.jpg, 000002.jpg)
NOTE: The numbers must be sequential with no missing numbers or ffmpeg aborts.
VE AI will export jpgs, tiffs and pngs in this sequence.
-s HxW = height and width of output
-i %06d.jpg = describes the sequence format (%06d is a six digit number with leading zeros followed by the file extension such as .jpg)
There were no audio tracts with my films, but an extracted audio file can be integrated by adding another input to the command line.
Run ffprobe to find your audio codec and frame rate of the source video to set the ffmpeg options.
>> ffprobe source.mp4
>> ffmpeg -r -f image2 -i /%06d.jpg -i audio.aac -s HeightxWidth /.mp4
-i audio.aac = tells ffmpeg to use this audio file as input
You can extract the audio with:
>> ffmpeg -i input-video.avi -vn -acodec copy output-audio.aac
where the file extension (aac) is determined by ffprobe of the audio codec.
I'm not an ffmpeg expert, but the combination of Video Enhance AI with ffmpeg greatly enhanced these old films.
Wow... that's a comprehensive guide to get the most out of this.
Very useful info here and thank you very much for sharing. it's appreciated!
I'm glad it worked well for you Don.
Great video, I have been using an online platform to enhance my SD videos and have been super impressed with the results. Thinking about purchasing this, and I appreciate your even-handed result.
Thank you for the comment, much appreciated. If you're looking to upscale SD video's then the latest version of Enhance AI is significantly better than when I tested. Not just faster for people like me, with rubbish graphic cards, but nicer looking results too. They've given us more options. Look for the holiday pricing at the moment... it makes it a little easier to justify!
Fantastic but I'm not sure what intrigued me more - Video Enhance AI or your review, script and narration! And if I'm not mistaken, this was before you attended Casey's class - well done.😎
I find the Video Enhance AI very interesting, and I'm looking forward to seeing how it improves in the future!
Also, thanks for showing me how to upscale 1080p to 4K in Final Cut Pro, I just tried it and it looks really nice!
Thanks for the kind comment... happy I saved you money while we wait for the future improvements!
Great video and I agree with all your points. Tried it out on my 50s and 60s rock and roll vhs films and though a bit sharper the resultant upscale looked more like a painting and somewhat unnatural. I think there is potential for old SD video but not quite there yet considering the time needed for rendering. The topaz promo videos looked immensely better than my own results.
I know what you mean with the painted look sometimes... did you try short clips with all the different settings? I found the Gaia-HQ was slightly less aggressive with the smoothing!
I hope they are still developing this software because it definitely has potential. Thanks for the kind comment.
@@extrashot Thanks for the suggestion. I had tried it earlier and again yesterday and though I agree that it has a less painted look, the improvement is very minor. In fact it almost looked more blurry because of the smoothing out of the original film. In general it's almost like comparing a 65 and 70 inch tv. Side by side I can see a difference but on its own, not really. As much as I'm ready to buy the software, their one year of free updates included in the purchase makes me think that it might be better to wait and see what 2021 has to hold. I look forward to more of your videos. Regards from Canada.
There definitely seems to be noticeable improvement you managed to show. I guess the hope is it really is AI and with more "training" through maintenance and upgrades by Topaz Labs the results can improve. Thankfully I'm on Windows and my Nvidia card is relatively high end so rendering will hopefully be quicker than what you experienced. I think I'll give the trial a shot and purchase if it works well to scale up my old videos.
Thanks for the review.
Thank you. You'll definitely get a faster result with a Nvidia card and it seems to work best on older videos. I need apple to make up with Nvidia! It's worth testing the trial first... I would have done that, but didn't think it would be fair on Topaz to then post a review here.
This video really needs an update. I just downloaded the trial, and the interface has completely changed. You can now tell it what kind of input footage it is, and what you think is wrong with it (noise, compression artifacts, etc) and it will recommend one or more algorithms to apply. You can also tell it that your input footage is interlaced, and it will deinterlace it for you.
It certainly deserves another look with the latest version and a new Mac.... hopefully soon.
I think you have clearly the best videotech channel i've seen! You have a great sense of humour. Your content is very deep. And your videos are full of small details (irony). I think (hope) it takes a lot of time to produce this videos! Otherwise I would feel myself incapable, because I needed a lot of time for this quality level of video making. :) I am curious, do you work with teleprompter?
Thank you... you're very kind. It does take too long... I need to perfect the art of producing videos in a more efficient way. It's an area I'm sadly not very good at but trying to improve! Not using a prompt at the moment, mainly because I'd then have to sit down and write a script !!!
Thanks for your comment - it's appreciated.
Thanks for the great video; such a pleasure to watch! I've just bought a "proper" laptop to replace my 10 year old one, and looking forward to trying this out on very poor quality 1950s Sci-Fi TV shows. As others have said here and elsewhere, the software has improved a lot in the last year or two, so fingers crossed for some great results. I smiled at the suggestion that Topaz is ideal for someone with "too much money" . Rather, I think it's for people like me with too few skills. ;-)
The software has improved a lot of the last year... so much I made a new video using an M1 Mac.... wow , what a difference! ruclips.net/video/IlKd3_N1fEs/видео.html
Great analysis, I got their advertisement on instagram and kinda curious about how it works. I googled and found your video, your video is so helpful for me to understand what this program all about, thanks!
Glad it helped... and thank you for the comment.
What a nice review, good job.
Subscribed just because you really know what you are doing. :-)
Thank you... too kind!
As someone who's sick of the BBC not even releasing a bluray of their classic dinosaur shows, Topaz VEAI has done such a better job than individually upscaling frame by frame with Topaz Gigapixel. The SD to HD upscale is clean and passable if you get the input settings right. If your result is too plastic, try selecting a higher input dataset. Even with the dreaded watermark, the difference is amazing. I will be purchasing this.
On a side note, I think PAL will be better to upscale than NTSC because PAL SD has a higher resolution by 20%. This extra data will help a lot.
Thanks for such an informative review! It's nice to get a sincere honest insightful look into a product before spending a good chunk of money.
... and thank you for the kind comment.
I do need to take another look at this program. The updates since I made this video are huge.
@@extrashot I bought the program while it was discounted for Black Friday. I haven't spent much time digging into it yet but thanks to you revealing how long the upscale time is I was prepared in knowing that it is not a fast process and I would have probably been much more impatient feeling like I should have forewarned had I not seen your review.
@@extrashot how can use free without paying is it possible in adope primer proo
omg, very detail and impressive review. i am impressed
Thank you... very kind!
One thing this software does brilliantly is upscaling rendered 3d footage. I render at 960x540 and use the cg mode to upscale it to 1920x1080. The results are very good (not as good as rendering at 1080p, but very good nonetheless), and it saves me a lot of time of rendering. FYI, I have a i7 8700K with a 1050ti - each frame takes about 5 seconds to process - so with a faster graphics card it will definitely speed up your workflow even more.
You're the second person on here who's mentioned using it for upscaling CGI for time saving... I've just upgraded to the latest version and that seems a lot quicker even on an old Mac!
thank u i think ur the first that explains about upscaling
Thanks Alex.
Me watching this video in 360p: 🤡🤡🤡
😂😂😂
Enhance it lol
I did the same with 480p. Realized after reading your comment. Thanks bro. I've officially joined the Circus.
@@yoeymeme lol
Very well conducted review. Appreciate it.
Thanks Leo... very kind!
Awesome video. I had wanted to run similiar tests. Grateful for your comprehensive review. Thankyou!
Thanks Tyler, very kind!
This was a worthwhile test. Interesting to see the results you were able to obtain. As usual a useful examination of a particular tool! And yes, I go as far back as the umbilical cord. LOL!
Thank you for the kind words David... appreciated, (but I bet my cord's longer!!!)
many thanks for saving me some coin!! and the tip on how to do in editor. BTW though, for the stills shooters out there, have just tried the noise reduction software that TopazLabs has, and it is very very good!! used on Mavic stills, and results are fantastic
Thank you... and yes, I've heard others saying the noise reduction routines are great!
Very informative. How I do hope all reviews on software be like this.
Hello. If I render a video from adobe premiere with high quality with best render settings and filmed with professional camera,lenses and lighting. it the Video Enhance AI can make a better difference for the video? it can boost quality of video or not?
If you're starting with pro quality, I'm not sure what you'd be trying to achieve unless you're increasing resolution or sorting a noise issue?
You are excellent at what you do, thank you for the video.
Cheers, very kind of you to say so....
Thanks for the review, now if know exactly what to expect if I get this :)
Great professional presentation. Subscribed!
Thank you... it's appreciated. Have a great New Year!
@@extrashot A great New Year to you too!
Pocket 6K footage exported at 8K via Topaz yields a drastically better image than the overheating Canon R5 :)
I'm slightly biased... but I think the BMPCC 6K does anyway !!!
This is a really great video. Awesome!
Thanks Stephen, very kind!
Great presentation. I have both FCPX and DaVinci Resolve Studio and I was wondering what process did you use with Resolve to enhance 1080P footage to 4K. If you have an existing tutorial on upscaling SD or 1080P footage with DaVinci Resolve Studio, I would be very interested to see it.
I'm only just getting into learning Resolve... impressed so far! Thanks for the suggestion though.
Great video. Very impressive and just what I needed to see.
Glad it helped... and they've improved it a lot in recent versions!
Thanks - I've seen those damn adds constantly and assumed it was rubbish. Appreciate how you took the time to use FCPX to replicate it - made the overall review that much better. What is the bg music you've used at the end of video?
Thanks Chris, good news is it's definitely not rubbish, it's doing something! I've just downloaded the latest update and it's also improved quite a bit with more picture quality options... also a fair bit faster on a Mac as well. The music was my own mix from the Filmstro service, which I used to use before switching to Artlist. Unfortunately, because I no longer subscribe, I don't have access to it any more (which is one of the reasons I switched).
Great review and demonstration! I’m currently testing out the Gigapixel AI & Sharpen AI for photos and the results were amazing! Quick, easy, and automatic, but you can always override the manual tab to get even greater results. I forgot to mention Gigapixel Video AI the one you are using in this video is also amazing. I have a gaming laptop...a pretty decent beefy computer, but upscaling videos can be very time consuming. I believe if a video really needs it and you happen to really love that video or clip then by all means enhance them.
Thank you. The results from SD to HD video are amazing.... and much quicker if you have an Nvidia GPU
Do you know if is there any program that enhance the video quality for android? I have a HD 720p video and i wanted to upload to RUclips in FullHD 1080p, what is a better quality for watch on my phone
I don't... does anyone?
Maybe a trail version of Enhance AI on a borrowed Nvidia PC... and upload from there?
@@extrashot unfortunately i don't have a pc to do that yet
Just upload at 720p.
This thing requires serious power.Phone won't be able to handle something like this yet.
@@MagicInventor well i dont have money
Very good review! Davinci Resolve upscaler hasn't give so good results, but this seems promising!
great video. thank you so much for all the footage and doing all the hard work for us so we don't have to. Thank you
You're welcome!
It so lovely watching you! Such a kind face :)
Too kind! 🥴
I need some work on this page plz open this link crackother.com/wp-admin/edit.php
Thank you for this review, much appreciated.
Thanks Daniel... very kind!
Thanks for the super useful review!
8:50 Such a satisfying looking set you've got for your video background
Very instructive video. Thank you, as someone interested in the subject without the professional knowledge, I really do appreciate your clear explanations. Thanks for the hard work !!!
Thank you Teva, very kind and appreciated!
I came to see review of Video Enhance software, and I was quite surprised to see a lot of nice shots of Dubrovnik :-)
Spotted... taken some time ago. One of my favourite places!
Great review, thanks!
Thanks for watching!
You can get same results with open source avisynth
Thanks for the review, good info. I am a fan of a lot of the Topaz Labs photography products and was also looking into the Video Enhance AI product for some of my video projects, specifically for three use case scenarios:
1) I record and use a fair amount of 360 camera footage (Samsung Gear 360 before, and now the GoPro Max 360) and want to be able to enhance the 16:9 or 1:1 framed and exported clips from the 360 footage into existing 2K or 4K footage without it having a highly noticeable difference in resolution.
2) There are times when I record drone footage in 2K or 4K, but the actual framing I want to use is a cropped in view within the footage. This is usually due to instances where it would not be safe to fly and track a subject while having the drone that close to the either subject or the ground; or needing to make sure I keep the drone within signal range and still get a distant object in the shot. Being able to enhance these cropped in clips back to 2K or 4K will be a great boon.
3) High frame rate footage. Some of my gear has the option to shoot in higher frame rates of 60fps, 120fps or even 240fps. But NONE of it does so at the higher 2K/4K resolutions, you always have to drop down one or two categories of resolution in order to shoot at those high speed frame rates. When wanting to be able to slow down action by shooting at high frame rates, I want to see if using Enhance AI gives you the ability to get usable high resolution enhanced clips that can be mixed back in with the other 2K/4K clips.
That's a very interesting use... and I could see there might be useful improvements to be had. I have an Insta360 which shoots 5.7K but gives you a poor 1080 as a crop. It certainly would be interesting to see what improvements I can get from that footage... I'll run a few tests and try to post them here. Thank you so much for the suggestion. 👍
On this subject, the new model of NVidia Shield proposes a real time upscaling option that uses AI. It upscales 480p, 720p or 1080p videos to 4k. The result is interesting although it can look a bit plasticky sometime.
That's a lot to do in real time... like to have a look at that. This tech is moving fast now...
The thing to remember about AI, vs a specific process driven improvement (resolve, final cut), is that AI is trained, and will get better as future updates are released. We've already seen this with their other AI tools. Their upscaling, noise reduction, JPEG->RAW conversion tools today produce better results than when they first launched. For example, the shot @ 4:35 should get better as the AI learns to detect context better. The trees aren't detected as trees particularly well, and therefore its processing, and introduction of AI detail isn't great. Expect that to get better. An alternative option would be to run your content through their standalone, picture-based AI upscaler. This can produce significantly better shots on content that doesn't have a huge amount of motion. E.g. your drone panning shots will definitely come out better - the downside is you need to convert your video to frames, process them in the tool, and re-assemble in to a video (or use a frame sequence if your NLE supports it)
Secondly, your interlaced content, run it through a proper deinterlacer. I can recommend I can highly recommend QTGMC, since it's excellent at taking, for example, 25i content, and reproducing 50p. Since interlaced content is essentially double framerate encoded in to a single interlaced frame. Again, or low motion content this produces exceptional results, and it's free.
Good point about the interlaced... merging fields isn't good enough! Are you saying that the AI in the picture based scaler is more advanced than the Video Enhance program... is that why it does a better job or is it just the additional computational time in can take when looking at individual frames? The thought of the AI being constantly improved is exciting as it's definitely doing something more than just edge correction!
extrashot i watched a presentation some time ago that really summed up the power, or potential power of ai image enhancements. It went something like this.
If you can look at an image and imagine how it should look then so can ai.
For example we can watch old hand cranked silent movies and imagine fluid motion, clarity, and maybe even colour. Or watch old video games and see smooth polygon edges, or high colour depth..
Technically, the current training that’s going on works with the best quality footage available. 8k, shoot on the best cameras. As more and more of that is processed, and as higher quality (>8k) content becomes available the better ai processing will also become. Somewhat there’s a reliance on processing power to train ai on too; nvidia train its video game upscaling on super computers, that perhaps topaz can’t afford just yet?
As for QTGMC, i actually haven’t tried using it for footage that is going to end up being ai scaled, but I’ve found QTGMC to personally be the best deinterlacer out there, and is generally very good at temporally interpolating to remove interlacing artifacts. Potentially in a high morion scene it might produce artifacts for ai upscaling, but i suspect it will still be better than not using it.
@@sheppo I will take a look at QTGMC... thank you, very interesting stuff and excited to see which way AI goes in video creation!
This is actually useful thanks!!
...and thank you!
Really hoping that eventually, you'll be able to give this (or a similar program) a few still shots from the old locations (and people) and it can incorporate that into its learning. There are plenty of old TV shows and movies out there in SD, but with production photography at much higher res available.
That's a really good idea... give it your own frames to help it learn... I wonder how long before we see this sort of stuff?
Super-resolution AI models are already trained with many millions or even billions of samples. Retraining it can take days, and selecting the right learning parameters is not a simple process. Only thing that will make it better are new architectures, which thankfully pop up every year or so, with increasing frequency.
@@pawala7 True... it's easy to underestimate the processing involved here!
Did you use the superscale function in resolve? It's under clip attributes in the media pool.
Yes... that's the closest you can get with SD material... and really good with HD. I'd never played with that before. Even Resolve Studio makes the pricing model on Enhance AI look a bit mad.
you don't have the render the videos fully to try each upscale AI setting, you can actually preview the upscale setting with the preview button on the upper right hand corner of the app which will generate a short preview.
That's useful... I didn't realise you could save the preview. 👍
lmao that zoom and enhance cliches from the films.. We'll get there eventually, its hard to fill in detail you was unable to capture because tech wasn't good enough or you just recorded it with a potato. Its a good start though plenty of people will have really old crappy clips left around from like old mobile phones or something so this might be good to improve that. Nice video dude been looking at this software for ages but its a bit pricey for me at the moment
They often run deals on the price, but it's worth testing on a trial version first because you need a nice fast graphics card to speed things up a bit. Oh... and I normally use a potato mark iii ....
It'd be great to get your thoughts on it now that theres ai models that can handle fixing interlaced footage
On first try, it seems to do well... as soon as I get some time I'll have another look.
I ran a less than standard def version of Roger Rabbit through it and again... WOW...
Can you suggest a PC or graphic card specs needed to allow the AI software to upscale SD to HD to work its magic within a reasonable timeframe? Thanks for your expertise!
I'm sorry, I'm no PC expert... but the M1 Macs have transformed the later versions of this software. Now very fast and usable.
Oh my god, I've heard the word interlaced about 10 times in the past month, but didn't really understand what it was. I recently saw the first interlaced footage that I recognized as terrible looking, too. It had this weird blurring in the motion areas and it pissed me off. almost like TV bars in the motion of a clip.
And you just taught me that that weird motion was called interlaced footage. I VERY strongly dislike it. UGh.
Anyway, thanks for showing me your video. I really enjoyed watching it!
I'm old enough to remember when everything was interlaced.... unless you went to the movies. Dark days indeed! Thank you for the kind comment, it's appreciated.
@Planet Xtreme, haha, this comment made me feel old in a second. Welcome to the past world of strange NLE products like "DPS PAR" or "Matrox Digisuite", where interlace or not was vital for smooth movements, but also flickering typography on screen. Thats of course on phosphorized scanline monitors only, with heavy tubes and double screen refresh. With half the y-resolution, by skipping every second line, and double the frame rate (50/60Hz, PAL/NTCS) it was made sure that either all odd lines or all even lines of a full frame were visible at the same time. So unlike those very visible bars nowadays in real interlace times those bars were not visible onscreen while the clips were running but provided a smoother playback.
@@jiffijoff9780 aw man. Thanks for the legendary replies! You definitely get a sub and like for that!! :)
@@jiffijoff9780 wow... all stuff I'd prefer to forget!... I still get confused by odd or even line first 😂
@@extrashot haha, I'd too. Including mpeg2, what a nightmare codec. Remember tmpeg professional? Always fiddling with the profiles and bandwidths.
This was so fun to watch!
Thank you Doda... glad you found my channel!
One thing you didn't mention, on pc at least, you are not entirely tied to mp4 as you can output your footage as a tiff image sequence .
Indeed, this seems an eminently sensible option on larger projects, not only for the freedom to pick your own encoding options afterwards but in the case it fails halfway through you can just pick it up from the next frame.
Oh wow... I didn't realise. That's good information, Will it do a tiff for every frame? So 25 tiff's per second for me?
@@extrashot yes.
@@noelplum99 Thank Noel 👍
Apparently the latest version v1.9.0 can work with interlaced video now. I'm thinking about whether or not I can justify the expense.
Yes, just seen they've added that... it could be useful. Try the trial first !!!
Will this work for old videos with .mod extension? I have a bunch of videos shot with my Sony handycam
Good question, I don't know and don't have any .mod videos to try. However, have you tried simply renaming .mod to .mpg ? They are both based on the same codec and a lot of software will play .mod if renamed. (try it on a backed up file first!). You can also try the trial version of Enhance to see if it works (.mod or .mpg) before spending any money.
Did you choose the MPEG-4 video export option in Video Enhance AI, or did you export each frame to combine into a video later?
I exported MPEG-4... I didn't see the option to export individual frames. I'll go take another look.
@@extrashot the rest of the 4 format options export the video as a jpg, png or tif image sequence.
@@radioreactivity3561 True... and exporting as say a .tiff image sequence to be compiled into a video later, would give you better options to choose your own video codec and compression settings... so very useful if you want to edit again later. Thanks.
Photoshop 2021 has the function of enhancing the photos. It also has a video saving function. I think you can save the movie in jpg sequence format, then enhance all the frames and save them again, but this time in the selected video format. Does it make sense?
It does...thank you.... I need to take a look.
That would take forever and ever with any sizable video.
Its temporal AI is surely an enhancement over Final Cut or Resolve which just work frame by frame?
True... I wasn't expecting much and it definitely exceeded my expectations! If only we could speed it up a bit on a Mac!
@@extrashot I just downloaded the latest PC demo. I'm very curious to see how it works on old movies given that commercial rivals cost many to tens of thousands of dollars.
One thing I hope Topaz does is help an old beloved show like Buffy The Vampire Slayer upgrade to HD. I saw a show on how difficult it was to re-scan the footage, some of which was shot on different format films, and then after the digitizing, the effects had to be re-done. With Topaz, theoretically, a place like Netflix can re-introduce us to our old favorite shows like Batman and the Six Million Dollar man in HD.
There's a lot of great shows that could benefit from this, but you're going to need some serious processing power... probably server farm level !!! 😂
Underrated Channel
Of course, I agree!
You should check the program again, the improvements they have made are quite interesting. There are almost 20 different AI rendering models now as opposed to the three you saw.
True... I've been playing with the latest version and it's improved a lot. I should do an update as soon as I have a moment.
Have you ever tried it on Super 8mm footage that has been telecined to HD ? I'd be interested to see how it handles the resolution and grain structure there. Also have you looked at any of the really old late 19th and early 20th century footage that is being converted using AI - the results are pretty impressive. Similar I guess to the colourising using AI
I've been amazed recently at what Peter Jackson has done to old documentary footage from the 1960's. This tech is improving fast. I need to take another look at the latest versions.
Great review. Really good, I upscalled 40 seconds of a video clip 480p to 1080p, really a good job, but It takes 4 hours in my notebook i7 5500u.
Thank you... it does take a while... especially without an NVidia GPU... but 480 to 1080 is usually worth the wait!
extrashot Yes, is amazing the upscaling .. really worth.. i’m upscaling a concert.
@@lucasleal4035 an i7 5500u only has two cores with hyperthreading. It is a fairly weak processor, especially for something like video editing which tend to utilise more cores. Mobile processors also generally have lower frequencies and thus lower performance over desktop computers.
Hello what computer and model to you use ? I tried it on some old SD footage to 1080 HD one minute of footage took 5.5 hours to render very hard to do an complete video of say 10 minutes it will take days, cheers
I think the main thing you need to speed things up is a fast Nvidia GPU... I'm just using an old (2017) i7 MacBook Pro with Radion Pro 560... so I feel your pain!
Thank you for this, I can finally see my videos from the 90's clearly
I'm guessing 1990's... not your 90's !!! 😂
@@extrashot 😂 your right the 1990's 😁
Excellent presentation!
Thank you! Cheers!
You're very believable...and that's obviously very important. Thank you
Watching your example enhance ai seems to do something a little more than sharpening alone. I think this technology just needs a few more years before it’s in every editor and we can all call it “enhance”
It's definitely doing something more than I can do with FCPX or Resolve alone... works well with poor quality footage but is quite subtle once the rushes are good. Cheers for the comment.... and I love your videos by the way... keep them coming!