Turning Hand Drawn Animations to 60 fps with AI
HTML-код
- Опубликовано: 24 мар 2020
- These are the results of testing the deep learning algorithm DAIN (Depth-Aware Video Frame Interpolation) that can detect movement patterns of a video or gif and increase the smoothness.
DAIN code: github.com/baowenbo/DAIN
Sources:
0:08 - www.pinterest.com/pin/3267221...
0:24 - www.pinterest.com/pin/4979996...
0:33 - www.pinterest.com/pin/2032250...
0:47 - • Crimson Alpine
1:03 - www.pinterest.com/pin/1726849...
1:19 - www.area-visual.com/2017/06/la...
1:27 - www.pinterest.com/pin/1189238...
1:50 - www.pinterest.com/pin/3730247...
1:58 - www.pinterest.com/pin/7439384...
2:14 - www.pinterest.com/pin/7019986...
------------------------------
Night Out by LiQWYD / liqwyd
Creative Commons - Attribution 3.0 Unported - CC BY 3.0
Free Download / Stream: bit.ly/2BLdhW5
Music promoted by Audio Library • Night Out - LiQWYD (No...
------------------------------ 
Наука
![Smoother animation ≠ Better animation [read description]](http://i.ytimg.com/vi/_KRb_qV9P4g/mqdefault.jpg)
![Smoother animation ≠ Better animation [read description]](/img/tr.png)
![[BLACKSWAN] ‘Roll Up’ Official Music Video](http://i.ytimg.com/vi/ulvCwyKrwqw/mqdefault.jpg)
From what I've seen so far of DAIN and general frame interpolation it's really nice, but depending on the starting frame rate it can REALLY work or REALLY flop. That's not very surprising, though. I think frame interpolation is more suited to being a tool for footage or animation that plans to use it in post production and plans the directing around it.
Extended Thoughts/Why Interpolation Looks Weird(long):
I think the mathematics definition of "to interpolate" is the most accurate for this kind of tool: "insert (an intermediate value or term) into a series by estimating or calculating it from surrounding known values."
If you record a fast moving object (like a baseball being thrown) with a low frame rate you get motion-blur. This is fine if the recording is presented at it's captured FPS, but it can get exaggerated and sometimes look like it's a lower frame rate than the presented one. (Check out some 60FPS Lord of the Rings and look at fast moving objects)
With hand-drawn animation it's a bit different. Artists/animators can use a wild variation of frame rates to animate at depending on the medium(GIF, internet video, etc.) and at what speed they intend it to be presented. There's also the infinite amount of artistic styles and stylistic choices: blurring to exaggerate motion, CG, realistic, cartoon, etc. DAIN is by far the best FI so far, but for art/video not created with interpolation planned in post can still look really off-putting, and this is a combination of both the original FPS and art style described above.
If a video was shot in 30fps and interpolated to 60fps then there might be some artifacting but it won't be bad. For every frame of the video, a new frame is created, and the program creates an image that is an in-between image. (1---2---3---4 versus 1-a-2-a-3-a-4, but it happens with the same amount of characters) But if you shot the same video in something like 24fps, the program has to create an extra one and a half of a frame(60/24=2.5) versus the extra single frame which can lead to even more distortion. With an animation that plays at less than 30fps, artifacting happens a lot the lower the frame rate is.
Check out 0:40 and watch her legs(slow it down if you need to). There's no blur in the frames to indicate motion, and check out how far her legs move between each frame. Because simple interpolation can only infer what's going from the frames, it can only create an image that is an in-between of the two, it can't draw a new frame like the original artist can. DAIN is better at this because it's an AI that can learn, but it's still a program that can't tell you what looks right or wrong. That's why there's so much smearing, fading, and artifacting in the interpolated version. Look at 0:32 and watch the feet(again, slow it down if needed). Notice the way some of the feet just kind of fade out instead of moving as it should? In the original, the leg is there one frame and then gone the next. The AI doesn't know what a cat is or how it's body works and should move, it just knows what the frame was before and after, so it just tries to fill in the gap with what comes next, which is just white space, thus the fade-out.
This is why I think it has more potential as a tool to output a desired frame-rate while only drawing half of the intended frames, or maybe even a quarter(30fps playback speed, but only 15 frames drawn). Animators could learn through experience how their art-style gets interpolated and what details to change so the experience and finished product come out very smooth without spending hours or days drawing an insane amount of pictures for one second of animation.
(If I got something wrong, please feel free to correct)
Still curious? Definitely watch the Slow Mo Guys' video ("Why aren't Slow Mo Guys videos 60fps?") about FPS(not interpolation, but it could help understand it and the differences between play-back speed and FPS)
Thank you for coming to my TEDx talk.
Thats why the results can be so different, is basically a combination of the style and how the frames are distributed.
That makes a ton of sense, I noticed a lot of artifacts and stuff in the 60 fps version
1:28 is one of the ones that worked crazy good imo.
After reading this I rewatched and came my ratio of which version I liked more drastically increased in favor of the original arts. Some 60fps did look great but yeah those subtle imperfections compared to the original just made me lean toward the originals more
This. I was exactly thinking about how just because it’s higher frames, doesn’t mean the animation will be any better. The greatest films of all times use a combination of 1s, 2s, and 3s and by sticking to only one can make the animation feel mechanical as shown within some parts of this video.
honestly, the 60 FPS animations are so smooth that it may look like they're boneless.
1:09 brrr
Edit: Lmao 280 likes
THE BONES DONT HAVE BONES
They are flacid
That's a good way if putting it
@@effretibooyag7837 are you sure about that?
*Sometimes the rough texture is what brings the animation to life*
Apparently to some people :T
no, fluidity, timing, principle and style does. using a slightly grainy brush ain’t changing anything. unless i’m completely missing the point of op’s comment.
I was searching this comment
@@hystericallover5989 he’s talking about the “roughness” of an animation, how an animation being just slightly imperfect can make it feel more alive
@@hystericallover5989 think they meant that the roughness/choppiness of some of the animations is what gives it more character than if it was perfectly smoothed out
Is nobody going to mention how talented the artist must be who created the original? ‘Cause all of the animations have very nice drawings.
Artists. All of these come from different sources
Some things work perfectly, whereas most things look unnatural and don't have that rustic charm.
It would interest me to see a film that incorporated both frame rates.
Might not be exactly what you mean, but in Spiderman into the spiderverse there's a couple shots where the 2 Spiderman are on screen together while they are animated at different FPS, Miles uses 12 frames as he's still young and inexperienced while Peter has 24 and feels more secure and precise
Both ideas are similar but not quite what I was thinking of.
Have you seen the film Pan's Labyrinth? There's a scene where a man has been heavily drugged and he is stumbling through a chaotic battle around him. If this was an animated movie, it would be really trippy and cool if the fighting in the background was in 60fps and the person was in 30, or even the other way around.
Nah. Most of them are better in 60
@@zakr1187 I said I'd be interested to see it, not that it would necessarily be better.
Owl house
The sliding down the mountain one was actually pretty smooth
To be fair the original was already smooth as fuck! Crimson Alpine is God tier animation!
@@DoubtlessCar0 yes
yeah i could barely see a difference hats off to resh for that
That was one I didn’t notice a difference in lol. The cat spinning in circles looked the best to me. Looked 3D
I feel like DAIN did a incredible job because in 60FPS it looked pretty good. But I feel like it did lose some of it’s impact with the frame rate increase because the gun recoil just felt way too smooth. Might just be me but yeah definitely agree with you
Honestly,the 60 fps feels kinda weird because of how 'jelly' it looks
I feel the same
Ikr
I like the charismatic vibes the originals have ☺️
I like the smoothness.. but say to smooth
Eh
Me watching on a 30 FPS device: ahh yes *smooth*
Wouldn't it be 30hz?
@@kiwimarshall3937 yes
Well maybe, it is about lower than 720p is not 60fps on youtube.
Do 30 hz devices even exist in this age ?
Stop lying there's like literally no screen out there that is 30, it's rare af
I feel like, when it fill in the frames it gives things such a fluidity and bounce to it, that it loses some of the weight behind the drawing. Somethings are designed to be choppy or to hold for a second or two to give it umph. But when you just have the image constantly moving, that weight is lost and it's like the image is dancing in a void
Animators:
“Finally, now it will only take 2 weeks to animate instead of 3”
@Chilly Weathers -Imposter- yes but 60 fps can really help
@Chilly Weathers -Imposter- downhill... Like in the example with the girl sliding down the hill? ;D
@@randori- no absolutly 0 animator us 60fps
@Chilly Weathers -Imposter- exactly
@Chilly Weathers -Imposter- I think they mean that it takes more time to animate really smoothly, so this helps reduce the time lmao
there’s just a certain... charm to the originals, seeing animation being so _fluid_ kinda freaks me out
I feel like im high somewhat 😀
Ikr
Yea...
I thought the same thing
@@commanderleo calm down Jamal
0:28 Double animation is so smooth
Nice icon
@@nyaw1215 Nice icon too xD
@@nyaw1215 Derpixon lol
Bruh
men of culture.
0:32 Damn, it's so smooth that it just looks like a filter...
Ikr?
Ikr
Ikr!
Man why are you following me?
@@Panxownsowndksss Lmao Ikr?
if the drawing is consistent and not so dependent on detail, this can really work out.
If you used this and just polished it, you could probably do a ton for most of these short animations.
it is
Especially if it’s still a rough animation. The detail could be added later. This could save time with inbetweens... but the running animation looks rough when slowed down so it’s probably better with small movements.
Is very recomendable for to archieve some efects like, alucinations, hd camera, or slowmotion.
But cut the effect of ' too fast for the eye' in dinamic actions.
Is nice for the girl with the shotgun becuse the camera is traveling at high speed and helps the effects of following the character while the camera is doing it's own movement. But not that nice, at least to me, with the other girl running.
kesinlikle 👍
Original be like: - - -
60 FPS: -
Xdddd
Lol
0.0018310546875 FPS: *Error, the spaces go to the side of the page now*
0.003662109375 FPS: - - - - - -
0.00732421875 FPS: - - - - - -
0.0146484375 FPS: - - - - - -
0.029296875 FPS: - - - - - -
0.05859375 FPS: - - - - - -
0.1171875 FPS: - - - - - -
0.234375 FPS: - - - - - -
0.46875 FPS: - - - - - -
0.9375 FPS: - - - - - -
1.875 FPS: - - - - - -
3.75 FPS: - - - - - -
7.5 FPS: - - - - - -
15 FPS: - - - - - -
30 FPS: ------
60 FPS: -
120 FPS: -
@@alexandergreene461 That problem is due to how low the input fps (15 FPS) is. 30 FPS to 60 FPS looks better than this sample.
0 FPS:
1:27 the gauntlet lost its weightiness from the original animation :(
Definitely. Everything gets so smoothed out that the intentional stutters in movement put their by the animators get erased.
@@gremlinchet well, its an AI. its not perfect
@@EmeraldLegate_ that's why you don't use it for animation.
@@EmeraldLegate_ Which is why we are critiquing it, so that people can realize this is not meant for animation.
@@idkhonestly7163 but it looks cool imo
The 60 fps takes away the impact & weight of the objects
YES. YES. THANK YOU.
Everybody: "Oh, that's so advanced!"
Me, not an animator: *"Ah yes, moving lines"*
As an animator, I can say it's complicated. If you look at my latest vid, you might know why XD I spent hours to get SMOOTHNESS on flipaclip.
@@LynxPlaysYT I don't have Instagram my mom would never let me get it. Also I'm not even done with the animation
@@TheTroggler yeah keep going with the animating you will get better
@@LynxPlaysYT I think I have been doing speedpaints and animation for about a year now so I'm still learning
@@eluartee cool. My animations kinda take longer because I usually animate dragons and stuff
it definitely doesn't suit everything, but some looked better in 60fps
Yup! Sometimes it made the original look like jelly or a filter. But, overall, pretty smooth and cool!
Yeah,I really like the look for a lot of these,but some don't work
I think if it's used in a project,or film,certain scenes and parts should only use this as it can look very out of place sometimes
Exactly what I thought
And some didn’t even need it
It's because the less draws per second they have, the more of a "jelly effect" they'll also have.
The more draws per second they have, the more natural their 60fps will feel.
The big problem I see with a few of these is that they make hand drawn stuff look like it was rotoscoped, which is really heckin weird
*heccin
*fucking
The problem is that the timing is lost because the AI is trying to fill it in with extra frames which result in weird looking animation
One of the reasons that I heard is that this AI is used for live videos, which is why the website has its examples for live photoge
0:56 best of resh!
Resh was WAY ahead of his time!.
it's in 12 fps in the original so you were watching it in 24. You both dum. It wasn't 60 fps
The DAIN really shines in action-rich, fast-paced scenes where a lot is going on.
yes agreed, i noticed it struggled with bones.
Yeah, it has the chance to generate some eye-watering sakuga.
While it really makes action scenes richer, i'd say DAIN could spark up tons of ink-like animations. The swimming silhouette looked gorgeous and i'm sure it would ease the process, it's such wonderful technology!
Yes it look off and janky when you can see it in detail but when a fight is going it’s to determine what exactly the animation is doing all you think is “Damn”
Like a cat chasing its tail
I definitely feel like something gets lost in the process. The jitteriness of hand drawn animation adds a lot pf charm.
The technical achievement of this though is fantastic
Completely agree. The action shots in red especially demonstrate this charm that you can get in traditional animation, a type of edge that's smoothed out in this. Not only does the quick and sharp attitude of the animation get lost, but it makes the transition to 60 FPS look pretty bad.
It smooths out a lot of the more subtle movements and animation, making it look bad.
I prefer using it for stop motion videos, works well.
I mean the goal doesn’t have to be 60fps. Maybe this technology can one day be used to help artists with inbetweens for keyframes in animation and thus make 2D Hand-drawn animation more Profitable again. without making it 60fps but ending on 24 or 30, keeping that traditional animation vibe intact.
This could refined someday I'm sure for letting less hard work at postproduction.
0:47 still love that animation
RESH IS LEGEND
Resh is a god
Yea..
Awesome Resh.
*"I've seen enough, I'm satisfied"*
@HeyGemini I understand Sargeant, I shall change my opinion..
If this ai can suceesfully fill the gaps between keyframes, that's definitely dope.
Yeah, no longer needing a small army of badly payed taiwanese animators to do all the inbetweens would be a blessing
@@carso1500 yea, but where would they work then?
@@antank5703 they would still get work, even with this technique you still need people who check the animations every now and then when the AI makes a mistake to correct it, especialy for longer or higher budged proyects, my comment was more along the lines for people who don't have the resources to hire one of those companies and as such they have to do all the inbetweens themselves which is a huge pain in the ass
@@carso1500 I figured,but it's still less jobs overall going around
@@antank5703 not really, look at it this way now that the prices of animation are lower and you require less people to accomplish the same end result what do you think it would happen, there are going to be the same amount of animations with less people working as animators
Or
There are just going to be a higher number of independent animated projects with now animators being capable of creating their own series or movies at the level of high quality productions in a fraction of the time and money
Historicaly the second one has held true, just for example compare the amount of animated TV series or animes that where being released during the late 80s compared to today, computers really helped to reduce the time and effort that was required to create one of this projects compared with the old method of celuloce paper that was a pain in the ass to animate, as a result there are a fuck ton more animations being created right now than 20 or hell, even 10 years ago with far more animators today, but even with the advent of computers animation its still an extremly hard and expensive endeavor, i have seen some really good animators like terkoiz (really recomend his work he is amazing) that to create even a single 10 to 20 minutes animation on his own can take him up to 9 months of non stop work
Now lets compare animation with another art form, with videogames, right now is easier than never to create a videogame from scratch, the tools are more accesible than ever and the raw power of modern systems mean that games that 10 to 20 years ago required a budged of millions and computers with the highest specs available to run now can be created for a couple thousands dollars at much and run on basically every system from a high end gamer rig to your grandmas computer she just buyed yesterday to check facebook, as such the videogame world has seen an exponential increase on indie developers creating their own ideas, sometimes a single develper with a lot of willpower can create a videogame capable of competing with AAA productions, and big corporations with the resources to spare are creating bigger and bigger proyects with more and more stuff cramped into them, what this means is that the are more videogames on then market and even if you don't find the game that you want you can probably create it yourself if thats what you desire to do
Imaginé that something like that happening to the animation industry, where basically any single indie animator could create their own series, how many independent high quality animations do you expect could be created by a team of three or four experienced animators if they don't have to draw every single inbetween but let the AI do the hard work and they just need to make corrections, then you have another AI that helps with the coloring with again the human only having to give the AI the raw data and correct it's mistakes, eventually you would probably see a spike of series, movies, etc all showing high quality animations at the level of current AAA but made by just a couple of people on their spare time
So basically instead of believing that this technique will let people without work, think of all the people that could suddenly work for themselves without needing to slave themselves to a big corporation
Thanks for comming to my Ted talk
1:19 the 60 fps looks real, a bit.
i agree
That was definitely one of the cooler and more effective ones.
If someone showed me just the 60fps version I'd think it was done over someone in a motion capture suit. Its too smooth.
1:20 that 60 fps version looks incredibly cool
Not really, imo the smoky intent of the artist completely vanished and turned into a smudged mess
You're so good at drawing!!!!!!!! Dude it looks so amazing.
they didn't make the animations
I think everyone is seeing the flaws more than the actual fact that this is promising technology - a computer is literally guessing motions (very accurately) in-between frames based on complex math. It's not a human quickly drawing more frames in between or a type of motion blur.
We can make statements about how it should be used and how it shouldn't be used currently, but technology always improves - the fact that stuff like this even exists is huge.
True and I tried slowing the video down to 0,25x and you can actually kinda see the difference
Yep! This has great potential in helping animators get more bang for their buck without breaking an arm and a leg to get there- if not overused it can do wonders to help the animation industry and AI similar to this have already been used in things like puppet animation (i.e. tweening) so it has loads of helpful uses
Appreciate the sentiment but hasn't this been out for years? Sorry if it's a stupid question.
The thing about A.I. is that most of the time it guesses correctly, but sometimes it guesses Toronto. I don't want to be there when A.I. is controlling something important and it guesses Toronto.
Maddalena L’episcopo 🚇🚖🚗🏎🚚🚋🚋🚉✈️🚀🛸🚑🦯🚀🛵🚀🛵🛵🚲🛵🛵🛸🛵🛵🛸🛵🛵🚆🚆🚜🚆🚜🚒🚙🎻🚔🚔🚨🚠🚝🚞🚂🛰🚄🛳⚓️🚢🛶
Hentai artist: interesting...
Lmao 💀
Bet
Hentai in 60fps :0
Minus....
Shup up and take my money
That is awesome. Especially the rotoscope clips.
Wow, good job dude!
Honestly, it entirely depends on the aesthetic you’re aiming for. Sometimes 60fps looks better, sometimes it doesn’t! This is amazing nonetheless.
Agreed. For some hand drawn animation looks miles better. It truly depends. For some charming comic-style animation 60fps looks odd as hell and just doesnt fit.
For fantasy and anime animations 60fps looks pretty good and arguably better
Stfu and watch the video boomer
60 fps makes everything look like a video game. Too smooth and jelly looking. Nothing moves like it has weight and moves like a robot is controlling it
absolutely agree. it always made the animation smoother, and smoother did look better in some styles, but in others it rounded off hard, intentional edges and details that were part of the style’s visual appeal. This will be a good tool for the post production of some types of animation, especially when the style is planned around it or if a final version of the system gets multiple selectable modes optimized for different styles, but even the, won’t work everywhere.
@@veronicaeatmon8725 oh look who just learned a new word
For what's it's worth this is extremely impressive.
I can only imagine how much this can improve in the future.
An original persona fan? rare to see you lot out in the wild
@@F4nta5y lol
300th like
Yeah, animation studios will can just spit out 24 or 30 fps animations then use this. They can literally only use half the budget for animation
@@F4nta5y funny, I came into the replies to comment on goblin's pfp too lmao
Some of them look like they're shifting into different dimensions..
Damn double looks sick!
it’s so smooth that it almost looks like a 3d model. personally prefer the hand-drawn but this could be quite useful for animators
It's just auto-tweening. It's been around for decades now, and it looks like crap. There is nothing new about this.
@@Keaze There’s more going on here than just tweening.
It looks so 3-D because it basically is. The program takes the info it can from the existing footage to essentially create an entire model of what's on screen and uses that to generate in-between frames, resulting in a hypersmooth and 3-Dimensional look.
@@Keaze It’s not the hammer but the carpenter. Even the shittiest tool can produce something great depending on the efforts and skills of the creator. The crap you’ve seen were most likely not well to suited for this tool
Someone doesn't know what tweens are... They are the frames that tie key frames together, they are already present in the originals, you could say it's adding more though. If you were to put an animation with only key frames through this program it would look awful. It can look bad, but quite a few of these look more than passable. Also what are you talking about when you say it's been around for years? Maybe a different process, but not AI extra tween generation.
I think this really shows how sometimes we don’t need 60fps
This
I Personally think some Anime scenes like Naruto & Sasuke vs Momoshiki or One Punch Man Vs Genos look better in 60Fps. The Flashier the scene is, the better it looks. As long as they keeep the rest of the episode in 30fps though.
dude 60fps is way better what are you talking about😂
No.
Movies and Tv Series are in 24 fps so yeah. 60 fps looks kinda weird.
THE SWIMMING ONE LOOKED AWESOME
The 60 fps are similar to pop-up ads that say make sure your alone and it's so very addictive. Lol
The point of this isn't to like either version better, it's to show the algorithm.
Still cool as heck
Yeah it shows what ai could do to animation it could make it better
@@seantaggart7382 But something will be gone, like the charm that it gives you when its handrawn
@@rythemoire Wait, but those are still hand drawn...the computer just makes them basically smoother..
@@fredericksaxton9782 I thought an AI did it? So for me it's basically not handrawn anymore, (atleast I don't consider it)
Most of them look somewhat "trippy" to me with the AI, but the cat one at 2:00 is quite lovely and so is the girl sliding down the mountain.
oh yes the mountain sniper is where the AI did best imo
I noticed that when the front leg goes back the most the ai merges it with the ribs
The tippy feeling is common. That's because most people process movement close to 24 frames. That's why it's used. Some people are more sensitive to it then others. This video hurt my head a little...but I know a few people who see 24 as choppy. Its actually pretty cool, there's a test you can do to see how sensitive your brain is to movement. 60 frames is used for things that wanna seem more real or where time is crucial. Video games are in 60 frames.
I love the one of the cat going in circles in 60 fps
I don't think this AI did a convincing job at all, but give it like, 4 days, and it will be far better at it.
1:12 looks perfect
Looks like a video game’s frame rate
Cool it works as intended! Now let´s just never do that. :)
exactly :D
Yes
Good tool for the wrong type of animation...
I like it
Yes exactly! It’s the wrong type of animation! So to the creator of this video, Don’t use it that way!
The paint brush woman swimming looked totally different and 10x better. Felt like she was made of smoke
@Slava Gorbunov I think in this situation the smearing actually made it better. Felt very fluid and like a small bit of motion blur
1:19
It made it look like a video of a person edited to look like a drawn animation rather than a drawn animation that looked realistic
I think atheist original concept was to make every frame unique instead of making it look smeared, the outline should move smoother, but the insides should look rough instead of smoke
1:20
99.9% of the comments: I like the original better!
0.01%: Seriously, is no one gonna talk about how good the animation is in general? Like god, people are so talented.
imagine if The Thief and The Cobbler had access to this technology... they wouldn't have wasted so much time and effort animating every single frame of animation on ones and avoid the end result of several decades worth of work being ultimately unfinished
It’s simple once you learn how it works. Even for the running one they only had about 9 fps which compared to pretty much any any animation is a walk in the park
Zeldagirl Yes, but the time and effort put into it is what’s really interesting. I can only dream of drawing like that someday!
i think the animation in the second one is amazing, i just personally have a soft soft for the way the first ones are animated
yes, most scenes where there is fast motion and action look very nice, it actually makes it look more life like with the animation. Personally though, there are some animations which don't feel right. The technology is very cool either way.
i love the way they bounce on the thing thats so satisfying
MIKA AT THE END!! What A Way To Go Off With A Boom! :D Love It!
0:31
Original: Cute cat animation.
60 FPS: Someone just recorded a cat and put a filter over it
(These would be my reactions if I didn't know it was the same image. Holy crap.)
That one specifically does looks kinda weird actually, like if you see closely the AI sometimes confuses the details of the cat and kind of merges lines with one another which is extremly weird, it's still awesome thou
The original one is probably rotoscoped anyway so you aren't completely wrong in that case
The cat has a lot of solid blobs of colour, so the morph-and-blur approach works pretty well on it. The very next example, the runner, shows how this technique is completely ignorant of lines. Sometimes it interpolates a pretty good motion-blurred version of an original frame, but 75% of the time it's a total hash.
In RUclips's Web interface, you can frame-by-frame your way through paused video with the . and , keys (also marked > and < on a US 101 keyboard).
"How many blurry frames do you want AI?"
"yes"
Wowie, those impact frames at 0:48 are really powerful!
That’s a really cool Double animation
1:37
The video: cool 60fps animation
Song: m a n k i n d w i l l b e
d e s t r o y e d
Lol
Mankind won’t be destroyed * mista u gotta listen better
@@schindy6385 sorry im deaf after giorno sucked me :(((
Don’t really like how they treated a sniper rifle like a grenade launcher.
@Chuerry i mean man and womankind xd
See you in 9 years when this video gets recommend
this should just be called “disney to cuphead converter”
what. they're both animated at 24fps, I don't get what your point is
T.K.A. Animations oh shit true lol
@@spaghettini268 didn't the cup head devs have to animate at 60?
@@voidofspaceandtime4684 no
They set the game to run at 60fps, but it was hand drawn at 24
Imagine converting a whole episode of an anime into 60 fps
Thank you for all the likes. I’ve never gotten this much and checking back on this comment really made my day, thanks!
will be best anime of the year
ferb i know what were gonna do today
It will feel like a real anime movie
Eeee
That was the first thing I imagined.
You are very talented
This is so beautiful. I've stared at this for 5 hours now.
Original: Simple Animation
60 FPS: Looks like a 3D animation
301 likes, and not a single comments.
It looks odd
@@nitrixflex2622 whats the problem
I wouldn’t call it simple animation to be honest
the "chunkiness" in the originals is on purpose to add weight to the movement, it's like a timing thing. the 60 fps is very smooth, but not all movements are perfectly smooth, if that makes sense
After seeing this I can say with absolute certainty that AI is not advanced enough to successfully transfer a hand drawn animation to 60fps. The drawing seems solid and stable but the AI creates 60fps one seems like what ever the original was but made of jello. It seems way too inconsistent.
Thats kinda the effect of 60fps. Its too much.
the 60 fps with the sniper girl looks better ngl
AI is not perfect, but its advantage to hand drawn animation is that AI can be adjusted and optimized. It won't take too long for AI to outperform.
@@klaviergavin5401 Yes. More training data for the AI and it'll storm the world
@@default632 But,,, animation and any art is not a matter of outperforming, it's how art can capture attention, emotions, and societal issues. AI, used properly, can amplify art. If used on its own, it's useless, frankly.
That clip of Double from Skull Girls at 0:24 looks so good. Need a colored version of that
like Pineapple-XL said in the pinned comment, this is a really good showcase of how sometimes this sort of frame-interpolation works and how sometimes it won’t. The earlier examples (1-3) all work really well, but something is lost in 4 & 5 (the cat and the running girl). there’s a character and a very specific visual weight to hand-drawn animation that doesn’t always translate well when upscaled to 60fps. And when you’re doing something like a sprint or a run cycle which are often loops of only a few specific frames (often less than 10), the interpolation gets very wacky and turns them into cartoon motorboat legs or basically cgi in the case of the cat.
Moral of the story is you have to know what you’re doing and why. If you’re heading a large animated project, like Spider-Verse, you need to understand how using a certain framerate in certain scenes affects the viewing experience.
My favorite example from ITSV is Miles running on top of the buses. He moves at a lower framerate than the background elements, which, paired with the chromatic-aberration focus/unfocus, makes Miles stand out WAY more than he would have if everything in that scene moved at 60fps.
I love how everyone is giving their honest opinion but no one's being rude about it. I think some of them look better and some of them don't.
That I do agree. with some of them looking really good and some of them look like ‘jelly’
The one I think that looks weird is the skeletal Deer, it looks like the legs are snapping back like a rubber band where as the original is so much smoother.
Yeah definitely
Forgot I was on RUclips for a second
It depends on how natural it is like the skeleton deer look odd but something fantasy blends in well
0:24
the ai also adds smoothness to the numbers, it satisfies me too much-
IMO it looks better than the actual animation
I think the only things i dont like about the generated animation are the bottom tube/leg things glitching out
Edit: spelling and grammar for I have the dumb
@@flare_studios. actually, that animation came from a game called Skullgirls, it’s not generated
Oooh at 47 seconds you used Crimson Alpine... one of my favorite animations... it looks so good in 60 fps
0:54 imo this shows the best representation of how the AI could improve certain scenes. Like many of the other comments, I say that the AI can make some animations look unnatural, such as the lady running, but in this action scene, it looks great.
When you say "the lady running", you mean 0:40?
I said this because the animation of a running woman is one of my favourite anime animations.
@@CorinaDoesAnimation that scene looks... Choppy to say the least. It hurts to look at for me.
0:32 on 60 fps makes it look like a filter
Yes, is awesome
oh wow, I see what you mean!!
just like 1:51
It's a filter lol
Check this, it's a software that interpolate every frame: ruclips.net/video/sFN9dzw0qH8/видео.html
idk how to properly articulate this but I've noticed Dain makes it look a bit "slithery" for lack of a better term.
perfect for hentai
I second the feeling, though I can't place it... I think it's the AI getting slightly confused what goes where around the finer details like the bubbly bits at 0:28
@@silverseth7 I think this clip demonstrates the possibilities and its limits. Seems to need a "proper" selection of keyframes to make sure, the AI does know, how to deal with it. With time artist will find a way to work with that in consideration and awesome results! Can't wait for it!
I think, I will give animation a try and begin to experiment a little bit. Time to get my old wacom into action agian. :)
it only works on animation with little to no weight , otherwise it looks wrong and takes the weight and energy out of the animation (which you call slithery ) walkcycles are a great example for this messup , the ai is not trained for 2d animation specifically but real video instead
the AI needs more drawn frames since the animators skip some spacing between frames to animate movement, so its just a little extra work for extra smoothness, rather making it look hella slithery
Wow it seems like I can tell there's digital smoothing transitions in some of the transitions especially on the shading on one of the cats but it's amazing how much it's doing and how it could be integrated into a work flow. You could pic and work on particular frames it seems to get much done. I wonder if you could reintroduce lower frame rate after the fact? playing around with which frames you insert and when. Super interesting. I'd also imagine you could play around with layering elements separately for the process. say just a gun or just hands.
This is so cool!!
In some cases I'd rather have the original because with the interpolation it smears it and ruins the feel for me.
Nah, its because you have a feeling like your crush is just using a filter on her facebook account but if you doesnt know, you will compliment it!
@@shirleendalman3975 LOLZ
The 60 fps thingy just ruins the entire timing of some of this animations
It only ruins it for Drawings, for Undertale anime’s and Swordfight things it’s better.
i mostly feel that for a lot of the rougher animations cause its too obvious and some frames just make it look weirdly jittery
I wonder how some of the epic stick fights would look after having this done.
same
Because the in between frames crated by ai is making the motion more fluent.
If you are thinking of using it on already polished work it wouldn't make a diffrence. However, in a rough animation it will make a big diffrence.
Might harm the impacts of the fights since over fluid animation could just make a attack lack any impact
@@temkin9298 it would probably glitch on rough anims
They look so smooth omg
The cat at 0:32 in 60 fps LOOKS SO REALISTIC. IT FEELS LIKE A REAL CAT
The legs got really blurry how is that realistic
*facepalm*
Oh yeah, i see it now
Call me crazy, but it looks better without the 60fps.
Crazy
Crazy
I agree. With most of them at least.
Crazy
Crazy
Everyone: *Sharing their thoughtful opinions on how the technology can be used and pointing out notable achievements of a new, possibly work-efficient animators' tool.*
Me, a comic artist and story-boarder who can't animate for shit and loves hand drawn animation:
*Hehe. Pretty lines go wheee...*
I feel you
We all feel you
Lol can relate
lmao *Pretty lines go brrr..*
Idk i like both. The originals have a certain charm to them, almost kind of rustic compared to the new. The news ones are obviously really great and smooth. It's amazing what AI can do.
The cat chasing it's tail is something I love and could watch all day, no matter it being the original or 60fps.
It works well for a large moving, but unchanging scene, like with that downhill slide scene, until it pans around for the end
at this point i’ll take anything to see a hand-drawn animated movie again
both are good tbh
Swordbird same. Hand drawn animations are just so much better. As much as I love the technological advancements and realism of scenery in movies like Frozen 2, they just don’t have the same charm or entertainment value as hand drawn movies
Well, good for you: wolfwalker is comming out soon
Io Som *iM SO EXCITED FOR THAT MOVIE YOU HAVE NO IDEA*
Watch anime
0:32 was the most satisfying in 60 FPS in my opinion
Squish that cat
To me it just looks a bit too slow, it is still cool either way.
@@fauxhuman0 in 1.5x that's seem better
Right? It looks like you just put a filter over a video of a cat
This is sick o.o
This is truly awesome..
0:33 makes it just look like a filter on a cat instead of a drawing!!
Yeah it looks so good!
Lavender_heart :3 it looks awful
Szlendak like you could do shit lol
@@coolrichkids I hope you are aware that you're talking about a program, right?
Twin Flame lmaoo trueee
0:32 looked like a real video with a filter over it
Check it out at 0.25 playback speed and see the magic dissolve
It looks like they used motion capture for it rather than animated it. Hand drawn is clearly superior
@@lucafacchinetti2522 the original looks like a bad animation, theres a skip between the paper
but the 60fps doesnt change, it still moves smoothly
Yeah this is why i like 70 fps m9re
That's some pretty neat AI
Very interesting!
Does this mean we could make Ah-Ha’s Take On Me music video 60fps?
Omg yes someone do it
+1 PLEASE SOMEONE~
Here, I did it ruclips.net/video/dQw4w9WgXcQ/видео.html
@@tatteryt Should of used the indihome meme
@@tatteryt Bless your soul
0:08 really shows how timeless well-drawn and consistent animation is. Forty-seven years old and the AI process throws into even sharper relief how dimensionally well-drawn the proportions are and how well the motion arcs were executed.
The traditional animators at Disney were masters at their craft. James Baxter and the dude who imagined thief and the cobbler are/were one of the best at fluid, consistent, and realistic animation. True art right there. they put their heart and soul into every single frame they did and made it look easy while doing it.
@@Kimmie6772 Miramax deserves very nasty things after what they did to The Thief and The Cobbler.
@@RETROMAN-RUclips-Channel well to be fair to Miramax, the man wasn't very cooperative when it came to showing progress and reaching deadlines and had an obscene budget. But then again idk if these deadlines were considered unreasonable or not.
@@Kimmie6772 Yeah, that makes sense. It's still a huge shame most of those hand-drawn 3D camera movement shots went to waste. That stuff is the best animation I've ever seen!
Crimson Alpine! Love that animation so much.
the skullgirl thing/character looks AMAZING, as does the first snow shooting scene, for most of the others is kinda weird, i guess part of the beauty of animation, sometimes, is the low framecount
DUDE I WANNA WATCH there are some movies id kill to be able to watch with this on max settings
The 60 fps looks 3D animation with a 2d filter on
Basically live2D
2.5D?
One thing that's interesting to me is how even though they're still moving the same amount per second, the amount of frames effects how fast or slow the animation feels. I mean this is something I've learned in my animation class, but even still this is an interesting example of that
This probably has something to do with the 12 principles of animation, though I'm not sure exactly how it ties in. Framerate definitely effects how weighty or weightless something feels. This AI is essentially taking in shots animated on twos and threes and spitting out shots animated on ones. Sometimes it works, sometimes it doesn't.
It’s like the slower the animation that it’s transferring is the better the 60 fps ones looked. Like, some of them barely moved and so it looked great as it was probably easier for the Ai to make it smooth
That’s really nice god damn
I know it’s not just me that feels the originals always have better timing and are snappier. Every footstep feels more certain and deliberate where the interpolated animation feels baggy and indeterminate. All the life kinda gets smoothed out and you’re left with syrupy, wobbly, plastic.
perfect for hentai
I did like it at 1:30 and 2:13 though! Seems a certain type of style looks better when smooth. I didn't mind he angel either, but both versions looked cool in that one
60fps is best used during slower movement, and not rapid like some of these
right? when it’s smoothed out it just looks like a imovie transition sped up lmao
@@soltrice not exactly, it would mess up weight and timing
Moral of the story: everything looks smoother at 60 FPS
Eeh... No
It looks smoother but 60 should be only for games not animation, you don't feel the weight on these, when the girl was running you didn't really feel the weight of her feet hitting the ground same goes for the girl with the big metal arm.
i'll passed on blurry in-between frames
Looks too rubbery
True it does make everything smooth butttttttt original will always be better its the memories of memories it is those childhood memories the origina is way better then that 60 it just can’t compare it’s like original is Like a thicccc bitch with four cs 60 it’s just a thicc bitch just only two i’m saying it’s not bad but preferably I’m a take the 4 cs if that do not make sense to you you’re uneducated swine love you muah 💋
that orange sniper thing was soo cool
Wow absolutely insane
1:03 the 60 fps is so strange
Lol ya
It looks like a 3d model oh my god
Not enough frames on the original, thats why. An AI can only be "so" good
I think it's because the 60 FPS one feels too "light", and like it doesn't have much weight... Which is different to actual deer
That's the only one I don't really like. It seems to creating a rubber band effect with the legs which throws me off.