I see a lot of concern, especially from animators, that tools like this will eventually make them obsolete. This isn't a replacement for someone that knows how to animate, nor someone who can draw. Tools constantly evolve, but making something visually captivating always requires those same core skills. It still takes an artist to make art. That hasn't changed. What we figured out here is a very advanced form of old-fashioned rotoscoping. Animation takes a lot of forms; Traditional, 3d, stop-motion... They all have different strengths, and enable different stories. Our method here isn't a replacement, but an attempt at something new. What excites me is that this tech makes it easier to bring my visual ideas to life. Ideas that were otherwise impossible. When I said this democratizes animation, I'm referring to the near-insurmountable mountain of work needed to make a full-length narrative animation. Currently that requires large studios and large budgets. Doing it on your own is nearly impossible. But I see potential in these tools to change that! That's what I'm so excited about. Imagine one person, or a few friends, bringing their crazy ideas to life. Imagine if a traditional animator could automatically have their drawings inked and colored. Imagine eliminating the uncanny valley on cgi faces. These tools have the potential to do that. We're trying to figure out how, and sharing our journey. If we want community-controlled AI tools, we need to develop them as a community, otherwise they become proprietary tools locked behind a company. And yes, this can be done with your own style. We trained our model, not from hundreds of artists, but from ONE film- Vampire Hunter D Bloodlust. We've been very open about this, and I think it's important to be. But this is also an experiment and a loving parody of this era of anime. I consider it no less ethical than the countless other videos on our channel that borrow from pop culture to tell their story. Sudden change can be scary, especially if it feels like your passion or livelihood is on the line. But that's why we're out here exploring it. Hopefully we can help shine a light into the fog for everyone. -Niko
@@laurenswintek895 Bruh this saves millions in costs and enables a solo dude like you do it on your own. How is that pro big corp ? It's literally made to help the tiny guys that don't have studios or equipment.
Please don’t let the haters get to you guys. I’ve watched your videos for well over a decade now and seen you all grow into adults with children for peat sakes. I feel old just reminiscing. I can’t help but have a sense of fear for the future as an artist but I am excited to see what you guys come up with next. ;) btw this comment section is filled with trolls pretending to be people who care about artists. Please for your own sanity just stay up here.
@@Lemosa3414 saving millions at the cost of the software literally building it’s foundation off of stolen art and talent. no matter how you look at it, a lot of ai tools relating to art creation is based one some type of engine that was trained off of art that had no consent to being used. we cannot look at this in a positive light until work from artists that were stolen has been acknowledged, reimbursed, and evaluated.
As an animator... this scares me. I've dedicated my life to draw and know how to recreate motion within the drawings. Only to be replaced in a couple of years.
I don’t think traditional animation will become obsolete, it may just be considered as a different style. Look at the painstaking hours put into stop motion. There’ll always be appreciation for traditional techniques
It's not like everyone will be able to create full cartoons just with couple of clicks though. Look at search engines: those didn't kill marketing. There's still a skill and expertise required to make a webpage properly indexed by search engines (and there are whole courses to learn SEO, it's not just a 15min tutorial). Just look at Sam's list of prompts he used. It requires time to learn what works and what doesn't.
@@viewsfromcairo How would it become more valuable? In order for that to occur, supply must lower while demand increases. Will demand increase? Or will there simply be more art? Will supply go down? The same number of traditional artists exist. You could argue AI art will cause more artists to give up but that's not really guaranteed. As it stands, most artists don't make a livable income off their art. They do it not as a career, but as a pursuit of life.
Around the 17:00 mark he says “Anime has no 3D camera movies”. Close to every modern anime does, even slightly older ones like Death Note had spinning 3D cameras in moments.
I think they wouldnt like it that much Since technology basicaly steals their jobs Edit: jeez so many replys 😭😂 I do agree that that kind of video would be cool to see But i as a digitital artist personaly dont like ai "art"... at all :/ I dont think that the ones who dont agree with me understand how frustrating it is
it would be a good idea, maybe their larger audience would finally see them talking about the ethical and moral implications of using AI -based on stolen and unethically sourced work cof cof- seems like they only talk about it on podcasts
@@alexanimatess5552 Not... yet... this still looks very rotoscoped and the movement isn't stylized enough. Having said that... it's clearly coming. This might take the jobs of lower skilled animators like those who work on most anime, etc.. It's still a ways away from taking the jobs of people at Studio Ghibli, Disney/Pixar/ILM, etc.. Like I said though... I do smell the wind turning and this taking even a lot of those jobs away. Not all of them, but certainly a significant amount.
I felt a great disturbance in the animation industry, as if millions of voices suddenly cried out in terror and were suddenly silenced. I fear something terrible has happened.
What’s so cool about this is that when I was younger I honestly thought cartoons were made from actual videos. So in my head I believed that when I was watching YuGiOh they actually filmed everything first then drew over it
That is a real animation technique but it is rarely the final product. I’m pretty sure they did that in the Lord Of The Rings animation for a few scenes.
lot of companies make a 3d animation and draw over it cause 3d is easier than hand drawn also they use stock footage like martial arts and stuff to get the fluid movement so you are quite close
Miayazaki used that style of animation in some of his work! Like in Castle in the Sky there's a scene of a brick wall getting broken, and it was a real brick wall they filmed and drew over.
How is this going to "replace animators"? Rotoscoping has existed for decades, but animators are still around. This is essentially just a more niche version of rotoscoping. There's also some time and effort intensive areas this method requires that traditional animation doesn't require - building the image generation model to only generate in one style and distinctly recognize three different people, costuming, choreography, filming, building the setting in Unreal Engine, and running the film and the background shots through that model.
Stable Diffusion was released in August 22, 2022. EIGHT MONTHS AGO! Chew on that. This was they did with a Tool in development 8 months ago. 8 years and you'll be soon Obsolete. And animators are already using Unreal Engine especially for 3d animation. You animators are doomed.
I find it baffling how a month ago, Jake gave a very in depth video regarding ai image generation and the "fair use" of it during the yet to be decided lawsuits, but corridor still releases this video basically showing they used vampire hunter d, a copyrighted series for training(with ads on the video), and the actual video on a for-profit basis
literally all anime back in the day looked like this. they don't have a copyright on generic 90's anime art styles... also the entire thing is free on youtube
@@retardedmonkey9000 The lawsuit is about if AI being trained on copyrighted material is a violation of copyright law. It was never about what the AI-generated images or training images look like. The images they trained the AI on are copyrighted, and that is all that matters.
As somebody who just graduated from college studying 2D animation; this video is pretty scary. It’s so impressive but it takes away years of progress that thousands spent their lives doing
Have drawn animation will never be replaced. It just has a different feel that I don't think can be replicated fully. In the future, who knows but I feel there will be a place for them for a long long time yet.
@@FullMetalAtheist it will. In the next 3-4 years at most, someone with just a single high-end RTX 60XX card will be able to ask an AI model to create entire anime series in just a few dozen hours (or a few hundred at most depending on the size of the project). You could have it use a source like a Light Novel, Manga, or even an original anime, and ask it to make an adaptation, a sequel, or even a remake for it. It will be able to make everything from story, to sounds, voices, and of course the art/animation. Also, have it come up with original stories based on your preferences will be entirely possible. The same will be possible for movies, and early in the next decade (because of the sheer size, complexity, and required processing power) even entire games.
@@OnigoroshiZero this is the same argument I see for guitar amp sims... there has to be an original in order to emulate... there can be no output without input. The beauty in animation is the vastness of styles presented by different artist and if they all just copy the same sources then they will all devolve into the same style and no one will want them.
@@OnigoroshiZero Possibly but I have accounted for that in my statement. There will always be hand drawn animation, it's like how everyone thought practical effects in movies would be totally replaced by CGI, yet practical effects are still in use. CGI is common but there still exists a market for practical effects. I think there will be different markets and some may use AI enhancement to create things but there will always be those who animate by hand.
We are all concerned and amazed at the same time. Amazed a small production can put together something that looks so good. Worried because it devalues our craft we've dedicated our lives to learn.
@@PikaPeteypeople who used to make typewriters lost their jobs when PCs became widespread, now everyone on Earth uses PCs and they have given jobs to billions of people. If skynet doesnt happen this will be a positive thing for humanity i believe.
@@MumboJumboZXC Things like GarageBand and other such programs haven't gotten rid of musicians using actual instruments, not in the slightest. So I think traditional art will be fine
This is a really unsettling video. I'm in animation school and there's a big fear of exactly this depriving the industry from respecting animation for what it is. Animation is respected as film so little already, stuff like this only makes it worse.
@@RodasAPCTV they fact that people only value the end product is the issue here. artists have been exploited for years, this will only make it so that art, and any creative job, is less valued as a whole. that's a valid concern.
@@RodasAPCTV They're not concerned about the end product. This "style" of animation just makes it much easier to animate without creative hands. Many animators will have studied, for nothing. COMPANIES care about the end product, and don't care who they step on to sell it to the public.
Just wanted to say…I’m watching this vid because of the haters. I wouldn’t have known about this video if it wasn’t for them. Lol. So their hate has shown me something very exciting! Good job. I went to the school of visual arts in Manhattan shortly after the Little Mermaid Disney movie came out. I learned how to hand draw and film each individual drawing. Then computers came along and put an end to that. So to all the haters…get over it and dry your eyes. You can’t stop the future.
With the recent rise in your guy's AI videos, we've heard about the Law side of it, and the possibilities that you guys have shown, BUT I would really love for you guys to get a bunch of animators and artists on to talk about it and the future they see it bringing because as a group, they are the ones that will be most affected by this development. Hayao Miyazaki himself from Studio Ghibli has expressed his distain for it (which is why I was shocked to even see a Studio Ghibli scene referenced in this video), and I think if you guys are peddling it as a future resource so hard, it's really important you also express the views of the other side of things. In this video especially it felt like you glossed over that by going "We got it from an anime which is free on RUclips" but that doesn't necessarily mean that those original artists gave you permission to use their style for this project. You have animators on react, would just love to see their opinion on the stuff you've recently shown.
exactly. they're gladly helping animation as a medium get killed off and replaced and pretending that this means "democratizing the medium". such bullshit. i'm so disappointed. had to unsubscribe
exactly. every animator i know is terrified of the implications of ai art for their field. this video just solidifies it. im pretty disappointed in these guys actually
Yeah, i agree. The result and the problem solving definitely looks impressive , but it was disheartening to hear them casually mention using Vampire Hunter D's style ( and that movie is insanely and lovingly animated by a lot of skilled animators that came with that style and put hard work in each frame. ) and just use that template to spew out anything in that specific style. Then again, for all the fun content this channel provides, i remember them hyping up NFT's so I don't have high expectations when it comes to their judgement for the moral/ethical use of new tech. Of all the mundane hard things we could use AI for making our lives easier, we decided immediately to use it for art "shortcuts" , forgetting that half of the fun as well as the knowledge/experience / growth as a creator comes from going through all the creative processes - ups and downs and everything. Well, can't wait for the inevitable AI mish mash of every franchise/art style flooding RUclips.
@@andrewreynolds912 the solution is literally just them being asked if they want their work in the dataset. It’s not that hard. Several of these AI already allow you to issue a request to have work removed from the set
He uses rotoscoping, which isn't really AI in the same sense, but does use computers to calculate the frames. He still has to hand draw the characters and such.
@@nintendomario007 but isnt CC's method just rotoscoping as well? Their style in the anime video is nothing like the anime they trained the SD Algorithm with. Also I love his style, checked out to remember, he uses Ebsynth. Sorry for my mistake
As an animator myself, this doesn't replace animation at all. It's another tool. There is now just one more new style. Painting moved digital a long time ago and cameras have come a long way and yet there are still somehow people buying and selling brushes and canvases painting portraits the old-fashioned way.
@@lawgx9819 I understand that you believe that opening up animation to more people will cause mass deaths, but I disagree. However, not to get too political, I do think that if the government begins regulating animation, there will be massive problems for people trying to survive in an ever-changing world.
@@lawgx9819 Really don't know where you got that idea from - military use has always been the preeminent driving force behind firearm development, going back to even the earliest examples like the Chinese 'fire lances'. Hunting? Self defense? With advanced technology? That's not something that the poor ever got to do lol; outside of military use, firearms were toys for the wealthy over the majority of the history of firearms. Being affordable and accessible to the everyman isn't something that happened for a LOOOONG time.
The difference in it being a “new style” compared to a replacement is in how the medium is being used. Making AI based anime by essentially rotoscoping live action won’t be seen by big companies as a fun style but instead cheap and easy to manufacture product. Truth be told there’s nothing wrong with live action, I even find the live action version of this video to look better than the “anime” one but simply putting what can be called a filter over an existing product shouldn’t be glorified as a new tool since it doesn’t serve to make a process easier, it just alters something that was already made. Actual advancements using AI have been made such as Cadmium which is a program that uses a persons work to help color in their animation. That’s a tool, it’s helps make an already intended project easier. If you want anime made there’s nothing wrong with just admitting to yourself you don’t have the skill or time to learn. I’m not gonna make tools for a painter to be good at baking, that’s what a baker is for. TLDR: Basically anything can be technically called a “style” but the actual application provides a cheap way to recreate other peoples work without actual work or talent in the field. Wanting to make anime with no care for the creation of anime is an incredibly ignorant mindset
@@WholeWheat_J I understand that you believe cameras (which I would consider a new style of making a portrait), really aren't a tool and that it takes no skill to use them. Only classical painters are the real artists eh? Electric hammers aren't tools either I guess and big companies or builders won't see them as such either. Maybe we should all just quit this new Photoshop "fad" since it will kill jobs and be seen as a cheap replacement instead of a new skill or style. To be completely honest, while I enjoy new styles like this, or Pixar, or old-school Anime for that matter, I also appreciate Disney's style, but still I appreciate claymation. There is room for all of it and the new stuff that'll come after. If anything it'll encourage innovation. Can't keep doing the same old thing and expect it to be tops forever. Just today though I saw someone killing it hand shadow puppetry doing stuff I've never imagined possible.
Vampire Hunter D is one of my all time favorite works of animation. Specific artists created it. It's not "generic 90's anime" house style, as I see a lot of people in the comments saying. The designs are by Yoshitaka Amano, who is a world renowned artist whose work is instantly recognizable, and the animation was directed by Yutaka Minowa-- if people are praising the look of this AI generated style, I hope they realize that it has a specific source. If machine learning is going to be another tool in the pocket of artists, then the creative labor of artists can't be treated as a free resource. For instance, nowhere in the CC video is the original source material credited; Yoshitaka Amano and Yutaka Minowa are not listed under the "artists" section in the description. The modelers who made the 3D assets ARE credited, but not the animators and artists that pioneered the style and produced the *entire work* CC used to train the AI. Calling this work "Anime Rock Paper Scissors", rather than "Vampire Hunter D: Rock Paper Scissors!" or something similar, totally erases the origin of the material, and the subtitle of "Making Our Own Anime" is disingenuous on multiple levels. I remain excited for the possibilities of this new technology, I do think it'd be very cool to train an algorithm on an original style-sheet I made *myself* or by another *paid artist* hired for that purpose, but this right here is theft. It's fun to look at, and I appreciate deeply that there is a baseline level of artistry and film making craft necessary to create it at all-- but I feel like CC hasn't even followed their *own* cautionary advice about AI art and respect for intellectual property on this one. You haven't "democratizing the animation industry" by filing the serial numbers off of the work done by actual animators and repackaging it as your own merchandise. I think there's definitely a world where automated machine learning tools are used ethically to aid in the creation of original art rather than just digesting and reconstituting existing work, but that is not the precedent being set here.
They are literally no better than people using a picture for commercial purposes with "I found it on google so it's free to take, right?" So disappointing.
@@pyropulseIXXI no, no they literally wouldn't... That's the whole point. There is literally no difference in them using the ai or if one of them sits down for two years, studies the style and then hand animates every scene. They don't have to pay to "original" creator or have to give credit to him/them because you can't copyright a style/color/method only individual art works. Even better, the only way the original creator would have any legal stands for compensation would be if they used the title of his work in thier title because then they would imply that they have anything to do with that creator...
@@kilor78 I think the point is those of us studying hand animation already don’t like the idea of a machine talking our jobs. It’s salt in the wound that they learned off of our work without compensating us.
As impressive as this is, it's scary when you realize a lot of animation companies might take advantage of this and use it as an excuse to put a lot of people out of a job.
As an aspiring animator, I couldn't agree more. I love innovation, but not when it can completely substitute, or steal an entire group of individuals life skills. Especially one that still requires a lot of skill and understanding of art from even its basic forms. A.I. art and animation is a fascinating tool, but I feel it really increases peoples NEGATIVE perspective that art is just some push of the button or filter. As if it wasn't a real skill that requires years of training to acquire the talent to make everyone's favorite "funny cartoons."
Are you guys also upset that 95% of the population aren't farmers? Or does it only bother you when it's the thing that you invested time into has a productivity tool that allows others to participate?
Fun fact. Vampire Hunter D Bloodlust has over 180 people credited as members of the animation department. Just wanted to throw them some credit, since the whole conversation of democratizing this technology didn't make any mention of just how much work went into creating the original art this AI style was trained on for free.
AI bros usually wave off the negatives of AI, cuz if there are no issues, then the positives conveniently outweigh the negatives. "AI isn't gonna replace you guys, it's just a tool!" Like, mate, computers didn't do 90% of the writer's job just because the keys were different from the typewriter!
@@pringles_mcgee well then something like chat gpt was trained on tons of text. Suppose we'll have to give credit to the entire humanity for making a.i learn language, possible. Same argument. What i see with these a.i tools is that the market wont be as saturated. Great artists will be noticed more as a lot simply give up. Also theres always going to be some niche need for human made art its not the end of the world. Its just that art by hand will need to be in the top 1-5% of artists in the world to make a living.
@@Mrhellslayerz @Fr3k3 Look I don't know your guy's whole stance on this, but those are not a fair comparisons, something more comparable would be the automation of factories which effectively decreases the manpower needed for the same output, and although it may create new jobs, it probably won't be enough to replace all the jobs it displaces, some people will adapt and work these new jobs, some people will move on to other fields. And that isn't a bad thing, because in the end we're just increasing our productivity and quality of life, less time from our limited time alive needs to be spent on tasks that we can delegate to machines. For me that's a good thing! Now, what we'll do if eventually there's not enough jobs to go around, that's another discussion entirely, but as for the artists, they'll need to adapt and integrate the technology into their workflow to increase their output and remain competitive, because for fortunate and unfortunate reasons, this technology isn't going to stop existing. I for one, as a game developer who does art, am thrilled that I will get to take the ideas in my head and put them into the real world faster than ever before.
@@GabrielKoba The difference is that factory workers didn't dedicate decades of their life to learn how to work in the factory, it's like an hour of instructions how to do your step if even that. What's an artist who spent 30-40 years mastering their craft going to do when they're replaced by AI? And with everything getting replaced, where's everyone's going to go? There's not going to be enough jobs for everyone, so are people just gonna have to starve and die?
@@leetri That's true, but that's the closest comparison I could come up with. As I said, that's whole other discussion, but I do believe sometime in the future some kind of welfare system will have to be implemented to couteract these effects, how and when I'll leave to brighter minds than mine to figure out. What I really don't want is for the solution to this problem to be prohibition or extreme regulation of automation and AI, as in the end these technologies can be extremely beneficial to us, IF we can adapt accordingly, and to do that we can't face these issues with fearmongering. Remember that money is just a thing we made up, and we made it up to figure out who gets to have what, so if there are no more jobs there won't be any people with money to buy anything anymore so we'll have to figure out another way to decide who gets to have what, or simply give money away even to people who don't work, like a UBI, though I don't know how feasible that would be.
Rotoscoping has been around since the dawn of time; we've seen it from Bakshi's Lord of the Rings, through A Scanner Darkly and more. While the ability to convert oneself to a 'drawn' character is super cool, no ifs ands or buts, there's a world of difference between animation as a medium unto itself and then just having rotoscoped content.
@@TragicGFuelyou do understand how ai art works right? it goes through segregated images and copies patterns it notices and tries to fill those in the best it can through either preexisting images (like the ones seen here) or by making something “original”, and either way it’s stealing.
@@jico5147 patterns or art styles are not ownable materials. They're not under copyright. That's whu two people can draw an apple in the same art style and not sue each other. Also, your explanation of AI's working tells me you don't have a clue on how it works beyond the layman's explanation. Which explains why you think it's "stealing"
@@TragicGFuel no i know it’s stealing because i’ve seen real artists use it and explain how it works, this is literally how it works. it copies patterns it picks up from whatever it’s told to copy off of. i don’t think you understand how ai art normally works. in this case this artwork just takes art it sees, copies what it sees, and applies it to the frames of the footage, it’s how you get things like inconsistent designs and patterns. it’s literally just copying whats seen and outputting whatever it thinks is correct. i also never said anything about copyrighting art, though ai mystery meat cannot be copyrighted, while real art can.
I'm an artist studying animation and illustration. This is awesomely terrifying; I love it and at the same time it makes me feel scared. Not sure what the future will be like but god, media is changing forever.
This could actually save animation studios in the western world. I used to be an animator. animators haven't seen much of a raise in 20 years. They are the lowest paid department in all of film, which is why i moved into regular film work. They are paid a flat weekly rate, no mater how much over time they do, and it just isn't fair. everyone else in film gets paid tons of over time. There is NO JUSTIFICATION for why animators and CGI artists are being paid so low, especially when they require the most education. Then the pandemic came along and things only got SO MUCH worse, because now it has opened the doors to the possibility of hiring people who work from home, and now studios can hire animators from India and Indonesia who are willing to work for far less, driving down the incomes of artists in the west. THIS might be the solution that fixes all that. This could see animation studios return to the west. They don't need long hours, or large staffs and can finally work under the constraints given to them without outsourcing to asian studios. This might actually be a GOOD THING.
@@FablestoneSeriesyou think studios will use this as a reason to improve hours and rates? Bullshit. They will use this to pump out more content for less money. Executives will see huge profit but the situation for animators will not improve, if not worsen as their skills will no longer make them valable
The heart of the problems with this is the state of labor selling as an artist is extremely poor. LABOR SELLING ITSELF IS IN DISARRAY. There isnt any future for this tech that doesn’t displace entire classes of workers and to say thats for the greater good only condones the system of exploitation.
No, you changed the art direction of live action forever. The art of animation is as much about creating unique movement that can't be done in real life than it is about how it looks, and you can't recreate that by filming live action and putting a filter over it.
It's really like assisted rotoscoping, it'd be fine for a sequel to 'a scanner darkly' but it's far from an animation replacement, and insulting to think it's a replacement for the actual craft.
I think this is a good point. The process of live filming and conversion to an animated style is not equivalent to animation because the movement of the characters is restricted to what the real human actors can do. Animation, meanwhile, can do literally anything, unbound by the physical capabilities of real people. It's stylized live-action, not animation.
Thanks to this guys comment, I've now learned that everything I've ever seen in live action movies is 100% based in reality. I can't believe Henry Cavil can fly and shoot lazers out of his eyes. I always thought that was special effects and green screening. Who knew? Also, your comment is dumb.
Couldn't they relatively easily take the model they've made and apply it to some 3D skeletal animation to achieve anime movements? Just like they're physically acting things out they could take their body scans and animate them.
@@sirdinkus6537 wow someone who misses the point of the comment and the general fear of the devaluation of the vfx industry that's been going on for years
I think John Muir said something like "It's not blind opposition to progress, it's opposition to blind progress" You're not nearly as excited about this as studio execs and producers with their finger on the "lay off" trigger
Do you light your home with candles and get to work on a horse? If not, how DARE you put all those chandlers and ferriers out of business. You're an actual monster, jesus. /s
@@legolorian3271There is not even tracing in this, so calling it rotoscoping animation is even a stretch (as the artist has to make important decisions about form, weight and movement if you are going to make rotoscoping with any artistic merit.) this is "Anime" in the same way a Snapchat filter is anime. In the end, it isn't animation at all, but what they are good at: Video editing, VFX and post production. Calling it animation is extremely offensive to those who have dedicated their lives to the craft.
I like that this still required good filmmaking techniques. You guys did an incredible job seriously combining these tools to execute very interesting mimicry of anime.
@@andrewreynolds912 That's right, but in theory, a small animation studio can create a data set in a consistent style and feed the AI with them to learn. Now instead of ~60k drawings for a feature movie drawn on twos, they just do a thousand drawings, which significantly decreases costs. And at the end of the day, they can theoretize that they used only their own assets, creating what is a glorified video filter they can apply to live footage. It's not exactly animation, it's not exactly live filmmaking, it's just something new. Can be exciting when used correctly, probably will be abused and miusesd 100:1 :D
@@KennethJAdams That sounds awful. I would never want to watch a half baked film like that. I want hand crafted animation from passionate artists, not the median of their skills.
This seems really good for static, or easy to produce camera shots. But animation still has a leg up for complex sequences and crazy camera perspectives that you'd commonly see in fights/climactic events.
Remember how mediocre AI art generation was when it first came out...6 months ago? Yeah, if it's gotten this much better in like half a year, how long do you think the "jank" is gonna be around? A year or two more?
@@sirdinkus6537 Even if they get past that, there's only so many styles to go off of. How long until it all gets old and they run out of styles to use? And how long until laws regarding animation are put in place where AI art that is made to resemble a specific style without permission becomes illegal and artists will be able to file a lawsuit over? Just as it's a matter of time before Artists are put out of business, it's just a matter of time before we'll need them again, because as obsolete as they are becoming, it's a lot less hassle to just go for a real animator. Plus they'll probably be in higher demand like animators were a little while after CGI was introduced and started taking over.
@@Karma-ji6ud they chose this style, but as they said in the video there were so many other types of styles to base their ai to work around. that’s just as limitless and subject to boredom as hand animated cartoons. i don’t see this as a way to entirely replace hand drawn work, but to complement as style evolves with it. whether you like it or not i don’t see this ever leaving the industry now that it has entered
@@sirdinkus6537 I think the jank will be for a while now. I draw but I also use AI a lot, I can say that the growth of the tech is not necessarily exponential, it has already hit a pretty hard ceiling and only minor improvements are being made at this point. But yes in a few years it will probably be able to do a lot more and with far more complexity. Will take a while though, don't expect it to be as fast as those last 6 months were.
@@andrewreynolds912 just like artists use other artists works to make their own art which is in turn used by even more artists to make their art and it goes on and on and on
A lot of this shit will be straight up illegal in 5 years. Japan is not going to allow their largest cultural export industry to be fucked up by morons with AI licenses. This will be made a serious crime in japan long, long before they allow a single domestic anime to be made with it.
Well I feel that but what they did was just A. I rotoscope animation where you trace over film a popular technique Disney used and invented, most of the stuff that makes it look good are techniques developed by anime artists. If A. I becomes an industry tool there will be copyright put in place so only certain works can be used by certain people at least that's what we all hope for but the thing is if everyone stopped making art these A. I imitations have nothing to pull from and now one to prevent stuff from becoming boring or static, so don't give up because things look impossible see through the illusion of things abd persevere we need to make A. I our tool not our replacement.
Can I offer you some encouragement? Be yourself, no substitutions, every line, stroke, whatever medium you wanna work in. Bring yourself into everything you make. Love doing it. This video wasn't made with care, it was obscenely executed with stock anime effects thrown on top. The background is blocky and aimless. Comparing yourself to something like this is self-sabatoge. This is a tech demo.
Part of what gave Ren and Stimpy its signature psychological style was that the pilot was given to 3 different studios to draw. Despite having the same animation guide, 3 different interpretations were made, so from scene to scene the style changes, showing the inconsistency in Ren's brain.
i think i read that they never wanted the same style shown, always a different one ... i loved that show growing up and drew ren and stimpy all the time... i miss that classic show
Depends really. When mechanical looms became widespread, weaving as a profession pretty much died out within a few generations. There are a few small brick and mortar stores that have been around for hundreds of years that still do it, but the vast majority of cloth for things like clothing, bags, backpacks, tents, ect are now all manufactured by large factory machines. I sadly suspect it will become something similar for AI art. There will always be a market for hand drawn and hand made goods, but it'll probably become more niche as time goes by. Meanwhile graphic design, especially those for and by large companies, is almost assuredly going to move to all AI sooner or later
HAHAHAHA! It is amazing how fellow artists have no imaginations. Can you not project 5 years into the future? I invite artists to get off the internet and sit by themselves. Conjecture and imagine how corporations, consumers, and creators fit into this puzzle. This technology WILL replace artists.
@@sparklingwiz2459 it won't replace artist, it will enhance artists... Just like the camera didn't replace artists at the time of its creation in 1800s... Or how not everyone became a visual designer just because Photoshop was released to the public... Or how having a high quality camera on your pocket doesn't make you a professional photographer... Technology's not on the level to replace humans, yet. As you see in this video, they had to do countless tests to make it work right, and still it didn't work perfectly, so they had to work over it to create a expected result... It's not like you could get this same result just with 1 click, you still need experience, you still need the knowledge to make it look how you want...
This has made me consider copyrighting in a creative way I hadn't thought about before. If AI copying a style from human works becomes the norm, I'm worried new animator styles won't have a chance to develop because studios would rather not pay for staff. One of the things I love about anime is when you see a key animators style pop that sometimes doesn't even match what was the norm for the show. I'm thinking of that episode of samurai champloo where Mugen gets super high. While I see this tech could help a vision get made, it does so by copying previous works for the style. I'm worried of the long term implications of that, since we may see less new creative styles.
Honestly I think this new tech actually does the opposite. Is usually easier to stick to the same artstyle then it is to not only create a new one but to teach an entire team of dozens or hundreds of people a new one. With AI tools in the future, you'll not only be able to easily switch between artstyles, you will also be able to mix countless different artstyles. It is like the difference between being limited to the paint dye that you could locally source pre-industrial revolution, to having access to every color imaginable in the digital age. You can create a pretty much limitless number of artstyles by combining old artstyles. But on top of that it is easier to incorporate new artstyles since you only need to draw a few examples, and it can be learned and applied by the AI pretty quickly. Its easier for corporations to justify being ambitions, when it becomes cheaper/less time consuming to do so. It's also important to remember that new artstyles that people creates are effectively combinations of existing artstyles anyway. There isn't really anything new under the sun, just creative ways of combining the same elements.
Very clever point, this could mean that we’ll not have an emersion of new styles and works of pure creativity. Not gonna lie we better regulate the shit out of this tech.
When you have to do something badly for so long to be able to do it well, this alternative says why bother? It's a discouraging obstacle to new artists
Feature extraction should be a criminal offence, the rich like this shouldn't be using feature extractors to steal from poor and ethnic/minority artisans. It's basically technological classism, or rather fascism with a touch of ruthless social darwinism.
This is 100% the type of thing I would have tried to do in film school. I absolutely love genre-bending multimedia filmmaking techniques, like Cloverfield's found-footage meets big budget sci-fi horror, or basically everything Linklater's been doing for like 25 years. Bravo, guys.
In the time it would take for a team to animate this, A.I. would have evolved to a point where it would be better than the animation done by the team. Seriously, A.I. art has been only been out for the public? 4-6 months? & we have already gotten to a point where we are already making A.I. animated videos in less than half the time of the actual teams creating videos without A.I. with less than half the crew.
I mean ... That's life, innovation will always happen and further what we do and how we go about doing it. Art isn't the first profession to which this happened to nor will it be the last.
Don’t be scared of it. Learn to use it. Their will always be animators but their responsibilities will be different depending the available technology. Hand drawn artist were afraid of computers replacing them. The only artist replaced were ones who didn’t know how to use the new tools (computer)
Hand drawn animation is the purest incarnate of the discipline. It will make you leagues more skilled and useful than people who pass it up to fumble with 3d models or whatever the workflow/learning process will be with this AI nonsense solely. It will never not be impressive to see someone sit with a pencil and sketchpad and limn something out accurately.
It should feel empowering. Right now they're using this tech to emulate old anime and make cool things from it. Think of learning animation. Now think that instead of needing to join some big studio and work on some director's projects for DECADES before you have the skills and clout to direct your own series (at which point you'll hardly be doing any of the actual animation, at beast some storyboarding and keyframing and approving concept art) you can instead be your own studio. Use the AI to help you develop a cast of characters, train it on your characters, your settings, and your environments. Turn that tool into an entire animation studio at your fingertips. Now you don't need to work for a studio. You can just make what you want. Now of course, will get you get paid? That's on you and whether others want to pay for what you make. So if you want a JOB, then you'll need to anticipate getting a job training the tools for some big studio.
Mates I studied CG 204 years ago and you bring me back those feelings, In my life i had to switch my sector from graphic designn to gastronomy, but I truly appreciete and feel your joy in this process.
As cool as this is, I hate what it spells for the future of animation. Large coorporations are absolutely going to use this to forgo paying actual artists, and imo that's just sad.
they have to invest in improving the software and avoiding litigation by hiring artists to produce datasets for models,, i do get your point tho, and it is sad to see the value of creatives decline, but that's just the wrld we live in now...
@@pyropulseIXXI You ever drawn anything? Or met an artist? The majority of people dont do stuff from scratch, they have styles that they like and try to emulate. Crying that it uses actual art to get results is ridiculous when human artists do the exact same thing
@@tristanhudkins5186 I draw for a living. The difference is I am not a machine that looks at ~6 billion images and then interpolates them into effortlessly created generations that competes with anyone on Earth for free with a little tweaking and actually respect the artists ability to live who I'm inspired by. Now the real question is, do you draw, or do you just think you can speak for us?
@@Xxxwwwwx This isn't a 'professional level'. What you're actually witnessing is a 'bottle film' style animation that is extremely messy animation/art wise, that has suspect art direction. I'm also not sure if smaller companies benefit greatly from this. You essentially swapped out an animation crew, for a VFX and live action and film crew(because people seem to forget that there's a bunch of actors involved, film crew, and that these people have multiple years worth of film and VFX experience). At least your animation crew aren't unionised and are paid less. There are also numerous ways to 'cheat' in animation to cut costs. It's not actually that hard to create a piece of animation that's 7 minutes set in a single location com[posed of mostly dialogue. It just wouldn't have the sweeping camera angles this uses so much, or rather, they wouldn't look as dynamic IF you only used 2D. But even then....I can think of ways...
18:15 The candles should be moving through the shot in the other direction, if you want it to look like the camera is orbiting around Nico's character. The background is moving right to left, which means that the foreground should be moving left to right, in the opposite direction. The way it is, it makes it look like the camera is dollying to the right, with Nico's character flying along with the camera through the room.
The reason we record dialogue first. Is so the animators can draw lip sync to the sounds. And helps with timing our shots. I guess now you can time your motion and action to the dialogue tracks. Sometimes the audio can inspire certain actions
@@mikeglasswell-gameplay I'm pretty sure as I played Destroy All Humans 2 - Reproded, I noticed the first time in years a lip synced audio for German, I think that must have been the first time ever I saw that. I'm almost certain Unreal Engine either has a tool for that or there is a middleware that now syncs lip movements to the lines spoken, it was too perfect and I'm almost sure they didn't do facial performance capture for every other language!....
@@Quast there are some lip sync generators in animation software we have used a couple. For 3d software it's easier as the mouth shape can be easier to manipulate. 2d Hand drawn mouth shapes are different. And you have to listen to the audio and draw the right shape for the sound. In Anime they like to save time and cash, so they will usually dub after the animation is done. The animator would animator just some open and closed mouth shapes. Hard consonants or hard vowels.
@@mikeglasswell-gameplay I'd certainly prefer if the audio still gets recorded in a studio and not during a performance capture, I really don't need the 100% respiratory rhythm of an exhausted human during a full body performance capture - that's where I wanted to go with this. :p
Very small correction but actually in the Asian (japanese, korean, chinese, etc) animation industry, the voice recording is part of the post production, when the animation is finished. However in western animation, they do the voices before the animation.
If you're talkin about 6:37 all they said was a cartoon and they are Western why would you correct them about Asian animation when they didn't mention it? As westerners who are familiar in Western animation why would they be talking about Asian animation without mentioning it?
That's like correcting a western chef on Asian cooking methods when what they're making looks vaguely like an Asian dish but it's a European dish made by Europeans in Europe just because they said they like Japanese food once
I think it's a gray area... There's a lot to be great use for Ai mainly in the health and medical industry however for the Arts and Entertainment Industries that's where the gray comes in. I can see where it can be useful however I completely validate the fact that people mainly artist will feel competitive with AI and might not beat that competitor. Studios and Hollywood in general is about making money and seeing how The Writers Guild Strike is going and people wanting more proper pay, I can see Ai being the cheap alternative and since it's new many people will go to it. So I validate the fear and nervousness for artists going against AI and it upsets me that with such a useful tool that can be used for again Health and Medical purposes it's now becoming a trend used popularly for social media and dipping into the Art and Entertainment Industry.
I'm so glad we've automated art into a uniform sludge that is indistinguishable from the next. Now we can have more time for our 9-5 and keep the slog of creativity out of our lives! :) /s
Yeah, i watched the John Oliver video about AI tech and when they showed how AI is currently used to detect subtle changes in a human's voice that is proven to be an early symptom for Parkinson's disease and dementia, i thought - yeah. That's where we should strive to apply AI to. Not this. One appliance of AI could potentially save thousands , if not millions of people, the other appliance shown here devalues ( or inevitably will lead to this ) any great art style and achievement by turning it into a readily available art "crutch" that most of the time limits the actual creativity and personal growth that happens during the process.
The automation happening here is the exact same as he been happening for the past several hundred years with every other industry. Your problem isn't with AI or CC, it's with capitalism. All you're doing here is looking for a scapegoat to direct your anger at, and shitting on a bunch of computer nerds is just convenient for you.
Not to mention a lot of 2D animation has been using 3D to help them create 3D moves in 2D space more easily. Quite literally using 3D in their production. Shoot, even comics make use of 3D to graybox out cities/backgrounds so they can paint over them.
I like this conceptually, but I hate what it will most likely inevitably mean for proper animators. I'm worried traditional animation will become an indie only thing kind of like certain game genres. Unfortunately, Pandora's Box has been opened and there's no putting the lid back on this one.
I just hope AI art will die out like a trend It's so annoying that they keep screaming their new stealing tools and these kids who have 0 skill rooting for these ppl
@@grandmastalin7796 It won't. As technology progresses, Lots of jobs are going extinct and HAVE gone extinct. Although it is hard to process seeing the extinction of many people's livelihoods, There also aren't any ways to prevent it. So long as Human society develops, Progressions in technology such as AI is inevitable.
the idea that they just "ripped off" vampire hunter d's style just leaves a bad taste in my mouth not sure if im alone in this. I dont have any issues with the unreal church backdrop that was paid for. I wish they would have paid an artist to create a style for the training data. (even if it is inspired by VHD the person would still do a self rendition.) im pretty sure they didnt get any permission by the creators of VHD to use that dataset. i am afraid that it will legitimize this way of working as it is already a big issue. as artists themselves they should be a bit more aware of this.
Don't let anyone get you guys down! You dudes down at corridor are awesome! Keep pushing the envelope an discovering/normalizing new game changing tools/methods for all creators alike, As well as making the best content!
Great stuff! now let's see every single animator guest youve had throughout the history of the channel watch this and have their say on this "democratizing art" nonsense
You all act like artist don't take inspiration from other artist and mediums yet I haven't heard the outcry on that, be fair here, this just shows that a deffrent way of animation has been made, just like when 3D came out, the industry said it would cause hell but here we are, moat big studios abandoned 2D, yet here we are...why isn't a call for those many artist who lost their jobs when 3D is been used
@@godovamoviereviewsandmore6531 Because taking inspiration and still putting in the effort and skill is different. If Corridor hand-animated or even cell-animated inspired by another style then it'd be ok. Instead they literally downloaded what they were "inspired by" and then turned green screened videos into that exploiting the work of another artist
@@godovamoviereviewsandmore6531 because animation implies ANIMATING. Even with motion capture 3-d, they still touch up animations by hand. 3D replaced 2D jobs and it sucked, but people got over it because it was just a new medium to animate. This isn't animating. This is applying a filter to appear as animation, off the backs of artists who got their art scrapped. Or in this case, an anime that was taken to "mimic".
@@godovamoviereviewsandmore6531 a man made creation will always have more soul and love put into it then a bunch of lines of code programmed to steal and to copy form other people
The automation happening here is the exact same as he been happening for the past several hundred years with every other industry. Your problem isn't with AI or CC, it's with capitalism. All you're doing here is looking for a scapegoat to direct your anger at, and shitting on a bunch of computer nerds is just convenient for you.
My university Final Year Film Project in 2009 was a 15-minute short film with a visual style derived from the rotoscoped look of A Scanner Darkly. I shot it live over 4-days and spent the next 4 months in the editing suite converting every single frame in Photoshop before exporting into Premiere 2.0 5-6 days a week, for 15+ hours a day. It's amazing to see how far we've come in producing the very same look using technology
I was just thinking about Scanner Darkly and the work that went into it. I suspect ten years from now Anime/Pixar movies will be filmed just like Avatar. I think we are seeing a change in motion picture technology with AI similar to the CGI boom in the 1990s. Video Games as well. I predict Animation will all be AI rotoscoped motion capture.
It's funny how all the bird people are complaining about the AI conversion tech, but seem to have completely forgotten about automated rotoscoping. I could only imagine what kind of films Ralph Bakshi could have made back in his prime with today's technology.
I know there are a lot of other comments here that start with “as an animator…” but As an animator, the whole speech about “democratizing animation” is at the very least, inaccurate. You don’t need a big studio to make something cool, all you need are the knowledge and skills required and an iPad with any drawing/animation program. Animation is a learned skill like riding a bike or playing guitar. If you learn the skills, all you have to do is put aside the time to create your vision, No art theft required! I just hope this gets used as another tool for animators rather than (like this video implied) a full replacement for us.
There's a level of objectivity to art determined on the basis of the highest common standard set in any field. Consider playing a guitar, you could play the guitar like an absolute amateur chortling and clanging away on the strings but everyone knows that doesn't make you a "guitarist". You could recreate motion on a surface but doesn't make you an animator without a certain qualifying standard having been achieved. Art has a harmonious form to it, if you cannot achieve it then you aren't creating Art, you're merely churning out garbled permutations of information.
The problem of turning live action cosplayers into cartoons is gravity. And human acting is usually less expressive than what professional animators achieve. For super Saiyan over the top expressions that will not be evident, but when it is time to drama and showing emotions, the differences are noticeable. AI allows very generic improvements. AI may defeat amateur mediocre works, but it is not yet ready to match the work of pros. You can tell when you watch Arcane. 80% of the messages conveyed in Arcane are in the face expressions and body language that allows a message without words.
They call the facial animation in Arcane "micro expressions". That shit was all done by hand. BY HAND MAN. I could hardly believe it; it took the studio YEARS. And I agree with you, the level of detail in the animation turned the cartoon characters into actors. That "life" was breathed into them by the skilled artists behind the animation. I don't think the mimicry of AI tools is going to replace that.
AI produces generic imperfect solutions. AI always is better than amateurs in every field, but it cannot replace pros in their field. AI can be a great aid as a content remixers to generate remixed ideas, but AI cannot create or improvise. If you teach AI to draw squares, it will only be able to draw squares. If you teach Van Gogh, it will be able to remix Van Gogh squares, which may look original for the casual eye, but it is a remix. For decision makers, AI is a tool to produce bar charts. If you would not use a bar chart to solve a problem, do not use AI. The great problem for AI decision making is that AI may underperform with corner cases. The non Van Gogh non square case. Corner cases add false positives and false negatives, and for decision making that is terrible, and real world is full of corner cases. So if you were told AI could replace people, I would say using AI could make decision makers be fired. I have found terrible glitches with AI. chatGPT for example. It told me about a Battletech battle that did not exist in the described year, in a castle with the name of a planet, located in a planet that is placed elsewhere. Terrible lore inaccirate error. It also cited sources with chapters that did not exist inside these sourcebooks. And I have known about a farmer who asked questions and got wrong data. if you asked AI to code in Visual Basic, it confused image and picture controls, creating inconsistent incompatible code that would not run. So AI can write s simple piece of code correctly, but it is still like that drunk friend who sometimes say things that make sense, but some other times, he has cantina existential chatter, finding pink elephants where there are none.. For art, AI has not learned the rules of art, so eyes may point in the wrong direction, for example. It has not learned to overcome the uncanny valley problem. That is a problem that is difficult, even for experienced artists. Using AI to convert people into cartoons brings a physics problem. Action sequences and character faces would be restricted by the talent of the actor and the contraptions used on an actor.
Imagine a small studio only having to hand-animate the over-the-top parts, rather than the whole thing. It's the mixing of the mediums where I think you'll find the true art -- no longer tied down by major corporations and millions of dollars of funding, but not tied to computer-generated ai-art either.
I think AI can lay the groundworks but for the details it would still require manual intervention and improvement. It would still lighten the workload by a fuckton
This is insane! It’s so cool to see how everyone’s projects over the past few months, like Sam’s Unreal Engine work and Dean’s AI animation work, are able to come together to create an amazing product like this. Bravo to you guys!
It's not though. They literally showed you everything they had to do to get this working, and it's nothing like a filter or rotoscoping. They showed what happens if you don't specifically train a model for the specific project you're doing and just try to let the AI interpret each frame without it.
I recognize that this is an evolution of the medium using technology, akin to how Pixar leapfrogged digital animation,but it does put into question how the art form of making anime or cartoons is lost. In terms of commercialization and mass production of animated output is concerned, this will be an effective tool. But it does add another knife on the back of an already heavily injured art form. IMHO But cool tech😊
Anime’s first appeal for me has always been the impossible camera angles. Like in the Animatrix when the camera follows the bullet through the headshot hole and out the back. It may take longer to implement since this style will be using a real camera, in time this style will probably mesh with cgi for these more difficult shots though.
@@sassythesasquatch1794 The background is an asset from the Unreal Store that was given a pass by their AI. You could quite easily do a CG bullet hole, then do a pass with the anime filter. Could also have an animator animate it and place it into the shot.
As a professional animator, for what it's worth, I find this really exciting... This makes me feel like so many more personal projects are within reach now, where before, the time constraints of animation as a medium made achieving all of my dream projects insurmountable. What a cool tool to have available and play around with, especially if you're training it on your own work samples
training it on your own art seems really interesting and something that can actually be called a tool. This is one take on ai art that isn’t negative I can get behind. Now their are many logistical leaps and hoping that users will be moral and won’t steal but promising none the less. Artists will always have the best takes when it comes to art. Thats just a rule.
@@Data-Expungeded I kind of see it how sampling has spread around the music industry. Unauthorized sampling still goes on, but its really tools that artists have chosen to use that have developed more recently from bottom up that's created more solutions. For example, things like splice, or producers trading and selling loop packs. Even platforms such as tracklib that provide pre-cleared samples. You're right when saying artists will have the best takes solving these problems. I can see something similar being used to smooth out unauthorized "sampling" in this field.
@@YatsuRL Lol Adobe should start by making their existing features actually work and run in a stable fashion. Almost everyone i have spoken to who has switched from Adobe to Resolve has done so because they were sick of having projects interrupted by showstopping bugs.
dont let it be. just phase it into your workflow and combine it with your skill that you already have. Imagine what actual animator could create with this tech.
@@mak00ileven Yeah, it would remove 90% of annoyingness because you can just make a single character sheet and then have that character do any sort of action in a reasonable amount of time. Only needing to work on very specific things yourself.
I am studying animation for a few years now, and I think the finalised version of this will enable a lot of small studios and creators a chance to make their own unique story, without needing to draw nearly 1400 frames for just one minute. I am ecstatic to see the finalised product.
@@mak00ileven Wishful thinking. An actual animator could do a lot with this tech, it could also completely obliterate a lot of their jobs, day rates, and overall salaries as it becomes much easier to execute. Simple economics "Markets with low entry barriers have many players and thus low profit margins.". The industry is already a race to the bottom, trust me, I've worked in it.
People making fun if this didnt watch the video, they designed the set in 3d, they recorded it live action, they wrote, they directed, they did voice acting, they edited everything together. The ai is basically just an animation filter at this point. Yall acting like they just prompted an ai with "make rock paper scissors anime" and posted whatever it spit out
First off, this video is very well made. There was a lot of artistic talent put into the production that cannot go understated. You set out to make something that was reminiscent of a “90’s anime style”, which they did. To call this animation however is disingenuous. You used an algorithm to rotoscope their video for them, after scalping art from Vampire D Hunter. You also did not credit the director Yoshiaki Kawajiri, the art director Yuji Ikehata or any other artists from VDH in the video. Second, saying the phrase “democratizing art” is like saying we’re “democratizing speaking” or “democratizing writing.” Anyone can create art; it isn’t some talent you’re born with that “non-artists” don’t have. Just like anything else, it’s a skill you need to build. This video is proof that the phrase is nonsensical, it took thousands of hours of collective skill to operate the software you used to make it! You are not “democratizing art”. At worst you’re only making it easier for cheapskate companies to try and make quick, unethical, and cheap content. Studios have already been laying workers off, overworking and underpaying their animators, and all the while making worse productions because of it. With how much reverence you gave the animation medium overall I’m annoyed at your choice of words and misplaced positivity in the phrase, “Did we just change Animation forever?” At best this is a useful tool for achieving a unique stylized film. If you created your own assets and references, instead of ripping off existing work, I can see the use of this as valid. Again, fantastic work, I enjoy your guys’ videos but please don’t claim this is some sort of boon to artists or that it’s the next step in animation or that it’s going to make creating anything you want easier. That kind of talk only adds to the idea that animation is a lesser form of art and film.
I just cannot get over how good the shot at 5:41 is. The orange light on one side, blue light on the other, the incredible focus on the facial detail. It looks amazing, it’s great to see talented artists use AI to evolve their workflow rather than substituting it for everything
What I can't get over is when Nikko claimed they were doing the right thing by making information free to everyone... then put it behind a paywall sub on their website. Scummy as hell.
This was the most awesome thing I've seen in forever but the most terrifying thing is the amount of animators who are already underpaid in the anime industry who will lose their livelihoods if they don't get ahead of this AI animation / art curve.
An artist should be always evolving and learning new skills, the elements that break every few seconds are the part that tell me there's still a ways to go before hand animators are completely pushed out. It could even be seen as an opportunity for individual animators to break out on their own terms own much like with 3D animation. This could be an absolute bone grinder for a feature film workflow by a large studio to do and maintain big budget quality, but it would be great boost for a _small_ team.
Unfortunately there's no getting ahead of it, there will always be a handful of artist used for corrections/cleanup but the days of full production crews will slowly go away. This is a studios/producers dream
@@jammygamer8961 yup. Corridor is literally promoting automating themselves out of a job. But they don’t care, they have their subscription service. As long as they don’t get hurt by this they’re fine, fuck other artists. AI art just makes me lose respect for you.
Wow, what an incredible video! The advancements and innovations you've showcased here are mind-blowing. It really feels like we're witnessing a revolutionary shift in the world of animation. The potential and possibilities are limitless, and I can't wait to see how this changes the industry. Amazing work, and thank you for pushing the boundaries of what's possible in animation! 🌟🚀🎨
I've done a few animated videos using Ebsynth with filmed footage and manually drawing keyframes with other artists. After watching this idk if its actually more work, I guess if you aren't an artist it is, but from my experience with that workflow you get a lot more consistency. I could see maybe a workflow where you did something like whats in this video for the rough draft of the scene and then had actual artists with ebsynth keyframe details like the faces so they don't lose consistency. I think what you guys did with this video is really cool, but it's also very obvious it was done with AI, even though it is really well done. I think this video touches a little bit on the "using AI as a tool" but it genuinely would have been a much more interesting video if you actually brought in a couple of artists to create a unique data set to train instead of just training off an existing film. That sorta dives headfirst in to the whole issue lots of people have with AI generation being considered "art theft" whether people agree on it or not. Yes as an individual it would be a ton of work to draw a whole set of animation data to train off of, but it also gives the work its own artistry and creative vision, which ultimately I think is what people appreciate the most about the finished product over the process and tools (granted maybe not on this channel, since its all about process and tools here). Either way interesting video on how you went about trying to solve all those problems. I just would have loved to see this where you actually brought in some artist friends to guide the style and vision instead of just ripping an existing anime.
If you want an exaggerated anime style, Ebsynth is probably not going to be very helpful, because it doesn't do well with altered proportions. It just follows the movement of the input video.
I feel like if your criticism is that it feels like "too much ai" and your solution is to "bring in more human artists" then you missed the point of why this tool is useful . Also the solution is a little self serving
This approach does seem like a prime opportunity for the likes of concept artists, background artists, etc. Even if the AI dominates the animation, the program still needs data to work with; so hiring a select team to craft the visual style of a given project (instead of just telling the AI to "copy X/Y show") would be the ideal strategy for projects going forward. I also see cleanup artists being an important position; there's still lots of jank in the individual frames (check out the eyes and hands in particular), so having artists on hand for "post-render" editing will improve the final product that much more - at least until the AI gets better at those details, I guess.
How about using motion capture suit and face capture to get realistic movements, put that in 3D model, then run it trough AI to get base frame and then artists have frame work to alter how they choose, so lots of it has been done already but fine details and fixes to AI crapping out can be fixed by human to get best result. Given anyone can do the motions based on what original artist drew and imagined. Hell one could 3D animate this and then run it trough the AI to least improve the shitty 3D animations. From 2D to 3D to back 2D via AI and human finalizing might be the best possible result one can hope for smaller budget artists that havent had chance to get their own animation series.
@@michaelmarshall8041 Corridor is made up of artists i think they were talking about getting like a 2D aminator to guide the process they really arent hard to find and jobs are needed. there was too much ai in the animation side of things but that was just bc this was a proof of concept
I'm not 100% sure this would work if noise pattern moves it's position, but here is another idea. Let's say you have 2 frames from original video, VideoA and VideoB. 1. You generate noise on VideoA (NoiseA) 2. You use motion vectors generator (like the ones from Nuke) 3. You move the noise based on motion vectors but fill the blank pixels (where no pixels came in from vectors) with VideoB noise (new noise) 4. Repeat... The idea behind this is that you have patches of noise moving around with your subject from motion vectors. The only issue I see if the stable diffusion is not only dependent on noise pattern but also posistion causing it to generate a completly new image
Video motion vectors aren't very good, it's basically just fixed blocks and diamond search, so it's either very coarse or very unstable, but there is a good way to propagate image information alongside apparent motion. The keyword you're looking for is optical flow, and the tool you may be looking for is the now-classic EbSynth. You just need to replace one target image with noise or whatever pattern you want to propagate; and then after it's done you'll notice some blank or distorted areas, and you put another image into the example set and fill the bad areas in, and usually just about any shot of reasonable length shouldn't take more than 3 examples to fully resolve. This tool is based on paper "Stylizing video by example" by Jamriska et al, it's edge mask enhanced motion flow. You could by all reason automate this fully, but this might cause issues of its own, since it doesn't really do disocclusion tracking, edge mask kind of stands in for that but it's pretty ambiguous.
With controlnet (extension for stable diffussion) you could maybe use depth, pose and normal maps to create even more consistent frames. You could pull the depth, pose and normal data from your original footage to use during generation. Would love to see this idea experiment with further.
I was going to say the same thing but my guess is when they were working on this controlnet wasn't even available yet. Especially now that you can stack multiple controlnets along with other extensions like pose editors they can really get deep in the weeds. But high-level the concepts what they have presented here showcases what is possible and it's all just accelerating at a breakneck pace.
ControlNet came out a few weeks ago and they started this project months ago. This tech is moving so fast. The next one they make will look completely different to this.
@@KeyTryer But this can be used as a foundation for that. Unlike 2 months ago where the idea was made from scratch, now they only need to improve it. It's easier to do something when you have a working guide.
Gah!😵 That moment when he says, "I really want to create cool things... But the only way I can create really cool things, is with the help of other people, helping make the technology to create those cool things." I'm like... dude, have you ever heard of growth and effort? You do realize that Walt Disney made really cool things... even though he had to work from the ground up, right? For that matter, he made really cool things, even though he didn't have the convenient digital techniques that are used for traditional animation today. Pardon my saying so, but the animation industry IS democratized. The definition of democratized is to "make (something) accessible to everyone." Anyone can choose to strive for excellency in animation. (And plenty of people start their own small companies and publish their work on streaming platforms. Additionally, some animators release their own content on RUclips. If you want to make entertaining art, you can.) Animation is a craft. You have to work at it, just like with any other skill. If people aren't willing to build the skills required to make a film worth seeing... that's on them.🤨 AI art is going to be bad for the future of Animation, and the future of creativity in general. Instantaneous gratification discourages humans from striving to learn for themselves. And for that matter it breeds contemptible laziness and entitlement.😑 AI art does nothing but flood an already saturated market with "no sweat" content. This will make it difficult for actual artists to get paying jobs in the craft of their choice. Making humans obsolete, and flooding movie theaters, Amazon Prime, and Netflix, with quick uninspiring projects will just make it harder for veiwers to find things actually worth watching. A five year olds drawing has more value in my eyes than any AI art peice that exists today. This is because the five year old had to grip their crayon, and try to capture their thoughts on paper. The human element is what makes art worthwhile. Remove that, and what's the point?🤔 Now you might say, "Hey! They had to film all the shots! They wrote and recorded the dialog themselves! They tinkered with the process until the AI suited their needs! Doesn't that count as the human element? Isn't it enough that a human came up with the concept and refined an AI software to execute it?" My response to that is, anyone and EVERYONE has ideas... The difference between a real craftsman and a idle daydreamer, is the will to work and dedicate actual time to something.✍️ For that matter, another difference between the two, is the willingness of the craftsman to fail again and again as he tries to acheive his artistic goal.💔❤️🔥 You heard the guy in the video. He said, "It's your ideas that matter. It's your direction, your story. Because the AI takes it the rest the way. I love it. It's such an awesome way to work." This guy loves, that he's found a way to eliminate the need to work at art and animation. He may be working on perfecting the AI approach to animation... but in the end, he's doing it all in order to make a HUGE shortcut. This isn't just a digital tool that helps animators to work quickly and efficiently... This is an AI tool, that eliminates the need for animators to well, animate at all.🤨 These guys are not doing future generations any favors. As a kid, I always tried to find shortcuts to everything... I loved art, and wanted to draw... but often found myself wishing that I didn't have to practice. I wished that the image in my mind would just magically apear on the page in front of me. In years to come, when kids get a creative urge... they'll turn to AI. The AI will learn and create, and our children will stagnate in ease. (Also, you don't own the movie "Vampire Hunter D: Bloodlust", so it's literally theft for you to take images from that specific movie, and let your AI mimic them. If you want to make an anime with AI, you should at least learn to draw, and apply your skills by creating all of the references that your AI will need in order to operate. At least you'll have the hard-earned skills of a concept artist, if not the skills of an animator.)
Yes, I'm sure you yourself never gained inspiration for an art style. Never thought a drawing or a melody could work well in a different context. That is literally what AI is doing, finding patterns in designs its given and applying them in a different, unique, context. It is doing the job of that is done by every single artist (because styles and inspiration don't come out of thin air), just better than someone like you ever could. So stop crying about it.
basically it's AI rotoscoping, which is cool and an amazing experiment but I think hiring artists to do rotoscoping would be more consistent and less janky
@@ShadeMeadows If using AI is unethical then using any computer for anything, in fact any man-made tool is unethical, because it's not really done by a person themselves, now is it??
@@sheyanjen3382 Animation is the process of creating the illusion of movement through sequential photographs. It's still animated therefore animation lol.
@@sheyanjen3382 Brilliant argument. My entire perspective is invalid because nobody knows what animation is except you thus I must have googled it and somehow that makes me wrong you special unique irreplaceable artist. I have never once animated, I am certainly no artist. My art isn't my secondary form of income. I have never made art for prominent youtubers, athletes, companies, and music talents before. Never. Congrats you one in a million happy little accident.
It's not tho. Just like mocap didn't render people out work. The biggest problem is that ai cannot express with using the principles of animation, as these are movements that we do not really make in real life, but are the essence of animation.
@@cobensalazar5492 what they meant is that the type of "animation" these guys did can only do so much before it gets to the point it is impossible to do in real life. So thankfully, it might not fully replace animation.
First when rotoscoping was invented people complained it was not real animation and sullied the art. I disagreed, how ever using a computer and algorithms to produce rotoscoping is.
I don’t think corridor has really automated ‘animation’ here, because I don’t see that the tech can integrate a lot of animation techniques like squash and stretch, creative use of timing and anticipation, or otherwise going off model to generate movement. What they have actually done is create/automate a kind of rotoscoping technique. This is still interesting, rotoscoping is used in some anime! But I don’t think this replaces what we get out of hand-animation. But the problem is that it might, and we may lose a lot of hand animation because companies will no longer pay animators for their work.
Very true, this is animation done by people who know nothing of animation and it shows. Exaggeration is one of the fundamental rules of animation and live-action doesn't allow for much of it. I don't think people want just live-action with a filter on it lol
Not even that. With rotoscoping, you can do whatever you want with the overlay drawing. You're just using the frame and pose as a reference. With this, you're just getting a stylized version of what you put in. It's basically applying a photoshop filter over every still frame... Something anyone could do if they were bored enough and had enough time.
@@mythrin Look at the random stray strands of hair that magically pop in and out of existence throughout the _finished_ product. The inconsistency of the in between frames makes for janky animation. It's literally just applying a filter of a specific art style, and an inconsistent one at that.
@@Zac_Frost For the final product to reach this point, a lot of touching up (by humans) had to be done by the team. You can take this two ways: that AI technology is still in its infancy and can’t replace the quality of real animators, or digital artists are in the process of learning how to implement AI to make their work better and easier. Its nowhere near being just a photoshop filter. Those filters run on fixed algorithms programmed by humans, while this technique uses AI to flexibly generate new stylized images based on *machine learning*. That’s the significant difference. The technology is in its infancy and writing it off as unimpressive and pointless is naïve, you wouldn’t say that about the first computers or televisions would you.
I think some people in the comments section praise this AI too high and do not understand the advantages of animation. No matter how rapidly AI develops, it may seem absurd to want to replace or eliminate the animation industry. However, it can indeed help ordinary people achieve some ideas, but the problem is to obtain permission from the original production team by using animation materials?
AI is the future and it's limitless and it works fast and accurate and we don't need to wait years for a new anime series or a new season we can wait couple of weeks or even days lmao
@@El_Goblino_ No friend, I don't think you understand what I mean. I don't deny that AI is indeed the future, and its development speed is terrifying. However, to some extent, it still has tragic limitations. Many people say it can evolve on its own, but the fact is that without human databases, it cannot develop in a better direction. You think the future will be good, but who dares to make the final decision whether it is due to AI's more shoddy fast food content or more high-quality products? You know that human morality can never keep up with technological iteration 笔记 双语对照 排序 重点词汇 掌握这个方法，轻松get3500必备词！ 重点词汇 我想你 I WANT YOU ; I miss you ; I MISS U 发展速度 development speed 可悲 sad ; deplorable ; lamentable ; pitiable 局限性 boundedness ; limitation 没办法 have no choice but ; no way out ; can't do anything about it ; be unable to find a way out 粗制滥造 crudely made ; cobble together ; bodge ; make a pig's ear of ; turn out rough and slipshod work ; fudge sth ; manufacture in a rough and slipshod way 快餐 fast food ; snack ; quick meal ; munchies 精品 top quality article ; fine work (of art) ; fine works (of art) or quality goods ; rare and fine goods 定论 final conclusion ; final verdict ; the last word 跟不上 Can't keep up ; fall behind ; unable to keep pace with ; drag
Too many CG artists are so quick to betray more traditional artists, I swear to god. They don't have any respect for the fundamentals, and it's going to hand the entire creative industry over to big tech and capitalists. All mainstream artistic expression is going to become a cynical affair, devoid of any passion for capturing life in different mediums.
Training the AI to specific art style to keep consistency for each frames/cuts makes sense. I'd imagine tho, at some point there'd be some issue or heck, a fee, on usage of an artist's works/style as reference material for the AI. Not all artist are gonna be fine with just being credited, while having an AI reproducing their style after all.
I entirely agree. The controversy and ethical discussions in the community for the last year or more make this way too problematic for other people. There's a lot of problems with it and it's concerning to me that they don't address that as far as I saw. The end result was cool but I would not call it animation.
@@abaddonarts1129 Animation is taking still images and flicking through them fast enough so that the human eye blends them all together into smooth motion. The meaning of the word has nothing to do with ideas on what constitutes art for people, it's a mechanical term.
Agreed. As cool and mind blowing as it was to see this technology in use here, I couldn’t help but think “do you have permission from the film studio/art director whose anime this is to be training a computer to replicate it’s art style?” That needs to be the case in my opinion. Or a work around would be to hire an artist to design and produce a set of images in the style you want your video in, then with the artist’s permission train the AI on those images.
@@abaddonarts1129 As if the process involved didn't require significant dedication, artistic exploration and rapid iterative technical and process innovation.
I feel like that'd be hard to enforce cause while its simple enough to trademark a character, art styles are too broad to really be able to take ownership of.
@@photobackflip Can you own styles? Sure you can create them but nothing (legally and morally) allows you to keep it as your property. In animation at least
@@ZedDevStuff I'm sure you can, if its distinctive enough, but I don't know for sure. This is a lot different to aping the style though, if someone sits and draws say, fanart in the style of the things they like, that's an entirely different matter to using the actual thing they like as the raw material for your own work. It's like taking an audio book you like and cutting all the words and component sounds out so you can reedit it to tell a story you wrote. It would be effort on your part, and different at the end, but not yours.
No, hipsters, you didn't change anything, the guys behind "stable" did. You just shot a video reference, did some editing and typed some words, bravo prompter.
Ok so I see a lot of FUD in the comments here. I'd like to make two points. First, the AI is a tool to convert film of people into an anime style. It's not generating the film, nor is it generating the source anime style. It certainly takes away the need for animators to draw every frame (and loses out on their experience and skill in capturing and interpreting motion), but here's the thing... so does motion capture! Which brings me to my second point: motion capture (or even 3D hand animation) applied to an anime-styled 3D model does exactly the same thing as this AI tool, but with vastly more control. You can render it at 12fps just the same, and apply all the same motion/speed lines and other effects. Just look at Spiderverse, Arcane or any number of other 3D-animated anime-styled shows and movies. It's like this: Capture the motion of an actor and a virtual camera (the same as Niko's step of filming the actors on a greenscreen), bring that into 3D rendering software and apply the anime-style effects (the same as Niko's step of running this AI tool over the input images), retime to 12fps and add final effects over the top. I simply don't see how this janky, unpredictable mess (that doesn't give you any potential for modifications whatsoever after recording the initial plates!) could possibly be _more useful_ to a production company trying to achieve an anime style as cheaply as possible than technologies that have existed for the past two decades could be. Nor do I see how this is any worse for animators than existing technologies. As a final point, I personally don't think AI will ever improve to the point of usability for real production studios. It's just too unpredictable. There's no direct control over the results, and a trial-and-error process is simply not good enough when you've got a strict deadline and budget.
Cope technology advances the close minded get left behind change is nothing new yet people always think that they will be different and will resist the flow of progress news flash buddy you can't.
As an amateur animator this scares me as I wanted to be an traditional animator for Disney or whatever. Now this is scary because if this is the future of animation They may not need many of us like before.
You assume that people will care for this compared to an animation that has a very distinct look to it? There's no one size fits all look for animation that'll tickle that fancy. Especially because the closer and closer it looks to real life movements, the more uncanny it feels. So no, it's just you not seeing the writing on the wall, and getting scared of something that only a select amount of people would prefer over the variations in animation styles we have today.
Then... find a different studio? Or make your own studio? Woodworkers didn't go out of business because mass market furniture exists. They just had to change their business model. This is no different. AI will never be able to replicate the feeling and the soul of human art.
The community backlash to this project kind of reminds me of when Corridor was promoting NFTs and Beeple. I love Corridor and genuinely feel like they just have a love for technology and seeing what can be done with advancements, but sometimes I feel like they don't think of the wider picture of what something might represent or the problems it presents.
The answer to automation is a guaranteed minimum life standard, not defining empathy by making everyone else give up greater opportunities of any technology, entertainment-focused or otherwise, because it personally affects your livelihood. Especially when some of the artist community mock and insult anyone who enjoys the fruits of said technology, all while pretending to be arbiters of empathy, value, "soul" and whatnot. As someone who couldn't find what I enjoyed but knew what aesthetics I cared for, I have taken much more to generating imagery I care for than to constantly browse in futility. It is enough of a statement of value that I'm willing to do that, no matter what I get for it outside of said images. No pretentious pricks who want to shove their idea of value down my throat will ever change this. If your argument becomes that nobody should be doing this without suffering as you have, training, rather than ensuring that nobody should have to suffer as you did, then empathy is not the priority for you, outside of what you see of yourself in others.
"Animation is the most creative yet least democratic form of expression, thats why I used AI to soullessly recreate animators' existing work, while companies are foaming at the mouth seeing this technology imagining how many people they can lay off with it in the future."
The automation happening here is the exact same as he been happening for the past several hundred years with every other industry. Your problem isn't with AI or CC, it's with capitalism. All you're doing here is looking for a scapegoat to direct your anger at, and shitting on a bunch of computer nerds is just convenient for you.
@@leonodonoghueburke4276 No I'm shitting on them because those rich computer nerds are keep trying to push a propaganda 'democratization of art'. Just be honest about what you're doing. Be aware of your action. By making programs that steal art from artist, they're just giving a new weapon to a bunch of companies. Stop trying to push bullshit propaganda and patting your backs. Just be honest of your action and its' consequences.
Not really. With retro scoping, you can do whatever you want with the overlay art piece. With this, it just stylizes the image you feed it. It's basically a photoshop filter applied to each still frame. Something that's not really new...
I've rotoscoped for thousands and thousands of paid hours. 1. This is not it. 2. If it was - any animator will tell you how much they hate rotoscoping, so I'm so pumped for the days other AI tools will help us bring an end to manual roto.
I used to love making animation, hated that it took so long to do, so I quit to do video editing, production, and marketing. Now, this technology makes me want to utilize AI and get back into it. Crazy how things come back around.
So now we're devaluating the work people took "so long to do" and, because it now "fits our schedule", it's the second best thing to whatever you went on to do? What about those who chose animation wholeheartedly, taking all those risks and making all that effort you never wanted to make? What an empath! Furthermore, as others stated far better, this won't change anything the way you seem to think it will. Not saying you shouldn't go have a try at it, but that's not what passionate folks seem to think about all this and you might want to look into that beforehand.
This is actually insane - I am 100% trying to set this up. The sheer number of possabilities for creative film-making this opens up is incredible. Thank you Corridor crew for seriously pushing the envelope yet again! 🙌
Obviously this isn't on the same level as a full hand-drawn animation, and it doesn't have a unique and recognizable style, but even so, I have to say,it's impressive to see how you made a video like that ,and it also amazes me how we got to a point where this kind of technology can be accessed so easily by anyone,it's amazing to know that a person can create a movie or an animation without having to be a slave to a gigantic company that will limit their creativity and modify the original idea,if you have a dream or an idea,now you can make it come true with your computer,even if A.I are very questionable in their actions, such as stealing other arts, it is undeniable that they are extremely interesting, and, if used in the right way, can deliver incredible results.
The cool thing is that even if you do want a unique and recognizable style, you don't have to draw every single frame by hand. Instead you can probably commission a few hundreds or thousands of sample images in the style you want (literally several _seconds_ of animation), then teach an NN on those, and it'll pick up from there. Which, I think, is entirely within reach of a Kickstarter-level project.
I've followed you guys since Frozen Crossing. It's been amazing watching you grow as creatives, and then seeing you bolster other "unseen" creatives on your react videos has been insightful. But if you guys are going all in on this, then I would hope to see you go all in on helping devise some kind of ethical system or guidelines for the people who are inevitably going to use what you've put out here. The potential for abuse here far outweighs its benefits, but it doesn't have to if there are ethics in place.
@@popgligor2585 even gold can be garbage, this whole thing is too new and everyone's reflexive reaction is to kick it away which is natural. AI is here to stay and it will destroy the idea of traditionally made animation because regardless of ethics or morals bullshit what it really hits is everyone's wallets. It's all just money.
@@Asturev You conflate their own influence on this, it's been happening and will continue to happen regardless of them. This thing will destroy every industry that works with traditional animation regardless of some random RUclips channel. Everyone will get hit in the wallet, everyone.
I see a lot of concern, especially from animators, that tools like this will eventually make them obsolete.
This isn't a replacement for someone that knows how to animate, nor someone who can draw. Tools constantly evolve, but making something visually captivating always requires those same core skills. It still takes an artist to make art. That hasn't changed.
What we figured out here is a very advanced form of old-fashioned rotoscoping. Animation takes a lot of forms; Traditional, 3d, stop-motion... They all have different strengths, and enable different stories. Our method here isn't a replacement, but an attempt at something new.
What excites me is that this tech makes it easier to bring my visual ideas to life. Ideas that were otherwise impossible. When I said this democratizes animation, I'm referring to the near-insurmountable mountain of work needed to make a full-length narrative animation. Currently that requires large studios and large budgets. Doing it on your own is nearly impossible.
But I see potential in these tools to change that! That's what I'm so excited about. Imagine one person, or a few friends, bringing their crazy ideas to life. Imagine if a traditional animator could automatically have their drawings inked and colored. Imagine eliminating the uncanny valley on cgi faces. These tools have the potential to do that. We're trying to figure out how, and sharing our journey. If we want community-controlled AI tools, we need to develop them as a community, otherwise they become proprietary tools locked behind a company.
And yes, this can be done with your own style. We trained our model, not from hundreds of artists, but from ONE film- Vampire Hunter D Bloodlust. We've been very open about this, and I think it's important to be. But this is also an experiment and a loving parody of this era of anime. I consider it no less ethical than the countless other videos on our channel that borrow from pop culture to tell their story.
Sudden change can be scary, especially if it feels like your passion or livelihood is on the line. But that's why we're out here exploring it. Hopefully we can help shine a light into the fog for everyone.
-Niko
People will just adapt just how engineers are using CAD programs nowadays instead of doing it with a pen and paper.
@@laurenswintek895 Bruh this saves millions in costs and enables a solo dude like you do it on your own. How is that pro big corp ? It's literally made to help the tiny guys that don't have studios or equipment.
Ty
Please don’t let the haters get to you guys. I’ve watched your videos for well over a decade now and seen you all grow into adults with children for peat sakes. I feel old just reminiscing. I can’t help but have a sense of fear for the future as an artist but I am excited to see what you guys come up with next. ;)
btw this comment section is filled with trolls pretending to be people who care about artists. Please for your own sanity just stay up here.
@@Lemosa3414 saving millions at the cost of the software literally building it’s foundation off of stolen art and talent. no matter how you look at it, a lot of ai tools relating to art creation is based one some type of engine that was trained off of art that had no consent to being used. we cannot look at this in a positive light until work from artists that were stolen has been acknowledged, reimbursed, and evaluated.
As an animator... this scares me. I've dedicated my life to draw and know how to recreate motion within the drawings. Only to be replaced in a couple of years.
exactly. every time i see someone endorsing ai imaging my dream of being an animator dies a little
as an illustrator I totally feel that. At the moment I'm too aware of the possibility of clients just replacing me to be excited about the tech
I don’t think traditional animation will become obsolete, it may just be considered as a different style. Look at the painstaking hours put into stop motion. There’ll always be appreciation for traditional techniques
It's not like everyone will be able to create full cartoons just with couple of clicks though.
Look at search engines: those didn't kill marketing. There's still a skill and expertise required to make a webpage properly indexed by search engines (and there are whole courses to learn SEO, it's not just a 15min tutorial).
Just look at Sam's list of prompts he used. It requires time to learn what works and what doesn't.
It's another tool. But it still requires the eye of an animator to do it right.
I have the feeling "designed by human" is going to be a trademark soon
it seems that this will happen soon, and "designed by human" is simply a sentence, anyone can just lie about it
It's like "artisan" food; while it means something, companies just take the word and use it however they want.
A trademark is a protection of IP. How is "designed by human", as a phrase, IP?
The silver lining in all of this is that, hypothetically, AI-free Art will be more valuable and thus artists could actually make more money
@@viewsfromcairo How would it become more valuable?
In order for that to occur, supply must lower while demand increases.
Will demand increase? Or will there simply be more art?
Will supply go down? The same number of traditional artists exist.
You could argue AI art will cause more artists to give up but that's not really guaranteed. As it stands, most artists don't make a livable income off their art. They do it not as a career, but as a pursuit of life.
I'm so excited to see where you go with this
Nice video
great
Hi
Nice
Nice
Around the 17:00 mark he says “Anime has no 3D camera movies”. Close to every modern anime does, even slightly older ones like Death Note had spinning 3D cameras in moments.
Akira comes to mind.
The next time you invite animators as guests, you should show this to them and get their reactions
I think they wouldnt like it that much
Since technology basicaly steals their jobs
Edit: jeez so many replys 😭😂
I do agree that that kind of video would be cool to see
But i as a digitital artist personaly dont like ai "art"...
at all :/
I dont think that the ones who dont agree with me understand how frustrating it is
it would be a good idea, maybe their larger audience would finally see them talking about the ethical and moral implications of using AI -based on stolen and unethically sourced work cof cof- seems like they only talk about it on podcasts
I don’t think they would like it, trust me
@@alexanimatess5552 Not... yet... this still looks very rotoscoped and the movement isn't stylized enough. Having said that... it's clearly coming. This might take the jobs of lower skilled animators like those who work on most anime, etc.. It's still a ways away from taking the jobs of people at Studio Ghibli, Disney/Pixar/ILM, etc.. Like I said though... I do smell the wind turning and this taking even a lot of those jobs away. Not all of them, but certainly a significant amount.
Ever watched Father Ted? Theres an episode where the woman who makes tea gets shown the new tea maker. I have a feeling it'd go the same way
I felt a great disturbance in the animation industry, as if millions of voices suddenly cried out in terror and were suddenly silenced. I fear something terrible has happened.
Eh...
Wow, very dramatic. Terrible? I think you've missed the entire point of the video.
This is the future inevitable and never ever going away not this time no US law can stop this
The way of AI can lead to animations some may consider... unnatural
@@MrForestExplorer star wars quote
What’s so cool about this is that when I was younger I honestly thought cartoons were made from actual videos. So in my head I believed that when I was watching YuGiOh they actually filmed everything first then drew over it
That is a real animation technique but it is rarely the final product. I’m pretty sure they did that in the Lord Of The Rings animation for a few scenes.
That's how they made fire and ice
lot of companies make a 3d animation and draw over it cause 3d is easier than hand drawn
also they use stock footage like martial arts and stuff to get the fluid movement so you are quite close
Miayazaki used that style of animation in some of his work! Like in Castle in the Sky there's a scene of a brick wall getting broken, and it was a real brick wall they filmed and drew over.
Rotoscoping?
How is this going to "replace animators"? Rotoscoping has existed for decades, but animators are still around. This is essentially just a more niche version of rotoscoping.
There's also some time and effort intensive areas this method requires that traditional animation doesn't require - building the image generation model to only generate in one style and distinctly recognize three different people, costuming, choreography, filming, building the setting in Unreal Engine, and running the film and the background shots through that model.
Stable Diffusion was released in August 22, 2022.
EIGHT MONTHS AGO!
Chew on that. This was they did with a Tool in development 8 months ago.
8 years and you'll be soon Obsolete.
And animators are already using Unreal Engine especially for 3d animation.
You animators are doomed.
I find it baffling how a month ago, Jake gave a very in depth video regarding ai image generation and the "fair use" of it during the yet to be decided lawsuits, but corridor still releases this video basically showing they used vampire hunter d, a copyrighted series for training(with ads on the video), and the actual video on a for-profit basis
I guess they better hope they win haha
literally all anime back in the day looked like this. they don't have a copyright on generic 90's anime art styles... also the entire thing is free on youtube
@@retardedmonkey9000 The lawsuit is about if AI being trained on copyrighted material is a violation of copyright law. It was never about what the AI-generated images or training images look like. The images they trained the AI on are copyrighted, and that is all that matters.
I would say it's fair to use the style !
I'm sorry burst your bubble but I'm pretty sure you can't copyright an ART Style.
Disney absolutely salivating about all the animators they won't have to pay once they get this tech sorted...
A.I art can't be monetised, you're scared for nothing
Yeah, they'll have to pay actors and VFX artists, alongside people who specializing in managing this tech to oversee each frame instead.
@@_xymi says who? It curretly can't be copyrighted, but bo one is stopping you from selling it.
Why just them? Wouldn't any company be tempted to do so? Even *normal people* are publicly embracing it, so it's not companies. It's society.
@@_xymiThere’s a person on DeviantArt who gets paid for it.
As somebody who just graduated from college studying 2D animation; this video is pretty scary. It’s so impressive but it takes away years of progress that thousands spent their lives doing
Have drawn animation will never be replaced. It just has a different feel that I don't think can be replicated fully. In the future, who knows but I feel there will be a place for them for a long long time yet.
@@FullMetalAtheist it will. In the next 3-4 years at most, someone with just a single high-end RTX 60XX card will be able to ask an AI model to create entire anime series in just a few dozen hours (or a few hundred at most depending on the size of the project).
You could have it use a source like a Light Novel, Manga, or even an original anime, and ask it to make an adaptation, a sequel, or even a remake for it.
It will be able to make everything from story, to sounds, voices, and of course the art/animation. Also, have it come up with original stories based on your preferences will be entirely possible.
The same will be possible for movies, and early in the next decade (because of the sheer size, complexity, and required processing power) even entire games.
@@OnigoroshiZero this is the same argument I see for guitar amp sims... there has to be an original in order to emulate... there can be no output without input. The beauty in animation is the vastness of styles presented by different artist and if they all just copy the same sources then they will all devolve into the same style and no one will want them.
@@OnigoroshiZero i truly hope you are wrong because that sounds like hell
@@OnigoroshiZero Possibly but I have accounted for that in my statement. There will always be hand drawn animation, it's like how everyone thought practical effects in movies would be totally replaced by CGI, yet practical effects are still in use. CGI is common but there still exists a market for practical effects. I think there will be different markets and some may use AI enhancement to create things but there will always be those who animate by hand.
Thanks!
Good! You given them small resources.
I'd be interested in seeing animators react to this.
We are all concerned and amazed at the same time.
Amazed a small production can put together something that looks so good.
Worried because it devalues our craft we've dedicated our lives to learn.
As a animator, i think more tools means more options.
@@PikaPeteypeople who used to make typewriters lost their jobs when PCs became widespread, now everyone on Earth uses PCs and they have given jobs to billions of people.
If skynet doesnt happen this will be a positive thing for humanity i believe.
@@PikaPetey there is no doubt in my mind that normal animation and art will always have a place.
@@MumboJumboZXC Things like GarageBand and other such programs haven't gotten rid of musicians using actual instruments, not in the slightest. So I think traditional art will be fine
This is a really unsettling video. I'm in animation school and there's a big fear of exactly this depriving the industry from respecting animation for what it is. Animation is respected as film so little already, stuff like this only makes it worse.
There's so much more to art than the end product. If that's all you're worried about, I'm afraid you'll forever question the field of your choosing.
@@RodasAPCTV they fact that people only value the end product is the issue here. artists have been exploited for years, this will only make it so that art, and any creative job, is less valued as a whole. that's a valid concern.
@@RodasAPCTV They're not concerned about the end product. This "style" of animation just makes it much easier to animate without creative hands. Many animators will have studied, for nothing. COMPANIES care about the end product, and don't care who they step on to sell it to the public.
@@RodasAPCTV you awnsered the issue and why ia "art" is bad yourself
embrace it, use it as a tool. it will enhance ur work
I love how we are in a time where, "It's designed by a human" is actually a selling feature.
I replayed that bit. Felt like a futurama gag
Handmade was a selling feature for over half a century now
But the image taken is AI, fed by screenshots of the anime.
@@michalslusarski usually the word "handmade" indicates higher quality but in reality it tends to just be pricier.
95% of it was all done by a human??? are you kidding me.
Just wanted to say…I’m watching this vid because of the haters. I wouldn’t have known about this video if it wasn’t for them. Lol. So their hate has shown me something very exciting! Good job. I went to the school of visual arts in Manhattan shortly after the Little Mermaid Disney movie came out. I learned how to hand draw and film each individual drawing. Then computers came along and put an end to that. So to all the haters…get over it and dry your eyes. You can’t stop the future.
the ppl still can be drawing on the screen (digital) its just being a tool for the artist, why did you stop? you were afraid of the changes?
With the recent rise in your guy's AI videos, we've heard about the Law side of it, and the possibilities that you guys have shown, BUT I would really love for you guys to get a bunch of animators and artists on to talk about it and the future they see it bringing because as a group, they are the ones that will be most affected by this development. Hayao Miyazaki himself from Studio Ghibli has expressed his distain for it (which is why I was shocked to even see a Studio Ghibli scene referenced in this video), and I think if you guys are peddling it as a future resource so hard, it's really important you also express the views of the other side of things. In this video especially it felt like you glossed over that by going "We got it from an anime which is free on RUclips" but that doesn't necessarily mean that those original artists gave you permission to use their style for this project.
You have animators on react, would just love to see their opinion on the stuff you've recently shown.
Agreed 100%.
exactly. they're gladly helping animation as a medium get killed off and replaced and pretending that this means "democratizing the medium". such bullshit. i'm so disappointed. had to unsubscribe
exactly. every animator i know is terrified of the implications of ai art for their field. this video just solidifies it. im pretty disappointed in these guys actually
Yeah, i agree. The result and the problem solving definitely looks impressive , but it was disheartening to hear them casually mention using Vampire Hunter D's style ( and that movie is insanely and lovingly animated by a lot of skilled animators that came with that style and put hard work in each frame. ) and just use that template to spew out anything in that specific style. Then again, for all the fun content this channel provides, i remember them hyping up NFT's so I don't have high expectations when it comes to their judgement for the moral/ethical use of new tech. Of all the mundane hard things we could use AI for making our lives easier, we decided immediately to use it for art "shortcuts" , forgetting that half of the fun as well as the knowledge/experience / growth as a creator comes from going through all the creative processes - ups and downs and everything. Well, can't wait for the inevitable AI mish mash of every franchise/art style flooding RUclips.
@@andrewreynolds912 the solution is literally just them being asked if they want their work in the dataset. It’s not that hard. Several of these AI already allow you to issue a request to have work removed from the set
This just makes me appreciate Joel Haver's animated skits more
Aren't they AI generated as well?
@@avokka no, he hand edit every frame and adds the colors
He uses rotoscoping, which isn't really AI in the same sense, but does use computers to calculate the frames. He still has to hand draw the characters and such.
@@nintendomario007 that’s what I mean
@@nintendomario007 but isnt CC's method just rotoscoping as well? Their style in the anime video is nothing like the anime they trained the SD Algorithm with.
Also I love his style, checked out to remember, he uses Ebsynth. Sorry for my mistake
As an animator myself, this doesn't replace animation at all. It's another tool. There is now just one more new style. Painting moved digital a long time ago and cameras have come a long way and yet there are still somehow people buying and selling brushes and canvases painting portraits the old-fashioned way.
a gun's purpose was for hunting and self defense and look at how that turned out, you're putting a lot of faith expecting people not to abuse this
@@lawgx9819 I understand that you believe that opening up animation to more people will cause mass deaths, but I disagree. However, not to get too political, I do think that if the government begins regulating animation, there will be massive problems for people trying to survive in an ever-changing world.
@@lawgx9819 Really don't know where you got that idea from - military use has always been the preeminent driving force behind firearm development, going back to even the earliest examples like the Chinese 'fire lances'.
Hunting? Self defense? With advanced technology? That's not something that the poor ever got to do lol; outside of military use, firearms were toys for the wealthy over the majority of the history of firearms. Being affordable and accessible to the everyman isn't something that happened for a LOOOONG time.
The difference in it being a “new style” compared to a replacement is in how the medium is being used. Making AI based anime by essentially rotoscoping live action won’t be seen by big companies as a fun style but instead cheap and easy to manufacture product. Truth be told there’s nothing wrong with live action, I even find the live action version of this video to look better than the “anime” one but simply putting what can be called a filter over an existing product shouldn’t be glorified as a new tool since it doesn’t serve to make a process easier, it just alters something that was already made. Actual advancements using AI have been made such as Cadmium which is a program that uses a persons work to help color in their animation. That’s a tool, it’s helps make an already intended project easier. If you want anime made there’s nothing wrong with just admitting to yourself you don’t have the skill or time to learn. I’m not gonna make tools for a painter to be good at baking, that’s what a baker is for.
TLDR: Basically anything can be technically called a “style” but the actual application provides a cheap way to recreate other peoples work without actual work or talent in the field. Wanting to make anime with no care for the creation of anime is an incredibly ignorant mindset
@@WholeWheat_J I understand that you believe cameras (which I would consider a new style of making a portrait), really aren't a tool and that it takes no skill to use them. Only classical painters are the real artists eh? Electric hammers aren't tools either I guess and big companies or builders won't see them as such either. Maybe we should all just quit this new Photoshop "fad" since it will kill jobs and be seen as a cheap replacement instead of a new skill or style. To be completely honest, while I enjoy new styles like this, or Pixar, or old-school Anime for that matter, I also appreciate Disney's style, but still I appreciate claymation. There is room for all of it and the new stuff that'll come after. If anything it'll encourage innovation. Can't keep doing the same old thing and expect it to be tops forever. Just today though I saw someone killing it hand shadow puppetry doing stuff I've never imagined possible.
This is good. It takes the power from the studios and gives it back to the artists. This is a good thing!
Vampire Hunter D is one of my all time favorite works of animation. Specific artists created it. It's not "generic 90's anime" house style, as I see a lot of people in the comments saying. The designs are by Yoshitaka Amano, who is a world renowned artist whose work is instantly recognizable, and the animation was directed by Yutaka Minowa-- if people are praising the look of this AI generated style, I hope they realize that it has a specific source. If machine learning is going to be another tool in the pocket of artists, then the creative labor of artists can't be treated as a free resource. For instance, nowhere in the CC video is the original source material credited; Yoshitaka Amano and Yutaka Minowa are not listed under the "artists" section in the description. The modelers who made the 3D assets ARE credited, but not the animators and artists that pioneered the style and produced the *entire work* CC used to train the AI. Calling this work "Anime Rock Paper Scissors", rather than "Vampire Hunter D: Rock Paper Scissors!" or something similar, totally erases the origin of the material, and the subtitle of "Making Our Own Anime" is disingenuous on multiple levels. I remain excited for the possibilities of this new technology, I do think it'd be very cool to train an algorithm on an original style-sheet I made *myself* or by another *paid artist* hired for that purpose, but this right here is theft. It's fun to look at, and I appreciate deeply that there is a baseline level of artistry and film making craft necessary to create it at all-- but I feel like CC hasn't even followed their *own* cautionary advice about AI art and respect for intellectual property on this one. You haven't "democratizing the animation industry" by filing the serial numbers off of the work done by actual animators and repackaging it as your own merchandise. I think there's definitely a world where automated machine learning tools are used ethically to aid in the creation of original art rather than just digesting and reconstituting existing work, but that is not the precedent being set here.
It’s so crazy this happened bc the day before this dropped I watched that movie and fell head over heels.. then this happens
They are literally no better than people using a picture for commercial purposes with "I found it on google so it's free to take, right?" So disappointing.
I think they are real fan, using “generic 90s anime” is “dry British humour”. I’m sure they know who Amano is. (I have several of his art books)
@@pyropulseIXXI no, no they literally wouldn't... That's the whole point. There is literally no difference in them using the ai or if one of them sits down for two years, studies the style and then hand animates every scene. They don't have to pay to "original" creator or have to give credit to him/them because you can't copyright a style/color/method only individual art works. Even better, the only way the original creator would have any legal stands for compensation would be if they used the title of his work in thier title because then they would imply that they have anything to do with that creator...
@@kilor78 I think the point is those of us studying hand animation already don’t like the idea of a machine talking our jobs. It’s salt in the wound that they learned off of our work without compensating us.
As impressive as this is, it's scary when you realize a lot of animation companies might take advantage of this and use it as an excuse to put a lot of people out of a job.
exactly my thoughts
As an aspiring animator, I couldn't agree more. I love innovation, but not when it can completely substitute, or steal an entire group of individuals life skills. Especially one that still requires a lot of skill and understanding of art from even its basic forms.
A.I. art and animation is a fascinating tool, but I feel it really increases peoples NEGATIVE perspective that art is just some push of the button or filter. As if it wasn't a real skill that requires years of training to acquire the talent to make everyone's favorite "funny cartoons."
@@jkrwhy It did, but now it won't require years of training anymore.
Then the companies will show themselves as enemies of the workers. They must not be allowed to create massive poverty for profit.
Are you guys also upset that 95% of the population aren't farmers? Or does it only bother you when it's the thing that you invested time into has a productivity tool that allows others to participate?
Fun fact. Vampire Hunter D Bloodlust has over 180 people credited as members of the animation department. Just wanted to throw them some credit, since the whole conversation of democratizing this technology didn't make any mention of just how much work went into creating the original art this AI style was trained on for free.
AI bros usually wave off the negatives of AI, cuz if there are no issues, then the positives conveniently outweigh the negatives.
"AI isn't gonna replace you guys, it's just a tool!" Like, mate, computers didn't do 90% of the writer's job just because the keys were different from the typewriter!
@@pringles_mcgee well then something like chat gpt was trained on tons of text. Suppose we'll have to give credit to the entire humanity for making a.i learn language, possible. Same argument. What i see with these a.i tools is that the market wont be as saturated. Great artists will be noticed more as a lot simply give up. Also theres always going to be some niche need for human made art its not the end of the world. Its just that art by hand will need to be in the top 1-5% of artists in the world to make a living.
@@Mrhellslayerz @Fr3k3 Look I don't know your guy's whole stance on this, but those are not a fair comparisons, something more comparable would be the automation of factories which effectively decreases the manpower needed for the same output, and although it may create new jobs, it probably won't be enough to replace all the jobs it displaces, some people will adapt and work these new jobs, some people will move on to other fields. And that isn't a bad thing, because in the end we're just increasing our productivity and quality of life, less time from our limited time alive needs to be spent on tasks that we can delegate to machines. For me that's a good thing!
Now, what we'll do if eventually there's not enough jobs to go around, that's another discussion entirely, but as for the artists, they'll need to adapt and integrate the technology into their workflow to increase their output and remain competitive, because for fortunate and unfortunate reasons, this technology isn't going to stop existing. I for one, as a game developer who does art, am thrilled that I will get to take the ideas in my head and put them into the real world faster than ever before.
@@GabrielKoba The difference is that factory workers didn't dedicate decades of their life to learn how to work in the factory, it's like an hour of instructions how to do your step if even that. What's an artist who spent 30-40 years mastering their craft going to do when they're replaced by AI? And with everything getting replaced, where's everyone's going to go? There's not going to be enough jobs for everyone, so are people just gonna have to starve and die?
@@leetri That's true, but that's the closest comparison I could come up with. As I said, that's whole other discussion, but I do believe sometime in the future some kind of welfare system will have to be implemented to couteract these effects, how and when I'll leave to brighter minds than mine to figure out.
What I really don't want is for the solution to this problem to be prohibition or extreme regulation of automation and AI, as in the end these technologies can be extremely beneficial to us, IF we can adapt accordingly, and to do that we can't face these issues with fearmongering.
Remember that money is just a thing we made up, and we made it up to figure out who gets to have what, so if there are no more jobs there won't be any people with money to buy anything anymore so we'll have to figure out another way to decide who gets to have what, or simply give money away even to people who don't work, like a UBI, though I don't know how feasible that would be.
Rotoscoping has been around since the dawn of time; we've seen it from Bakshi's Lord of the Rings, through A Scanner Darkly and more.
While the ability to convert oneself to a 'drawn' character is super cool, no ifs ands or buts, there's a world of difference between animation as a medium unto itself and then just having rotoscoped content.
This is a very different concept considering it literally can’t exist without art to plagiarize.
@@Potterphilly13 it doesn't plagiarize anything...
The models don't store any art
@@TragicGFuelyou do understand how ai art works right? it goes through segregated images and copies patterns it notices and tries to fill those in the best it can through either preexisting images (like the ones seen here) or by making something “original”, and either way it’s stealing.
@@jico5147 patterns or art styles are not ownable materials. They're not under copyright. That's whu two people can draw an apple in the same art style and not sue each other.
Also, your explanation of AI's working tells me you don't have a clue on how it works beyond the layman's explanation. Which explains why you think it's "stealing"
@@TragicGFuel no i know it’s stealing because i’ve seen real artists use it and explain how it works, this is literally how it works. it copies patterns it picks up from whatever it’s told to copy off of. i don’t think you understand how ai art normally works. in this case this artwork just takes art it sees, copies what it sees, and applies it to the frames of the footage, it’s how you get things like inconsistent designs and patterns. it’s literally just copying whats seen and outputting whatever it thinks is correct. i also never said anything about copyrighting art, though ai mystery meat cannot be copyrighted, while real art can.
I'm an artist studying animation and illustration. This is awesomely terrifying; I love it and at the same time it makes me feel scared. Not sure what the future will be like but god, media is changing forever.
This could actually save animation studios in the western world. I used to be an animator. animators haven't seen much of a raise in 20 years. They are the lowest paid department in all of film, which is why i moved into regular film work. They are paid a flat weekly rate, no mater how much over time they do, and it just isn't fair. everyone else in film gets paid tons of over time. There is NO JUSTIFICATION for why animators and CGI artists are being paid so low, especially when they require the most education. Then the pandemic came along and things only got SO MUCH worse, because now it has opened the doors to the possibility of hiring people who work from home, and now studios can hire animators from India and Indonesia who are willing to work for far less, driving down the incomes of artists in the west.
THIS might be the solution that fixes all that. This could see animation studios return to the west. They don't need long hours, or large staffs and can finally work under the constraints given to them without outsourcing to asian studios. This might actually be a GOOD THING.
There will always be a place for traditional art. As the style set will need to be created and further tweaked for production
@@squip7 yeah, all the jank could have been quickly touched up. Way faster than drawing frames from scratch
@@FablestoneSeriesyou think studios will use this as a reason to improve hours and rates? Bullshit. They will use this to pump out more content for less money. Executives will see huge profit but the situation for animators will not improve, if not worsen as their skills will no longer make them valable
The heart of the problems with this is the state of labor selling as an artist is extremely poor. LABOR SELLING ITSELF IS IN DISARRAY. There isnt any future for this tech that doesn’t displace entire classes of workers and to say thats for the greater good only condones the system of exploitation.
No, you changed the art direction of live action forever. The art of animation is as much about creating unique movement that can't be done in real life than it is about how it looks, and you can't recreate that by filming live action and putting a filter over it.
It's really like assisted rotoscoping, it'd be fine for a sequel to 'a scanner darkly' but it's far from an animation replacement, and insulting to think it's a replacement for the actual craft.
I think this is a good point. The process of live filming and conversion to an animated style is not equivalent to animation because the movement of the characters is restricted to what the real human actors can do. Animation, meanwhile, can do literally anything, unbound by the physical capabilities of real people. It's stylized live-action, not animation.
Thanks to this guys comment, I've now learned that everything I've ever seen in live action movies is 100% based in reality. I can't believe Henry Cavil can fly and shoot lazers out of his eyes. I always thought that was special effects and green screening. Who knew?
Also, your comment is dumb.
Couldn't they relatively easily take the model they've made and apply it to some 3D skeletal animation to achieve anime movements?
Just like they're physically acting things out they could take their body scans and animate them.
@@sirdinkus6537 wow someone who misses the point of the comment and the general fear of the devaluation of the vfx industry that's been going on for years
I think John Muir said something like "It's not blind opposition to progress, it's opposition to blind progress"
You're not nearly as excited about this as studio execs and producers with their finger on the "lay off" trigger
Exactly this
It’s not that people fear the possibility of bad things
It’s that people fear opportunists using those possibilities
Do you light your home with candles and get to work on a horse? If not, how DARE you put all those chandlers and ferriers out of business. You're an actual monster, jesus. /s
whatever, I'm not into hamstring progress to artificially create jobs
@@kjohn5224 Define progress. This seems like a total regression of the art form, yet passable enough to get an audience.
This isn't animation, this is rotoscoping.
“Rotoscoping is an animation technique that animators use to trace over motion picture footage, frame by frame, to produce realistic action.”
@@legolorian3271There is not even tracing in this, so calling it rotoscoping animation is even a stretch (as the artist has to make important decisions about form, weight and movement if you are going to make rotoscoping with any artistic merit.)
this is "Anime" in the same way a Snapchat filter is anime. In the end, it isn't animation at all, but what they are good at: Video editing, VFX and post production. Calling it animation is extremely offensive to those who have dedicated their lives to the craft.
@MelloCello7 😭😭😭🧂
I call it "AI Rotoscoping" - exactly!
I like that this still required good filmmaking techniques. You guys did an incredible job seriously combining these tools to execute very interesting mimicry of anime.
o
@@andrewreynolds912 That's right, but in theory, a small animation studio can create a data set in a consistent style and feed the AI with them to learn. Now instead of ~60k drawings for a feature movie drawn on twos, they just do a thousand drawings, which significantly decreases costs. And at the end of the day, they can theoretize that they used only their own assets, creating what is a glorified video filter they can apply to live footage. It's not exactly animation, it's not exactly live filmmaking, it's just something new. Can be exciting when used correctly, probably will be abused and miusesd 100:1 :D
@@andrewreynolds912 no
@@KennethJAdams That sounds awful. I would never want to watch a half baked film like that. I want hand crafted animation from passionate artists, not the median of their skills.
@@KennethJAdams the whole point is that it is drawn by people, if it isn’t then it is just soulless.
This seems really good for static, or easy to produce camera shots.
But animation still has a leg up for complex sequences and crazy camera perspectives that you'd commonly see in fights/climactic events.
It's a matter of time though
Remember how mediocre AI art generation was when it first came out...6 months ago? Yeah, if it's gotten this much better in like half a year, how long do you think the "jank" is gonna be around? A year or two more?
@@sirdinkus6537 Even if they get past that, there's only so many styles to go off of. How long until it all gets old and they run out of styles to use?
And how long until laws regarding animation are put in place where AI art that is made to resemble a specific style without permission becomes illegal and artists will be able to file a lawsuit over?
Just as it's a matter of time before Artists are put out of business, it's just a matter of time before we'll need them again, because as obsolete as they are becoming, it's a lot less hassle to just go for a real animator. Plus they'll probably be in higher demand like animators were a little while after CGI was introduced and started taking over.
@@Karma-ji6ud they chose this style, but as they said in the video there were so many other types of styles to base their ai to work around. that’s just as limitless and subject to boredom as hand animated cartoons. i don’t see this as a way to entirely replace hand drawn work, but to complement as style evolves with it. whether you like it or not i don’t see this ever leaving the industry now that it has entered
@@sirdinkus6537 I think the jank will be for a while now. I draw but I also use AI a lot, I can say that the growth of the tech is not necessarily exponential, it has already hit a pretty hard ceiling and only minor improvements are being made at this point. But yes in a few years it will probably be able to do a lot more and with far more complexity. Will take a while though, don't expect it to be as fast as those last 6 months were.
5 years from now things are going to be so different, it's wild how things are changing fast
Just think about how 3d animation went from a novelty to everyday thing in 20 years.
@@andrewreynolds912 A lot of people are all for it tho. Now, which one will win?
@@andrewreynolds912 just like artists use other artists works to make their own art which is in turn used by even more artists to make their art and it goes on and on and on
@@shinigamisenpai3303 Wonder which one makes more money? AI? Well then that side will win.
A lot of this shit will be straight up illegal in 5 years. Japan is not going to allow their largest cultural export industry to be fucked up by morons with AI licenses. This will be made a serious crime in japan long, long before they allow a single domestic anime to be made with it.
Here’s they way I see it: this is just mocap. It’s already used for movies, video games… why not tv shows? This is just mocap with an anime art style.
As soon as I began to gain confidence in my drawing ability this comes out
Don't waste your time thinking about it.
Well I feel that but what they did was just A. I rotoscope animation where you trace over film a popular technique Disney used and invented, most of the stuff that makes it look good are techniques developed by anime artists. If A. I becomes an industry tool there will be copyright put in place so only certain works can be used by certain people at least that's what we all hope for but the thing is if everyone stopped making art these A. I imitations have nothing to pull from and now one to prevent stuff from becoming boring or static, so don't give up because things look impossible see through the illusion of things abd persevere we need to make A. I our tool not our replacement.
@@HypArtz002 well said mate 🤝
Can I offer you some encouragement? Be yourself, no substitutions, every line, stroke, whatever medium you wanna work in. Bring yourself into everything you make. Love doing it. This video wasn't made with care, it was obscenely executed with stock anime effects thrown on top. The background is blocky and aimless.
Comparing yourself to something like this is self-sabatoge. This is a tech demo.
@@NicoleHam gave me a smile, thanks!
Part of what gave Ren and Stimpy its signature psychological style was that the pilot was given to 3 different studios to draw. Despite having the same animation guide, 3 different interpretations were made, so from scene to scene the style changes, showing the inconsistency in Ren's brain.
i think i read that they never wanted the same style shown, always a different one ... i loved that show growing up and drew ren and stimpy all the time... i miss that classic show
ok
@@camquoc5718
Yep
@@camquoc5718 mkay
no wonder it sucked so much
I guess AI is inevitable... Hope it will be used as an artists "tool" rather than a "replacement" for the artists
I hope so too.
Depends really. When mechanical looms became widespread, weaving as a profession pretty much died out within a few generations. There are a few small brick and mortar stores that have been around for hundreds of years that still do it, but the vast majority of cloth for things like clothing, bags, backpacks, tents, ect are now all manufactured by large factory machines.
I sadly suspect it will become something similar for AI art. There will always be a market for hand drawn and hand made goods, but it'll probably become more niche as time goes by. Meanwhile graphic design, especially those for and by large companies, is almost assuredly going to move to all AI sooner or later
Maybe the hope is that imaginative animators can produce their visions quicker and without the constraints of budget or studio interference.
HAHAHAHA!
It is amazing how fellow artists have no imaginations.
Can you not project 5 years into the future?
I invite artists to get off the internet and sit by themselves. Conjecture and imagine how corporations, consumers, and creators fit into this puzzle.
This technology WILL replace artists.
@@sparklingwiz2459 it won't replace artist, it will enhance artists... Just like the camera didn't replace artists at the time of its creation in 1800s... Or how not everyone became a visual designer just because Photoshop was released to the public... Or how having a high quality camera on your pocket doesn't make you a professional photographer... Technology's not on the level to replace humans, yet. As you see in this video, they had to do countless tests to make it work right, and still it didn't work perfectly, so they had to work over it to create a expected result... It's not like you could get this same result just with 1 click, you still need experience, you still need the knowledge to make it look how you want...
This has made me consider copyrighting in a creative way I hadn't thought about before. If AI copying a style from human works becomes the norm, I'm worried new animator styles won't have a chance to develop because studios would rather not pay for staff. One of the things I love about anime is when you see a key animators style pop that sometimes doesn't even match what was the norm for the show. I'm thinking of that episode of samurai champloo where Mugen gets super high. While I see this tech could help a vision get made, it does so by copying previous works for the style. I'm worried of the long term implications of that, since we may see less new creative styles.
Yes these people dont give a thing about it
Honestly I think this new tech actually does the opposite. Is usually easier to stick to the same artstyle then it is to not only create a new one but to teach an entire team of dozens or hundreds of people a new one. With AI tools in the future, you'll not only be able to easily switch between artstyles, you will also be able to mix countless different artstyles. It is like the difference between being limited to the paint dye that you could locally source pre-industrial revolution, to having access to every color imaginable in the digital age. You can create a pretty much limitless number of artstyles by combining old artstyles. But on top of that it is easier to incorporate new artstyles since you only need to draw a few examples, and it can be learned and applied by the AI pretty quickly. Its easier for corporations to justify being ambitions, when it becomes cheaper/less time consuming to do so.
It's also important to remember that new artstyles that people creates are effectively combinations of existing artstyles anyway. There isn't really anything new under the sun, just creative ways of combining the same elements.
Very clever point, this could mean that we’ll not have an emersion of new styles and works of pure creativity.
Not gonna lie we better regulate the shit out of this tech.
When you have to do something badly for so long to be able to do it well, this alternative says why bother? It's a discouraging obstacle to new artists
Feature extraction should be a criminal offence, the rich like this shouldn't be using feature extractors to steal from poor and ethnic/minority artisans. It's basically technological classism, or rather fascism with a touch of ruthless social darwinism.
This is 100% the type of thing I would have tried to do in film school. I absolutely love genre-bending multimedia filmmaking techniques, like Cloverfield's found-footage meets big budget sci-fi horror, or basically everything Linklater's been doing for like 25 years. Bravo, guys.
Someone should reanimated this and do a comparison between the two
Great idea. Might take time though..
@@TonaliteSiO2 atleast the audio and reference pictures are there already
In the time it would take for a team to animate this, A.I. would have evolved to a point where it would be better than the animation done by the team. Seriously, A.I. art has been only been out for the public? 4-6 months? & we have already gotten to a point where we are already making A.I. animated videos in less than half the time of the actual teams creating videos without A.I. with less than half the crew.
@@ghostagent3552 if real animators tried itdd take over a year.
If it was actually animated by real people it would be immediately better and there is no comparison.
As someone who's still learning art and dreams of learning animation, this video is scary.
Cool, absolutely but also terrifying.
so wiill you just change your carrer asking because iam larning art too
I mean ... That's life, innovation will always happen and further what we do and how we go about doing it. Art isn't the first profession to which this happened to nor will it be the last.
Don’t be scared of it. Learn to use it. Their will always be animators but their responsibilities will be different depending the available technology.
Hand drawn artist were afraid of computers replacing them. The only artist replaced were ones who didn’t know how to use the new tools (computer)
Hand drawn animation is the purest incarnate of the discipline. It will make you leagues more skilled and useful than people who pass it up to fumble with 3d models or whatever the workflow/learning process will be with this AI nonsense solely. It will never not be impressive to see someone sit with a pencil and sketchpad and limn something out accurately.
It should feel empowering. Right now they're using this tech to emulate old anime and make cool things from it.
Think of learning animation. Now think that instead of needing to join some big studio and work on some director's projects for DECADES before you have the skills and clout to direct your own series (at which point you'll hardly be doing any of the actual animation, at beast some storyboarding and keyframing and approving concept art) you can instead be your own studio. Use the AI to help you develop a cast of characters, train it on your characters, your settings, and your environments. Turn that tool into an entire animation studio at your fingertips. Now you don't need to work for a studio. You can just make what you want.
Now of course, will get you get paid? That's on you and whether others want to pay for what you make. So if you want a JOB, then you'll need to anticipate getting a job training the tools for some big studio.
Mates I studied CG 204 years ago and you bring me back those feelings, In my life i had to switch my sector from graphic designn to gastronomy, but I truly appreciete and feel your joy in this process.
As cool as this is, I hate what it spells for the future of animation. Large coorporations are absolutely going to use this to forgo paying actual artists, and imo that's just sad.
they have to invest in improving the software and avoiding litigation by hiring artists to produce datasets for models,, i do get your point tho, and it is sad to see the value of creatives decline, but that's just the wrld we live in now...
@@pyropulseIXXI You ever drawn anything? Or met an artist? The majority of people dont do stuff from scratch, they have styles that they like and try to emulate. Crying that it uses actual art to get results is ridiculous when human artists do the exact same thing
@@tristanhudkins5186 I draw for a living. The difference is I am not a machine that looks at ~6 billion images and then interpolates them into effortlessly created generations that competes with anyone on Earth for free with a little tweaking and actually respect the artists ability to live who I'm inspired by. Now the real question is, do you draw, or do you just think you can speak for us?
@@tristanhudkins5186 this is the same take these ai bros keep spewing and it's just so braindead lmfao
@@Xxxwwwwx This isn't a 'professional level'. What you're actually witnessing is a 'bottle film' style animation that is extremely messy animation/art wise, that has suspect art direction. I'm also not sure if smaller companies benefit greatly from this. You essentially swapped out an animation crew, for a VFX and live action and film crew(because people seem to forget that there's a bunch of actors involved, film crew, and that these people have multiple years worth of film and VFX experience). At least your animation crew aren't unionised and are paid less. There are also numerous ways to 'cheat' in animation to cut costs.
It's not actually that hard to create a piece of animation that's 7 minutes set in a single location com[posed of mostly dialogue. It just wouldn't have the sweeping camera angles this uses so much, or rather, they wouldn't look as dynamic IF you only used 2D. But even then....I can think of ways...
18:15 The candles should be moving through the shot in the other direction, if you want it to look like the camera is orbiting around Nico's character. The background is moving right to left, which means that the foreground should be moving left to right, in the opposite direction. The way it is, it makes it look like the camera is dollying to the right, with Nico's character flying along with the camera through the room.
I was looking for this comment, it bugged me alot
thats what happens when people let AI do the job instead and dont understand what theyre doing
@@armandoalvarado3956 or, or... Maybe it's a mistake that slipped through before they finished the final product
@@armandoalvarado3956 It was composited in, not made by AI. That was a human mistake.
Glad someone else noticed this too! Incredible video regardless!
The reason we record dialogue first. Is so the animators can draw lip sync to the sounds. And helps with timing our shots. I guess now you can time your motion and action to the dialogue tracks. Sometimes the audio can inspire certain actions
In Japan they actually do it the other way round though. Animate first, dub later. Recording first is a western thing.
@@lujho yeah. A quick way to work to a tighter tv schedule. Though there are definately major benefits to recording your actors first
@@mikeglasswell-gameplay I'm pretty sure as I played Destroy All Humans 2 - Reproded, I noticed the first time in years a lip synced audio for German, I think that must have been the first time ever I saw that. I'm almost certain Unreal Engine either has a tool for that or there is a middleware that now syncs lip movements to the lines spoken, it was too perfect and I'm almost sure they didn't do facial performance capture for every other language!....
@@Quast there are some lip sync generators in animation software we have used a couple. For 3d software it's easier as the mouth shape can be easier to manipulate. 2d Hand drawn mouth shapes are different. And you have to listen to the audio and draw the right shape for the sound. In Anime they like to save time and cash, so they will usually dub after the animation is done. The animator would animator just some open and closed mouth shapes. Hard consonants or hard vowels.
@@mikeglasswell-gameplay I'd certainly prefer if the audio still gets recorded in a studio and not during a performance capture, I really don't need the 100% respiratory rhythm of an exhausted human during a full body performance capture - that's where I wanted to go with this. :p
Everyone needs to relax, this is just like an advanced version of rotoscoping
I'll admit with the amount of jank that was still in the Spiderman short, I didn't think you could take it to this level so quickly. Amazing work!
Very small correction but actually in the Asian (japanese, korean, chinese, etc) animation industry, the voice recording is part of the post production, when the animation is finished. However in western animation, they do the voices before the animation.
That is because there are no specific mouth movement in most asian anime
@@shunbeats5431 yea they do it after and it fuckin shows lmao
@@highdefinition450 Eh not really. In dubs, sure, but more often than not, in the original language it's totally fine
If you're talkin about 6:37 all they said was a cartoon and they are Western why would you correct them about Asian animation when they didn't mention it? As westerners who are familiar in Western animation why would they be talking about Asian animation without mentioning it?
That's like correcting a western chef on Asian cooking methods when what they're making looks vaguely like an Asian dish but it's a European dish made by Europeans in Europe just because they said they like Japanese food once
Niko: "Hey look, I figured out how to turn live action videos into anime, come watch it!"
Everyone: "I'm here for Kevin's sound design"
No
I think it's a gray area... There's a lot to be great use for Ai mainly in the health and medical industry however for the Arts and Entertainment Industries that's where the gray comes in. I can see where it can be useful however I completely validate the fact that people mainly artist will feel competitive with AI and might not beat that competitor. Studios and Hollywood in general is about making money and seeing how The Writers Guild Strike is going and people wanting more proper pay, I can see Ai being the cheap alternative and since it's new many people will go to it. So I validate the fear and nervousness for artists going against AI and it upsets me that with such a useful tool that can be used for again Health and Medical purposes it's now becoming a trend used popularly for social media and dipping into the Art and Entertainment Industry.
I agree in some areas but i do still think there is a world where we can have cool things like this, and more traditional art.
I'm so glad we've automated art into a uniform sludge that is indistinguishable from the next. Now we can have more time for our 9-5 and keep the slog of creativity out of our lives! :)
/s
Based
Yeah, i watched the John Oliver video about AI tech and when they showed how AI is currently used to detect subtle changes in a human's voice that is proven to be an early symptom for Parkinson's disease and dementia, i thought - yeah. That's where we should strive to apply AI to. Not this. One appliance of AI could potentially save thousands , if not millions of people, the other appliance shown here devalues ( or inevitably will lead to this ) any great art style and achievement by turning it into a readily available art "crutch" that most of the time limits the actual creativity and personal growth that happens during the process.
so far
The automation happening here is the exact same as he been happening for the past several hundred years with every other industry. Your problem isn't with AI or CC, it's with capitalism. All you're doing here is looking for a scapegoat to direct your anger at, and shitting on a bunch of computer nerds is just convenient for you.
Reddit is the other way bro
Dean: "animation has no 3D moves"
Me: Someone's never seen the opening of The Littles. Biggest animator flex I've ever seen.
They also need to watch all of James Baxter's works and see how wrong that statement is
"animation has no 3D moves" eh the fuck that even mean?
Not to mention a lot of 2D animation has been using 3D to help them create 3D moves in 2D space more easily. Quite literally using 3D in their production. Shoot, even comics make use of 3D to graybox out cities/backgrounds so they can paint over them.
I like this conceptually, but I hate what it will most likely inevitably mean for proper animators. I'm worried traditional animation will become an indie only thing kind of like certain game genres. Unfortunately, Pandora's Box has been opened and there's no putting the lid back on this one.
I just hope AI art will die out like a trend
It's so annoying that they keep screaming their new stealing tools and these kids who have 0 skill rooting for these ppl
@@grandmastalin7796 It won't. As technology progresses, Lots of jobs are going extinct and HAVE gone extinct. Although it is hard to process seeing the extinction of many people's livelihoods, There also aren't any ways to prevent it.
So long as Human society develops, Progressions in technology such as AI is inevitable.
the idea that they just "ripped off" vampire hunter d's style just leaves a bad taste in my mouth not sure if im alone in this. I dont have any issues with the unreal church backdrop that was paid for. I wish they would have paid an artist to create a style for the training data. (even if it is inspired by VHD the person would still do a self rendition.)
im pretty sure they didnt get any permission by the creators of VHD to use that dataset. i am afraid that it will legitimize this way of working as it is already a big issue. as artists themselves they should be a bit more aware of this.
@@grandmastalin7796 this is such a dumb take
I think this will be an excellent tool for already established artists to use.
Don't let anyone get you guys down! You dudes down at corridor are awesome! Keep pushing the envelope an discovering/normalizing new game changing tools/methods for all creators alike, As well as making the best content!
Great stuff! now let's see every single animator guest youve had throughout the history of the channel watch this and have their say on this "democratizing art" nonsense
You all act like artist don't take inspiration from other artist and mediums yet I haven't heard the outcry on that, be fair here, this just shows that a deffrent way of animation has been made, just like when 3D came out, the industry said it would cause hell but here we are, moat big studios abandoned 2D, yet here we are...why isn't a call for those many artist who lost their jobs when 3D is been used
@@godovamoviereviewsandmore6531 Because taking inspiration and still putting in the effort and skill is different. If Corridor hand-animated or even cell-animated inspired by another style then it'd be ok. Instead they literally downloaded what they were "inspired by" and then turned green screened videos into that exploiting the work of another artist
@@godovamoviereviewsandmore6531 because animation implies ANIMATING. Even with motion capture 3-d, they still touch up animations by hand. 3D replaced 2D jobs and it sucked, but people got over it because it was just a new medium to animate. This isn't animating. This is applying a filter to appear as animation, off the backs of artists who got their art scrapped. Or in this case, an anime that was taken to "mimic".
@@godovamoviereviewsandmore6531 a man made creation will always have more soul and love put into it then a bunch of lines of code programmed to steal and to copy form other people
The automation happening here is the exact same as he been happening for the past several hundred years with every other industry. Your problem isn't with AI or CC, it's with capitalism. All you're doing here is looking for a scapegoat to direct your anger at, and shitting on a bunch of computer nerds is just convenient for you.
My university Final Year Film Project in 2009 was a 15-minute short film with a visual style derived from the rotoscoped look of A Scanner Darkly. I shot it live over 4-days and spent the next 4 months in the editing suite converting every single frame in Photoshop before exporting into Premiere 2.0 5-6 days a week, for 15+ hours a day.
It's amazing to see how far we've come in producing the very same look using technology
I was just thinking about Scanner Darkly and the work that went into it. I suspect ten years from now Anime/Pixar movies will be filmed just like Avatar. I think we are seeing a change in motion picture technology with AI similar to the CGI boom in the 1990s. Video Games as well.
I predict Animation will all be AI rotoscoped motion capture.
would you mind posting it on your youtube channel?
Can you post in on RUclips
It's funny how all the bird people are complaining about the AI conversion tech, but seem to have completely forgotten about automated rotoscoping. I could only imagine what kind of films Ralph Bakshi could have made back in his prime with today's technology.
@@ZarconVideo pixar as a company is incredibly against motion capture, especially as live action acting doesn't have the same principals as animation
It's not just the AI, but the cinematography, the visuals, music, the overall execution, that made this so good! Great work, guys.
I know there are a lot of other comments here that start with “as an animator…” but
As an animator, the whole speech about “democratizing animation” is at the very least, inaccurate. You don’t need a big studio to make something cool, all you need are the knowledge and skills required and an iPad with any drawing/animation program. Animation is a learned skill like riding a bike or playing guitar. If you learn the skills, all you have to do is put aside the time to create your vision, No art theft required! I just hope this gets used as another tool for animators rather than (like this video implied) a full replacement for us.
There's a level of objectivity to art determined on the basis of the highest common standard set in any field.
Consider playing a guitar, you could play the guitar like an absolute amateur chortling and clanging away on the strings but everyone knows that doesn't make you a "guitarist". You could recreate motion on a surface but doesn't make you an animator without a certain qualifying standard having been achieved. Art has a harmonious form to it, if you cannot achieve it then you aren't creating Art, you're merely churning out garbled permutations of information.
The problem of turning live action cosplayers into cartoons is gravity. And human acting is usually less expressive than what professional animators achieve. For super Saiyan over the top expressions that will not be evident, but when it is time to drama and showing emotions, the differences are noticeable. AI allows very generic improvements. AI may defeat amateur mediocre works, but it is not yet ready to match the work of pros.
You can tell when you watch Arcane. 80% of the messages conveyed in Arcane are in the face expressions and body language that allows a message without words.
They call the facial animation in Arcane "micro expressions". That shit was all done by hand. BY HAND MAN. I could hardly believe it; it took the studio YEARS. And I agree with you, the level of detail in the animation turned the cartoon characters into actors. That "life" was breathed into them by the skilled artists behind the animation. I don't think the mimicry of AI tools is going to replace that.
AI produces generic imperfect solutions. AI always is better than amateurs in every field, but it cannot replace pros in their field. AI can be a great aid as a content remixers to generate remixed ideas, but AI cannot create or improvise.
If you teach AI to draw squares, it will only be able to draw squares. If you teach Van Gogh, it will be able to remix Van Gogh squares, which may look original for the casual eye, but it is a remix.
For decision makers, AI is a tool to produce bar charts. If you would not use a bar chart to solve a problem, do not use AI. The great problem for AI decision making is that AI may underperform with corner cases. The non Van Gogh non square case.
Corner cases add false positives and false negatives, and for decision making that is terrible, and real world is full of corner cases.
So if you were told AI could replace people, I would say using AI could make decision makers be fired.
I have found terrible glitches with AI. chatGPT for example. It told me about a Battletech battle that did not exist in the described year, in a castle with the name of a planet, located in a planet that is placed elsewhere. Terrible lore inaccirate error.
It also cited sources with chapters that did not exist inside these sourcebooks.
And I have known about a farmer who asked questions and got wrong data.
if you asked AI to code in Visual Basic, it confused image and picture controls, creating inconsistent incompatible code that would not run.
So AI can write s simple piece of code correctly, but it is still like that drunk friend who sometimes say things that make sense, but some other times, he has cantina existential chatter, finding pink elephants where there are none..
For art, AI has not learned the rules of art, so eyes may point in the wrong direction, for example. It has not learned to overcome the uncanny valley problem. That is a problem that is difficult, even for experienced artists.
Using AI to convert people into cartoons brings a physics problem. Action sequences and character faces would be restricted by the talent of the actor and the contraptions used on an actor.
Agreed.
Imagine a small studio only having to hand-animate the over-the-top parts, rather than the whole thing. It's the mixing of the mediums where I think you'll find the true art -- no longer tied down by major corporations and millions of dollars of funding, but not tied to computer-generated ai-art either.
I think AI can lay the groundworks but for the details it would still require manual intervention and improvement.
It would still lighten the workload by a fuckton
This is insane! It’s so cool to see how everyone’s projects over the past few months, like Sam’s Unreal Engine work and Dean’s AI animation work, are able to come together to create an amazing product like this. Bravo to you guys!
The criticism is that it is not even an animation, its a better version of anime filter.
It's not though. They literally showed you everything they had to do to get this working, and it's nothing like a filter or rotoscoping. They showed what happens if you don't specifically train a model for the specific project you're doing and just try to let the AI interpret each frame without it.
I recognize that this is an evolution of the medium using technology, akin to how Pixar leapfrogged digital animation,but it does put into question how the art form of making anime or cartoons is lost. In terms of commercialization and mass production of animated output is concerned, this will be an effective tool. But it does add another knife on the back of an already heavily injured art form. IMHO
But cool tech😊
Anime’s first appeal for me has always been the impossible camera angles. Like in the Animatrix when the camera follows the bullet through the headshot hole and out the back. It may take longer to implement since this style will be using a real camera, in time this style will probably mesh with cgi for these more difficult shots though.
It'll be pretty easy to create that bullet thorough head shot though
@@asar2252 do it then
actually if this was actually animated then it wouldnt be that hard but this isnt animated
Nice point
@@sassythesasquatch1794 The background is an asset from the Unreal Store that was given a pass by their AI. You could quite easily do a CG bullet hole, then do a pass with the anime filter. Could also have an animator animate it and place it into the shot.
10:08 It's designed by a human. What a time to be alive.
i'm gonna make a t-shirt that has some random artwork i have and on the chest written "designed by human"
better make a AI bot called human and have it design it
As a professional animator, for what it's worth, I find this really exciting... This makes me feel like so many more personal projects are within reach now, where before, the time constraints of animation as a medium made achieving all of my dream projects insurmountable. What a cool tool to have available and play around with, especially if you're training it on your own work samples
god bless, what a time
training it on your own art seems really interesting and something that can actually be called a tool. This is one take on ai art that isn’t negative I can get behind.
Now their are many logistical leaps and hoping that users will be moral and won’t steal but promising none the less. Artists will always have the best takes when it comes to art. Thats just a rule.
@@Data-Expungeded I kind of see it how sampling has spread around the music industry. Unauthorized sampling still goes on, but its really tools that artists have chosen to use that have developed more recently from bottom up that's created more solutions. For example, things like splice, or producers trading and selling loop packs. Even platforms such as tracklib that provide pre-cleared samples. You're right when saying artists will have the best takes solving these problems. I can see something similar being used to smooth out unauthorized "sampling" in this field.
@@jp-is1is i have a real problem with ai in art that always says “all or nothing” instead of limited use and correction but i’m getting better
@@Data-Expungeded Honestly, same lol
you are worthy of all subscriptions in the world
I see you're all on Davinci Resolve now... maybe I should make the jump from Adobe to this as well!
Davinci is quickly becoming the standard over the oldies like Avid
The free version is very useable, I highly recommend checking it out!
adobe better start working on introducing nodes in AE
@@YatsuRL Lol Adobe should start by making their existing features actually work and run in a stable fashion. Almost everyone i have spoken to who has switched from Adobe to Resolve has done so because they were sick of having projects interrupted by showstopping bugs.
u should!
this technology is so cool and watching it develop like this is fascinating but as an animator its also terrifying
dont let it be. just phase it into your workflow and combine it with your skill that you already have. Imagine what actual animator could create with this tech.
@@mak00ileven Yeah, it would remove 90% of annoyingness because you can just make a single character sheet and then have that character do any sort of action in a reasonable amount of time. Only needing to work on very specific things yourself.
I am studying animation for a few years now, and I think the finalised version of this will enable a lot of small studios and creators a chance to make their own unique story, without needing to draw nearly 1400 frames for just one minute.
I am ecstatic to see the finalised product.
I think this is super awesome because it means there can be opportunities in the future where we streamline certain shots and specific processes
@@mak00ileven Wishful thinking. An actual animator could do a lot with this tech, it could also completely obliterate a lot of their jobs, day rates, and overall salaries as it becomes much easier to execute. Simple economics "Markets with low entry barriers have many players and thus low profit margins.". The industry is already a race to the bottom, trust me, I've worked in it.
What would really be scary if you could use ai to make a live action movie based off an anime
which is totally gonna happen and sooner rather than later
it's just making the opposite proccess
too late. im 3 steps ahead. 1 person and even had AI help me make fake celebrities as actors.
@@thejdirector6057 link to footage?
@@criticadelespacio I mean yeah, that makes sense actually. grab animated footage, use img2img with a live action dataset, go frame by frame, done
People making fun if this didnt watch the video, they designed the set in 3d, they recorded it live action, they wrote, they directed, they did voice acting, they edited everything together. The ai is basically just an animation filter at this point. Yall acting like they just prompted an ai with "make rock paper scissors anime" and posted whatever it spit out
First off, this video is very well made. There was a lot of artistic talent put into the production that cannot go understated. You set out to make something that was reminiscent of a “90’s anime style”, which they did. To call this animation however is disingenuous. You used an algorithm to rotoscope their video for them, after scalping art from Vampire D Hunter. You also did not credit the director Yoshiaki Kawajiri, the art director Yuji Ikehata or any other artists from VDH in the video.
Second, saying the phrase “democratizing art” is like saying we’re “democratizing speaking” or “democratizing writing.” Anyone can create art; it isn’t some talent you’re born with that “non-artists” don’t have. Just like anything else, it’s a skill you need to build. This video is proof that the phrase is nonsensical, it took thousands of hours of collective skill to operate the software you used to make it!
You are not “democratizing art”.
At worst you’re only making it easier for cheapskate companies to try and make quick, unethical, and cheap content. Studios have already been laying workers off, overworking and underpaying their animators, and all the while making worse productions because of it. With how much reverence you gave the animation medium overall I’m annoyed at your choice of words and misplaced positivity in the phrase, “Did we just change Animation forever?”
At best this is a useful tool for achieving a unique stylized film. If you created your own assets and references, instead of ripping off existing work, I can see the use of this as valid.
Again, fantastic work, I enjoy your guys’ videos but please don’t claim this is some sort of boon to artists or that it’s the next step in animation or that it’s going to make creating anything you want easier. That kind of talk only adds to the idea that animation is a lesser form of art and film.
I just cannot get over how good the shot at 5:41 is. The orange light on one side, blue light on the other, the incredible focus on the facial detail. It looks amazing, it’s great to see talented artists use AI to evolve their workflow rather than substituting it for everything
What I can't get over is when Nikko claimed they were doing the right thing by making information free to everyone... then put it behind a paywall sub on their website. Scummy as hell.
This was the most awesome thing I've seen in forever but the most terrifying thing is the amount of animators who are already underpaid in the anime industry who will lose their livelihoods if they don't get ahead of this AI animation / art curve.
An artist should be always evolving and learning new skills, the elements that break every few seconds are the part that tell me there's still a ways to go before hand animators are completely pushed out. It could even be seen as an opportunity for individual animators to break out on their own terms own much like with 3D animation. This could be an absolute bone grinder for a feature film workflow by a large studio to do and maintain big budget quality, but it would be great boost for a _small_ team.
Unfortunately there's no getting ahead of it, there will always be a handful of artist used for corrections/cleanup but the days of full production crews will slowly go away. This is a studios/producers dream
@@tomnel Yep your correct and no one seems to get that
@@jammygamer8961 yup. Corridor is literally promoting automating themselves out of a job. But they don’t care, they have their subscription service. As long as they don’t get hurt by this they’re fine, fuck other artists.
AI art just makes me lose respect for you.
@@RDR911 cope😂
Wow, what an incredible video! The advancements and innovations you've showcased here are mind-blowing. It really feels like we're witnessing a revolutionary shift in the world of animation. The potential and possibilities are limitless, and I can't wait to see how this changes the industry. Amazing work, and thank you for pushing the boundaries of what's possible in animation! 🌟🚀🎨
I've done a few animated videos using Ebsynth with filmed footage and manually drawing keyframes with other artists. After watching this idk if its actually more work, I guess if you aren't an artist it is, but from my experience with that workflow you get a lot more consistency. I could see maybe a workflow where you did something like whats in this video for the rough draft of the scene and then had actual artists with ebsynth keyframe details like the faces so they don't lose consistency. I think what you guys did with this video is really cool, but it's also very obvious it was done with AI, even though it is really well done. I think this video touches a little bit on the "using AI as a tool" but it genuinely would have been a much more interesting video if you actually brought in a couple of artists to create a unique data set to train instead of just training off an existing film. That sorta dives headfirst in to the whole issue lots of people have with AI generation being considered "art theft" whether people agree on it or not.
Yes as an individual it would be a ton of work to draw a whole set of animation data to train off of, but it also gives the work its own artistry and creative vision, which ultimately I think is what people appreciate the most about the finished product over the process and tools (granted maybe not on this channel, since its all about process and tools here). Either way interesting video on how you went about trying to solve all those problems. I just would have loved to see this where you actually brought in some artist friends to guide the style and vision instead of just ripping an existing anime.
If you want an exaggerated anime style, Ebsynth is probably not going to be very helpful, because it doesn't do well with altered proportions. It just follows the movement of the input video.
I feel like if your criticism is that it feels like "too much ai" and your solution is to "bring in more human artists" then you missed the point of why this tool is useful . Also the solution is a little self serving
This approach does seem like a prime opportunity for the likes of concept artists, background artists, etc. Even if the AI dominates the animation, the program still needs data to work with; so hiring a select team to craft the visual style of a given project (instead of just telling the AI to "copy X/Y show") would be the ideal strategy for projects going forward.
I also see cleanup artists being an important position; there's still lots of jank in the individual frames (check out the eyes and hands in particular), so having artists on hand for "post-render" editing will improve the final product that much more - at least until the AI gets better at those details, I guess.
How about using motion capture suit and face capture to get realistic movements, put that in 3D model, then run it trough AI to get base frame and then artists have frame work to alter how they choose, so lots of it has been done already but fine details and fixes to AI crapping out can be fixed by human to get best result. Given anyone can do the motions based on what original artist drew and imagined. Hell one could 3D animate this and then run it trough the AI to least improve the shitty 3D animations. From 2D to 3D to back 2D via AI and human finalizing might be the best possible result one can hope for smaller budget artists that havent had chance to get their own animation series.
@@michaelmarshall8041 Corridor is made up of artists i think they were talking about getting like a 2D aminator to guide the process they really arent hard to find and jobs are needed. there was too much ai in the animation side of things but that was just bc this was a proof of concept
I'm not 100% sure this would work if noise pattern moves it's position, but here is another idea.
Let's say you have 2 frames from original video, VideoA and VideoB.
1. You generate noise on VideoA (NoiseA)
2. You use motion vectors generator (like the ones from Nuke)
3. You move the noise based on motion vectors but fill the blank pixels (where no pixels came in from vectors) with VideoB noise (new noise)
4. Repeat...
The idea behind this is that you have patches of noise moving around with your subject from motion vectors.
The only issue I see if the stable diffusion is not only dependent on noise pattern but also posistion causing it to generate a completly new image
Video motion vectors aren't very good, it's basically just fixed blocks and diamond search, so it's either very coarse or very unstable, but there is a good way to propagate image information alongside apparent motion. The keyword you're looking for is optical flow, and the tool you may be looking for is the now-classic EbSynth. You just need to replace one target image with noise or whatever pattern you want to propagate; and then after it's done you'll notice some blank or distorted areas, and you put another image into the example set and fill the bad areas in, and usually just about any shot of reasonable length shouldn't take more than 3 examples to fully resolve. This tool is based on paper "Stylizing video by example" by Jamriska et al, it's edge mask enhanced motion flow. You could by all reason automate this fully, but this might cause issues of its own, since it doesn't really do disocclusion tracking, edge mask kind of stands in for that but it's pretty ambiguous.
@@SianaGearz optical flow is the algorithm that generates motion vectors, we're talking about the same thing
imagine if he put this effort towards drawing some lines.....................................................
@@passerinemotion Imagine putting that effort in some coding.
@@gridmeter2571 don't forget, the power to settle this lies in the palm of our hand 👊🖐✌
With controlnet (extension for stable diffussion) you could maybe use depth, pose and normal maps to create even more consistent frames. You could pull the depth, pose and normal data from your original footage to use during generation. Would love to see this idea experiment with further.
Technology is moving so fast.
I was going to say the same thing but my guess is when they were working on this controlnet wasn't even available yet. Especially now that you can stack multiple controlnets along with other extensions like pose editors they can really get deep in the weeds. But high-level the concepts what they have presented here showcases what is possible and it's all just accelerating at a breakneck pace.
ControlNet came out a few weeks ago and they started this project months ago.
This tech is moving so fast. The next one they make will look completely different to this.
@@KeyTryer But this can be used as a foundation for that. Unlike 2 months ago where the idea was made from scratch, now they only need to improve it. It's easier to do something when you have a working guide.
I was on reddit and someone there pointed out that it was visible somewhere in the video but they never talk about it
Gah!😵 That moment when he says, "I really want to create cool things... But the only way I can create really cool things, is with the help of other people, helping make the technology to create those cool things." I'm like... dude, have you ever heard of growth and effort? You do realize that Walt Disney made really cool things... even though he had to work from the ground up, right? For that matter, he made really cool things, even though he didn't have the convenient digital techniques that are used for traditional animation today. Pardon my saying so, but the animation industry IS democratized. The definition of democratized is to "make (something) accessible to everyone." Anyone can choose to strive for excellency in animation. (And plenty of people start their own small companies and publish their work on streaming platforms. Additionally, some animators release their own content on RUclips. If you want to make entertaining art, you can.) Animation is a craft. You have to work at it, just like with any other skill. If people aren't willing to build the skills required to make a film worth seeing... that's on them.🤨
AI art is going to be bad for the future of Animation, and the future of creativity in general. Instantaneous gratification discourages humans from striving to learn for themselves. And for that matter it breeds contemptible laziness and entitlement.😑 AI art does nothing but flood an already saturated market with "no sweat" content. This will make it difficult for actual artists to get paying jobs in the craft of their choice. Making humans obsolete, and flooding movie theaters, Amazon Prime, and Netflix, with quick uninspiring projects will just make it harder for veiwers to find things actually worth watching. A five year olds drawing has more value in my eyes than any AI art peice that exists today. This is because the five year old had to grip their crayon, and try to capture their thoughts on paper. The human element is what makes art worthwhile. Remove that, and what's the point?🤔
Now you might say, "Hey! They had to film all the shots! They wrote and recorded the dialog themselves! They tinkered with the process until the AI suited their needs! Doesn't that count as the human element? Isn't it enough that a human came up with the concept and refined an AI software to execute it?" My response to that is, anyone and EVERYONE has ideas... The difference between a real craftsman and a idle daydreamer, is the will to work and dedicate actual time to something.✍️ For that matter, another difference between the two, is the willingness of the craftsman to fail again and again as he tries to acheive his artistic goal.💔❤️🔥 You heard the guy in the video. He said, "It's your ideas that matter. It's your direction, your story. Because the AI takes it the rest the way. I love it. It's such an awesome way to work."
This guy loves, that he's found a way to eliminate the need to work at art and animation. He may be working on perfecting the AI approach to animation... but in the end, he's doing it all in order to make a HUGE shortcut. This isn't just a digital tool that helps animators to work quickly and efficiently... This is an AI tool, that eliminates the need for animators to well, animate at all.🤨
These guys are not doing future generations any favors. As a kid, I always tried to find shortcuts to everything... I loved art, and wanted to draw... but often found myself wishing that I didn't have to practice. I wished that the image in my mind would just magically apear on the page in front of me. In years to come, when kids get a creative urge... they'll turn to AI. The AI will learn and create, and our children will stagnate in ease.
(Also, you don't own the movie "Vampire Hunter D: Bloodlust", so it's literally theft for you to take images from that specific movie, and let your AI mimic them. If you want to make an anime with AI, you should at least learn to draw, and apply your skills by creating all of the references that your AI will need in order to operate. At least you'll have the hard-earned skills of a concept artist, if not the skills of an animator.)
Yes, I'm sure you yourself never gained inspiration for an art style. Never thought a drawing or a melody could work well in a different context. That is literally what AI is doing, finding patterns in designs its given and applying them in a different, unique, context. It is doing the job of that is done by every single artist (because styles and inspiration don't come out of thin air), just better than someone like you ever could. So stop crying about it.
basically it's AI rotoscoping, which is cool and an amazing experiment but I think hiring artists to do rotoscoping would be more consistent and less janky
Well yeah, that's a given. That's not really the point of the project though
The point is that the tech is almost there. 1 year, maybe less.
And Ethical.
And massively more expensive, to the point where the project wouldn't make sense.
@@ShadeMeadows If using AI is unethical then using any computer for anything, in fact any man-made tool is unethical, because it's not really done by a person themselves, now is it??
You changed nothing in animation because this isn't animation... this is programming and machine learning.
still animation lol.
@@na5567 hell no. It's just rotoscopy
@@sheyanjen3382 Animation is the process of creating the illusion of movement through sequential photographs. It's still animated therefore animation lol.
@@na5567 haha thanks for googling it
@@sheyanjen3382 Brilliant argument. My entire perspective is invalid because nobody knows what animation is except you thus I must have googled it and somehow that makes me wrong you special unique irreplaceable artist. I have never once animated, I am certainly no artist. My art isn't my secondary form of income. I have never made art for prominent youtubers, athletes, companies, and music talents before. Never. Congrats you one in a million happy little accident.
This is scary developing technology for legit animators.
It's not tho. Just like mocap didn't render people out work. The biggest problem is that ai cannot express with using the principles of animation, as these are movements that we do not really make in real life, but are the essence of animation.
@@AdamMadejAnim what????
@@cobensalazar5492 if you wanted to make something unnatural you’d still have to do it manually
@@cobensalazar5492 what they meant is that the type of "animation" these guys did can only do so much before it gets to the point it is impossible to do in real life.
So thankfully, it might not fully replace animation.
@@cobensalazar5492 They're saying: in animation, movements are exaggerated and usual don't follow physical rules to the teeth.
First when rotoscoping was invented people complained it was not real animation and sullied the art. I disagreed, how ever using a computer and algorithms to produce rotoscoping is.
I don’t think corridor has really automated ‘animation’ here, because I don’t see that the tech can integrate a lot of animation techniques like squash and stretch, creative use of timing and anticipation, or otherwise going off model to generate movement. What they have actually done is create/automate a kind of rotoscoping technique. This is still interesting, rotoscoping is used in some anime! But I don’t think this replaces what we get out of hand-animation. But the problem is that it might, and we may lose a lot of hand animation because companies will no longer pay animators for their work.
Very true, this is animation done by people who know nothing of animation and it shows. Exaggeration is one of the fundamental rules of animation and live-action doesn't allow for much of it. I don't think people want just live-action with a filter on it lol
Wow. You've invented rotoscoping. Fucking amazing.
Not even that. With rotoscoping, you can do whatever you want with the overlay drawing. You're just using the frame and pose as a reference. With this, you're just getting a stylized version of what you put in.
It's basically applying a photoshop filter over every still frame... Something anyone could do if they were bored enough and had enough time.
@@Zac_Frost Yes Zac, because I’m sure you could do this far better while understanding the fine intricacies of the AI technology.
@@mythrin Look at the random stray strands of hair that magically pop in and out of existence throughout the _finished_ product. The inconsistency of the in between frames makes for janky animation. It's literally just applying a filter of a specific art style, and an inconsistent one at that.
@@mythrin they're selling an hour long tutorial for 4 dollars something tells me its not that complicated
@@Zac_Frost For the final product to reach this point, a lot of touching up (by humans) had to be done by the team. You can take this two ways: that AI technology is still in its infancy and can’t replace the quality of real animators, or digital artists are in the process of learning how to implement AI to make their work better and easier.
Its nowhere near being just a photoshop filter. Those filters run on fixed algorithms programmed by humans, while this technique uses AI to flexibly generate new stylized images based on *machine learning*. That’s the significant difference. The technology is in its infancy and writing it off as unimpressive and pointless is naïve, you wouldn’t say that about the first computers or televisions would you.
10:07 "It's designed by human" I never expected to hear that as a selling point in my lifespan.
I think some people in the comments section praise this AI too high and do not understand the advantages of animation. No matter how rapidly AI develops, it may seem absurd to want to replace or eliminate the animation industry. However, it can indeed help ordinary people achieve some ideas, but the problem is to obtain permission from the original production team by using animation materials?
AI is the future and it's limitless and it works fast and accurate and we don't need to wait years for a new anime series or a new season we can wait couple of weeks or even days lmao
@@El_Goblino_ No friend, I don't think you understand what I mean. I don't deny that AI is indeed the future, and its development speed is terrifying. However, to some extent, it still has tragic limitations. Many people say it can evolve on its own, but the fact is that without human databases, it cannot develop in a better direction. You think the future will be good, but who dares to make the final decision whether it is due to AI's more shoddy fast food content or more high-quality products? You know that human morality can never keep up with technological iteration
笔记
双语对照
排序
重点词汇
掌握这个方法，轻松get3500必备词！
重点词汇
我想你 I WANT YOU ; I miss you ; I MISS U
发展速度 development speed
可悲 sad ; deplorable ; lamentable ; pitiable
局限性 boundedness ; limitation
没办法 have no choice but ; no way out ; can't do anything about it ; be unable to find a way out
粗制滥造 crudely made ; cobble together ; bodge ; make a pig's ear of ; turn out rough and slipshod work ; fudge sth ; manufacture in a rough and slipshod way
快餐 fast food ; snack ; quick meal ; munchies
精品 top quality article ; fine work (of art) ; fine works (of art) or quality goods ; rare and fine goods
定论 final conclusion ; final verdict ; the last word
跟不上 Can't keep up ; fall behind ; unable to keep pace with ; drag
Too many CG artists are so quick to betray more traditional artists, I swear to god. They don't have any respect for the fundamentals, and it's going to hand the entire creative industry over to big tech and capitalists. All mainstream artistic expression is going to become a cynical affair, devoid of any passion for capturing life in different mediums.
Training the AI to specific art style to keep consistency for each frames/cuts makes sense.
I'd imagine tho, at some point there'd be some issue or heck, a fee, on usage of an artist's works/style as reference material for the AI.
Not all artist are gonna be fine with just being credited, while having an AI reproducing their style after all.
I entirely agree. The controversy and ethical discussions in the community for the last year or more make this way too problematic for other people. There's a lot of problems with it and it's concerning to me that they don't address that as far as I saw.
The end result was cool but I would not call it animation.
@@abaddonarts1129 Animation is taking still images and flicking through them fast enough so that the human eye blends them all together into smooth motion. The meaning of the word has nothing to do with ideas on what constitutes art for people, it's a mechanical term.
Agreed. As cool and mind blowing as it was to see this technology in use here, I couldn’t help but think “do you have permission from the film studio/art director whose anime this is to be training a computer to replicate it’s art style?” That needs to be the case in my opinion. Or a work around would be to hire an artist to design and produce a set of images in the style you want your video in, then with the artist’s permission train the AI on those images.
@@abaddonarts1129 As if the process involved didn't require significant dedication, artistic exploration and rapid iterative technical and process innovation.
I feel like that'd be hard to enforce cause while its simple enough to trademark a character, art styles are too broad to really be able to take ownership of.
I would love to see an entire series in this style. It's really cool looking.
They did take inspiration from vampire Hunter D bloodlust, so there is a series with this art style already.
It'd be cool if they actually made it with artists.
@@photobackflip Can you own styles? Sure you can create them but nothing (legally and morally) allows you to keep it as your property. In animation at least
@@ZedDevStuff I'm sure you can, if its distinctive enough, but I don't know for sure. This is a lot different to aping the style though, if someone sits and draws say, fanart in the style of the things they like, that's an entirely different matter to using the actual thing they like as the raw material for your own work.
It's like taking an audio book you like and cutting all the words and component sounds out so you can reedit it to tell a story you wrote. It would be effort on your part, and different at the end, but not yours.
@@photobackflip Yeah, but why do that for a fun yt project? They literally threw all the credit right here in the video lol.
No, hipsters, you didn't change anything, the guys behind "stable" did.
You just shot a video reference, did some editing and typed some words, bravo prompter.
As an animator, this technology is extremely upsetting.
L
Ok so I see a lot of FUD in the comments here. I'd like to make two points. First, the AI is a tool to convert film of people into an anime style. It's not generating the film, nor is it generating the source anime style. It certainly takes away the need for animators to draw every frame (and loses out on their experience and skill in capturing and interpreting motion), but here's the thing... so does motion capture! Which brings me to my second point: motion capture (or even 3D hand animation) applied to an anime-styled 3D model does exactly the same thing as this AI tool, but with vastly more control. You can render it at 12fps just the same, and apply all the same motion/speed lines and other effects. Just look at Spiderverse, Arcane or any number of other 3D-animated anime-styled shows and movies.
It's like this: Capture the motion of an actor and a virtual camera (the same as Niko's step of filming the actors on a greenscreen), bring that into 3D rendering software and apply the anime-style effects (the same as Niko's step of running this AI tool over the input images), retime to 12fps and add final effects over the top. I simply don't see how this janky, unpredictable mess (that doesn't give you any potential for modifications whatsoever after recording the initial plates!) could possibly be _more useful_ to a production company trying to achieve an anime style as cheaply as possible than technologies that have existed for the past two decades could be. Nor do I see how this is any worse for animators than existing technologies.
As a final point, I personally don't think AI will ever improve to the point of usability for real production studios. It's just too unpredictable. There's no direct control over the results, and a trial-and-error process is simply not good enough when you've got a strict deadline and budget.
Cope
Cope technology advances the close minded get left behind change is nothing new yet people always think that they will be different and will resist the flow of progress news flash buddy you can't.
As an amateur animator this scares me as I wanted to be an traditional animator for Disney or whatever. Now this is scary because if this is the future of animation They may not need many of us like before.
I mean there's no traditional animation for Disney its all 3d models.... thats long long gone for Disney
Disney is not that good 🤨 for some people who were there said they own what You do with the pencil there
You assume that people will care for this compared to an animation that has a very distinct look to it? There's no one size fits all look for animation that'll tickle that fancy.
Especially because the closer and closer it looks to real life movements, the more uncanny it feels. So no, it's just you not seeing the writing on the wall, and getting scared of something that only a select amount of people would prefer over the variations in animation styles we have today.
Just learn this tech instead
Then... find a different studio? Or make your own studio?
Woodworkers didn't go out of business because mass market furniture exists. They just had to change their business model. This is no different. AI will never be able to replicate the feeling and the soul of human art.
The community backlash to this project kind of reminds me of when Corridor was promoting NFTs and Beeple.
I love Corridor and genuinely feel like they just have a love for technology and seeing what can be done with advancements, but sometimes I feel like they don't think of the wider picture of what something might represent or the problems it presents.
The answer to automation is a guaranteed minimum life standard, not defining empathy by making everyone else give up greater opportunities of any technology, entertainment-focused or otherwise, because it personally affects your livelihood. Especially when some of the artist community mock and insult anyone who enjoys the fruits of said technology, all while pretending to be arbiters of empathy, value, "soul" and whatnot.
As someone who couldn't find what I enjoyed but knew what aesthetics I cared for, I have taken much more to generating imagery I care for than to constantly browse in futility. It is enough of a statement of value that I'm willing to do that, no matter what I get for it outside of said images. No pretentious pricks who want to shove their idea of value down my throat will ever change this.
If your argument becomes that nobody should be doing this without suffering as you have, training, rather than ensuring that nobody should have to suffer as you did, then empathy is not the priority for you, outside of what you see of yourself in others.
Saying 2D animators are barely skilled is a wild ass sentence bruh.
"Animation is the most creative yet least democratic form of expression, thats why I used AI to soullessly recreate animators' existing work, while companies are foaming at the mouth seeing this technology imagining how many people they can lay off with it in the future."
Well said. Honestly it's disgusting how they actually believe this is the democratization of art. Please don't fool yourselves.
Precisement
The automation happening here is the exact same as he been happening for the past several hundred years with every other industry. Your problem isn't with AI or CC, it's with capitalism. All you're doing here is looking for a scapegoat to direct your anger at, and shitting on a bunch of computer nerds is just convenient for you.
@@leonodonoghueburke4276 No I'm shitting on them because those rich computer nerds are keep trying to push a propaganda 'democratization of art'. Just be honest about what you're doing. Be aware of your action. By making programs that steal art from artist, they're just giving a new weapon to a bunch of companies. Stop trying to push bullshit propaganda and patting your backs. Just be honest of your action and its' consequences.
My dudes. This is just glorified retro scoping.
so true, that's the first thing I thought, it looks worse than rotoscoping tough, because of the glitches
Not really. With retro scoping, you can do whatever you want with the overlay art piece. With this, it just stylizes the image you feed it.
It's basically a photoshop filter applied to each still frame. Something that's not really new...
Finally someone pointing this out lol
I've rotoscoped for thousands and thousands of paid hours. 1. This is not it. 2. If it was - any animator will tell you how much they hate rotoscoping, so I'm so pumped for the days other AI tools will help us bring an end to manual roto.
@@SolSeeker941 i am pumped as well to be out of job and on food stamps, can't wait
I used to love making animation, hated that it took so long to do, so I quit to do video editing, production, and marketing. Now, this technology makes me want to utilize AI and get back into it. Crazy how things come back around.
So now we're devaluating the work people took "so long to do" and, because it now "fits our schedule", it's the second best thing to whatever you went on to do? What about those who chose animation wholeheartedly, taking all those risks and making all that effort you never wanted to make? What an empath! Furthermore, as others stated far better, this won't change anything the way you seem to think it will. Not saying you shouldn't go have a try at it, but that's not what passionate folks seem to think about all this and you might want to look into that beforehand.
@Ioana Tbh yes I am. 🤣🤣🤣
@@ssj_roger skill issue
@@ssj_roger Skill issue is right. You don't have it. 'Waaa- it takes so long and I'm terrible at it any way so now I'll just steal."
@@soultroll1 based
This is actually insane - I am 100% trying to set this up. The sheer number of possabilities for creative film-making this opens up is incredible.
Thank you Corridor crew for seriously pushing the envelope yet again! 🙌
Obviously this isn't on the same level as a full hand-drawn animation, and it doesn't have a unique and recognizable style, but even so, I have to say,it's impressive to see how you made a video like that ,and it also amazes me how we got to a point where this kind of technology can be accessed so easily by anyone,it's amazing to know that a person can create a movie or an animation without having to be a slave to a gigantic company that will limit their creativity and modify the original idea,if you have a dream or an idea,now you can make it come true with your computer,even if A.I are very questionable in their actions, such as stealing other arts, it is undeniable that they are extremely interesting, and, if used in the right way, can deliver incredible results.
my gamer friend, learn to use commas right consequently. It's surprisingly difficult to read
@@crispypear8183 There is way too many god damned commas!
Cool, it, Captain, Commanism!
The cool thing is that even if you do want a unique and recognizable style, you don't have to draw every single frame by hand. Instead you can probably commission a few hundreds or thousands of sample images in the style you want (literally several _seconds_ of animation), then teach an NN on those, and it'll pick up from there. Which, I think, is entirely within reach of a Kickstarter-level project.
Id say ai does a unique and recognizable style in that it will almost always look close to a style you know, but not quite there
I've followed you guys since Frozen Crossing. It's been amazing watching you grow as creatives, and then seeing you bolster other "unseen" creatives on your react videos has been insightful. But if you guys are going all in on this, then I would hope to see you go all in on helping devise some kind of ethical system or guidelines for the people who are inevitably going to use what you've put out here. The potential for abuse here far outweighs its benefits, but it doesn't have to if there are ethics in place.
@@popgligor2585 even gold can be garbage, this whole thing is too new and everyone's reflexive reaction is to kick it away which is natural. AI is here to stay and it will destroy the idea of traditionally made animation because regardless of ethics or morals bullshit what it really hits is everyone's wallets.
It's all just money.
@Pop Gligor "Garbage is art" - Sun Tzu
They are just spitting in every animators eyes. They really only care about money.
@@fabianlaibin6956 if you let it happen then yeah.
@@Asturev You conflate their own influence on this, it's been happening and will continue to happen regardless of them. This thing will destroy every industry that works with traditional animation regardless of some random RUclips channel.
Everyone will get hit in the wallet, everyone.