Siren Real-Time Performance | Project Spotlight | Unreal Engine
HTML-код
- Опубликовано: 15 сен 2024
- Epic Games teamed with 3Lateral, Cubic Motion, Tencent and Vicon to take live captured digital humans to the next level using Unreal Engine. Meet “Siren,” a high-fidelity, real-time digital character based on the likeness of Chinese actress Bingjie Jiang.
Learn more and download Unreal for free at at www.UnrealEngi....
2055: “lol look how shitty our graphics were back then”
* Somewhere in the year 4150 * : lol that technology is out dated... its no where near to our technology. We can upload our consciousness in a real ideal world just like the planet earth or fantasy and able to have all senses and u cant tell what is real or not. Oh you have the option to live there forever and be immortal.
2020: The verdict is still out on 'Will we make it to 2021. The people above me are optimists.'
@@DataJuggler
by 2055 the world will probably be split up into thousands of smaller city-states run by warlords and lots of killing genocide and war
close to how things used to be 200 years ago
I don't think they will said that.
Now think about a real 2055 person reading this.
Thought this was amazing, reading the comments and see people making complaints about the animation, and complaints about those complaints. The more perfect you make something, the easier it is too see the flaws. If anything, it's a testament to how well and how close unreal has come to replicating reality.
This is incredible! Guys, you have to remember that this is running in real-time, not pre-rendered. It just go to show you how far we've come in real-time rendering - excellent job, Epic and all those involved!
Who’s here after they announced MetaHumans?
I do
Yeah me
Me
Such experts in the comments giving animation advice. Thank you guys for your unique ability to see motion on a screen.
omg people are great at detecting non-human faces, how surprising
This is internet. Everybody's an expert.
Have you ever considered that other artists and game developers actually watch RUclips videos and are actually qualified as experts?
I've been a game developer/artist for over 30 years for instance. Artists can usually see things that non-artists just don't see, they have a "unique level of ability to see motion", which is why they're artists and other people are not.
Not all of RUclips is commented on by clueless dweebs with a PC, that think owning a PC makes them an expert... some of us actually do related things as a profession. Some do facial rigging, some do motion capture but many have enough experience and knowledge, to know when something isn't quite right.
The best artists in the world don't always get it right and constructive criticism is how they grow and improve. If you're not an artist, I am sure you have unique skills that an artist doesn't have, that possibly make you an expert in your specialised field. Would you expect to be criticised if you commented on something you knew was wrong? I suspect you wouldn't and rightly so.
Jim Bo if every human can see it including the creators, then it's not a criticism, it's an empty retarded statement that you're using to seem knowledgeable about something you have no knowledge of, because if you did, you would have offered a comment that helps development that the creators don't know about.
Jim Bo I get triggered when people are unoriginal or lack self awareness. I'd like to at least shake them out of it or ridicule them to death.
All these people complaining about her facial muscles, hairworks, lips and arms. And I'm here continuously repeating the video just to see the unparalleled beauty they created. Human kind has achieved great milestone and I can't think how much they will in coming days.
Razor X yes i have grown up gaming through 1990s to now and every year seen immense improvements in graphics technology. As a young kid I looked forward to the day when there would be full visual immersion in a video game, where graphics become so realistic they cannot easily be distinguished from reality, and now we are almost there and this is a lifelong dream come true
What beauty? She's ugly.
Deliverygirl you watch too much anime probably forgot what girls look like
"2D girls are better than 3D girls" the anime guy says LOOOOL
redo her arms!! the face is amazing but her arms are scaring me!
I think it lacks muscles deformations, therefore looking a bit stiff when the arms are flexing.
What I was thinking. They don't move naturally at all. Not talking about the muscles. But the general movement of them.
You can see the main issue at 0:04 the length of the arms seems pretty strange, especially where the elbows are which seem to thin out depending on the rotation. That with no muscle deformation, and the contrast of how realistic the face looks, and it can throw off the illusion. The dress clipping below the shoulders doesn't help either.
Since this was all mocapped and the focus was mostly on the face, they likely didn't have time to make corrective shapes for the arm movements. The demo serves its purpose.
Faizan
Agreed. The whole thing is exceptionally realistic, only the stray hairs giving much of anything away. And why shouldn't it be realistic? It's a high-res facsimile driven by an actual actress' motions mapped on and her voice coming out of the CGI mouth. I'll wait until the whole thing can be synthetically generated in real time entirely out of software.
Faizan Ali um no, they are way too thin. it's not a "i see too many fat people" issue. it's a "her arms are anatomically incorrect" issue. her shoulders are too narrow and her arms are way to thin. if I had to guess I'd say their artists attempted to make her more attractive to today's standards and messed it up really bad. either that or the person who skinned the character to the bones didn't make the shoulder bones wide enough. we have to remember another woman with a different body type is mothioning her.
Epic Games we are forever grateful for your engines over the year , so many of my favorite games were based off Unreal engine 2 & 3
impressive work the engine is improving years and years
Brilliant work, I'm humbled by the efforts and the result. You can find the difference but it is close enough for real time graphics.
0:18 In my eyes, skin and haar.
im polish so i would speak it Hard EYS SKIEN and Heirr
I say HAAR too😂😂😂
OK this is one of the first times I think the uncanny valley has been crossed for the most part. That it's being driven in realtime is even more impressive.
The eyes are done perfectly in this, wow.
This is great milestone in motion capture and rendering. People can keep nitpicking but compared to what came before. This is real time render and not pre-rendered like cgi and videogames you usually see. So thats outstanding . It might not be 100% realistic buts its amazing progress. Video game Developers stated once that realistic facial expressions are very hard as we have nano expression in our face.
显然，这个演示要展示的是表情捕捉的进步，一旦应用到游戏里，剧情的带入感将是惊人的。这个革命性就在于，玩家可以通过人物的表情来了解角色的内心活动，而不仅仅是声音和文字。
The face is incredible. So much musculature happening. Even the lip sync is beyond the usual. It's amazing how jaded people are.
Incredible progress.
Needs some Nvidia Hairworks though. Also the mouth/teeth movements aren't quite right for the pronunciation.
i believe the hair looks beautiful, personally. it really doesn't need some proprietary Nvidia bullshit
Why not TressFX? It's open-source and, IIRC, often yields better performance than HairWorks.
agreed, anything GameWorks is literal cancer for gaming in general, people should finally realize that
yeah getting organic mouth movement has always been a weird thing. They usually overdo it and it ends up looking like Until Dawn instead of The Last of Us or LA Noire.
FIFA games have terrible facial expressions.
UNREAL CHILL OUT YOU'RE GETTING TOO SPOOKY
IT'S GWTTING UNREAL!!!
NO!
it looks like 32 years old woman in kids body
you don't see asians very often, do you?
It looks like a regular 20 year old asian female.
GronkAkowA i live in asia and i saw them everyday, oh.. i'm asian aswell
Frank Oellien 20 years old asian female don't have a wrinkle on their eyelids until they reach age 30 as they getting older
northborneo27 the proportion of the neck and the body are fucked up.
Real time digital puppetry is a sector that our performance capture gloves are perfect for. So exciting to see work like this and imagine how quickly it's going to advance - especially with the right gear!
very impressive! can't wait for the first of these to make it on the switch :)
to people that saying that she doesn't look real - well that's because she isn't, that is a 3d model driven by mocap data and rendered in realtime by a game engine :P
should i make a *sacrasm* sign for you? some people have such small brains, I just can tell if you even have one :P
Explanation just can't be more exact - she just isn't real! For her to look real guys would have to do too much more of everything - design, modeling, coding real-time computations etc.
That was more impressive than ILM's recent Tarkin and Leia, and in real time too? W.O.W!
Rich Mond Just what I was thinking, better off just hire 3lateral and epic to do your cgi. Sad that Tarkin was prerendered and epic created something better in real-time.
This will lift the VR porn to the next level.
@@molten2587 he is
You're a grown man
This is amazing. If this is a live mocap & rendering then there are some weird anomaly with the mouth-lips as I think the model/actor might have a wider mouth those making the 3D part kinda forced widen. But still, this is such an amazing progress.
All the people nitpicking don't seem to appreciate that this is rendering/playing back in real time, sure, you could get better animation in CG in a feature film...but that takes a server farm hours to render a single frame. Even though this is likely still running on a pretty hefty rig, it's pretty amazing for real-time.
Oooooh the Uncanny Valley is strong with this one :/
I think it's getting a little bit past uncanny valley and into the way too realistic valley.
I guess lot of people IRL are uncanny by themselves )
Scrolled to the comments just to say this. Mighty impressive though.
If the avatar was an android then everything would make sense.
indeed
To think that only 20 years ago I was playing Metal Gear Solid on PS1 and Half Life 1 and thinking that those games looked pretty good. Now only 20 years later and we are so close to achieving true photo realism. When we get to that point where we can't really improve the graphics anymore, that is the time when true innovation and game design makes a leap forward. As that will be the only way to amaze us.
Who's here after they announced MetaHuman Creator?
Yup. Straight after 🥴😂
Impressive tech! Obviously a few nitpicks, but for real time, it is great!
One thing I consistently notice that seems off with creations like this is the shadows around the nose
Another consistent misstep is the audio
The voice actor does not sound like they are in the space represented by the omagery, and there is too much high end and mouth noise
Just notes for the next round!
Nude mod when?
motion tracking existing porn but you get to change your actor/actress when
I knew some one would beat me to it! Lol
Wait until quantum computers are a thing
the legend...
Yamete kudasai!
Amazing graphics. Interesting how strong the uncanney valley effect is though. It still has that high level of "strangeness" to it
i think any attempt at making AI realistic is going to have the uncanny valley effect. i believe it’s unavoidable. we see it and know it isn’t human, no matter how real it could possibly look. deep down we know it’s unsettling, even if we’re wildly impressed. also the fact that we might not be able to differentiate between AI and humans at some point is scary.
The realism is so uncanny it's scary af
She’s beautiful, the tech is very impressive, her body gesture and eyes/skin, specially, are very believable (720p even 1080p won’t do justice to how detailed she is). There’s still room for improvements, though, like her hair and some modeling details. What amazes me is how hard it is to make lips/mouth movement like the real thing. Everywhere, it’s still like the holy grail of 3D. But this tech demo shows a lot of big and subtle things that are, in my opinion, welcome changes in the right direction.
Dang, I haven't seen one comment that wasnt posted by some hater complaining about this video. Obviously you all are missing the great work epic has been up to. No one jumps from atari to xbox one overnight. No need to try and talk down to the guys pushing the game engine world more than anyone else.
This is just a mocapped real person. We've had thousands of those already. When you can simulate real movement and voices without needing to have a real person do all the hard work, then I'll be impressed.
Is that the voice for the Resident Evil girl, the Red Queen, fitting dress lol. The face is ok but there is too much of a gap on each side of the mouth so it looks artificial maybe they did that on purpose so people dont freak out. That said, I think its friggin amazing.
Alright this is impressive! I'm wondering what hardware this is running on though. Can't wait to see this in my games
So much negativity. She's just a 3d character, not your president.
and you are white-knighting for a pile of polygons, you sad virgin
Jaroslav Záruba Dude you’re commenting on everything, what do you have against this project lmao?
Hopefully Trump puts tariffs on your country
I would have voted for her, hands down.
SIREN 2020 MAKE GAMES GREAT AGAIN! MaGGA!
Shame the audio is out of sync with the visuals, that's a major component in making this look more convincing.
Amazing but please do something with the pupils dynamics 👀 they still look static and not at all interactive 👁
Incredible... from now in 10 years, we will see something of incredible...
She's no Hatsune Miku. Good try though.
😂
Humans are really good at reading others humans faces, it is literally hardcoded in our brain, we are not yet there but the progress is amazing
Now Unreal is just showing off they can pull off pairing the likeness of one woman with the voice and accent of another woman of different ethnicity!
that is awesome, needs to be uploaded in 4k!
Video games will pass this graphics in few years coming in near future
Were they wanting to show raw input/output, including latency between the actress's performance and the 'real-time' rendering?
Because the VO dubbing is a couple frames early.
Impressive, I think in 10 years time this same demo will be flawless.
Her arms and shoulders distract me from everything she says and mouth motion is a bit scary, opens a wee bit too much I think. Skin, eyes and hair though, nice!
I think part of the problem might be the mocap rig. People wearing a giant head rig probably don't behave naturally.
I feel like everyone is so busy scrutinizing the details and talking about how far it is from perfect, but nobody is appreciating that *video games* can look like this in the near future. Yeah, I get it. It's not perfect. But good gracious, is it still impressive that we're THIS deep in the uncanny valley. That only means that we're closer and closer to finally achieving realism. So close that we can very discretely point out the specific problems that it has, which means that the actual quantity of problems to overcome is becoming smaller and smaller.
are you serious saying it's not yet perfect? if you can do better just do it and show us, of course it's not perfect but it's surprasingly near to perfection, i am astonished, great time ahead for computer graphics
Nobody seems to realize that this is real-time, not CGI. It's not perfect, but it's irrefutably impressive.
Holy cow that's perfect, I thought she was real.......!!!!!
Is the prescription on your glasses up-to-date? :)
"...unprecedented level of detail, in my eyes, skin, and haaah. Call roight? Bet."
Wow! UNREAL!
I don't even feel any 'Uncanny Valley' type repulsion, which is probably a testament to the good work here
its the mouth. try to hide her mouth with your hand and no more uncanny valley
No micro mimik wrinkles. Most often we do not even notice them, but the brain notices their presence. Therefore, the appearance of a fictional character is perceived much more naturally than a person's face
I for one support our new CGI overlords...
It's wierd. The smaller the gap between real and unreal, the more I can feel it. Truly amazing technology, though it shows how far there is to go.
The British-speaking Chinese girl has some seriously small arms.
@Chocolate Sheep am too lazy to do that too much effort. but i will tell you what cupcake ! i will let you with those pretty lips of yours.u can suck all the life out of me XD
These comments kill me lmao
13randon: looking at the arms, can't you tell it's a Barbie? ;p
Silent Market it's not her fault 😑🤦🏻♂️ she's born that way
You know there are Asian people living in Europe with matching accents...
I hate how everybody is complaining about the little details being slightly off. Why cant you just enjoy what great technology we have at the moment?
It's still not right. The eyes are too cloudy and the mouth motion seems overly wide and exaggerated. The arms seem rigid too, especially as she pointed to the camera at the end.
better then "Sorry, my face is tired" game
You guys will always complain ...
Is real time for a game, is not a CGI that is the impressive part, if that would be a film, well probably not so amazing, but in a game a capturing the actor in real time, is amazing
This is nonsense; every movement is mapped from an actual actress; if the actress has/uses rigid movements that's probably because she's not a high-end actress and she following pre-scripted and over-rehearsed motions.
I bet the actress is actually like this and she's crying right now over your comment
Yes, I could nitpick the hell out of this, but honestly, considering what facial mocap has been for the last few years, this is some amazing stuff. It could be completely photorealistic down to every single nuance, but people will always nitpick. Still, it's very promising and it looks like we're getting the "basics" of good facial mocap down, and we can finally start working on those pesky details.
I get the mass effect andromeda vibe from her mouth..
Her face is tired.
Kiido11 this comment is pure gold
PrimyFritzellz if you think this looks anything like when Andromeda first came out, you need glasses.
everyone is nitpicking, cos that's what we do. But what we have to remember is that this isn't rendered though some advanced renderfarm for a 3D movie, frame by frame taking weeks. This is rendered in real-time, mirroring the actress movements. That the engine can do that, and *pretty close* to realism, is amazing really.
Now, everyone that is nitpicking: go off and make your own with reactive pupils, longer arms, muscle definition, better fabric etc. Unreal gave you the tech, now go take us out of the Uncanny.
hoooly mooly thats real!!!!!
Congratulations. Excellent work guys. Can you please rework her arms. . All the best
Seeing a lot of people saying it's not convincing - I bet you if you posted a video of a real actor there'd still be lots of "uncanny valley" and "her eyes are wrong" posts.
Thought so as well.
no they wont lmaoo
Mlafk93owC - It's not untrue though. One of the highest voted nitpicks is that her voice sounds like a "blonde girl", which doesn't even have anything to do with the CGI (not to mention the actress isn't blonde, and many Asians have English accents). It's more like a hidden camera show where they fill up bottles with garden hose water and give it to people in a fancy restaurant telling them it's some expensive fancy water and they act like they can taste the difference. People nitpick little cues because their perception is being groomed by the context. In the wild, with no context, it's likely most would read those "uncanny valley" mannerisms as idiosyncrasies rather than clues it's CGI.
You are a moron, get over it. Your parents did.
"Her eyes are wrong"?
RACIST.
Everyone mad about something chill the hell out. Animation is good, obviously stuff needs to be further enhanced and obviously this is the possible next gen visuals we can expect on a high end computer.
That smile in the end made me feel very uncomfortable.
from the beginning, her mouth movements/lips are very unnatural to human eyes.
I wanna get into the virtual world.................to meet Andy serkis and Siren to see how beautiful the unreal engine world is.
She need some Nvidia hair physics
Wow, incredible advance in realtime graphics. Still in uncanny valley but wow. Amazing
Mouth movement is just wrong
beachbum111111 No
I think it's because the voice is ahead of the mouth, instead of the other way round. The mouth shapes should precede the voice made by them by a couple of frames. Presumable because it's done in real time, the model is lagging behind.
Wilbert Santoso there is bad sync with the lips
Thats how British people look/talk... Im sorry😂
Chevifier lol
Cool! Now I want to see Saya (the japanese CGI character) using this technology
half life 2 came out in 2004 and the mouth movement on the G-man is still better than hers
Don't think HL2 used mocap.
Nope. Nothing better in half life 2
For those who wonder how they implemented such detail on senua's face in the hellblade 2 teaser. NT used the same tech in real time.
Amazing Next gen hardware will be amazing oh it's current gen of Consoles and PC can do this and better graphics. 😍🤩
can we undress her ? :p
This kinda graphics + photorealism will be great for vr
The voice doesn't match the character. I picture a very small blonde British lady by the name of lily
lol its not her fault. she was born that way man
"raised that way" - The accent part
Would you rather have " HERRO ME HOW U WANT SUCKY SUCKY 5 DOLLA"? Stop bitching.
You remind me of Rachel from Friends when she first met Julie, Ross' Asian Girlfriend... "Hi Im from New York!". LOOOL
Really? See, I pictured a 327 pound black woman by the name of shequisha... This is so unrealistic!
I think we've almost reached the limits of how far can graphics be realistic
merry me
Its improvement in deed compared to similar real time performances. Firs impression, Mouth and the teeth. Always something that's not right in RT-CG and the cloth is way to cg but still very, very impressive.
Naked body scan? i imagine
Looks like the tech that've been used in Hellblade has been evolving. Nice progress!
ohh.. these people in the comments that know "uncanny valley" phrase... watch real uncany valley videos and come back :D
I agree that a lot of people use that term wrong, and apply it to anything that is supposed to look human, but looks far from it, due to lackluster technical implementation. This video however seems to me like a good example of real time rendered humanoids getting pretty close to the true uncanny valley. Some aspects look very real, others do not, creating an unsettling clash.
imgur.com/a/prAH2
What are you trying to say?
Rasmus Jagd he's trying to say he doesn't know understand what uncanny valley means
technically as long as people can tell it's not human, it's still within the uncanny valley
Alot of people cant help but point out what's wrong. I'm just amazed at how far we've come with graphics. I remember playing the 1st Playstation thinking graphics couldnt get any better.
She looks 32 but sounds like a 12 year old
Something doesn't feel quite right. Until I remembered "microexpressions". These are small movements that you barely notice in a real person. But if they are missing you can immediately tell something is off. Or creepy.
Mouth too wide, accent doesn't help.
damnnnn!!!!!!! technology of graphics r in next level now
Minecraft still has better graphics !!
but can it run crisis on ultra ? :O
I see they put it on a touch-screen monitor at the unreal showcase. You can rotate the camera around the actor.
If the aim was to make this look realistic they failed by a long shot. Arms are scary and cartoon like. Teeth look like a 70 yr old smoker mixed with Wallace from Wallace and Gromit. The hair literally doesn't move as it should with gravity and head motion. Lighting is still lackluster and pretty flat. The eyes lack microsaccades with is pretty noticeable. I wish they'd make models based off actual human anatomy and all the muscles in a human face (and arms Ha!).
It's realtime mocap though. It takes weeks to clean up mocap traditionally to get the perfect animation.
I suppose you're dating a Victoria Secret model...
Even if it doesn't look 100% perfect, it's still impressive nonetheless
They succeeded in making just about the most realistic realtime mocap ever made.
Some things just aren't technologically possible yet, and perfect realism in realtime mocap of humans is impossible right now, but as far as realtime graphics go, they definitely succeeded in getting closer to the goal than anything else, ever.
In some moments, her mouth snaps open and close in a very unnaturally quick manner. That was one of the first things that immediately stood out to me. The look of her arms as well as their animations also looks off. Definitely still in the uncanny valley. She kinda reminds me of Samantha from Need for Speed Underground 1, a neat character who also had some odd uncanny valley issues.
The voice throws it off completely.
Getting closer.
We're now close enough to real humans to only be disappointed by digital ones. Not quite uncanny valley, but I can't help notice how it ISN'T like a human.
Why so many complaints? It looks amazing!