Mocap from your Phone for FREE - AI-based motion capture technology

Поделиться
HTML-код
  • Опубликовано: 7 сен 2024

Комментарии • 102

  • @CGShortcuts
    @CGShortcuts  Год назад +2

    Try the app here: rokoko.co/CGshortcuts
    And download Rokoko Studio here to export your mocap animation to Cinema 4D: www.rokoko.com/products/studio

  • @infojaviernova
    @infojaviernova Год назад +8

    Wow! This tuturial, is pure gold, thank you very much, :)

    • @CGShortcuts
      @CGShortcuts  Год назад

      Glad it was helpful! Did you give that app a try?

  • @iamYork_
    @iamYork_ Год назад +3

    I finally acquire a lidar cam and this releases hahaha... story of my life...

    • @CGShortcuts
      @CGShortcuts  Год назад

      haha, always the way isnt it!

    • @chadgtr34
      @chadgtr34 Год назад

      lidar cam is probably more accurate, this video doesn't answer to 'high speed running ' mocap though.

  • @i65Design
    @i65Design Год назад +3

    Excellent tutorial. A most interesting tool. AI tools for mocap are popping up all over the place now! Change is happening faster that we can adjust to a 'current' offering!

    • @CGShortcuts
      @CGShortcuts  Год назад

      Very true, AI everywhere all of a sudden. If it saves time I'm all for it

  • @EZZYLAND
    @EZZYLAND Год назад +7

    this is it. we dont need mocap suits anymore. the AI present is here

  • @watchandproduce
    @watchandproduce Год назад +6

    It would be great to see this workflow in Blender as well.

    • @CGShortcuts
      @CGShortcuts  Год назад +5

      Sorry Mark, we dont use Blender

    • @bogscave
      @bogscave Год назад +1

      @@CGShortcuts and thank you for that, my hobby would not exist without you guys 🤍

  • @mnl8286
    @mnl8286 Год назад +3

    不知道你是否可以翻译中文,但是我真的非常喜欢你的视频,每次都能带来不一样的惊喜!

  • @TamOlyn
    @TamOlyn Год назад +18

    Oh come on, It's not FREE If you have to PAY FOR IT.

    • @CGShortcuts
      @CGShortcuts  Год назад +4

      Rokoko Video is FREE, their other stuff is paid

    • @goodnessanimate108
      @goodnessanimate108 6 дней назад

      Rokoko is only free to iPhone users on mobile.

  • @EZZYLAND
    @EZZYLAND Год назад +1

    could we pls get a unreal engine workflow! also will i be able to use livelink (face mocap AI app) in conjunction with rokoko video?

    • @CGShortcuts
      @CGShortcuts  Год назад +1

      I think an Unreal Workflow tutorial is a great idea! I'll add it to the list! - If you can get the Livelink dat into C4D I dont see why not

  • @smileyaliona
    @smileyaliona Год назад +1

    So cool!

  • @optimus6858
    @optimus6858 Год назад +1

    GOLD

  • @hihihing7302
    @hihihing7302 Год назад

    Thanks as always!

  • @mufasa2079
    @mufasa2079 Год назад +1

    The camrera has to be low enough so that it doesnt look like you are on your tippy toes

    • @CGShortcuts
      @CGShortcuts  Год назад +1

      You might be right there Mufasa, I just whacked it on my tripod

  • @DeepMotionInc
    @DeepMotionInc Год назад

    We'd love to know what you think about DeepMotion - we have Hand & Face Tracking available with Multi-Person coming soon!

    • @CGShortcuts
      @CGShortcuts  Год назад

      Havnt heard of it, is it similar? Better results?

    • @DeepMotionInc
      @DeepMotionInc Год назад

      @@CGShortcuts Definitely better results -We've been working on ours for a lot longer and offer many more features (Face & Hand Tracking) than Rokoko. We have free accounts, and would love to know what you think!

  • @oblivion1501
    @oblivion1501 Год назад +3

    Great stuff! However, is it possible to extract the posing from just a picture instead of a video in rokoko studio? I guess most probably not, but then what would be the ideal way to do it?

    • @CGShortcuts
      @CGShortcuts  Год назад +1

      I think it only accept video files. Just record yourself making the pose or try exporting your still as a video and see what happens

    • @extrathicc78
      @extrathicc78 Год назад

      any follow up on this? did you try exporting a still image as a video to extract a pose?

  • @percyrogers7246
    @percyrogers7246 Год назад

    Not really that good of an app but it works somewhat. The recordings are not even accurate but it slightly picks up what you did.im going to just wait for an update for it to get more accurate with video's cause right now my options is only do it live for a small price.

    • @CGShortcuts
      @CGShortcuts  Год назад

      Early days for the sofware, it should only get better, still pretty impressive I thought

    • @percyrogers7246
      @percyrogers7246 Год назад

      @@CGShortcuts agreed! it is pretty neat, but hopefully it gets better with detecting the body.

  • @delsings
    @delsings Год назад

    Thank you for this!

    • @CGShortcuts
      @CGShortcuts  Год назад +1

      No problem Del, If you give it a try let us know what you think!

    • @delsings
      @delsings Год назад

      @@CGShortcuts sure thing! I'm trying to figure out all aspects right now so may be a while XD (My brain wants to move from mo cap right to a custom model to apply it to lol)

  • @halfcalf72
    @halfcalf72 11 месяцев назад

    This was excellent. Thank you. I am looking at a way to get MoCap without the suit. I looked at MoveAI and Rokoko and this Rokoko workflow resonates better with me. Do you find it easier? also, my office is small where my computer's webcam is. I will have to take short clips of several action takes in order to blend the mocap together in c4d...?

    • @CGShortcuts
      @CGShortcuts  11 месяцев назад

      Cheers, I never tried MoveAI in the end, was turned off by the fact that I needed several iPhones (not sure if thats still the case) and the extra space. Rokoko has been around for ages and have solid workflows and software so it should be a good bet

  • @ladybugcatnoirfangirl65
    @ladybugcatnoirfangirl65 4 месяца назад

    Say if i want to get a dance from a video can I do that too

  • @eberlekim8763
    @eberlekim8763 7 месяцев назад

    Hey there, very nice Video thanks a lot! Quick question: I am working as a GameDev & currently looking for the best and most efficient way to make many different animations and clothing options for my character.
    I thought about rigging my charcacter with the same skeleton scructure that Rokoko will export the animation data. Then I dont have to retarget & instead just copy/paste the keyframes of the bones. At least I think so haha. Then I need just a way to make a own control rig out of the skeleton the make some own animations if I want to. And also i got to find a way to weightpaint & parent the new clothings to the skeleton if i make new ones. Do you have any thoughts about that?
    Sorry for all these questions, I hope I dont bother you :) I''ll be very thankul for every response, have a great day!

    • @CGShortcuts
      @CGShortcuts  7 месяцев назад

      Rigging is a pretty complex topic, are you planning to do it all in Cinema 4D? A combination of motion capture and keyframing by hand is usually the way, but it sounds like you know what you need to do. Realy depends on how detailed you want to get (considering budget and time restraints)

  • @vasily3994
    @vasily3994 Год назад

    extremly useful.🤙🤙🙏🙏

  • @samuelosborn2548
    @samuelosborn2548 10 месяцев назад

    do the fingers move at all? or do you have to do some finagling to make that happen?

    • @CGShortcuts
      @CGShortcuts  10 месяцев назад

      It doesnt capture finger movements, you'd need the suit for that

  • @oxhid3
    @oxhid3 6 месяцев назад

    now it feels it is not free anymore, I am asked to upgrade plan to export

    • @CGShortcuts
      @CGShortcuts  6 месяцев назад

      No way, really. Thats a shame, I thought it was meant to be free forever

  • @sophialiarou4688
    @sophialiarou4688 Год назад

    AMAZING!!!!!!

  • @chadgtr34
    @chadgtr34 Год назад

    does it do well with the scane ' a women walking very fast on high heel ' ?

    • @CGShortcuts
      @CGShortcuts  Год назад

      Not sure, I didnt try it with high heels on;)

  • @philippeLebret
    @philippeLebret Год назад

    Great, but how to update that process with facial rig for more options ? :p

    • @CGShortcuts
      @CGShortcuts  Год назад +1

      You could probably blend it with Moves by Maxon for the facial animation part: www.maxon.net/en/cinema-4d/features/moves-by-maxon

  • @MegaBexon
    @MegaBexon Год назад

    Omg we have a same tummy. Let's blame C4D :)

    • @CGShortcuts
      @CGShortcuts  Год назад

      Yep, the more I use C4D the more 3D my belly becomes!

  • @gladmerchshop
    @gladmerchshop Год назад

    how can i export it like an mp4 without a background and put the avatar besides me ?

    • @CGShortcuts
      @CGShortcuts  Год назад

      Export it as a PNG sequence with an Alpha Channel then comp it into footage of yourself

  • @parapoliticos52
    @parapoliticos52 10 месяцев назад

    I dont get it why it is not possible to make an affordable motion suit. Why would be any different that the VR avatars generated using the handles.

    • @CGShortcuts
      @CGShortcuts  10 месяцев назад

      They have definitely come down a lot in price over the years

  • @anything_x
    @anything_x 10 месяцев назад

    Yea, just upload your videos

    • @CGShortcuts
      @CGShortcuts  10 месяцев назад

      Not sure what you mean

  • @macitseferi1843
    @macitseferi1843 Год назад

    Does the software allow me to use more than one camera to get better quality results?

    • @CGShortcuts
      @CGShortcuts  Год назад

      I dont think so, not at the time we tried it amyway

  • @MadDogHatesWoke
    @MadDogHatesWoke Год назад

    is the unreal skeleton in the app settings unreal 4 or 5 skeleton?

  • @rohilabrar5708
    @rohilabrar5708 Год назад

    What about facial it's work on facial too

    • @CGShortcuts
      @CGShortcuts  Год назад

      No face or fingers yet, but we'll do videos about how to do that soon

  • @SlowPell
    @SlowPell 6 месяцев назад

    Okay but how do i do it from my phone

    • @CGShortcuts
      @CGShortcuts  6 месяцев назад

      the phone part is just taking a video of yourself. I just connected the phone to the pc and uploaded the video from there

  • @avesia4678
    @avesia4678 Год назад

    Not works for mobile. Choosing existing video not loading lol

    • @CGShortcuts
      @CGShortcuts  Год назад

      I think I just shot the videos on my phone and transferred them to desktop

  • @Kondi_Animation
    @Kondi_Animation 11 месяцев назад

    Can I do that in C4D lite?

  • @barba3377
    @barba3377 Год назад

    are there ways to actually improve the results? for example wearing a specific color, using a green screen ecc.?

    • @CGShortcuts
      @CGShortcuts  Год назад

      not in my testing. angling the camera as straight as you can to the subject does help though, dont shoot from slightly below or above

    • @randomdudr
      @randomdudr Год назад

      Green screen may make it worse IMHO. Unless you make the ground a different color. Just my opinion though

  • @randyharris882
    @randyharris882 10 месяцев назад

    Does this work with Daz studio?

    • @CGShortcuts
      @CGShortcuts  10 месяцев назад

      Not sure, I'd only use Daz for character creation, would rather handle the animation in c4d

  • @davidguerrero9706
    @davidguerrero9706 Год назад

    Have you used maxon's move? Do you think its better option? especially if you use c4d.

    • @CGShortcuts
      @CGShortcuts  Год назад

      Hi David, I would love too but I dont have an iPhone!

  • @user-pu5yy6pu9v
    @user-pu5yy6pu9v Год назад

    cant work with ue5?

    • @CGShortcuts
      @CGShortcuts  Год назад

      Im pretty sure it does, just need to export it in the right format;)

  • @ApexArtistX
    @ApexArtistX Год назад

    Why does American free always has a limit

    • @CGShortcuts
      @CGShortcuts  Год назад

      Because they're a business and it costs money to develop such tools

  • @WillyCash69
    @WillyCash69 4 месяца назад

    Funny how all videos showing motion captures like this, strategically choose Characters that have no face or its covered with a mask so you cant see the major flaws it.

    • @CGShortcuts
      @CGShortcuts  4 месяца назад

      It doesn't track facial features so it's not really necessary.

  • @DirectionGaming
    @DirectionGaming 9 месяцев назад

    No Fingers

  • @Keji839
    @Keji839 Год назад

    AI needs work This is nowhere ready for production workflows. I’ll stick to IPIsoft mocap with 2 Xbox kinects

    • @CGShortcuts
      @CGShortcuts  Год назад +2

      I think its definitely the best AI mocap out there, plus Rokoko plan to develop it further so hopefully it'll only get better - was good fun playing around with it though!

    • @EZZYLAND
      @EZZYLAND Год назад +2

      AI improves at exponential speeds lol humans dont

    • @Keji839
      @Keji839 Год назад

      You are both very correct

  • @martincarp4671
    @martincarp4671 10 месяцев назад

    rokoko is not free

    • @CGShortcuts
      @CGShortcuts  10 месяцев назад

      Have they changed it? Was free when I recorded this video

  • @gokhanelmac
    @gokhanelmac 3 месяца назад

    There is no tutorial about speaking, mouth, lips and tongue with C4D.... Can you imagine ? zero tutorial

    • @CGShortcuts
      @CGShortcuts  3 месяца назад

      This app doesnt capture that data, you'd need a different setup or to do it by hand