Unity Sentis: Create AI-driven XR experiences

Поделиться
HTML-код
  • Опубликовано: 26 дек 2024

Комментарии • 32

  • @jumprabbit8946
    @jumprabbit8946 7 месяцев назад +1

    Thank you so much!!

  • @ajit5626
    @ajit5626 9 месяцев назад +1

    Great Video! Would love to know which asset pack that background world is from please!

  • @SarpKaya-p3m
    @SarpKaya-p3m 3 месяца назад +1

    How can I add more sign recognitions like 4 + - / * And is it possible to do this with a 3d drawing pen?

  • @crazyfox55
    @crazyfox55 11 месяцев назад +1

    One small thing, why not use the built-in "using" keyword, which will dispose of the objects even when an exception is thrown. Also can you dispose the input tensor within the execute function either at the end or after the model has already ran? Thanks.

  • @YeahThatGuy7
    @YeahThatGuy7 11 месяцев назад +5

    Can you make a tutorial that shows how to create an AI that is capable of having a dialogue with the player. They showed that at Unite but have 0 examples, very frustrating.

  • @betterwithlasers
    @betterwithlasers Год назад

    Thanks for the great tutorials! Really helpful with navigating the SDK changes. Quick one - how do handle moving the camera (walking around) with analog stick? Wondering if you directly change the transform of the OVRCamera, give it a parent object or something else. Cheers

    • @blackwhalestudio
      @blackwhalestudio  11 месяцев назад +1

      You can give your OVR Rig a Character Controller component and move it that way. Using the analog stick would be the preferred way yes!

  • @JackHeslewood
    @JackHeslewood 9 месяцев назад +1

    I did not know that you can add layers within Sentis, I thought it was purely inference. Would you suggest for performance reasons to add the layer within the ONNX model? Thank you for the video!

    • @blackwhalestudio
      @blackwhalestudio  9 месяцев назад

      I would suggest to do as much as you can outside of Unity already, yes!

  • @DevDunkStudio
    @DevDunkStudio 9 месяцев назад

    Nice guide!
    I wonder how the texture converter converts texture, 28, 28, 1, into 1,1,28,28
    Shouldnt it be in the same order?

  • @zappist751
    @zappist751 11 месяцев назад +2

    Can you please make an object detection video using it?

    • @blackwhalestudio
      @blackwhalestudio  11 месяцев назад +3

      Hi, nice idea, I will look into it for sure!

    • @zappist751
      @zappist751 11 месяцев назад

      Thanks! @@blackwhalestudio

  • @SarpKaya-p3m
    @SarpKaya-p3m 3 месяца назад +1

    Hi, I've followed the exact steps but the script gives me errors like TensorFloat and Iworker couldnt been found. And I am sure that I've downloaded sentis

    • @firefly5033
      @firefly5033 Месяц назад

      how did u fix the error?
      I've encountered the same errors

    • @SarpKaya-p3m
      @SarpKaya-p3m Месяц назад

      @@firefly5033 Well If I remmember it right be sure that you have downloaded the older version of this unity package, like the test experimental one. You can do it by looking and downloading the exact version number of that. But after I used, it didnt worked well so I gave up on this project

  • @abderrazakschannel4491
    @abderrazakschannel4491 10 месяцев назад

    Please can you tell me what is the sprite used in the first object detection game(car....), transparent but has soem kind of boudries around the objectc. Thank you

    • @blackwhalestudio
      @blackwhalestudio  10 месяцев назад

      This is an object detection sample from Unity. They haven't released it yet unfortunately!

  • @mq6802
    @mq6802 10 месяцев назад

    Would it be possible to do this but in passthrough mode reading a book or words on physical object?

    • @blackwhalestudio
      @blackwhalestudio  10 месяцев назад

      Yes, absolutely

    • @mq6802
      @mq6802 10 месяцев назад

      @@blackwhalestudio how? i been trying to find the script that gives you access to the camera?

    • @blackwhalestudio
      @blackwhalestudio  10 месяцев назад

      We dont have access to the camera of Meta Quest!@@mq6802
      What exactly are you trying to build?

    • @mq6802
      @mq6802 10 месяцев назад

      @@blackwhalestudio thank you for your quick Reponses. I would like to use the quest 3 cameras for real time number classification like in your video. For example a math problem hand written in a paper would be solved by being in passthrough mode and and a combination of neural networks. When having the quest on would display the numbers in your headset.

    • @blackwhalestudio
      @blackwhalestudio  10 месяцев назад

      Ah, I understand now. Unfortunately, this is impossible right now, since we don't have any way to access the camera.@@mq6802

  • @carpineti93
    @carpineti93 Год назад +1

    Very interesting. I think I will try to do that. Can you tell me if you can use meta quest 2 or do you need quest 3?

  • @emmanouildrivas4961
    @emmanouildrivas4961 2 месяца назад

    Hi, another great video. I was thinking maybe you can create a tutorial how to use unity sentis to create an AI NPCs that generate dialogs based on its knowledge database? I saw a video for the Inworld AI ruclips.net/video/gUCahPSAut4/видео.html but right now it don't exist in the asset store and I dont want to integrate the chatGPT so I was wondering maybe I can create an AI with similar abilities but using instead the Unity Sentis. What do you think about it? Also is there a tutorial how to create models for Unity sentis?

  • @SaschaRobitzki
    @SaschaRobitzki 10 месяцев назад

    Do you also get a bunch of warnings of the following kind?
    `Shader warning in 'Compute.Shaders.Broadcast.gen': integer modulus may be much slower, try using uints if possible. at kernel ElementwiseFModInt at Compute.Shaders.Broadcast.gen.compute`

    • @blackwhalestudio
      @blackwhalestudio  10 месяцев назад

      I haven't experienced such errors before

    • @SaschaRobitzki
      @SaschaRobitzki 10 месяцев назад

      @@blackwhalestudio It disappeared for me as well. I only got it at some of my first runs, even though I didn't change anything after that but the warnings disappeared.