nDisplay with Vive Tracker in UE4 (Tutorial)

Поделиться
HTML-код
  • Опубликовано: 16 янв 2025

Комментарии • 126

  • @Megasteakman
    @Megasteakman 2 года назад

    22:07 really got me. Perfect comedic timing.

    • @3d_Something
      @3d_Something  2 года назад

      She is the most annoying cat i've ever had.

  • @bruceaquina1799
    @bruceaquina1799 3 года назад +5

    Great release! Thank you for the great content! I recently picked up a used 75" LED TV to mess with this exact setup. Also, really enjoyed the cat interruption. So funny, laughed hard. I'm excited for the next video Aiden Wilson!

  • @sage_morei
    @sage_morei 2 года назад +2

    my guy! this was incredibly comprehensive and probably the vid that paves the way for my VP undertaking:) Appreciate you putting this out for us!

    • @timoyliraisanen2336
      @timoyliraisanen2336 2 года назад

      I have to agree, brilliant that you built everything from scratch, makes so much more sense without all the clutter!

  • @timmyallen6148
    @timmyallen6148 3 года назад +1

    yeeees! this is exactly stitching together some gaps i had. thank you so much aiden!

  • @notso_usualyoutbuer
    @notso_usualyoutbuer 2 года назад

    22:07 INTRUDER!!! ALLERT ALLERT!!! RED CODE :D
    Thank you very much for this video ! It's really help a lot! Keep Doing the stuff! Commented - Liked - Subscribed!

  • @gerialkot
    @gerialkot 3 года назад +1

    Thank you for this tutorial! I followed your instructions and everything works fine.

  • @vettorazi
    @vettorazi 3 года назад +1

    amazing content! Please post more videos with this quality about Ndisplay please!

  • @jmepence
    @jmepence 2 года назад +1

    Great vid bro...

  • @dpredie
    @dpredie 3 года назад +1

    20:38 go to windows display, enable HDR ( or enable disable) it will be fixed

  • @imaiven
    @imaiven 2 года назад +2

    I followed the video step by step like 6 times, and everything is ok but when i enter switchboard the tracking stop working. I've seen some people that didnt add a value to cineCamera in the blueprint but just cant find my problem

    • @TaylorGMoore
      @TaylorGMoore Год назад

      I'm currently dealing with this same issue, any luck?

  • @giordanoshai
    @giordanoshai 3 года назад +1

    Nice video!!!!

  • @yasimchannam
    @yasimchannam 2 года назад

    Good Tutorial !! 27:00 How to fix inner camera view port on screen(projector)?

  • @ZeroNineFilms
    @ZeroNineFilms 2 года назад

    Nice is this best used with projector or can a green screen work?

    • @3d_Something
      @3d_Something  2 года назад +1

      Greenscreen can work but it’s a completely different setup

  • @nathanmeyer5250
    @nathanmeyer5250 2 года назад

    Great video! I'm not using a headset, do you know what I should do to set a zero point?

    • @3d_Something
      @3d_Something  2 года назад

      Not 100% sure, this is one of the reasons i just forked out for a headset

  • @detlefhochgeschurz9212
    @detlefhochgeschurz9212 2 года назад

    Thanks for the amazing video. If I buy a vive tracker I need a base station for this ?

    • @3d_Something
      @3d_Something  2 года назад

      Yes, and I would recommend a headset as well but you can use it without

  • @SuperdeluxeDaveyJ
    @SuperdeluxeDaveyJ 3 года назад

    This is amazingly helpful. Can you specify the base stations/tracker model and headset. you mentioned Cosmos for the headset. 2.0 lighthouses? 3.0 trackers?

    • @3d_Something
      @3d_Something  3 года назад

      I was using 2.0 trackers as well however the version of them does not make a difference to the setup and cosmos elite for the headset

  • @SpektorBaal
    @SpektorBaal 3 года назад

    May I ask what projector you using? I am trying to setup and learn. I am only using a green screen. I subbed to learn more. Thanks for the video.

    • @3d_Something
      @3d_Something  3 года назад

      Just a cheap on off of ebay, I would not recommend it

    • @SpektorBaal
      @SpektorBaal 3 года назад

      @@3d_Something Thanks

  • @Vsmphoto
    @Vsmphoto Год назад

    I think I messed up something, as the camera track is nowhere near the camera. Any help would be much appreciated.

  • @sable1wolf1
    @sable1wolf1 3 года назад

    Fantastic work. Thank you for your time. Does this method achieve Parallax? I might have missed that part.

    • @3d_Something
      @3d_Something  3 года назад

      Yes it does, you can see it at the very end as the camera moves about

    • @sable1wolf1
      @sable1wolf1 3 года назад +1

      @@3d_Something amazing. Thanks again. So long green screen!

  • @zhipingwang4107
    @zhipingwang4107 2 года назад +1

    hello, ue5 switchboard Can't start, is there any way?

  • @dpredie
    @dpredie 3 года назад +1

    hey aiden, around 12:25 you talked about Camera Render Mode and "Disable Chromakey".. can you explain a bit how would chromakey fit in the ndisplay? is this displaying green on the fustrum?

    • @3d_Something
      @3d_Something  3 года назад +1

      So you can either set the Uber frustrum to be green or if you like the entire LeD wall to be green, alternatively you can instead load a texture to display in the inner frustrum or the entire wall

    • @dpredie
      @dpredie 3 года назад +1

      @@3d_Something ah ok.. interesting. i'm thinking to loopback the ICVFX footage back to UE for composure LED set extension ( so when camera point outside the wall it transition off to CG composure), but i think there will be issues of Color matching and time sync..like resolume. i think i might be able to blur the alpha edges a bit for blending the color but not sure about time sync yet

    • @3d_Something
      @3d_Something  3 года назад

      As much I would like to tackle this I don’t think I will be able to unless I get access to an LeD stage to do some research and testing, would be cool to see a completely in engine solution for this

  • @ubong120
    @ubong120 2 года назад

    Can you please show your hardware set up

    • @3d_Something
      @3d_Something  2 года назад

      The hard ware setup is described at the start of the video

  • @xuesenli5968
    @xuesenli5968 Год назад

    BOSS, How can I use linetracebychannel correctly with switchboard???

  • @irfaankhan4880
    @irfaankhan4880 2 года назад

    Great video !!
    I have a question, hope that you can explain what to do.
    I don’t have any trackers. But I still want to use unreal engine to project with my short throw projector, so I only can see the screen with my projector, how do I split the screen? What step to follow in your video ? Hope that my question make sense 🙏
    Looking forward to hearing from you.

    • @3d_Something
      @3d_Something  Год назад

      Instead of attaching the Livelink camera to your Cinecamera just move the cine camera to roughly match where your real camera is and you will still get the right depth and effect.

  • @BryanLabarrere
    @BryanLabarrere 2 года назад

    Hello! Excelent tutorial it helped me so much! I want to ask you how to connect the zoom to the blueprint with a second tracker, right now is only working in editor for me. Thanks!!!

  • @antxionrhykel2699
    @antxionrhykel2699 3 года назад

    Good tutorial man, even if you are late to the party!
    I had a question, why did you chose to use XR instead of VRPN?
    I've been using vrpn and it's less temperamental and the setup is easier without the use of blueprints.

    • @3d_Something
      @3d_Something  3 года назад

      Live link I find easier there is even a VRPN to Livelink plugin, however almost all tracking solutions now have a Livelink Plugin,
      Blueprints are also nice in case I want to insert code to run in the chain

    • @antxionrhykel2699
      @antxionrhykel2699 3 года назад

      @@3d_Something sorry I should have specified;
      Livelink XR vs Livelink VRPN

    • @3d_Something
      @3d_Something  3 года назад

      @@antxionrhykel2699 ah, well that is entirely up to you then

  • @mandragoramedia
    @mandragoramedia 2 года назад +1

    When I press "play" on the portion for "Camera Tracker", my tracker doesn't move the camera. However in the blueprint viewport, it moves just fine. Any insights as to why that might be?

    • @3d_Something
      @3d_Something  2 года назад

      Did you include the apply to client node setup? That's the section in required to get it to run in nDisplay.

    • @mandragoramedia
      @mandragoramedia 2 года назад

      @@3d_Something I did. Followed the video faithfully, having watched it over and over. I'll keep at it though, because as a student in charge of getting the LED wall set up, the chance to learn all this is nuts

    • @knightinashes6934
      @knightinashes6934 Год назад

      @@mandragoramedia i am in the exact same situation with the exact same problem

  • @nadeemdeme
    @nadeemdeme 2 года назад

    I lost the control of vive tracker in Switchboard! please help

  • @JDARRASVP
    @JDARRASVP 3 года назад

    Can we keep the editor open when we start connexion in switchboard ?

    • @3d_Something
      @3d_Something  3 года назад +1

      You can however editing the scene in editor will not update in nDisplay and you will need to relaunch nDisplay to get the updated scene. Alternatively you can use multiuser editing which I may tackle soon.

  • @almuradyh
    @almuradyh 2 года назад

    that flickering layout bug related to GPU roll back to your previous driver✌

  • @jdpro7470
    @jdpro7470 2 года назад

    Great video Aiden. I'm using Antilatency as a tracker device and it comes with the blueprint ready and I'm trying to skip the part with making a blueprint for HTC in order to work but when I run Ndisaplay, the tracker doesn't work. It works only when I hit Play in the Engine, so I assume I'm missing something...

    • @3d_Something
      @3d_Something  2 года назад

      If antilatency is using livelink then you will need the Apply to client node and setup from the vive blueprint to get it to work. It's still worth creating the vive blueprint in it's entirety even if you aren't using vive, because the blueprint does more than just get the data from the vive tracker.

  • @deadmikehun
    @deadmikehun 2 года назад

    You mentioned at the end that the htc vice tracking is not so good. Im new to unreal and would like to experiment with camera tracking and was actually thinking of buying the HTC vive (not the pro) set with two base stations, controllers, but im afraid the tracking will not be good even for simple camera movement. Would love to hear your thoughts on this. Great vod anyways!

    • @3d_Something
      @3d_Something  2 года назад +1

      It’s great for learning however I would steer clear of it in any production environment

  • @nadeemdeme
    @nadeemdeme 2 года назад +1

    Hi, did you use any card for output display on wall like BMD deck l ink or something?

    • @3d_Something
      @3d_Something  2 года назад +1

      You output directly out of the GpU, as far as I know there is no way to use a Blackmagic card

  • @Oliverwanglin
    @Oliverwanglin 2 года назад

    Hi,when i use Switchboard,and i can not choose my level, it just show "default map",What could be the problem?

  • @nadeemdeme
    @nadeemdeme 2 года назад

    Hi, Vive tracker not workig in switchboard please help!

    • @3d_Something
      @3d_Something  2 года назад +1

      Make sure you save the Livelink XR as a preset and use the Apply to client node in the blueprint.

    • @nadeemdeme
      @nadeemdeme 2 года назад

      @@3d_Something Thanks 😀

  • @deebee5378
    @deebee5378 2 года назад +1

    I got this working, but one issue I'm having is that when I run the level in Switchboard the control of my camera tracker is weird. The pitch is reversed and it seems like the tracker's location is offset. I think it's starting position is at whatever values it's getting from LiveLink when I the level in the viewport, and I can't change them to 0 manually while it's active.
    Is there a way I can save the level with everything at 0, or a node in the blueprint I can use to set it's initial position?

  • @bkentffichter
    @bkentffichter 2 года назад

    Has anyone ever gotten a "Controller can't control selected component" message next to the "Transform Role" under "Role Controllers" in the "LiveLinkComponentController" ?

  • @tylerwalker492
    @tylerwalker492 2 года назад

    My LiveLinkXR movement isn't translating into my Game Mode! I've done everything up to 16:30, and when I press "Play", my camera is stationary. However, the camera + nDisplay screen both move with my LiveLinkXR controllers, but ONLY when not in Game Mode! I've been using UE4 for about 2 weeks so I have no idea what I'm doing or where to even begin looking for answers. Does anyone have any ideas? Thanks! :)

    • @3d_Something
      @3d_Something  2 года назад

      Did you remember to set the camera value in the blueprint? I believe someone else had the same issue and that was their solution

  • @sinanarts
    @sinanarts 2 года назад

    Thank you for this tutorial. I hope you can answer my question. I use Null Driver so Without a Headset. In this case when calibrating the 1st time the CENTER where is my center since there is no headset physically.? Appreciate your efforts.

    • @3d_Something
      @3d_Something  2 года назад +1

      Hello, i have never used the vive without a headset before so i'm afraid i have no idea where it sets the center.

    • @sinanarts
      @sinanarts 2 года назад

      @@3d_Something Thank you Aiden for your reply. Have a great day.

  • @ubong120
    @ubong120 2 года назад

    For your bgh1 do you use sdi output or hdmi and do you also use the time code and gen lock as well

    • @3d_Something
      @3d_Something  2 года назад

      For this tutorial setup I was not using genlock or timecode and i wasn't using any output on the camera, it was all captured in camera so there is no need to plug the camera into the PC.

  • @chriswatters7254
    @chriswatters7254 2 года назад

    Thank you for the information it really helped me get started. Is there a way to get better resolution on the NDisplay camera once Switchboard is triggered? The scene is tracking well, but the environment I'm using looks pixelated and there seems to be a ton of aliasing.

    • @3d_Something
      @3d_Something  2 года назад

      By default it should run at 100% resolution, but remember that the inner frustrum on the camera is only rendered on a small section of your display so it will be lower resolution than the display itself.

  • @tranpham19
    @tranpham19 2 года назад

    Hello. Can I ask if this set up can run in UE5 yet? thank you!

    • @3d_Something
      @3d_Something  2 года назад

      It can, simply follow the exact same setup, or you can make it in 4.27 then transfer it over to 5.0

  • @kidneyhunter6783
    @kidneyhunter6783 Год назад

    Thank you for offering great session! but unfortunately, I must be doing something wrong... If I fire up ndisplay, fps is really low like 3~5 fps. what should I do to solve this problem?

    • @3d_Something
      @3d_Something  Год назад

      With ndisplay you can expect 2-4 time worse performance then in the editor depending on the resolution of your nDisplay screen

  • @tranpham19
    @tranpham19 2 года назад

    Greate tutorial! I've successfully set up nDisplay and genlock by following your tutorials. However where I could genlock the editor viewport to decklink, when I enter nDisplay the genlock doesn't work. Do I need a quadro card to do this? Thank you.

    • @3d_Something
      @3d_Something  2 года назад

      Yes you would need a quadro card to genlock the graphics card, although in practice running at 2 or 3 times your cameras framerate on the screen should work just as fine if you can't genlock.

  • @DemeterZephyr
    @DemeterZephyr 3 года назад

    Hey Aiden, I'm not sure if you are still looking into moving on a controller only, now that I assume you are using specifically vive, but in the past 10 days or so I've been running through a lot of your videos among other resources setting up a test project to present to my college and I've managed to figure out how to use the joystick to control movement properly, similar to an fps character and the dpad method, so that where the camera is facing that is always forward, rather than the world forward always being forward on the joystick for the Oculus Quest 2
    I haven't tested non dapad esque joystick movement just quite yet, but I've figured out a lot of things, if you're interested at all feel free to leave a reply, I'm not entirely sure how to privately contact you but if need be I can leave an email address.

    • @3d_Something
      @3d_Something  3 года назад +1

      Is that using a character movement component? I am aware of quite a few ways to move around an object using a joystick now in Unreal, I know a lot more now then I did when I started, however if you do wish to share feel free to reach out to me on another platform such as linked in

    • @DemeterZephyr
      @DemeterZephyr 3 года назад

      @@3d_Something OK I sent a connection request, since messages are locked, the movement is based on the tracked camera bp, the way I've done it, so using a controller and not being in vr

  • @funkytek75
    @funkytek75 3 года назад

    Thx a lot for your tutorial ! I am so amazed by what what can be done with virtual production :) Everything is working almost fine ! however when i move close to my screen the object become little, and when i am further to my screen the object are becoming bigger ?!!! I think my tracker has inverted the Y axis. Is there a way to invert these moves ? (sorry for my english;))) and thx a lot for your help

    • @3d_Something
      @3d_Something  3 года назад +2

      That is correct yes, when you move closer the camera will see a smaller part of the screen so the window shrinks

  • @royaldanfield
    @royaldanfield 2 года назад

    great video, but does someone know if this whole process is supported in UE5 already? It is hard for me to wrap my head around the process for connecting the Vive Tracker (with Mars) to all the nDisplay-Stuff at make it work.

    • @3d_Something
      @3d_Something  2 года назад +3

      It works just fine in Unreal 5 although I plan on making a new video for it in Unreal 5

    • @royaldanfield
      @royaldanfield 2 года назад

      @@3d_Something yeah, nice! Looking forward to it!

    • @irfaankhan4880
      @irfaankhan4880 2 года назад

      I would also love to this this tutorial in 5.
      But i really did enjoy this tutorial aswell :)

  • @tilkymacky
    @tilkymacky 2 года назад

    Hey Aiden, I followed your tutorial and live link is working in the editor but it’s not working while running ndisplay from switchboard. Any idea why tracker data is not coming into ndisplay ?

    • @3d_Something
      @3d_Something  2 года назад

      did you setup the node to re add the livelink preset on event begin play?

    • @tilkymacky
      @tilkymacky 2 года назад

      @@3d_Something Ya, I setup the blueprint as its in the video and selected the right livelink preset in it. I'm getting the ndisplay out with inner frustrum displaying the ndisplay camera view but only camera tracking data is not passing to the ndisplay camera

    • @tilkymacky
      @tilkymacky 2 года назад

      I got it working now. I missed adding Cine camera in the camera tracker blueprint. Thank you very much for this tutorial.

    • @3d_Something
      @3d_Something  2 года назад

      @@tilkymacky all good

  • @cuefogthe
    @cuefogthe 2 года назад

    Does this work in Unreal 5 yet?

    • @3d_Something
      @3d_Something  2 года назад

      Yes it does

    • @cuefogthe
      @cuefogthe 2 года назад

      @@3d_Something I have a problem where even after connecting the tracker and base stations then opening unreal (@ 5:55 in the tutorial) there is no XR subject that appears. I can't seem to figure out what I'm missing, but when I add a LiveLinkXR Source I don't get anything as an option. Any ideas what this could be? I followed this tutorial step-by-step.

  • @garthmccarthy4911
    @garthmccarthy4911 2 года назад

    I have a Radion graphic card would it be able to handle this or do I have to go through an Nvidia GTX card

    • @3d_Something
      @3d_Something  2 года назад

      Well AMD makes the ai upscale so I imagine it will work with it

  • @stephanfitch7749
    @stephanfitch7749 2 года назад

    Would it be possible to solicit your remote help? Following your guide but hitting a wall when Switchboard tries to "play". Says the following: "Node_0: nDisplay uasset transfer failed: Error while trying to write to D:\UnrealD\Test5\Content
    DisplayConfig.uasset"

    • @3d_Something
      @3d_Something  2 года назад

      Perhaps try running switchboard as administrator

  • @kevinschwaiger8325
    @kevinschwaiger8325 2 года назад

    Does this mean that the CP ( the Headset) is always on the floor or can I choose it further away, so it isnt in the way when you are operating the camera freely?
    Thank you

    • @3d_Something
      @3d_Something  2 года назад +1

      Oh once you set the Center point with the headset you can move it to whoever you want

    • @kevinschwaiger8325
      @kevinschwaiger8325 2 года назад

      @@3d_Something Thank you dou you have a Discord server or smthg?

    • @3d_Something
      @3d_Something  2 года назад

      Yea in the video description is a link

  • @timothywood642
    @timothywood642 Год назад

    could you redo this for 5.3 :P

  • @ninomancuso7021
    @ninomancuso7021 2 года назад

    there is a fix for that windows not working thing in UE4, it's an NVIDIA issue

  • @rosariopanzitta6801
    @rosariopanzitta6801 Год назад

    error on unreal 5.1
    LogSwitchboard: Display: Started FlipMode monitor 9604: ../../../Engine/Binaries/ThirdParty/PresentMon/Win64/PresentMon64-1.5.2.exe -session_name session_16180 -output_stdout -dont_restart_as_admin -terminate_on_proc_exit -stop_existing_session -process_id 16180
    LogSwitchboard: Display: Process 9604 (flipmode_monitor) exited with returncode: 6
    LogSwitchboard: Display: Output:
    warning: PresentMon requires elevated privilege in order to query processes
    started on another account, so these processes won't be targetted by name
    and will be listed as ''. Further, there may be tracking errors
    near process termination, and if they are targetted
    -terminate_on_proc_exit won't work.
    error: failed to start session (error=5).
    how do i run switchboard as administrator? I can't fix it in any way, I also try to run unreal as administrator but nothing.

  • @sj5041
    @sj5041 2 года назад

    i got this error
    LogSwitchboard: Display: Started FlipMode monitor 17740: ../../../Engine/Binaries/ThirdParty/PresentMon/Win64/PresentMon64-1.5.2.exe -session_name session_19564 -output_stdout -dont_restart_as_admin -terminate_on_proc_exit -stop_existing_session -process_id 19564
    LogSwitchboard: Display: Process 17740 (flipmode_monitor) exited with returncode: 6
    LogSwitchboard: Display: Output:
    warning: PresentMon requires elevated privilege in order to query processes
    started on another account, so these processes won't be targetted by name
    and will be listed as ''. Further, there may be tracking errors
    near process termination, and if they are targetted
    -terminate_on_proc_exit won't work.
    error: failed to start session (error=5)

    • @3d_Something
      @3d_Something  2 года назад

      Looks like you need to run it as administrator

    • @sj5041
      @sj5041 2 года назад

      @@3d_Something you mean change switchboard, ndisplay ip adress? my vive tracker doesnt move like u

    • @3d_Something
      @3d_Something  2 года назад

      @@sj5041 that error looks like you need to run switchboard as an administrator on your Pc

    • @sj5041
      @sj5041 2 года назад

      thank u… how about why my tracker doesnt move..? i follow all step like u

  • @leahkallen2162
    @leahkallen2162 2 года назад

    Hi, I have a strange glitch where a sphere appears in the scene when I hit Play... Has anyone else had this issue and found a fix? Here is a link to a pic of the issue: drive.google.com/file/d/1MMdGT0nxoiRQjHtARMUflu5_nIeMnQre/view?usp=sharing

    • @3d_Something
      @3d_Something  2 года назад

      What your seeing is the player, i did do a video about this along time ago, another option is to start the camera very far away from your scene when you hit play or create a begin play very far away. Or the last option would be to build your setup so that it includes a player pawn.

    • @JeanBaptisteAndrez
      @JeanBaptisteAndrez Год назад

      I found an easier solution from user Greg Corson :
      Another way to get rid of it is to go to Edit->Project Settings->Maps & Modes and set Default Pawn Class to "None". Then Unreal won't spawn it when you press play.
      If "Default Pawn Class" is greyed out, In the selection of Game Mode, click +, New Game Mode and then you can put pawn as none.

  • @benjaminbrown282
    @benjaminbrown282 2 года назад

    For some reason when trying to connect the device in switchboard it says "Socket error: (ip address:2980). and the node won't connect to the device. Any ideas?

    • @3d_Something
      @3d_Something  2 года назад

      Did you launch the list we and the controller? Both need to be running for it to work.

    • @benjaminbrown282
      @benjaminbrown282 2 года назад

      @@3d_Something Wow. You're a genius. I had switchboard listener close out. I got it working great! Only thing now is figuring out the offset maybe from the tracker to the lens. When I look through the view finder it is a pretty big gap between the frustum and the cameras fov. Is there a way to make it so that the camera sees closer to just the inner frustum. Also thanks for all the work you put into these videos, they've been a huge help.

    • @benjaminbrown282
      @benjaminbrown282 2 года назад

      Also in the video you mention how to render the parts outside the inner frustum at a lower resolution, but you cat interrupted and I didn't catch how to do it, any tips?

    • @3d_Something
      @3d_Something  2 года назад

      @@benjaminbrown282 if you click on the frustrum plane there is a resolution multiplier