- Видео 43
- Просмотров 42 395
Lightcraft Technology
США
Добавлен 18 дек 2013
Lightcraft builds Jetset and Autoshot, an ultralight virtual production system that works with Blender and Unreal.
www.lightcraft.pro/
www.lightcraft.pro/
Gaussian Splat Setup
This video covers the new Gaussian Splat authoring workflow in Jetset Pro and Jetset Cine.
00:00 Gaussian Splat Setup
00:31 Installing Gaussian Splat Add-on
01:24 Importing Gaussian Splat
02:01 Viewing Splat
02:45 Adding Splat Locator
03:46 Parenting Gaussian Splat to splatloc
04:25 Creating 3D Reference Geo
06:23 Rough Splat Location
07:22 Setting Wireframe Display
07:53 Fixing Splat Orientation
08:43 Fixing Splat Scale
09:56 Avoiding Splat File Changes
10:36 Verifying Splat Scale
11:18 Adding Scene Locators
15:38 Hiding Reference Geometry
16:15 Exporting to USD
16:40 Pushing Multiple File Formats
17:19 Loading USDZ File
17:43 Loading .PLY File
18:07 Switching Scene Locators
18:31 Reflection Handling
00:00 Gaussian Splat Setup
00:31 Installing Gaussian Splat Add-on
01:24 Importing Gaussian Splat
02:01 Viewing Splat
02:45 Adding Splat Locator
03:46 Parenting Gaussian Splat to splatloc
04:25 Creating 3D Reference Geo
06:23 Rough Splat Location
07:22 Setting Wireframe Display
07:53 Fixing Splat Orientation
08:43 Fixing Splat Scale
09:56 Avoiding Splat File Changes
10:36 Verifying Splat Scale
11:18 Adding Scene Locators
15:38 Hiding Reference Geometry
16:15 Exporting to USD
16:40 Pushing Multiple File Formats
17:19 Loading USDZ File
17:43 Loading .PLY File
18:07 Switching Scene Locators
18:31 Reflection Handling
Просмотров: 390
Видео
Jetset Cine drives SynthEyes sub-pixel tracking refinement in seconds!
Просмотров 561Месяц назад
This video shows the Autoshot-scripted Jetset Cine shot import and refinement workflow with SynthEyes in less than 2 minutes! Starting with AI rotomattes to keep trackers off actors, and rapidly setting survey points using the Jetset stage geo scan, we refine the solve to a sub-pixel level while maintaining the original on-set scale, orientation, and position. This workflow solves the 'tracking...
Synchronized Rendering in Unreal
Просмотров 490Месяц назад
Thanks to Bennet Win for his excellent walkthrough! ruclips.net/video/NvcFtDYupfc/видео.htmlsi=hiKZ15bKH_HcsAJr lightcraft.pro/ 00:00 Synchronized Rendering in Unreal 00:11 Hardware Used 00:42 Setting up Unreal Plugins 01:38 Running Live Render Preview Script 02:23 Configuring LONET2 on Jetset 03:07 Adding Live Link Source and Preset 03:59 Creating AJA Media Bundle 05:20 Dragging Media Bundle I...
Tracking Refinement with Syntheyes
Просмотров 1,9 тыс.2 месяца назад
Syntheyes Essentials: ruclips.net/video/IIF1Htbog_o/видео.htmlsi=lpwg3I0HsOrYGP7A Auto Tracking Deep Dive: ruclips.net/video/iu3Ils6GlD4/видео.htmlsi=4gipnS-uduTZUduZ InSpyReNet Download: lightcraft.pro/downloads/ 0:00 Tracking Refinement with Syntheyes 00:28 Installing InSpyReNet 01:33 Verifying Installation 02:04 Take Color Space 02:44 Generating AI Roto Mattes 03:49 Blender Render File 04:20...
Unreal Live Render Preview v2
Просмотров 6383 месяца назад
This is a video about Live Render Preview with LONET v2 0:00 Live Render Preview with LONET v2 01:47 24 fps Required 02:24 Jetset Setup 03:30 Installing LONET Plugins 04:18 Enabling Plugins and UI 04:56 Unreal Live Link Setup 05:08 Live Render Preview Script 05:33 Composure Layers 06:18 LC Media Player and Texture 06:39 Correcting Video Player UR 07:24 Live Media Layer 07:51 Keyer Settings 09:0...
Jetset Cine with Blackmagic BRAW
Просмотров 2,1 тыс.3 месяца назад
lightcraft.pro/ 0:00 Jetset Cine with Blackmagic BRAW 00:35 Accsoon See App Installation 00:52 Connecting Accsoon SeeMo to iPhone 01:41 Tentacle Sync App Setup 02:04 Project Folder Setup 02:45 Tentacle to Jetset Connection 03:18 Cine Calibration Setup 03:39 Cine Calibration Capture 06:02 Exiting Calibration Capture and Red Reticule 06:36 Autoshot Calibration Panel 06:47 Cine Camera Sensor Width...
JetsetCineRigging
Просмотров 2,9 тыс.3 месяца назад
Jetset Cine rigging components: lightcraft.pro/docs/jetset-cine-rigging/ Accsoon SeeMo components: lightcraft.pro/docs/which-accsoon-seemo/ 0:00 JetsetCineRigging 00:20 Cine Camera Cage 01:31 iPhone Cage 03:14 Rails on Camera Cage 04:05 Mounting iPhone to Rails 04:53 Accsoon SeeMo 05:17 MagSafe Cooler 06:10 Video Cable to iPhone 06:29 NP-F Battery 06:38 HDMI to SeeMo 07:26 Tentacle Sync 08:41 E...
Autoshot Unreal Round Trip
Просмотров 2 тыс.3 месяца назад
Fantasy Castle on Unreal Marketplace: www.unrealengine.com/marketplace/en-US/product/infinity-blade-castle nVidia Omniverse: www.nvidia.com/en-us/omniverse/ Lightcraft Downloads: lightcraft.pro/downloads/ 0:00 Autoshot Unreal Round Trip 00:20 Creating Jetset Project 01:00 Installing Autoshot Tools & Autoshot 01:56 Create Matching Autoshot Project Folder 02:29 Project Folder Organization 03:11 n...
Autoshot Blender Round Trip
Просмотров 8894 месяца назад
lightcraft.pro/downloads/ 0:00 Autoshot Blender Round Trip 00:42 Downloads 01:27 Installing Autoshot and Tools 01:54 Installing Blender Add-On 02:32 Setting Autoshot Project Folder 03:16 Project Folder File Structure 03:57 Importing Polycam Scan 05:13 Setting Materials to Emissive 06:19 Decimating Mesh 07:11 Adding Scene Locators 07:46 sceneloc_* prefix 09:52 Scene Locator Orientation In Jetset...
Setting Cine Offset Manually
Просмотров 8215 месяцев назад
lightcraft.pro 0:00 Setting Cine Offset Manually 00:11 Create Timeline at Cine Frame Rate 00:45 Set Cine Marker 01:00 Set Jetset Marker 01:14 Aligning Clips 01:27 Checking Time Alignment 01:52 Calculating Frame Offset 02:29 Entering Offset in Autoshot
Importing Animated Takes
Просмотров 4688 месяцев назад
www.lightcraft.pro/ 0:00 Importing Animated Takes 00:19 Autoshot Settings 01:05 Creating the Unreal Sequence 01:27 Adding the Elevator Subsequence 01:46 Adding Scene Locator to Elevator Sequence 01:59 Adding Camera Attach Track 02:26 Fixing Animated Texture Display 02:45 Fixing Texture Brightness 03:33 Disabling Image Plate 04:11 Command Line Encoder Shortcut 04:50 Rendering with Movie Render Q...
Exporting Animated Scenes
Просмотров 3628 месяцев назад
www.lightcraft.pro/ Get nVidia Omniverse FREE at: www.nvidia.com/en-us/omniverse/ 0:00 Exporting Animated Scenes with Omniverse 00:23 Omniverse Setup 00:55 Select Export Layer Objects 01:31 Adding the Level Sequence Animation 01:44 Exporting to Omniverse 02:33 Downloading USD Zip from Nucleus 03:43 Converting USD to USDZ in Autoshot 04:18 Loading Scene and 360 Pano in Jetset 05:07 Synchronizing...
Rendering 360 Panoramic Backgrounds
Просмотров 3608 месяцев назад
Link to WINBUSH's 360 tutorial: ruclips.net/video/SpkP1XCF_mE/видео.htmlsi=UpzuwXWYFVOc-MLt 0:00 Rendering 360 Panoramic Backgrounds 00:43 USD Export Layer 01:06 Placing 360 Camera 01:33 Setting Foreground Objects to Hidden in Game 02:02 Creating 360 Level Sequence 02:36 Movie Render Queue Panoramic Setup 03:40 Reverting Scene and MRQ Settings 04:12 Transferring 360 Images to Jetset
Animation Timeline Control
Просмотров 6688 месяцев назад
lightcraft.pro 0:00 Animation Timeline Control 00:22 Jetset Timeline UI 01:01 Remote UI 01:20 Timeline Settings 01:37 Timeline UI 01:50 Reset Point 02:16 Example Take
Exporting Animated Characters
Просмотров 7669 месяцев назад
Lightcraft Downloads: lightcraft.pro/downloads 0:00 Exporting Animated Characters 00:19 Default Animated USD Export Problems 00:44 Skin 2 Solid Blender Add-on 01:15 Importing Move.One FBX 01:59 Skin to Solid Conversion 03:04 Converting Mixamo Animation
Setting Tracking Origin with Markers
Просмотров 69811 месяцев назад
Setting Tracking Origin with Markers
"Hello, Lightcraft Technology. Does Seemo already synchronize timecode between an iPhone and a camera, or is it necessary to purchase a Tentacle Sync or similar device for timecode synchronization?"
The status of LONET2 Livelink shows Receiving but doesn't complete Why the subject name doesn't show?
Thank you for this video. I'm stuck at the livelink configuration. I have jetset running on the iphone, ip adress in the clipboard, when adding the livesource, I see a source machine "receiving" but there is no "JetSet" inside.
The same problem as u :(
Can you join an Office Hours session? We do then Mon/Tues/Fri at 9am Pacific time. Easier to debug live.
So, the phone sits on top of the lens, not the sensor? Why is that?
The Jetset Cine lens calibration system calculates the offset between the iPhone lens and the cine camera lens wherever they are. The lens 'entry pupils' are (usually) close to the front of the glass, so it's a good idea to keep the iPhone close to the front (and also gives the phone a clear line of site.)
this is soooooo cool! thank you!
I'm wondering what Jetset's performance will be like in low-light conditions. Thoughts? Thanks you!
When using Jetset Cine with an external cine camera, the iPhone can operate at a different exposure than the main phone (and in fact we run the iPhone at auto exposure during Cine shots for exactly this reason. )
Great video as always, I'm guessing we could do a similar workflow but use Unreal Engine?
I haven't used any of the Gaussian implementations in Unreal so I don't know how they behave. The basic splatloc concept should work, however.
Hello Lightcraft Technology. Thanks for sharing video. Which Lens on the BMPCC are you using in this demonstration?
This is a standard Canon 24-105 zoom.
I'm in the VFX industry for many years, and seeing this workflow and the new technology you're bringing to the masses is so exiting :) Can't wait to test Jetset once I finish my new green screen studio (cyclorama). Amazing job guys!
Thanks! Post some shots when can!
@@eliotmacksure 👍
Has anyone had issues with the proxy step? I'm not sure if it's the amount of clips but it doesn't even load for me
Hello. I am considering purchasing an iPhone Pro to use the LiDAR feature specifically for virtual production with the LightCraft application. Could you please let me know if there is a significant difference in LiDAR quality and performance between the iPhone models from version 12 up to the upcoming iPhone 16? Are there any major benefits of using the newer models with your application?
We've found remarkable improvements with each new generation of iPhone, especially in GPU capacity and in cooling. The LiDAR hasn't changed much, but I'd still recommended getting the newest iPhone you can simply for the other performance aspects. It makes a big difference. We're getting Jetset ready for iOS 18 and looking forward to what is in the new hardware coming up soon.
@@eliotmack thank you for the clearly answer.
Ensure your camera is focused on the object you're scanning, to get more tracking points.
Would this workflow with Jetset Cine and Syntheyes be useful outside of virtual production applications? Footage shot with the Jetset Cine rig mounted on your camera is basically able to capture a pretty solid camera track and attach some tracked lidar scanned geo that can represent the set? I could definitely see a huge time savings being able to bring a shot into syntheyes with the camera and geo already tracked for reference to integrate CG and VFX. Or am I misunderstanding what it does? Also, does it only work with solid backgrounds/green screen?
Yes -- we think this will be very useful for 'normal' non-greenscreen projects! The AI rotomattes are very good, and the set scanning + post tracking technique will work on any shot that needs VFX added. In fact, the iPhone uses a natural feature tracking algorithm that will work better in a 'normal' environment, since there are many more trackable corner features than on a greenscreen.
and now you just buy the ultimatte keyer from BMD and you have a professional virtual studio setup. Was waiting for this, NOW i will go for JETSET CINE....awesome. I worked many years ago with a Lightcraft Tech Previzion system, which was extremely expensive but now this is way better for an indie producer. Congrats, guys !!
this is f**** amazing, i need an iphone now
Thank you so much for this! When using USD viewer I noticed you loaded Castle_3 but didn't show what those export settings were. When I load _2 version I get the d3d error that crashed Unreal. Any help be greatly appreciated!
I thought I was crazy because I didn't a _3 version and was wondering when that was supposed to be created? It seems like a part of the tutorial is missing?
I am interested in only gathering 1. Camera tracking data 2. Camera track plus respective lens data Can we please have a simple tutorial on how to gather inputs and use with Unreal post? And pls share shoot data so that one can try first hand?
Have you tested this with full blown rigs with mattebox? What is the limit of distance between cine lens and the iPhone lens? In most case of movie shoot we have matteboxes, why not demonstrate such scenario?
Good suggestion. I'm working on an update of the rigging that better handles an underslung camera rig by mounting the iPhone to the side of the main lens instead of above it. It's also fine to raise up the iPhone a bit to clear the matte box.
you should make more tutorial about SYNTHEYES
Is there a link to InSpyReNet? I found it on GitHub but not sure what to download
Thank you! So there is no workflow where a Tentacle Sync is not required? For example, having Unreal follow the built-in timecode coming from the camera itself? (Even if the camera's speed drifts ever so slightly over time)
If you want the live action and rendered CG signal to stay in sync, you'll need the Tentacle Sync. There may be some way to hack Timed Data Monitor to make that work, but frankly the Tentacle works great and is inexpensive. We also plan to use the timecode data to assist post production take syncing.
@eliotmack Sounds good :) I ask because I try to keep my camera rigs with the least amount of extra battery powered hardware as possible. Less hassle and points of failure for a rig that is already full of lens encoders, tracking system, monitor, etc etc. I was also able to get a non-Jetset VP rig to "appear" to be in sync with Unreal without a Tentacle Sync so was wondering if your script might be able to do the same. Good point on organizing the takes, though. I'll go with the TS on the rig.
wow
Hey. Can we get a video with cine-camera pipeline to blender? We only have with iphone and that makes me confused...
The base version of Jetset is iPhone/iPad only. Jetset Cine (the version in this video) connects to external cine cameras and provides the lens calibration and post production footage processing.
Is tenacle sync a must?
Required for synchronized real time rendering in Unreal. Highly recommended for general use as then the tracking data has the same timecode as the cine video takes.
@@eliotmack can I get away with it for just camtrack data to be used in post?
Why do I set Lonet2 livelink and subject name show nothing?
✨😎😮😵😮😎👍✨
Under what circumstances would you need to refine the live track?
Shots with visible CGI & live action joins. In this case it's the join between the CG railing and the practical floor, but in other shots it might be high degrees of floor contact.
how to bring them over to unreal or blender ? tried fbx and usd does not works.. fails hard.. unreal has no camera sometimes
Watch closely at 17:32 -- it goes into detail on the Blender import process.
Amazing
How to do foreground occlusion composition
What happens if there is duplicated and drop frames ?
USD importer is still beta damn
The top view does not work for me its just grey space even after pressing F. I'm not sure what the reason is
Make sure you have something in the Unreal scene selected before hitting F; the F command just frames the selected object in the viewport.
Ok so I've got the USD working but for some reason the model I am using is always laying on the ground. I've tried rotating the scene-loc and I've tried switch the z-axis to the y-axis and it still doesn't work. Also does the tracking work without the full preview. For example, filming with the door messed up and just adjusting the camera after the fact in unreal. Thanks!
Is there a Mac workflow to this? Because the omniverse launcher only has windows and linux.
I also can't export the layer as a USD
Unreal has an integrated USD exporter that works on Mac. It works but doesn't handle everything that the Omniverse exporter does. We''ll do a tutorial on it at some point.
@@eliotmack Thank you so much
Hello Team, I am looking to use my Sony Fx3 for Virtual Production, does jetset and its software integrate well with this specific camera? if not how do I go ahead using my Fx3 for Virtual Production?
Can you save the hdri that has been captured?
Yes, but the quality of the HDRI wasn't that high, so we haven't pursued this heavily for VFX integration.
@@eliotmack Oh that’s too bad. It would be awesome if that was possible somehow. Thank you for the answer!
Thanks for this video, been following and keen to get on the board with Cine.
in my case it doesnt create the level sequence when copy pasting the code in unreal! its having issues everywhere...
check if imageplate plugin is enabled, worked for me
@@knstntn.g cool thanks! i will try it out!
Hi, I have the Seemo Pro 1080p version and was wondering if that will work?
Yes -- all of the SeeMo devices will work with Jetset Cine.
@@eliotmack thank you! Any limitations with the non-4K version?
@@alexandertabrizi2083 1080p is fine for calibration. The SeeMo 4K has a SD card reader so you will be able to record takes directly to it if desired. Very useful for productions that don't want anything near iCloud.
@@alexandertabrizi2083 The SeeMo 4K has a SD card slot that Jetset will soon be able to record to. Other than that no limitations.
Can or has this been calibrated with an anamorphic lens with a round trip into blender? Or is best to stick to spherical glass?
We've tested spherical extensively. Anamorphic calibration in Jetset should be fine for getting a basic track. For sub-pixel refinement we're developing a Syntheyes workflow that can be extended to anamorphic solves.
@@lightcrafttechnology Thank you, looking forward to it
Thanks for all of the great tutorials on how the system works. I'm interested in Jetset Cine for applications where there are few usable tracking points visible in the view of the main camera (e.g. the frame is full of moving people or moving elements like foliage or water). From your tutorials, it appears that Jetset is designed to have the iPhone camera facing the same direction as the main camera, so that they share a similar view of the scene. Is it possible to set the system up so that the iPhone faces in a different direction from the main camera - for example, to the left of the camera or behind the camera - where there may be a richer set of fixed points to track?
The system as you said is designed around the phone and the camera pointing in the same direction. The iOS camera is quite wide angle (19-20mm S35 equivalent) so it can pick up more points than the Cine camera usually can.
I don't have an option for External Tracking Protocol, that drop down does not exist and I'm updated to the latest versions.
Are you on Jetset Cine v1.0.118? That's the one with the updated external tracking protocols. Check under Settings & Support -> Settings and scroll down to see the version #. You can update manually with the App Store.
Perhaps this question has been already answered in another video; I'm confused which Accsoon SeeMo should I get - the SeeMo 4K HDMI Smartphone Adapter or the SeeMo Pro SDI/HDMI to USB-C Video Capture Adapter? Also, would I need the CineView transmitter?
Here's a good link: lightcraft.pro/docs/which-accsoon-seemo/
@@lightcrafttechnology Thank you!
Great video! But I'm still waiting for the sytheye pipline tutorial.
Exciting :) Did you solve the timecode sync issue for the Decklink cards that you mentioned, or are you still working on it and expecting to solve it? Rough eta on that tutorial? Can't wait. Thank you! :)
Yes -- we have a pretty clean workflow working by now with AJA/Blackmagic SDI capture cards. We're putting together a tutorial in the next couple of weeks.
@@eliotmack Amazing news!
Do you need Tentacle Sync? I noticed it's off by default, is there a huge difference in the track without it?
Tracking will be the same with or without the Tentacle. It's very useful for automatic take matching in post, and for synchronized real time data. Such a good device that we're now recommending it as standard use.
Is the tentacle necessary for lightcraft cine? Bc based on your other videos it seems like it is an additional accessory instead of a necessary one
It's not absolutely necessary but highly recommended.
@@lightcrafttechnology I thought Jetset Cine already had its own genlock thing with the digital slate to sync the tracking data and the footage? how crucial is the Tentacle and can I do by without it just fine or will I encounter problems in post?
@@cyrusstanola3929 The digital slate works for the Autoshot post tracking workflow, but under some lighting situations the automatic marker recognition can be fragile (lights reflecting in the digital slate screen, etc.) In general timecode is a great idea to tie things together, and the Tentacle Sync is both inexpensive and works well.
Is accurate manual synchronization possible without using tentacle sync?
@@aust917 Yes, but we recommend the Tentacle as it can speed up take matching considerably. We're working on the implementation of timecode based take matching now.