Unity Perception: Beginner Tutorial (for Synthetic Image Data)
HTML-код
- Опубликовано: 15 сен 2024
- This beginner tutorial explains the use of the #Unity #Perception for creating synthetic image data. It is especially for developers with no prior Unity / gamedev experience.
.......................................................................
➤ Our game Beans or Bones on Steam: store.steampow...
USED ASSETS in Beans or Bones (Affiliate links)
➤ POLYGON - Pirates Pack assetstore.uni...
➤ Opsive - Ultimate Character Controller (UCC) assetstore.uni...
➤ Crest Ocean System URP assetstore.uni...
➤ Gaia Pro assetstore.uni...
➤ Enviro assetstore.uni...
➤ Vegetation Studio Pro assetstore.uni...
➤ Microsplat assetstore.uni...
➤ Stylized Grass assetstore.uni...
assetstore.uni...
RPG Character Mecanim Animation Pack assetstore.uni...
Third Person Motion Controller assetstore.uni...
Bird Flock Bundle assetstore.uni...
Bird Flock Bundle 2 assetstore.uni...
Low Poly Animated Animals assetstore.uni...
.......................................................................
ABOUT
I am Christian, I have a Ph.D. in theoretical physics, and almost 20 years of experience in the IT industry, mostly as chief architect in a large software company. In 2018 I founded Atlantic Tech & Candy to bridge the gap between the AI and the business world.
IF YOU ARE INTERESTED in learning more about AI, check out my artificial intelligence course:
atnc.ai/online...
This course is especially intended for non-experts.
CONTACT
Email: info@atnc.ai
SOCIAL MEDIA
Twitter @christian_wiele ( / christian_wiele )
PRODUCED BY
Atlantic Tech & Candy (atnc.ai)
Thank you for this material. I am an AI developer starting to study synthetic data generation. I have no background in game development and your tutorial was easy to follow. Looking forward the next video on this topic. Great job!
Thanks for the feedback. Unfortunately, Unity decided to freeze the free version of Perception, and release a paid enterprise version instead. So I am nor sure, whether I will do any more videos on Perception.
Hi, I looked around a lot and couldn't find any anouncement about this freeze or any enterprise version. Do you know where I can find information on this? Maybe they have changed their minds and will keep Perception free and updated?@@TheSecretsofApagayoIsland
Thanks for this tutorial, it really helped me understand how to use the Perception package so much better :)
Glad, the tutorial helped. Let me know if you have any questions.
Love the vids! Keep up the good work!
Thanks for the feedback 🤓
Please I can't see the semantic mask overlayed on my objects in the "Game" screen however it outputs to the folder. Any reason for this please?
However I can see 2D and 3D Bounding box.
I keep getting the error:
Assets\Scripts\Perception\DicePlacementRandomizer.cs(16,12): error CS0246: The type or namespace name 'GameObjectParameter' could not be found (are you missing a using directive or an assembly reference?)
Great Video!
i am exploring the feasibility of labeling objects based on their normal maps for a defect detection project. The idea is to utilize different normal maps corresponding to various defects present on objects. Essentially, I want to know if it's possible to label defects by analyzing the information encoded in the normal maps?
I have a problem when I do this for my own project. When I click 'play,' my game screen becomes black. Any ideas why?
Thank you so much for this helpful tutorial, sir, I learned a lot. Could you please give some advice in terms of creating moving camera instead of moving objects? For example, I want the camera to move around the room and take pictures of different objects inside this room. Appreciate your help, thank you in advance!
thanks! Please do more :)
Will do 🤓
Thanks for material:) Is there any possibility to generate semantic segmentation image including terrain layers or trees etc. ?
Thanks for the feedback. The terrain mesh is supported, but just as a whole (different textures / terrain layers are not supported). Terrain vegetation like grass and trees is also not supported. Unfortunately, Unity has decided to basically freeze the current free version of Perception, and only add new features to the upcoming enterprise (paid) version.
Hi , Do you Know how we can disable the labelling of the objects that are half visible , in Unity Perception. Like for every iteration unity perception will check whether a particular object is visible or not and if not fully visible then it wont get labelled in that image frame.
I have tried this using couple of ways but none of them seems to work fine. Help!
I don't think there is a simple solution, and right now it doesn't work. You should post your question on the git repo. There have been similar requests in the past. github.com/Unity-Technologies/com.unity.perception/issues
@@TheSecretsofApagayoIsland Thanks
Is it possible to use this asset to make symbol recognition (like magic touch)?
You could do it, but I am not sure whether this is the best solution for symbol recognition. It's basically about drawing a bunch of randomized simple geometric shapes. And you might be better off with a Python script generating the shapes/images.
@@TheSecretsofApagayoIsland thanks
Foe URP, Unity Perception only support with Unity 2020, it does not support 2021 and 2022.
Is there any python API for doing it? The UI looks so unnecessarily complex.
No, there is no Python wrapper. You could use Blender for image generation. It supports Python natively. Google provides a Blender-based solution for synthetic images. But Blender has an even more complex UI. Game engines and 3D modeling tools are for pretty complex tasks, so don't expect to find a real simple solution here.
Thanks for the tutorial, I have created a too in Unity to get data for shoe try-on, annotation data from shoe with respect to world co-ordinaire, 3d points its 2d point with respect to camera. Try getting rotation from default 3d point & rotated 3d point also with 3d to rotated 2d point using Python Solve PnP - the value is not coming fine if 3 axis got rotated, with any 2 axis all perfect, what could be the issue, can you help on it. Not used perception, tool is created from scratch and have randomizer to change shoe, env, pant, light etc.
Camera is static and object gets rotated
I guess the problem lies in the fact that Euler-rotation in 3d is non-commutative, so the order of rotation matters. This is why 3d engines use quaternions for rotations internally.
@@TheSecretsofApagayoIsland okay, the rotation we are try calculate using translation of annotation points, that is giving wrong result in SolvePnP, any way there to match Unity and Python SolvePnP coordinate system, RH and LH system
Is it possible to create key points/annotation points in 3D bounding box and get those values
I guess you didnt have any problems with 2020.3 ? Official documentation recommends to use 2020.2.X:
"Install the latest version of 2020.2.x Unity Editor from here. (The Perception package has not been fully tested on newer Unity versions)"
ps. Grüße aus Deutschland :)
No, 2020.3 works fine. 2021 is still unsupported.