Unity AI - Unity 3D Artificial Intelligence
HTML-код
- Опубликовано: 15 сен 2024
- Creating 3D Artificial Intelligence in a simulated world is actually pretty easy using Unity 5. It's a powerful tool and I'll go over its new ML Agents toolkit, that allows researchers and developers to build/train ML models in a 3D simulation. It's pretty fun watching it in a 3D world, lets break down the code and concepts. Please Subscribe! That's what keeps me going.
EDIT: I made a mistake, minecraft was not created in Unity, but it has been recreated in Unity countless times.
Code for this video (Please hit the red subscribe button for more):
github.com/llS...
Brendan's Winning Code:
github.com/bha...
Shadman's Runner Up Code:
github.com/kud...
Want more education? Subscribe! And connect with me here:
Twitter: / sirajraval
Facebook: / sirajology
instagram: / sirajraval
More learning resources:
unity3d.colleg...
github.com/Uni...
blogs.unity3d....
software.intel...
Join us in the Wizards Slack channel:
wizards.herokua...
And please support me on Patreon:
www.patreon.co...
Credits to sykoo for the unity footage
Signup for my newsletter for exciting updates in the field of AI:
goo.gl/FZzJ5w
Hit the Join button above to sign up to become a member of my channel for access to exclusive content! Join my AI community: chatgptschool.io/ Sign up for my AI Sports betting Bot, WagerGPT! (500 spots available):
www.wagergpt.co
Minecraft made using Unity? I thought it was a Java game. Not that it couldnt be made in unity tough
FuZZbaLLbee No, you're right, it was made in its own game engine. It wasn't made in Unity.
Yeah, super meat boy was made in flash not unity!
i think he meant minecraft pe
FuZZbaLLbee Yeah, Minecraft was created using LWGJL, Lightweight Java Game Library.
slicxx He is still super Awesome tough :-)
Siraj thank you for cutting down the memes.
Although I am not the one who mentioned those memes are distracting in the past videos, but video like this one without the memes really help me focus more on what you are trying to teach.
OH, MY DAYS.
This is what I've been looking for a LONG TIME!
Thank you so much, Siraj!
Minecraft was created using Java/LWJGL but great video! Thanks for the consistently awesome educational content.
I think he meant Minecraft Pocket edition.
Loc pham still not unity
No it was made in unity . Where did you get this information from?
Muhm Ho i ussd to mod for regular minecraft - its all Java, so there is no way it is unity. Cant speak to PAM
i meant pocket edition thanks!
Hey everyone! I've been working with these for a couple of months. While this video does provide a good intro to how to use Unity ML Agents, it also glosses over a couple of gotchas. If you get stuck, I made this video called "The Ugly End-To-End". It's not really designed to be entertaining, it's more of a reference video. It shows the entire process of getting Unity ML up and running (including a couple missteps along the way). ruclips.net/video/VGnTQE4mszM/видео.html
And tonight (Sorry for the delay, getting over a cold), I did an end-to-end coding session to show all steps involved with authoring a Unity ML Agent. (Video starts 9 minutes in because I was talking with my mic off and RUclips won't let me edit the video) ruclips.net/video/3PMaaHABfEU/видео.html
1. types some magic word into a random text field and then reload the editor suite to have an effect;
2. changes a value in another radom drop down list to make a whole set of dozen other random fields appear;
3. somehow involves tensor flow (c++ lib), python notebooks with important looking graphs(c)(that may or may not be a bitcoin price prediction) then uploads it back to c# driven unity
...
4. profit, the balls are balanced!
Sorry Siraj, but the whole UNITY part just makes no sense and looks like a black magic for a newbie like me. And this has nothing to do with c#.
Exactly,
It is not clear how the whole github project got into example folders either
Pretty sure Minecraft (even pocket edition) wasn't made with Unity, neither was super meat boy
Ok thanks, my larger point was that all these games can be recreated easily using unity
Eliter Roguer.... If that was True, than He would have a pretty big staff to prepare his work..., and by now He would have picked up some of the knowledge...
Eliter Rogeur, that has to be the dumbest comment i've ever seen in my life
@@SirajRaval pfff. any game can be reacreated on almost any engine. except some 'half-functionality' engines
No commercial version of Minecraft has ever used Unity. However, there are many examples of fans doing "make-a-game" challenges replicating some of the look and functionality of Minecraft in Unity. I think that's what he was referring to.
Michael Galindo That’s not what he was referring to. He just made a mistake. He also mistakenly said that Super Meat Boy and Limbo were made in Unity.
If I watched this video before starting Unity, I wouldn't start it.
By far, my favorite video that you have done!!! Thank you for always making new and awesome videos about everything that I enjoy!
Great video! Unity plus AI ROCKS! 👍🤓
But Minecraft was made in UNITY? Wut? That's not correct! 😝
when i drag mlagent in assets in unity it give 8 errors like that "Assets\ml-agents-master\UnitySDK\Assets\ML-Agents\Scripts\InferenceBrain\TFSharpInferenceEngine.cs(3,7): error CS0246: The type or namespace name 'TensorFlow' could not be found (are you missing a using directive or an assembly reference?)" why ?
Exactly what I was looking for. Thank you!
Sorry but Non of the games was make in Unity
Minecraft(java), Limbo(custom built engine) & Super meat boy(flash) if i remember correct :)
maybe some have make some type of copy of the games in unity
super meat boy was also a custom engine
aa ok :) thanks
Its the pocket edition genius guy
Minecraft is a java game not Unity.
Samurai Jack my bad then
Samurai Jack still not unity
so many comments on this! Hah. Thanks for keeping me sharp. My larger point is that all these games can be recreated using Unity
@liberP lovPrimeNumbers no, it uses c# as its main language, it used to support javascript (not java), but has since slowly removing js from the engine.
@Riley Powis no, it does not support Java. It does support JS, but you can't create a JS script in the unity GUI anymore.
When a first started with your videos, I couldn't keep up because you were speaking so fast. Now, that you're not, I have to increase the speed of the video.
Minecraft is Java, some ports maybe unity. Also unity free has ZERO graphical features missing, its really all in there, (which rocks!!!)
i made a tic tac toe game and am wondering how I would add machine learning to it as the enemy player
Wait what. Minecraft wasn't created in Unity. I'm somewhat sure Super Meat Boy and Limbo also weren't.
Snowy ツ minecraft was firstly created in java so I also doubt that unity was used even aftrrwards
Minecraft wasn't made in Unity. Its made using Java.
Super Meat Boy was made in Flash.
Limbo was made on a custom engine.
The only correct thing is Eve Online using Unity for prototyping but even then its only PROTOTYPING. Eve Online runs on Python which doesn't work with Unity.
Thanks to this Siraj, I am famous in school for doing AI project for my semester project. :P
hi
look im want to learn AI for making facial mocap and i know absolutely nothing about it
where i start to learn ?
How what amazing all your videos, I like & love it, makes alive by listening, watching, understand all the machine learning topics, I am now so obsessed in Machine Learning....
7:31 "a range of values from 0 to 0" xD
Unlike Sophia.. omg that burn.. :D
m ・ ́ω・ thank you sir for explaining it to the others..
m ・ ́ω・ agreed.. What others or non AI people think about ML/DL in general is that they are bunch of sophisticated if else statements.. Practitioners know that they are much deeper concepts to it than that..
Let us also remember that hardcoded is not incompatible with AI. Hardcoded is incompatible with ML, but AI has always been larger than ML, despite ML currently eating most of it.
As someone who has a passing familiarity with Unity, that is - for Unity, a bizarre workflow setup. I certainly understand why they would go through Python given the current state of ML algorithms, but I'm still somehow surprised they didn't manage to pipe it through MonoDevelop.
FMOD failed to initialize. This may be because your sound card is configured to give applications exclusive access, thus preventing Unity from using this device. You can change this in Control Panel > Audio Devices and Sound Themes > Playback Device > Properties > Options ... : "Soundcard does not support the minimum features needed for this soundsystem (16bit stereo output). " (59)
HOW TO FIX THIS ANY ONE HELP PLZZ
Congratulations, Brendan Hansknecht.
When Tommy Refenes finds out that he actually made #SuperMeatBoy using Unity, thanks to this very informative video, I Wonder who'll be wearing the bandage :D
Did not realize MCPE was Unity, that's cool.
dude..what happened to the RL series?
Minecraft, Super Meat Boy and Limbo weren't created in Unity. If you even bothered to visit the Unity website, you would have noticed a Made With Unity section.
That's great. I want to test many things in 3D Environments in Unity
Isn't Othello the western ripoff name for Go?
I am a beginner. How would I add AI to a game like chess but it is not chess? Let say I want like 10 levels of difficulty. What would I need to learn? I think it would take years though.
guys he is probably alrready aware... stop spamming in the comments about it
unity free gets all feature for free
Yeah!! Personal(free) edition has all the pro features. only made w/ unity spash screen!!
Sadly no dark theme though :(
Minecraft wasn't in Unity, it was home grown java.
Does anyone know how to run those Unity environments in headless mode? (Linux, ssh access only, without sudo). I need autonomous vehicle with camera sensors, but afaik there's no simple way to get the renderer without the window itself.
Minecraft was created in Java in some graphics library, as I recall, Super Meat Boy was 100% created in Flash and Limbo... I don't remember, but I don't think it was Unity.
If you want popular examples of made-in-unity games, there's Cuphead (Unity has some of the best 2D gamedev tools of modern times), Hearthstone and ever beautiful Ori and the blind forest
Shadman is also a pretty good digital artist I hear ;)
Hello Siraj I am bit confuded about one topic which is not very much related with this particular video, but still...Maybe you could help :Which Mashine learning algorithms are commonly used in describing point cloud data sets or pixels of images in visual recognition? Lets say I want to work with 3D point clouds (or raster images made from point clouds) of buildings. First task would be to teach algorithms where are windows, roof type, doors, etc. Second task would be automatically compare two or more point clouds of the SAME buildings where another algorithm could say where are some changes like new roof, new window or old door is missing. Which programming language would be best for such tasks and on what software as base would be better to start? (for example, maybe Python is suitable and would work on Autocad?). Literature on this particular case would be awesome as well :) Tadas
None of these games were made in Unity.
But still a great video!
Hey Siraj, my team and I are working on a simple unity project in VR that allows you to talk to a 3d avatar like you would siri or alexa. Is there any advice you could give us when it comes to training her in responses? Any direction you could point us toward that would make her more intelligent? Thank you for your videos, they rock!
This coding challenge submission is the implementation of CartPole-v0 in Unity and ML-Agents ready. Oh, and not only that, it can be trained by a Reinforcement Learning Agent implemented with OpenMined library with Unity backend! Go and try it!
Video showcase: ruclips.net/video/kquNeYG8ZF4/видео.html
Github PR to OpenMined/ml-agents repo (submission): github.com/OpenMined/ml-agents/pull/1
Github PR to OpenMined/OpenMined repo (submission): github.com/OpenMined/OpenMined/pull/402
And I just want to remember you guys that you can do right now your own RL environment and solve it with the OM backend. Moreover, we're open to new contributors and this kind of contributions would be DOPE!
awesome job as always Alberto! :)
Meat Boy wasn't made on Unity, according to Wikipedia they made their own "engine", but really cool vid
It might help to add github.com/Unity-Technologies/ml-agents to the description and explain to drag it into the Unity project for people still new to Unity.
Also, thank you so much. It's like you giving me no choice everything is here laid out plain as day.
Hi Siraj, have you ever used Matlab to create NN ? What do you think about this software ?
hello i need your help how can i contact you
The title says "Unity AI - Unity 3D Artificial Intelligence", but the actual video is about unity in general.
The free version of unity doesn't have the avanced rendering options ?! Sounds like a Unreal engine fan would say there is everything you need to make stunning graphics in Unity free the only thing is that you have to actually make them not using the pseudo realistic set of options every unreal projects has frop start
Request: Please make a tutorial vdo for Unity and CNTK. Thank you for very useful channel, keep up the good work.
off to study Unity's AI feature thanks Siraj
I feel this is Siraj's longest video
Wait? Days to get a 3D object rendered on screen? I can go to a tutorial site for reference and create cube on the screen in a matter of hours!
I read somewhere that Unity will not support unityscript aka javascript anymore.
Blender has a easy Python API... would also work nice for this kind of Tasks
This video is a classic example of how not to title or start a video. "Unity 3d Artificial Intelligence": half the video is about why to use a game engine/which game engine to choose.
you did not put the ppo video link in the description
How I can find fast all the candidates to this challenge and the winner of it ? I look few videos later after this one and I see any mention of winners. I'm interesting to see what people do with this challenge. Never find any submission in all " minecraft is not done in unity ... etc " comments :)
No official versions of Minecraft were created with Unity. Minecraft Java was created using LWJGL (Lightweight Java Game Library). Minecraft Win10, PE and recently Console (except for PS4) are made with Monogame. Not that you can't create Minecraft bootlegs in it.
unity personal edition has had the same rendering options as pro since unity 5. The only difference is the unity logo it shows on starting your game
Too many technicalities, I can’t even start on a game because it takes days to learn a new skill.
Great stuff !!! The Unity ML project is a fantastic hands on example of how to integrate simple tensorflow models with Unity for advanced game AI experimentation. I have been playing around with using OpenCV 3.3 DNN caffe/tensorflow model prediction inside Unity as well. I have not figured out how to freeze/transform re-trained (transfer learning) tensorflow models in order to get them to load properly in OpenCV 3.3. TensorflowSharp does not work either on these retrained models. Any insight into how to do transfer learning and deploy tensorflow models for open cv 3.3 DNN consumption would be greatly appreciated.
Man glad you chose c#, I really dislike JavaScript
Super meat boy and minecraft isn't made in unity
neither is limbo
Damn I just realized we are in a simulation...
Minecraft wasn't made in unity. It was made in java. Good video though.
Hello ! Have You a video where you explain PPO algoritm?
Agree Unity truely for virtual reality !!
the free version has no graphical or any type of limitation ( you have to use the plus or the pro if you have more than 100,000$ in yearly revenue )
hello Siraj, its the loss function waving at ya!
Thanks for making this video.
Very interesting stuff indeed, thank you
So we can build fully functional AI agent ?
hi siraj,make a video on "voice authentication" if possible .can we create "voice authentication system" using neural network?
Wow, an Indian without accent, subbed.
Please remove the yellow cover on the cursor. It makes it quite difficult to see what you are clicking on when the background is white
How exactly do i install ML Agents?
where is the link to the PPO video?
Last two minutes are moving kinda fast. I couldn't get to train my agent.
*ML AGENTS FOR UNITY 5.6 32 BITS LINK ???*
*HEI COULD YOU SHARE HERE A SCRIPT FOR ADVANCED ENEMY AI FOR UNITY ??*
This video is so incorrect, Siraj getting lazy? :P
just the games made with unity statement. even then the larger point is that they can all be recreated with unity. none of the actual technical walkthrough is incorrect. thanks for keeping me sharp though
Personal (free) version = Pro(paid version)... Only black skin and made with Unity spash screen...
How heavyweight is AI? Can I have 100 bots running simultaniously?
I'm two and a half minutes in and this video hasn't even approached its headline.
Love your efforts siraj
ooo...thank you so much dude. So fun.
Can AI be used in procedural content generation?
I totally beginner how should I start?please help me
You mean I should first learn python and then
"Each Agent has a brain, Unlike Sophia!" =]]]]] Love it! lmao
Great tutorial man! Very informative! I've been looking to learn about ML Agents in Unity for a while now so this tutorial was very helpful.
Btw, about Unity's free version, a while back they removed the restrictions and made it so anyone using Unity Personal (free) would be able to use the engine with all the features unlocked. With Unity Plus and Pro you get to use the various other services they offer. Also, as far as I know, Javascript has been deprecated. Unity just uses C# now.
The only guy on the internet who can make programming exciting!
where is the PPO video? i cant find it
Minecraft - Java then C#
Super Meat Boy - Flash
Limbo was the only one you listed, that was made in Unity.
Actually it wasn't, it was an in house engine... Which means 3 of them were wrong
Minecraft, Limbo, Super meat boy. These are not made in Unity btw...
Minecraft created by Java, Limbo created by it's custom game engine, and meatboy is not created by unity too... thanks for the tutorial :)
Easier than open AI's training platform ?
None of those games that he listed were made in Unity.
Not scripting languages, they're compiled. The performance loss for a game engine would be unforgivable
Hi siraj, great work !!! Keep it up.
I want to ask you something,though it is not completely related to this video.
I have a hexapod robot that I control using Arduino.......but I wish to use Reinforcement learning (Q learning maybe??)so that it teaches itself to walk, but I dont know how to begin. I see videos where robots are simulated and they learn in that simulated environment. Which simulator do people use? Can I then upload that "learned knowledge" to my hexapod? Can you please also guide me to relevant study/learning material online?