Deep Learning Cars

Поделиться
HTML-код
  • Опубликовано: 29 сен 2024
  • A small 2D simulation in which cars learn to maneuver through a course by themselves, using a neural network and evolutionary algorithms.
    Also check out my other project "AI Learns to Park":
    • AI Learns to Park - De...
    Two AI fight for the same Parking Spot:
    • Two AI Fight for the s...
    Interested in how Neural Networks work? Have a look at my one-minute-explanation: • Explained In A Minute:...
    This simulation was implemented in Unity. You can find detailed information about how this simulation works, as well as a link to the entire source code on my website: arztsamuel.git...
    Don't miss any future videos, by subscribing to my channel.
    Follow me on Twitter: / samuelarzt
    #MachineLearning #Evolution #GeneticAlgorithm

Комментарии • 2,7 тыс.

  • @SamuelArzt
    @SamuelArzt  4 года назад +446

    Check out my new video! AI Learns how to parallel park: ruclips.net/video/MlFZjLkEIEw/видео.html

    • @davideareias7876
      @davideareias7876 4 года назад +5

      Hey, I’m trying to learn this kinda off machine learning witch course do you recommend?

    • @TuanAnh-mq6sw
      @TuanAnh-mq6sw 4 года назад +2

      Please explain how the fitness value of each car was calculated?

    • @SamuelArzt
      @SamuelArzt  4 года назад +5

      @@TuanAnh-mq6sw Each car's fitness value is equal to the percentage of track completion. Since that can't be calculate by simple distance to end point, I placed several "checkpoints" throughout the map. It's pretty straight forward from there.

    • @TuanAnh-mq6sw
      @TuanAnh-mq6sw 4 года назад +1

      @@SamuelArzt Thank you. I understand, because i think if fitness value only based the distance, cars has trending to rotate around in their place.

    • @__--_--_-----
      @__--_--_----- 4 года назад

      @@SamuelArzt deep learning or just a complex genetic algorithm?

  • @unexpired1
    @unexpired1 3 года назад +9484

    Here's my takeaway : no matter how many generations have passed, there will always be idiots on the road driving backwards

    • @keir_murray6567
      @keir_murray6567 3 года назад +707

      Here’s my takeaway: sweet n sour chicken balls with extra sweet chilli sauce, basmati rice and some prawn crackers on the side

    • @randomaccount8020
      @randomaccount8020 3 года назад +229

      @@keir_murray6567 i like your words magic man

    • @liahmmessinger3753
      @liahmmessinger3753 3 года назад +33

      The People you have to share the road with are insane

    • @randomaccount8020
      @randomaccount8020 3 года назад +1

      @@kelvinyusuf6658 *of*

    • @cynicaldrummer286
      @cynicaldrummer286 3 года назад +1

      @@keir_murray6567 same for me but I don't like prawn crackers

  • @christiangonzalez6945
    @christiangonzalez6945 4 года назад

    I love how the prize its their freedom

  • @nelsonespanol645
    @nelsonespanol645 Год назад +1

    Wow that's amazing

  • @MachineLearningJack
    @MachineLearningJack 4 года назад

    Nice! How could I not see it before?

  • @dariuschoo8495
    @dariuschoo8495 4 года назад +4

    This is why A.I trumps humans.
    You can see how just because some cars are faster and further at the start, it doesn't mean they will end up the furthest at the end of the race even though all of them are travelling at the same speed.
    Similarly, just because one side has material advantage in the game of chess, i.e, up a knight or bishop, does not mean they will win the game. Positional advantage is something that's very hard for humans to gauge and A.I can understand it a lot more accurately.
    In a complex situation, humans tend to break down one goal into multiple smaller goals and achieve them. This simplification makes them efficient at solving tasks given a limited time frame and number of tries, but it doesn't always result in the most efficient solution. Our strength is also our limitation

    • @SKtheMage
      @SKtheMage 4 года назад +1

      Trumps humans?

    • @dariuschoo8495
      @dariuschoo8495 4 года назад

      @@SKtheMage Yeap, no human can win against Deepmind consistently in chess, or rather, everyone consistently loses to Deepmind.
      I truly believe AI surpasses humans, and it will be interesting to see it's usage in the modern world. I just hope we don't end in some post-apocalyptic endgame

  • @theintuitivetruth
    @theintuitivetruth 2 года назад

    So many generations but none of them learned to take reverse.

  • @XwitterEye
    @XwitterEye 2 года назад

    Imagine being the cars in gen 46 that crashed

  • @cont3ssa
    @cont3ssa Год назад +1

    So in which generation exercises Tesla now 🤔

  • @vasco2016
    @vasco2016 4 года назад +14042

    I knew the green car was going to win

    • @blalmal10a
      @blalmal10a 4 года назад +242

      whoever lead turns green

    • @vasco2016
      @vasco2016 4 года назад +987

      Gr0Us3da4 I know, this is just irony

    • @johnnyace1086
      @johnnyace1086 4 года назад +267

      whooosh?

    • @BlueM0bius
      @BlueM0bius 4 года назад +125

      @@vasco2016 Did you mean joke?

    • @timur5241
      @timur5241 4 года назад +283

      @@johnnyace1086 shut up redditor

  • @ShazenVideos
    @ShazenVideos 7 лет назад +9805

    That's how I've earned my driving license.

    • @scott110699
      @scott110699 7 лет назад +513

      Smashing into walls repeatedly until figuring out how to not smash into walls repeatedly?

    • @computo2000
      @computo2000 7 лет назад +137

      Oh Spongebob... Whyyyyyyyy...

    • @galaxyprotector2804
      @galaxyprotector2804 7 лет назад +226

      Nice. You died 46 times to get a driver license

    • @committedcoder3352
      @committedcoder3352 7 лет назад +35

      Galaxy Protector better than me, I died 89 times to get my drivers license

    • @mason7031
      @mason7031 7 лет назад +39

      XxNexusxX better than me, i haven't got one yet

  • @iMorands
    @iMorands 3 года назад +370

    1:25 that was so hype

  • @apoksubutai5237
    @apoksubutai5237 4 года назад +144

    0:15 Generation 4.
    Me and my pals graduating from online classes

  • @spongetv337
    @spongetv337 5 лет назад +3546

    245 generations later..
    Cars found out that getting out of the track was pointless, now they're building a city in the spawn area

    • @qExAi5
      @qExAi5 3 года назад +128

      And this was Cars prequel.

    • @leetairaki2441
      @leetairaki2441 3 года назад +26

      They gained sentience

    • @3zz147
      @3zz147 2 года назад +4

      Creative 😂

    • @Dunkelspeziesmensch
      @Dunkelspeziesmensch 2 года назад

      Now they pass turing's

    • @Wipa4
      @Wipa4 2 года назад +5

      Ending is tragic, tho - they've found out they have built a New-Jersey

  • @crackedemerald4930
    @crackedemerald4930 7 лет назад +3964

    Generation 420: they learned to drift and eurobeat everywhere

  • @Oyuncuinsan
    @Oyuncuinsan 7 лет назад +4481

    Some brave individuals refuse to do what you force them to do, they just crash to the nearest spot right away. They are heroes of their kind, standing against the system.

    • @Electronic424
      @Electronic424 6 лет назад +109

      Not to ruin the fun but it's just a genetic algorithm bruteforcing all possibilities of the matrix. When and if they had a mind of their own we would have achieved general intelligence... stay tuned

    • @Oyuncuinsan
      @Oyuncuinsan 6 лет назад +248

      QuickMix wow, really? I thought we were creating and then killing real intelligent species.

    • @Electronic424
      @Electronic424 6 лет назад +22

      Hey, you called them individuals, that means they have their own opinions and that requires intellect... Just sayin'

    • @Oyuncuinsan
      @Oyuncuinsan 6 лет назад +113

      QuickMix And that was the joke.

    • @Electronic424
      @Electronic424 6 лет назад +48

      I tend to overthink things, pardon my superior neural net.

  • @hajimuradahimov8313
    @hajimuradahimov8313 4 года назад +5

    Why am I watching this?

  • @ruslankokarev8331
    @ruslankokarev8331 4 года назад +141

    2:39
    When you're not the fastest, but you are the best

  • @smartereveryday
    @smartereveryday 5 лет назад +1160

    Wow I loved this

    • @SamuelArzt
      @SamuelArzt  5 лет назад +101

      Thanks, Destin! Hearing that from you means a lot to me.
      I really enjoy your videos and have been a fan of your channel for a long time!

    • @smartereveryday
      @smartereveryday 5 лет назад +68

      @@SamuelArzt it was a great visual. Good work.

    • @johnmctavish1021
      @johnmctavish1021 4 года назад +7

      @@SamuelArzt Oh! I didn't really realise it was Destin's comment until I read "Been a fan for long time" and then checked. :P

    • @harsh9558
      @harsh9558 4 года назад +2

      @@johnmctavish1021 yup

    • @hashuh4821
      @hashuh4821 4 года назад +1

      Wait why does Destin doesn't even have 100 likes?

  • @pixelseverywhere1219
    @pixelseverywhere1219 7 лет назад +2210

    I felt bad for the car when it fiinished because it seemed to just wander in circles not knowing what else to do. As of if to say, "what now!?!?! My existence has lost all meaning!"

    • @alejandrogarcia-puente6948
      @alejandrogarcia-puente6948 6 лет назад +186

      Pixels Everywhere that’s what happens when you achieve everything you ever wanted

    • @GuiTheKratos
      @GuiTheKratos 6 лет назад +80

      When you get what you want, but not what you need

    • @zazenboy
      @zazenboy 5 лет назад +33

      "One must imagine Sisyphus happy"

    • @nicholasc.5944
      @nicholasc.5944 5 лет назад +5

      STOP

    • @miguelpereira9859
      @miguelpereira9859 5 лет назад +4

      @@alejandrogarcia-puente6948 wow man real shit so deep bro

  • @noiamhippyman
    @noiamhippyman 7 лет назад +610

    I've never wanted a rectangle to go through a tiny gap so badly in my entire life. This is great!

    • @Krawna
      @Krawna 2 года назад +25

      That's what she said

    • @goblokidinahui4420
      @goblokidinahui4420 2 года назад +8

      @@Krawna ur pp = rectangle?

    • @Keijspermeister
      @Keijspermeister 2 года назад +8

      @@goblokidinahui4420 if you censor it

    • @No-cc1fq
      @No-cc1fq 2 года назад

      @@goblokidinahui4420 a block head

  • @kuiperbelt2488
    @kuiperbelt2488 4 года назад +69

    2:39 "All hope is lost!"
    2:43 "Not on my watch!"

  • @ThomateMaligno
    @ThomateMaligno 3 года назад +487

    I found it comforting to discover that even machines make mistakes while learning.

    • @aliensarerealttsa6198
      @aliensarerealttsa6198 2 года назад +46

      Typically because the human programmer can't teach or use logic.
      Machines are only as smart as their creator.

    • @prateekpanwar646
      @prateekpanwar646 2 года назад +48

      @@aliensarerealttsa6198 2nd line is untrue. With enough training they'll eventually outperform their creators and the code will no longer recognisable. Ex: RUclips algorithm.

    • @feelsadgeman
      @feelsadgeman 2 года назад +4

      True, machine learning learn through their mistakes during tests

    • @hispantrapmusic301
      @hispantrapmusic301 2 года назад

      @@prateekpanwar646 it seem u understand pretty well, I have a question on why don’t the other cars follow the track of the green one

    • @nutsackreviews
      @nutsackreviews 2 года назад

      @@hispantrapmusic301 because if the green one dies they all die, they need go as many different ways as possible to have the highest chance of success

  • @benjaminmiranda4607
    @benjaminmiranda4607 7 лет назад +2338

    When they escape do they take over the world

    • @SamuelArzt
      @SamuelArzt  7 лет назад +270

      Yes.
      Yes of course.

    • @SamuelArzt
      @SamuelArzt  7 лет назад +282

      Shhhh... don't hurt their feelings.

    • @eaglgenes101
      @eaglgenes101 7 лет назад +60

      No, they keep driving on and wondering why it's a wide open world.

    • @greenfox1991
      @greenfox1991 7 лет назад +15

      it's not wide open, they will find the overflow boarder.

    • @SamuelArzt
      @SamuelArzt  7 лет назад +210

      One of them might ask "Hey guys! Do you think this could all just be a simulation?"
      While the others answer "Pfff... don't be silly!"

  • @scott110699
    @scott110699 7 лет назад +926

    I'm rooting for the green car

    • @VulcanOnWheels
      @VulcanOnWheels 6 лет назад +21

      The frontmost car always turns green.

    • @SwimmingSwampert
      @SwimmingSwampert 6 лет назад +154

      Vulcan Viper
      *whooosh*

    • @yeetswan117
      @yeetswan117 6 лет назад +3

      Vulcan Viper
      WOOSH

    • @hiiamacat8605
      @hiiamacat8605 6 лет назад +2

      +Swimming Swampert
      NOOOO I've always wanted to woosh somebody!!

    • @neotei9561
      @neotei9561 6 лет назад +5

      go onto twitter find some idiot that likes to correct everyone say "go commit die" and bam you got a woosh

  • @gountaa
    @gountaa 7 лет назад +4304

    If you placed the final generation in a completly different track would they have to learn from scratch or would they be able to apply what they've already learned to clear it much faster?

    • @SamuelArzt
      @SamuelArzt  7 лет назад +3068

      They would be able to clear it much faster. If the new track does not introduce any fundamentally new features (such as u-turns or gaps in the walls) they should be able to finish the track right away.

    • @RobertsBoissiere
      @RobertsBoissiere 7 лет назад +191

      What were you using for the five input nodes? I know they were points, but was it just the distance of these points from the car?

    • @shadowds4ever
      @shadowds4ever 7 лет назад +85

      I think they were collision indicators. 5 points ahead of where a collision would happen for reference on guiding.

    • @SamuelArzt
      @SamuelArzt  7 лет назад +533

      The five points you are seeing are just the current reading of the five distance sensors of the car.
      Each car has 5 sensors which measure the distance to the nearest wall. The readings of these sensors are the input of the neural network.
      The blue crosses are simply there to visualize where the sensors are currently pointing.

    • @rayzecor
      @rayzecor 7 лет назад +77

      Did you use an open source neural network or code your own? I was surprised to see such good results in the first 10 gens. I was expecting it to take longer for even one car to finish the track.

  • @Brian-zj4mm
    @Brian-zj4mm 3 года назад +26

    Imagine standing in traffic and your car says: "Deep learning protocol started"

  • @TrophyGuide101
    @TrophyGuide101 3 года назад +145

    The cars that just go the wrong way instantly and crash are my spirit animals

  • @BaseerSiddiqui
    @BaseerSiddiqui 5 лет назад +852

    2:44 when you graduate college and enter the promised land of jobs

    • @theoverlander4579
      @theoverlander4579 5 лет назад +94

      Baseer Siddiqui “It’s empty!”

    • @dendikurniawan8577
      @dendikurniawan8577 5 лет назад +6

      L0L. but, true 😂

    • @paul4381
      @paul4381 4 года назад +2

      Lil U turn first lol

    • @NostalgiaT
      @NostalgiaT 4 года назад +3

      True lol

    • @gpt-jcommentbot4759
      @gpt-jcommentbot4759 4 года назад +21

      Without jokes: The A.I is actually unable to detect anything since it only detects walls, so it doesnt know where to go.

  • @fairytaleoverworlds7795
    @fairytaleoverworlds7795 7 лет назад +439

    These are just illustrated statistics from a random sample of drunk drivers.

  • @thattubechannel
    @thattubechannel 6 лет назад +565

    That last car in generation 15: "Oh God I have no purpose!"

    • @TheGhjgjgjgjgjg
      @TheGhjgjgjgjgjg 6 лет назад +14

      This is humans in the future,once machines are doing everything for us.

    • @iinRez
      @iinRez 6 лет назад +21

      I don't think so. We'll likely just move on to the next non menial thing. The industrial revolution and automation destroyed _jobs_ not the job market itself, and that era compelled an overall expansion, the AI revolution will probably result in the same. There's more to life than Eating, Copulating, and Working 9 - 5.

    • @satibel
      @satibel 6 лет назад

      I'd be fine with the first too if you add sleep :p

    • @afadeevz
      @afadeevz 5 лет назад +8

      "You pass butter"

    • @cryingwater
      @cryingwater 5 лет назад

      @Kerimcan Ak(Sionistas Fuera!) That's humanity's goal as far as I can tell

  • @tituscapehart6635
    @tituscapehart6635 3 года назад +18

    Its all fun and games till the cars start reading Socrates

    • @edmundironside9435
      @edmundironside9435 3 года назад +1

      You mean the philosopher who never wrote anything?

    • @tituscapehart6635
      @tituscapehart6635 3 года назад +1

      @@edmundironside9435 He never wrote anything himself but his students wrote down his thoughts and lessons

    • @qwerteria7366
      @qwerteria7366 3 года назад

      then they would hate diplomacy cause we humans are idiots i think we woul all die then

  • @logixindie
    @logixindie 3 года назад +7

    It feels a little disturbing when they make it out. Like they accomplished their purpose of existence and then they just don't know where they are and why.

  • @OktoberStorm
    @OktoberStorm 7 лет назад +347

    Spoiler alert: the green car wins

  • @enterthejouz6728
    @enterthejouz6728 6 лет назад +275

    this is how sperm works.

    • @gll830
      @gll830 6 лет назад +1

      Enter the Jouz better said: how your brain works:))

    • @인천아저씨
      @인천아저씨 5 лет назад

      Naughty boy.

    • @HdRFan7
      @HdRFan7 5 лет назад

      Exactly thought the same xD

    • @daytonasayswhat9333
      @daytonasayswhat9333 5 лет назад

      Lol

    • @omgfackdehell
      @omgfackdehell 5 лет назад +2

      Sperm would just send almost endless cars off the track hoping 1 would finish.. also a few crashed cars would "widen" the track

  • @sunnybeta_
    @sunnybeta_ 7 лет назад +461

    Lovely. Well Done.

  • @Schenkel101
    @Schenkel101 3 года назад +36

    Gen 4 was really efficient at reaching a wall.

  • @AhrkFinTey
    @AhrkFinTey 4 года назад +16

    I love how utterly confused the cars get when they exit the track haha

    • @taureon_
      @taureon_ 3 года назад +1

      "where... where is road???"

  • @shayneoneill1506
    @shayneoneill1506 7 лет назад +259

    Orders an Uber
    About 30 Ubers crash into the wall next door
    Yay deep learning!

    • @zeeshanahmadkhalil8920
      @zeeshanahmadkhalil8920 5 лет назад

      They will first do 200 iterations on virtual cars and then implement the algo on actual car.

    • @random-0
      @random-0 5 лет назад +4

      @@zeeshanahmadkhalil8920 just 200 I bet they will simulate 1000+ times with all the possible roads available and traffic then only it can be practical
      Because if only few accidents happen because of this then then everywhere it will be banned 😂

    • @sf8262
      @sf8262 3 года назад

      Order from us more often or we'll crash your house

    • @Lucas-jq6kk
      @Lucas-jq6kk 3 года назад +1

      @@random-0 I think they'd censor the news and try fix the holes in the AI while selling it as usual

  • @Anamnesia
    @Anamnesia 7 лет назад +93

    It's like watching sperm swim in fallopian tubes!

    • @tjarod11
      @tjarod11 7 лет назад +25

      I knew there would be at least one person who would say or think that.

    • @daniser87
      @daniser87 7 лет назад +2

      ...I even typed "sper" in Google Chrome search to find comments like that.

    • @wil54
      @wil54 7 лет назад +1

      that's one way to describe it....

    • @That_One_Guy...
      @That_One_Guy... 4 года назад

      Suddenly i remembered that one game where u r a sperm and trying to race to the egg

  • @emtkjaers.journey
    @emtkjaers.journey 7 лет назад +372

    I love your simulation.
    And I would love me to see some more in-depth look at your neural network, or maybe the code/project?

    • @SamuelArzt
      @SamuelArzt  7 лет назад +51

      Thank your for your nice comment!
      I am actually planning on making more videos explaining neural networks in general for a long time now and I would also like to put the source code of this project on github. Unfortunetaly I am quite busy at the moment, but hopefully I get around doing it next month. So feel free to keep an eye on my channel ;)

    • @emtkjaers.journey
      @emtkjaers.journey 7 лет назад +2

      Cool, I would love to see it.
      I'll look forward to it :)

    • @SamuelArzt
      @SamuelArzt  7 лет назад +56

      Unfortunately, I think I still won't be able to upload new videos this month... But at least I finally came around to upload the project on github. You can now find a link to the repository containing the entire source code at the top of my website: arztsamuel.github.io/en/projects/unity/deepCars/deepCars.html

    • @XRagnouX
      @XRagnouX 7 лет назад +4

      Samuel Arzt Thanks so much dude ! I start learning deep learning and it is really cool from you to share it. If you upload explanations videos I will watch them :)

    • @ardisulaiman9740
      @ardisulaiman9740 5 лет назад +2

      @@SamuelArzt i just see your comment this year, i am new, is your video available sir? thanks

  • @0KJaye
    @0KJaye 3 года назад +23

    Looks like when I play *any* Racing game , hit a wall, then click "restart race"

  • @mischiefssb4971
    @mischiefssb4971 3 года назад +12

    I can’t help but imagine Mario Kart bots doing nothing but ran into walls for literal weeks to develop the bots

    • @cykablyat6348
      @cykablyat6348 3 года назад +1

      nah they make a path for the bot

  • @viharcontractor1679
    @viharcontractor1679 7 лет назад +136

    In my city people actually drive like this.

  • @tomtommy2105
    @tomtommy2105 7 лет назад +353

    Great job. Simple but smart.

    • @billgates6131
      @billgates6131 7 лет назад +14

      Simple?

    • @rich1051414
      @rich1051414 7 лет назад +16

      Neural networks actually are really simple, but the concept is a bit difficult to grasp. It is basically just trial and error, where each 'node' is a variable that it is trying to maximize or minimize to try to maximize whatever the final expectation is.

  • @spacejonas
    @spacejonas 5 лет назад +42

    3:13 47 Generations and still half of them drive against the wall right at the beginning. 😂

    • @aleksandersuur9475
      @aleksandersuur9475 4 года назад +6

      Of course they do, cars of a new generation are random mutations from best performing car(s) of last generation. The control network is mutated completely randomly, most of the time it does not result in beneficial changes, no matter how many generations you evolve it for.

    • @tamjidterrorblade
      @tamjidterrorblade 4 года назад +2

      @@aleksandersuur9475 so just like human beings right?

    • @aleksandersuur9475
      @aleksandersuur9475 4 года назад +1

      @@tamjidterrorblade Well sure it's just like stillbirth in mammals. Of course in software the mutation rate is a free choice of the programmer, so it can be set much higher than it naturally is in animals. Simpler GMO techniques for grains and such work much the same, you irradiate your batch as seeds, and sure many of them fail to even sprout, but few specimens get a beneficial mutation. And you really only care about the best performer, the tens of thousands of bottom performers don't matter in such a case, the faster they eliminate themselves from the race the better. It's basically sped up version of normal breeding, in the end you get the same result, but with less generations.

  • @Huntress_Hannah
    @Huntress_Hannah 3 года назад +30

    I love how when the cars got out, they were like “well wtf do we do now”

    • @benurm2390
      @benurm2390 3 года назад +1

      it was dancing from happiness

  • @kiwi_2_official
    @kiwi_2_official 2 года назад +13

    it's amazing how quickly they can get so much better; in gen 1 every car crashed before there were any large turns and by gen 13 many were getting far.

  • @Iuki10
    @Iuki10 7 лет назад +19

    put some music in the background and you got yourself your own 'fast and deep learning furious'

  • @AirCannonChannel
    @AirCannonChannel 7 лет назад +148

    This was so hypnotizing to watch. I like it!

  • @sanghoonlee5171
    @sanghoonlee5171 3 года назад +27

    It terrifies me to think this is in fact how Mother Nature operates--throwing countless individuals at the obstacle course of life until she hits on the few with the right combination of evolved traits to make it through. Each car that crashed represents a death--a casualty in her ruthless strategy.

    • @sf8262
      @sf8262 3 года назад +4

      Hmm I see it more like a bunch of cars thrown on a road until one of them doesn't crash

    • @starscream5055
      @starscream5055 3 года назад

      @@sf8262 F evolution bs tired with these liers

  • @miketlf1811
    @miketlf1811 3 года назад +10

    I love how most of them just smash into the wall immediately lol

    • @KimiOmega
      @KimiOmega 3 года назад +1

      Some of these cars are just built different ig

  • @denisa.6793
    @denisa.6793 4 года назад +2

    Their life is meaningless. Whatever path they choose - go through the course or crash in nearest spot - they will die. There are no "winners" or "losers". And the only intention, that they probably can have - reach the end - is just for entertainment of auditory of creatures, that they don't even know about. They don't even know, that they were made by one of these creatures. Just imagine, that they are thinking, that reaching the end is like life goal. But it is just entertainment of us. That's intense.
    Interestingly, what if there are some creatures, who can watch our lives like in couple of minutes and make entertainment out from this. Or contest, whose human can quicker gain social success. Someone, who made Bill Gates or Elon Musk should be proud of him.

    • @KOU_Higashikata
      @KOU_Higashikata 4 года назад

      When they somehow gain their emotion and realize everything is meaningless but they still can't stop it, it was called NieR:Automata

  • @mukulsharma5636
    @mukulsharma5636 5 лет назад +12

    Thanks you so much for providing your source code so that I could understand the process . I mean it from the core of my heart be blessed and all the success to you buddy

    • @SamuelArzt
      @SamuelArzt  5 лет назад

      Thank you for your kind comment! That truly means a lot to me. I am glad that my project was able to help you.

    • @YN-lo1is
      @YN-lo1is 3 года назад

      Had to drop a like and sub when I seen you gave out the source code 🙌

  • @SamuelArzt
    @SamuelArzt  7 лет назад +395

    In case you are interested in how Neural Networks work, I made a one-minute explainer: ruclips.net/video/rEDzUT3ymw4/видео.html

    • @FizzleFX
      @FizzleFX 7 лет назад +7

      *THANKS FOR SKYNET; BASTARD!*

    • @Cowicide
      @Cowicide 6 лет назад +6

      Or... thanks for a nano-scale autonomous probe that can wiggle harmlessly through human intestines to find and remove a dangerous tumor or something.

    • @VulcanOnWheels
      @VulcanOnWheels 6 лет назад

      Why did you make a link that skips the first second?

    • @SamuelArzt
      @SamuelArzt  6 лет назад

      Haha, didn't even notice that, thanks!

    • @jakobmertens6426
      @jakobmertens6426 6 лет назад +6

      The only Question I really have is:
      Do these cars really learn how to drive on streets or do they just learn how to drive on this specific street?
      Like would they be at some point so intelligent that you could give them another street? (after like gen. 1000)

  • @cloudmarc27
    @cloudmarc27 5 лет назад +30

    They: what videos to you actually watch?
    Me: it's complicated

  • @GolfWang520
    @GolfWang520 4 года назад +34

    Generation 11:
    “Alright COOL guys, we are ALMOST there”
    Generation 46:
    “Alright COOL guys, we are ALMOST there”
    Generation year 2020(trying to improve myself):
    “WHY IS THIS IN MY RECOMMENDATIONS😭”

  • @waylonscott6162
    @waylonscott6162 5 лет назад +6

    But for this to be actually learning to drive wouldn’t it have to be on randomizes tracks, or at least multiple, because right not they are learning exact movements for this track and not necessarily learning the rules of driving

    • @pspann6349
      @pspann6349 3 года назад

      Very late comment, but this showed up on my stream just today. As opposed to what he content creator is claiming, this network is not deep in the slightest.
      What you are describing is called over-fitting, but due to the limited amount of information containable in this network that will not be a problem.

  • @ryanchatterjee
    @ryanchatterjee 7 лет назад +13

    I cheered out loud when the first car made it all the way through.

  • @Kram1032
    @Kram1032 7 лет назад +15

    Instead of creating a fixed track, could you try building procedural tracks? There is a chance at least a *part* of what they are doing might be due to the agents learning the track by heart.

    • @SamuelArzt
      @SamuelArzt  7 лет назад +12

      Yes, the tracks could be generated procedurally and also yes, there is a chance (a very high one even) that the agents are simply learning this particular track by hard. After all, if you only train them on one track then that's what you want them to do: learn how to navigate this particular course in the best possible way.
      If you want the agents to generalize to other tracks, if you want them to be able to complete tracks they have never seen before, you have to train them on many different tracks. Otherwhise they get overfitted (or overtrained) on a small amount of tracks (which they become quite good at) but their generalization capability decreases.
      Still, the cars shown in the video are not overfitted at that point (at least not substantially overfitted). You can even see how the cars, which were able to leave the course, learned to maintain a certain distance from walls, in order to not crash. Of course it could be that this particular distance only works on this track, or that the car only learned to keep a distance from walls to the left of it, etc. But that's exactly why you would then take that neural net and train it on other tracks as well (usually: the more, the better).

    • @11WicToR11
      @11WicToR11 6 лет назад +1

      I myself did similiar simulation with 8 input neurons with values of distances to walls around the car ...as far as i can tell, there is no way this approach would make agent memorize track. I mean it learns how to steer to balance distances from walls so that none of those gets close to 0 ...there is no reason why that wouldnt be general solution because all that agent learn is rules like : "if there is wall on the left, steer right"

  • @Fewless
    @Fewless 3 года назад +5

    This is more intense than watching the dvd screensaver.

  • @igrvks
    @igrvks 3 года назад +6

    So when I was playing Super Meat Boy the replay just showed my deep learing progress.

  • @the_gouda_man
    @the_gouda_man 5 лет назад +8

    I really love how they're just spinning simultaniously after beating level (you can see it for a moment). Clearly it's happening because without obsticles in their sight, networks input is just zeros and they have "no information" whatsoever (one single input value) to make different decisions so they're just spinning not "understanding" what to do.

  • @alexbaryzhikov6458
    @alexbaryzhikov6458 7 лет назад +16

    The slower you go -- the further you get. Nice job, man!

    • @ibknl1986
      @ibknl1986 5 лет назад +2

      Not always. I too thought so, but have seen some instances where even slower cars crashed earlier. I think it's an optimized speed that matters.

    • @PretentiousStuff
      @PretentiousStuff 5 лет назад +2

      @@ibknl1986 да он тупую русскую пословицу перевел на англ, не обращай внимания

  • @dannymartial7997
    @dannymartial7997 2 года назад +9

    Machines are pretty bad at learning if you ask me.

    • @VanNguyen-zh4tl
      @VanNguyen-zh4tl 5 месяцев назад

      with yo 86 billion neuron ass

    • @bananamanog5596
      @bananamanog5596 4 месяца назад

      Why do you say that? Machines are a creation of us humans so I guess that calls everyone dumb.😂 Everything has its quirks and Machines are faster than we will ever be. Us and Machines are built completely different. In this video the programmer is using a small and slow learning neural network. Meaning it takes some time and may look dumb and slow in the process but after many attempts it learns to be a better driver in that simulation than a human could ever be. And... it takes a lot less time to master as that (brain) than it does ours. We learn faster but not exactly better.

  • @milan6782
    @milan6782 3 года назад +5

    Reminds me of Happy wheels honestly.

  • @Dakkyun
    @Dakkyun 3 года назад +3

    Programmed by Pastor Maldonado and Romain Grojean.

  • @wonkaytry
    @wonkaytry 7 лет назад +20

    There is a green rectangle in my backyard and is trying to kill me help!

  • @TheFatPunisher
    @TheFatPunisher 4 года назад +5

    is it just learning this specific track, or is it learning how to avoid walls?
    Can you apply the network to multiple tracks and reinforce the learning? what about more advanced tracks?

  • @wwee1r951
    @wwee1r951 3 года назад +8

    2:43 P1!P1! Great job man, well managed. Absolute masterpiece.

    • @XenophonSoulis
      @XenophonSoulis 3 года назад

      Get in there Lewis.

    • @wwee1r951
      @wwee1r951 3 года назад

      @@XenophonSoulis pls lewis, dont get in there anymore.

    • @XenophonSoulis
      @XenophonSoulis 3 года назад

      @@wwee1r951 It's not like I like Lewis winning, but that phrase is pretty iconic.

    • @wwee1r951
      @wwee1r951 3 года назад +1

      @@XenophonSoulis i know man just kidding xD

  • @WayoftheDave
    @WayoftheDave 5 лет назад +6

    I can't wait for this technology to be used in real cars, after the initial body count, this will be way better

  • @Empress_Theresa
    @Empress_Theresa 7 лет назад +9

    A lot of people fear AI because they don't understand how the damn thing works.

    • @Koudy111
      @Koudy111 2 года назад

      do you?

    • @Empress_Theresa
      @Empress_Theresa 2 года назад

      @@Koudy111 Yes. It just "memorize" patterns. It can't make educated or measured decisions. Don't matter how much they try, it's not intelligent at all.

    • @Koudy111
      @Koudy111 2 года назад

      @@Empress_Theresa Don't do humans just memorize patterns as well? When you think really hard about how you navigate the world - we learned it as we grew up. AI could be like human todlers now - they go somewhere, bump into things, learn not to bump into things and go around them. Oversimplified but its how it works. And AI will only become smarter.

    • @Empress_Theresa
      @Empress_Theresa 2 года назад

      @@Koudy111 Yes...when we are 10 or so. But, eventually, we use this data collecting mechanism to make conscious decisions based on each individual situation. With access to the same exact information I can react angrily or calmly, depending on different factors. AI can do none of that, and never will, because it is not conscious.

    • @Koudy111
      @Koudy111 2 года назад

      @@Empress_Theresa I don't think anyone can say something will NEVER happen. History and science taught us that much. What seemed impossible 100 years ago, is mundane now. We cannot comprehened what the future 100 years from now will be like. What seems impossible now can be mundane then. Computer science, biology or conjunction of the two etc...

  • @thingykd
    @thingykd 3 года назад +4

    I'd like to see this kind of AI in Cyberpunk 2077

    • @MrSkinnyWhale
      @MrSkinnyWhale 3 года назад +1

      It's there, but they just left it at gen 5

  • @HwT808
    @HwT808 2 года назад +2

    I can’t believe I spent 3 minutes watching a rectangle get through a hole

  • @sindhusojan8225
    @sindhusojan8225 3 года назад +6

    Each turn is a “learning curve”

  • @JonesCrimson
    @JonesCrimson 7 лет назад +6

    I like how they go too fast because they think it's accomplishing the goal.

  • @itscatiooo
    @itscatiooo 5 лет назад +9

    This is how I was born. I won.

  • @willowkepler
    @willowkepler 3 года назад +3

    This is a great example of how evolution works for life on Earth. Each generation is almost the same as the last one except with a few random changes to the DNA (from radiation, chemicals, etc.). If those changes hinder an organism's ability to survive (which they most likely will), they'll likely die off before reproducing. If the changes help the organism to survive and reproduce (and if those traits are genetic), the next generation might have those traits and will be stronger. This is how life evolved from single cells to complex animals like humans.

  • @Protoreon
    @Protoreon 5 лет назад +2

    Generation 2980: Steals a wheelbarrow, crosses the border with Mexico, becomes a drug lord.

  • @AAvfx
    @AAvfx 3 года назад +9

    I wish I had this algorithm installed!

    • @allanhanan
      @allanhanan 3 года назад

      Well this works by giving punishment when they do wrong and an compliment when they do correct
      It is just human ai

    • @ahsanulhaque4811
      @ahsanulhaque4811 3 года назад

      @@allanhanan reinforcement learning you mean?

    • @allanhanan
      @allanhanan 3 года назад

      @@ahsanulhaque4811 yes but its slightly different

    • @MASQUALER0
      @MASQUALER0 3 года назад

      @@allanhanan this isnt a reinforcement alg. It says in the description its a evolution alg.

  • @blueshade26
    @blueshade26 7 лет назад +5

    Nothing explains a concept better than showing its application in progress. Fantastic video.

  • @tyzonemusic
    @tyzonemusic 7 лет назад +41

    From what I think I understood, the importance of hidden layers lies within the fact that some functions can't be replicated simply with linear operations (multiplying inputs by weights and adding them together), and that the squashing function (hyperbolic tangent, for instance) was the key to creating more complex functions that enlarged the neural network's search space. I may have read this all wrong, but I think you said that you didn't use any squashing function in your network.
    Have you tried simulating it without using hidden layers, by any chance - and if so, did you actually get very different results from it?

    • @SamuelArzt
      @SamuelArzt  7 лет назад +31

      Thanks for your in depth comment!
      You are right that the non-linearity of neural network layers is very important. However you can achieve non-linearity with single layer networks. Kolmogorov famously proposed a theorem in 1965, stating that a neural network with only a single hidden layer comprising enough hidden neurons can approximate any multivariate continuous function.
      However, many expirements and studies have shown that generally deeper architectures are superior to less deep architectures, as far as their performance and generalization capability is concerned.
      I did use a squashing function, however I prefer the term activation function. I don't know why you thought I didn't, I'm sorry if I didn't state that clear enough. The network shown in the video (which is an older version) uses the commonly used sigmoid function. After a lot of research I changed the network to use the "softsign" function instead. The softsign function is similar to the hyperbolic tangent, which you mentioned, with some additional advantages. The hyperbolic tanget is also a better function than the sigmoid (at least for this application). If you are interested in the softsign function and its advantages and why the sigmoid function seems unfitting for this particular application, I recommend reading Bengio and Glorot's paper from 2010 called "Understanding the difficulty of training deep feedforward neural networks". It's not that long and I think it is quite interesting. You can find it on Google-Scholar.
      I don't remember testing it with a single layer, however I recall testing it with one more and one less layer and I did indeed get very different results. However, I have to admit that back then I did not run enough test cases to jump to a clear empirical conclusion.

    • @Emre_Solak
      @Emre_Solak 7 лет назад

      Same...

    • @Emre_Solak
      @Emre_Solak 7 лет назад +1

      TEACH ME WHAT YOU KNOW seriously, you got discord? Good add me Boostio#5047

    • @SimonK91
      @SimonK91 7 лет назад +2

      @Samuel Arzt, I think the huge difference in performance of testing with one more or less layer might be because you use an genetic algorithm for the training. Most of the research focus on back-propagation, not evolution, since the evolution is really slow to converge in comparison to back-propagation.
      For an evolutionary approach the best "neural network" could possibly be [input] -> [output] without any hidden layer in between, since you still have some weights. This result in fewer parameters to tweak, and the evolution could speed up.
      For more complex data it might not be possible to solve it using only a single hidden layer (within reasonable time and computational power). Face recognition for example use several hidden convolutional layers, where each layer creates an intermediate representation of the image.
      The choice of tanh or softsign should not really change the performance anything if you are using evolution for the training. As long as you use a non-linear function you will benefit from having multiple hidden layers.

  • @leonshi8717
    @leonshi8717 6 лет назад +7

    Me and my siblings journey from my father to my mother

  • @ryanwhiteside4333
    @ryanwhiteside4333 3 года назад +3

    Elon Musk wants to know your location

  • @aklimyerindedegil
    @aklimyerindedegil 10 месяцев назад +3

    Hey there, this is an amazing learning opportunity for me. Your video inspired me on an extremely important project, and I used the source code you shared ,a lot. Can not thank you enough.

    • @SamuelArzt
      @SamuelArzt  10 месяцев назад +2

      Thanks for the kind words!

  • @ronaldg7522
    @ronaldg7522 4 года назад +5

    Why did i watched this to the end?

  • @TheRedmondEthan
    @TheRedmondEthan 7 лет назад +15

    That's actually really interesting how you used multiple cars in each run. Really cool

  • @MoonGlow22
    @MoonGlow22 3 месяца назад +1

    İt seems they go slower when there is no other car
    My guess is they get rewarded for the time they are green, and so their goal
    That explains why they still keep racing after track is ended

  • @heatitaku
    @heatitaku Год назад +1

    Its Just like watching Sperm Race
    0:00 - 2:24 Its The Rich Family Who wants a children
    2:25 - 2:47 The Average Family
    2:48 - 3:18 The MBA One

  • @DigitalicaEG
    @DigitalicaEG 7 лет назад +4

    I like how they spin brodies to celebrate when they make it.

  • @Tabula.rasa.abracadavra
    @Tabula.rasa.abracadavra 7 лет назад +83

    a shame this video doesn't have Eurobeat music on

    • @HoutarouOrekiOsu
      @HoutarouOrekiOsu 7 лет назад +3

      I watched the video and read this comment while listening to The Beat of The Rising Sun

    • @WfrArcPol
      @WfrArcPol 6 лет назад

      eurobeat but its a midi file

    • @Wilker_uwu
      @Wilker_uwu 6 лет назад

      brought to you by Piano Sheet Boss

  • @saffiullah9080
    @saffiullah9080 4 года назад +3

    I think it's interesting to think if whether they're actually learning to avoid the walls or just learning the track and trying not to hit where they've already hit before.

  • @mahadevovnl
    @mahadevovnl 2 года назад +1

    This is stupid. It's not learning to take corners, it's constantly forgetting what it's supposed to do until it doesn't crash. It's brute force. If you would teach it how to take corners and it would apply its knowledge, THAT would be learning. This is just adding to a stack of track knowledge, nothing more. It's extremely unimpressive and literally the dumbest thing ever.

  • @nicklasdincer6720
    @nicklasdincer6720 2 года назад +2

    Really cool, but why are the other cars so dumb?

  • @hey77741
    @hey77741 3 года назад +3

    So that's how I was born

  • @jeantimex
    @jeantimex 4 года назад +13

    This is amazing! I wanted to learn how you program this! What’s the program language you are using? What framework is required? Is there a tutorial? Thank you!!!

    • @bernardoolisan1010
      @bernardoolisan1010 2 года назад +7

      the topic is deep learning, python is a very good language to start coding it, it is actually the best one for dl and ml, this algorthms are neural networks but with evolutionary algortithms or also genetic algorthms

    • @hsynkaragzz
      @hsynkaragzz Год назад

      ​@@bernardoolisan1010 Do you think it's easy to encode what's in this video or does it take some effort?

  • @ohaRega
    @ohaRega 5 лет назад +12

    I really appreciate you taking the time to comprehensively answer the questions on the comments. I also appreciate that you wrote this from scratch. Well done!

    • @SamuelArzt
      @SamuelArzt  5 лет назад +3

      Thank you for the kind words! That means a lot to me.

  • @diagorasofmel0s
    @diagorasofmel0s 6 месяцев назад +1

    this is so creepy when you think about how evolution of living things also follows the same rules, survival of the fittest and mutual aid.

  • @莫比-q4r
    @莫比-q4r 3 года назад +8

    0:11 my parents
    0:16 me

  • @NoNameLeft1500
    @NoNameLeft1500 7 лет назад +12

    the ending was too soon... It just got into racing... would be fun to see how they discover ideal lines and such things to carry the most speed through the turns and so on...
    maybe they would realize that the car was a bit understeery and they might want to soften the front antirollbar a bit.. and maybe tighten the rear suspension or bump dampening a bit..

    • @jessiejanson1528
      @jessiejanson1528 6 лет назад +1

      it would be amazing if someone did an AI like this.

    • @AdamsAppleseed
      @AdamsAppleseed 6 лет назад +2

      Exactly what I was thinking too! Not sure if anyone else has made something like this..

    • @julienlamy1937
      @julienlamy1937 5 лет назад

      ruclips.net/video/QtVbch-02Fs/видео.html There's actually a thing like this. It's called roborace.