Linesight
Linesight
  • Видео 9
  • Просмотров 706 778
The Story of The Best Trackmania AI Ever Made
I trained an AI that plays Trackmania with reinforcement learning. It's getting good enough to challenge Official World Records. This is the story of how my AI reached such an incredible level.
Link to raw run playlist: ruclips.net/p/PLZ-JKrjYnD1GBlp-WS3Mr8bKmqsqSSO-U
Link to replay pack: drive.google.com/file/d/19p10V3g4RfFUoUUdVWNN2RXwJmcXfHC2/view?usp=drive_link
Link to input files: drive.google.com/file/d/12Jfp6nDNhAb7vQIeUIao_VU0W8652s_r/view?usp=drive_link
Project Github: github.com/pb4git/trackmania_rl_public
Game: Trackmania Nations Forever
Buymeacoffee: buymeacoffee.com/linesight
00:00 Intro
00:43 map5 (v1 and v2)
03:58 A01
05:10 map5 (v3)
07:27 Official Campaign intro
08:42 A02
11:11 D06
14:2...
Просмотров: 315 612

Видео

Trackmania AI Learns To Drift and Beat Pros ? | Hockolicious
Просмотров 346 тыс.9 месяцев назад
We trained an AI to play Trackmania on Hockolicious, one of the game's most prestigious tracks. The AI set a strong time, beating the 2012 World Record previously set by CarlJr. Link to map: tmnf.exchange/trackshow/414041 Link to replay: drive.google.com/file/d/1b0p2QSXAea1v7lVCGuWkNr-5xQ6PdqHo/view?usp=drive_link Game: Trackmania Nations Forever Project Github: (the code is not intended to wor...
Superhuman Trackmania AI Demo | map5
Просмотров 28 тыс.9 месяцев назад
Linesight project. We used reinforcement learning to train an AI that plays Trackmania. On its training track, the AI is faster than the current human world record. We put this video out as a challenge: can a human still overcome our AI? Game: Trackmania Nations Forever (TMNF) Map: tmnf.exchange/trackshow/10460245 Replay (.gbx file): drive.google.com/file/d/1jfOyhRQCvOC5XSEhhajE2OvmJcCHKDjR Wir...
AI Plays Trackmania - Bloopers
Просмотров 3 тыс.Год назад
In this video, and AI is trained with reinforcement learning to accumulate speed and finish a map as fast as possible. The AI learned a behavior where it turns around right before the finish line. This is not a one-off mistake, the AI repeatedly did similar things in back-to-back runs. Can you guess why ?
AI Plays Trackmania - Map5 2:04:91
Просмотров 9 тыс.Год назад
The AI is trained via reinforcement learning. Game: Trackmania Nations Forever (TMNF) Map: tmnf.exchange/trackshow/10460245 Replay (.gbx file): drive.google.com/file/d/1hp1Mz0ooR2YBNpqNjvvxjFrBOGXs8DYD/view?usp=sharing
AI Plays Trackmania - Training Progression Side by Side
Просмотров 3 тыс.Год назад
In this video, an AI is trained via reinforcement learning. In order from the top left corner, top right corner, bottom left corner and bottom right corner the AI has received progressively less training time. The video compares the lines taken by the various AIs in different parts of the map. Game: Trackmania Nations Forever (TMNF) Map: tmnf.exchange/trackshow/10460245
AI Plays Trackmania - Map5 2:07:00
Просмотров 1 тыс.Год назад
The AI is trained via reinforcement learning. Game: Trackmania Nations Forever (TMNF) Map: tmnf.exchange/trackshow/10460245
AI plays Trackmania - Map5 2:09:12
Просмотров 949Год назад
The AI is trained via reinforcement learning. Game: Trackmania Nations Forever (TMNF) Map: tmnf.exchange/trackshow/10460245
(Teaser 01) AI learns to play Trackmania with reinforcement learning
Просмотров 1,7 тыс.Год назад
This video is a recording of an AI currently training to finish a custom map as fast as possible with reinforcement learning. This run was played on Trackmania Nations Forever, with TMInterface to link the game and our AI. The run was played on a custom map. The .Gbx map file is available for download here : tmnf.exchange/trackshow/10460245 The AI took 2mn12s25 to complete the map during that t...

Комментарии

  • @jareypoohbears
    @jareypoohbears День назад

    I need this to work at 80% capacity to set medal times on my map because I'm actually hot garbage at driving BUT BOB TFN BUILD

  • @jarno8608
    @jarno8608 День назад

    And than the AI got banned

  • @bellidrael7457
    @bellidrael7457 2 дня назад

    'It took players 9 years to realize they could do this trick...' -Ai literally within 24 hours with no human input 'Hey look what I found'

  • @MichelBin-rs5df
    @MichelBin-rs5df 3 дня назад

    Why dont you make a program, that lets us all make a giant computer cluster to train the ai?

  • @Tenderloin-yt7tn
    @Tenderloin-yt7tn 5 дней назад

    They said the AI played 20hz I play 10

  • @NathanaelNewton
    @NathanaelNewton 6 дней назад

    omg ahahah 14:13 I started lauging aloud the same before agent smith omg hahahah

  • @jobasti
    @jobasti 6 дней назад

    New here! Love the content, keep it coming!

  • @balboni7363
    @balboni7363 6 дней назад

    As someone who creates maps, but isn't a stellar driver, one of the issues I run into is building around incorrect racing lines. I may build turns that will be taken a different way by a better player resulting in far more speed than expected on the exit. This causes the flow to be completely wrong and the maps to break. In these times I often wish I could have access to more strong players to test my map so I could build around these issues. With this AI, theoretically I could have it run on the map instead and learn from how it drives my maps. I could then make improvements and increase my map quality. Amazing work and excited for the future

  • @basildaoust2821
    @basildaoust2821 7 дней назад

    First I know I complained a bit, but I did like and subscribe so I hope we hear more about how your AI does, I can't drive those races though I did try a few as long as coming in like 10000 place or worse is an achievement :) Later.

  • @basildaoust2821
    @basildaoust2821 7 дней назад

    OK, very interesting. I have to ask, why are you trailing so much like even in the last race basically right from the start you are already losing and nothing has happened, it seems you must be missing something to always come out at the start behind and then you have to speed up. Also when you know a shortcut exists and that using it on lap two is bad because you will lose time why can't you teach the ai to use it on lap three because now it would be faster, maybe, must be since you ended up behind, I get how wheels on the track accelerate the car and wheels in the air do nothing, but still, in the race you won, you still had to come from behind when you could have been a touch slower but farther down the track and had a bigger lead on the human. I know this is teaching it how to measure best performance, but I bet you could teach it, maybe it needs to try jumps that it will fail then it could rank the jump undoable at speed x so it doesn't try and jump and when it has more speed it considers it and learns it's still slower so it marks the jump at that speed as also a bad choice and on lap three when it's going even faster it tries again and sees the better result. I get that this might be hard in your algorithm or web of choices but you seem smarter than me and I would just like to see the AI really kick human asses even harder, though I do have to dislike the use of the AI your using :)

  • @basildaoust2821
    @basildaoust2821 7 дней назад

    Wait you're saying an AI can't learn as fast as a human, that seems like just maybe your code is fucked in the head, can't the ai review the track design. Then guestimate the best speed he could drive through the area then figure out how good a bounce would be at let's say 20 points around the curve and just try those 20 spots, and see which one is the best then try 20 spots around the known current best and try again, if none are better is has the best one it can know, I mean how does the human player hit every wall ram/crash drive out at speed, for every corner, obviously an AI should be able to try and test these 24 hours a day and find the route?

  • @HexDeck
    @HexDeck 7 дней назад

    Wonder how hard it would be to train it to get vertical setups by itself and start noseboosting all over the place. PS I think the setup is far harder to train than the noseboosts themselves

  • @thegamer97HS
    @thegamer97HS 7 дней назад

    insane video, well done.

  • @ejkmovies594
    @ejkmovies594 8 дней назад

    In the video you give rewards to the agent for following the line of the course. How do you initialize the line? Is it just defined by the track itself or do you hardcode a line for every track yourself? If you do hardcode it, how do you hardcode it? Then how do you assign the reward? Is it just based on distance to the line? Because wouldnt that mean that if it moves backward that it still gets a reward for being close to the line. How do you make sure it moves forward with your reward function?

  • @seifyk
    @seifyk 10 дней назад

    What happens if you add a multiplier for the reward for reaching mini checkpoints out of order?

  • @mrosskne
    @mrosskne 10 дней назад

    bro's gonna accidentally create AGI while trying to beat records in a video game

  • @ImNotYo.u
    @ImNotYo.u 10 дней назад

    Shortcuts are found via analysis from the freecam so maybe you need to give the AI some sort of blueprint of the map

  • @ImNotYo.u
    @ImNotYo.u 10 дней назад

    Train it on Deep Dip 2

  • @robosergTV
    @robosergTV 10 дней назад

    Good stuff.

  • @robinx1615
    @robinx1615 11 дней назад

    Do you see, Mr. Anderson?

  • @gavinmcknight9206
    @gavinmcknight9206 12 дней назад

    Investing in your channel from 13k. Big things ahead

  • @peterhansmann3289
    @peterhansmann3289 12 дней назад

    what if the progress line was also part of the ai network? now that the distance to the line also has an impact on the reward, maybe giving the ai the ability to modify the line will make it possible for even better optimized race lines.

  • @NorgesGlass
    @NorgesGlass 12 дней назад

    You sould learn the AI to overcome Deep Dip 2, that would be amazing if that is even imposible 🤩

  • @thekoalaguy9597
    @thekoalaguy9597 13 дней назад

    our wives - rollerating our obsession

  • @LucasJohn0723
    @LucasJohn0723 14 дней назад

    wait til this guy learns about tasing

  • @TheUntamedNetwork
    @TheUntamedNetwork 14 дней назад

    Out of curiousity have you tried using a dynamic utility score? For example on a full speed map, the AI would start almost exclusively maximising for top speed/acceleration, and then as training progresses the utility score smoothly changes to maximise for track progression rate. Like one of the things that seams 'cheaty' with these AI's is changing the variables intentionally (like making prioritise path seperation) makes it seam less genuine. But I don't see why you couldn't have it run a few smaller populations with different priorities initially: like top speed, acceleration, checkpoint seperation or even imitating current WR (as basically all real players do) and you slowly change each indivigial populations towards simply finishing the track quickly you also grow or shrink the populations based rate of improvement+current performance. Once things start to stabalise, ofcourse. Which whilst obviously adding some computational requirments would mean the AI, whilst still requiring training on any indivigual map, could face a wide bredth of maps and optomise appropriately without a human needing to tweak the variables a little. I guess the coolest AI is one which after an initial training session, can beat WR on maps with a reasonable amount or real time further training on that specific map. Maybe a 100 hours equivelant or so.

  • @pfm57
    @pfm57 14 дней назад

    Impressive stuff. But what would be truly amazing is an AI trained on all existing maps that can take on any new map without retraining.

  • @dinamiteurdinamiteur2324
    @dinamiteurdinamiteur2324 15 дней назад

    Cool, do more

  • @sirhoog8321
    @sirhoog8321 15 дней назад

    My idea: Instead of rewarding it just on its distance from the ideal path, you should also reward it for following the direction and speed of the ideal path. 1) Get the cos of the angle between the path and the AI's velocity: cos(theta) 2) Get the difference in speed between the path and velocity: abs( |path| - |velocity| ) So, something like this: cos(theta) - abs( |path| - |velocity| ) Essentially, the path shouldn't be a set of points but a set of vectors. Edit: I think there's some flaws with this: 1) The AI has less freedom to find a better path. 2) Knowing the ideal path before training beats the entire point of training the AI BUT: 1) During training, you can set the "ideal path" to the path the best AI follows (basically a reward system that adjusts itself during training)

  • @bambusll3155
    @bambusll3155 15 дней назад

    I love that unlike TAS you Don't need to find it by your self and I believe AI can learn/find anything like overwalls, nose dances and especially uber bugs! how it got wallbangs is incredible!! maybe it can discover some new way to get less time

  • @erickramer7924
    @erickramer7924 15 дней назад

    Awesome content with the right amount of technical depths into AI technology, keep going!

  • @zachfitzgerald7304
    @zachfitzgerald7304 16 дней назад

    I would love to see this AI try to complete deep dip one then try deep dip 2

  • @user-ph3zl7gf3q
    @user-ph3zl7gf3q 16 дней назад

    Only 5 minutes in and I can already tell this is a great video, almost on the level of Wirtual’s videos which is something the majority of Trackmania content creators struggle to accomplish. Be proud for what you have created and strive to make more content like this❤

  • @keegany4r176
    @keegany4r176 16 дней назад

    "The neural network I use is not much bigger than a fruit fly's brain." I know that rats can drive, why haven't we tried flies yet?

  • @DesignWithTommy
    @DesignWithTommy 16 дней назад

    If replays are just the input of the game. Can’t you train an ai from high score replays? And then have it be able to predict the best time to press the best input?

  • @knightfromjupiter
    @knightfromjupiter 16 дней назад

    19:56 relatable AI

  • @JohnSmithhh
    @JohnSmithhh 16 дней назад

    Microsoft asur can be a sponsor of your work, try contact them ;) good job!

  • @rufus9508
    @rufus9508 16 дней назад

    Please make a technical video about the whole algorithm, modifications and training tricks you have used

  • @angeloid_
    @angeloid_ 17 дней назад

    This is neato, but from a tech perspective I definitely think a zero-shot AI is gonna be wayyyy cooler!

  • @ShadEoin
    @ShadEoin 17 дней назад

    Bro what are u coding this on is it python or somthing else

  • @lilbilMT
    @lilbilMT 17 дней назад

    Awesome work It’s so cool to see AI play video games like this great work

  • @VGLounge
    @VGLounge 17 дней назад

    This is cool, but once every track has an AI topping the records it will feel like the game is over

  • @MultiKeto
    @MultiKeto 17 дней назад

    You could have called every human WR car. "Mr. Anderson". :)

  • @dmitryrybin7831
    @dmitryrybin7831 17 дней назад

    Absolutely mind blowing, it is Deepmind level stuff

  • @mc-not_escher
    @mc-not_escher 18 дней назад

    Get the AI to beat Deep Dip 2.0 before anyone else, then I’ll be impressed.

  • @Harry_Blotter
    @Harry_Blotter 18 дней назад

    awesome project! I remember seeing v1 ages ago and I just got caught up. I'm curious, is there a reason the image is still so heavily compressed? it seems like you're probably losing quite a lot of information this way.

    • @linesight-rl
      @linesight-rl 17 дней назад

      The reasons are processing time (2x more pixels ~2x slower pass through the network) and RAM usage. We need ~64Go of RAM for ~1Million images at that resolution, if we had 2x more pixels we would need 2x more RAM.

  • @melvaa2819
    @melvaa2819 18 дней назад

    Man, you are a true talent. First of all your video is so well made, this alone deserves applaus. Then there‘s your skill in programing AI. Im not an expert in this field but in my understanding this need quiet some knowledge to do. I really hope for you that you will use these skills in your career. I hope you all the best and looking forward to see a new update video 😁😁👍🏼

  • @malou13337
    @malou13337 18 дней назад

    Hi you should try Deep dip

  • @introCvideos
    @introCvideos 18 дней назад

    This is incredible.

  • @drivejapan6293
    @drivejapan6293 18 дней назад

    I'm not sure the video creator knows what a win loss record is. He seems to ignore the fact people beat it then he needs to come back and tweak it.