My Final Year Computer Engineering Project Explained | Virtual Reality Cube

Поделиться
HTML-код
  • Опубликовано: 26 ноя 2022
  • Me showing off my fully working and final implementation of my massive final year project. I'm a final year Computer Engineering student at the University of Pretoria (Tuks) but also do a whoooooooole lot of other stuff. Check out the rest below...
    Insta: / mitch7w
    So the full title of my Project was "Real-time hand gesture control of a virtual object in augmented reality." This is a detailed explanation of how I built it and all of its functionality. I built the hand gesture Convolutional Neural Networks from scratch, built up the rendering pipeline with OpenGL and did a lot of first-principles algorithmic work for the surface and object detection systems using the Kinect depth data and the RANSAC algorithm. I am really happy with how it turned out and am looking forward to getting that final mark. It was an insane year of hard work on it but I am glad it's over and that it turned out so well!
    If you liked this video you'll probably like some of my others!
    Tuks Campus Tour | University Of Pretoria Virtual Tour: • Tuks Campus Tour | Uni...
    Artificial Intelligence Course Explained: • Artificial Intelligenc...
    Moving In Day At The University Of Pretoria: • Moving In Day At The U...
    16 Tips For Tuks | University Advice: • 16 Tips For Tuks | Uni...
    How To Get A Software Engineering Job In South Africa: • How To Get A Software ...
    What Do Computer Engineering Students Study? : • What Do Computer Engin...
    LENTEDAG 2019 | AFTERMOVIE : • LENTEDAG 2019 | AFTERM...
    This video contains me talking about my Project, lots of Python code, me moving my cube around and the usual background noise of the Project labs...
    You can message me at / mitch7w but I only check this once a week for my own sanity - the Insta rabbithole is real.
    Thank you for taking the time to watch my video - attention is valuable so it means a lot. Please subscribe for more brief glances into my life. :)
    My name is Mitch Williams and I'm a twenty-three year-old living in South Africa. I am really passionate about learning, technology, space, reading, hiking, always improving and am studying Computer Engineering at The University of Pretoria (Tuks). These videos are a way of remembering my life and to possibly help out some other future varsity students get a sense of what they're in for.
    Music: - Blue Wednesday - Dots
    - Provided by Lofi Records
    - Watch: • Blue Wednesday - Dots
    - Download/Stream: fanlink.to/AfterHoursEp
    #computerengineering #studywithme #university
  • НаукаНаука

Комментарии • 62

  • @SM-se5eq
    @SM-se5eq Год назад +48

    Had no idea what he was saying the whole time but he really did a great job convincing me to take up computer engineering

  • @gooze3888
    @gooze3888 Год назад +1

    This looks amazing, congrats man

    • @mitch7w
      @mitch7w  Год назад

      Thanks so much hey!

  • @hlokomani
    @hlokomani Год назад +7

    Congrats Mitch, super proud of you mate

    • @mitch7w
      @mitch7w  Год назад +1

      Thanks hey, feels great!

  • @affecttheeffect
    @affecttheeffect Год назад +2

    Just brilliant Mitch! I like the fact that the system can detect and react appropriately to newly placed objects like the Kinect box. It's one thing for the network to prevent the cube from passing through a desk surface which occupies a set of XYZ coordinates that are discovered at the moment the program starts running but it's an even more impressive thing for the network to stop the cube from conflicting with the Kinect box whose presence, size and position were completely unknown to the network until it was moved into range at some random time long after the program had begun to run. How interesting that one neural network (viz. your mind) expressed frustration with another neural network (viz. the one embodied by your project) on those few occasions when the latter didn't operate in accordance with a desired function.

    • @mitch7w
      @mitch7w  Год назад +2

      Thanks Pete! Turned out so nicely

  • @MrRadnartjie
    @MrRadnartjie Год назад +6

    If you don't get a distinction for this project. I'll be very surprised. Bright future ahead for you mate.

    • @mitch7w
      @mitch7w  Год назад +2

      Got that A. Life is good. Thanks man!

  • @adlawnmariga
    @adlawnmariga Год назад +3

    Its been great man,although you started way before I have watched your channel since move in day 😂😂when you had that Nasa Shirt on. 💪Now going into my Final year studying Mechanical Engineering, Me coming to UP in 2020 your videos played a role and I am glad I did 👍 I appreciate it man. All the best in your future endeavors...

    • @mitch7w
      @mitch7w  Год назад

      Thanks so much for being such a longtime fan. Good luck with the end of yours!

  • @jamesthomson13
    @jamesthomson13 Год назад

    Congrats bro, we made it ❤️

    • @mitch7w
      @mitch7w  Год назад

      We did indeed❤️

  • @kaegengovender8791
    @kaegengovender8791 Год назад +2

    This is both exciting and terrifying. I'm approaching my final year in electronics engineering and choosing image processing as one of my electives. It's cool to know that this is a project I could do but also intimidating to try to get this done

    • @mitch7w
      @mitch7w  11 месяцев назад

      You can do it! Day by day and subsystem by subsystem

  • @Blearky
    @Blearky Год назад

    That is an awesome project dude! I wonder if you could increase performance by letting the camera just calculate the surface when it appears (like the box) completely, than catching 4 points per side on a x,y,z cordinate to span a plane in the room and clear the cache to get some performance back. But again this is awesome keep it up my man.

    • @mitch7w
      @mitch7w  Год назад

      Yeah lots of things could be changed but ah it worked and if I built it again I think I'd redesign a lot of stuff to make it more efficient...

    • @Blearky
      @Blearky Год назад +2

      ​@@mitch7w If it works, that's all that matters. As an outsider, it's always easier to make assumptions, so you probably had your reasons for the choices you made along the way. I also understand that time constraints played a big part. I hope the hard work paid off for you. Keep up the good work.

  • @basswellbiotech
    @basswellbiotech Год назад

    hey can you share excel schedule time table.. awesome final year project, this is truly inspiring for me , someone whose a final year project in computer science....

  • @wianlewies8391
    @wianlewies8391 Год назад

    Hi Mitch, I'm in Grade 12 this year and I'm going to study Computer Engineering next year at UP. Your videos have been a great help. I was hoping you could maybe send me a list of software you used during your time there.

    • @mitch7w
      @mitch7w  11 месяцев назад +1

      Watch enough videos and you'll hear mention but python, c++, lateX

  • @benno8699
    @benno8699 Год назад +1

    Congrats, can you maybe share your time schedule for the engineering somewhere? Would be interesting to see.

    • @mitch7w
      @mitch7w  Год назад

      Wake up 6 and go to bed at 00:00. Mostly work in there with breaks at lunchtime and in the evening for gym and dinner. That was kinda the schedule this year, obviously changed a lot throughout the degree

  • @boristomov9816
    @boristomov9816 2 месяца назад

    Hey Mitch, seems like I am a year late to the party, but just wanted to let you know I absolutely love your project! I am an undergrad just finishing an ML class at UC Berkeley and have been on the search for cool summer project ideas to improve my resume. My idea was to use a raspberry pi with a camera, mounted on top of a VR/AR headset in order to be able to render complex virtual objects (like Architecture 3D models) over open spaces (like an actual construction site). As it seems you have already gone through the struggle and gained some experience in that field, I was wondering if you have any advice on approaching such a project. Based on your experience, do you think training those cnns might be too computationally difficult for the raspberry's processor? Also, is there some minimum hardware specs you could recommend for the camera module - do you think having a moving setup (like in a headset) might create additional performance issues? Those might be difficult questions to answer, I know, I would appreciate your perspective though ;) Thanks for the video and wish you all the best!

    • @mitch7w
      @mitch7w  2 месяца назад

      Hey man! Good luck with the degree. I don't think you'll be able to train on the Pi but can probably do inference if you're smart. I trained on a laptop. Use a basic webcam for video input (cheap and good enough quality) and then I don't have much experience with VR but whatever you can for cheapest and has the best API is probably your best bet! DM me on Twitter if you wanna chat more💯

  • @DJDarkDash1122
    @DJDarkDash1122 Год назад

    I'm studying computer programming and I don't know what we would do with you and your ideas.

    • @mitch7w
      @mitch7w  11 месяцев назад +2

      Haha, very kind.

  • @saiyashwanthdasari3352
    @saiyashwanthdasari3352 12 часов назад

    What happens if you use it in front of a mirror?

  • @zainebaurangzeb9083
    @zainebaurangzeb9083 Год назад

    can i have the project for the sample??

  • @tmakombe
    @tmakombe Год назад +1

    Hi Mitch. I wanted to ask where you bought your website domain or where you host it on?

    • @mitch7w
      @mitch7w  Год назад

      GoDaddy, Firebase.

  • @shimisimi8431
    @shimisimi8431 Год назад

    Hi....So if fail a module Neh,and it blocks the next year's module and so on ...will there be a point where you will be attending 2 or 1 module for the whole year?

    • @mitch7w
      @mitch7w  11 месяцев назад +1

      Yeah, if you don't get academically disqualified for not passing the minimum number of modules

  • @benno8699
    @benno8699 Год назад

    I'm guessing this project was more software focused than hardware? Were there any real hardware aspects?

    • @mitch7w
      @mitch7w  Год назад

      Almost entirely software-based

  • @mpumezoamahle2041
    @mpumezoamahle2041 Год назад

    Mitch i need your help
    I'm a first year student at UP for computer engineering and I'm experiencing some problems when registering.
    While choosing modules, Cos 110 states that "Requisites are not met for class, not enrolled "

    • @mitch7w
      @mitch7w  Год назад

      contact the faculty/admin

    • @SHDWMhofulet
      @SHDWMhofulet Год назад

      Hey I'm a first year too and I have the same problem. They said you can only register for it during orientation week

    • @mpumezoamahle2041
      @mpumezoamahle2041 Год назад

      @@SHDWMhofulet message the student administration for that program, they helped me

  • @LucidSonder
    @LucidSonder Год назад

    Is there a repo with the code?

    • @mitch7w
      @mitch7w  Год назад

      Private one yeah ;)

  • @zwivhuyandou493
    @zwivhuyandou493 Год назад +2

    You just gotta love python

    • @mitch7w
      @mitch7w  Год назад +1

      SO MUCH. Some of my mates wrote entire components of their Projects in C++ for efficiency and then had to modify them later and rewrote in Python just cause of the ease

  • @Alien-cr1zb
    @Alien-cr1zb 4 месяца назад

    do mind sharing some resources that helped you during the project

    • @mitch7w
      @mitch7w  4 месяца назад

      3b1b NN videos, geeks for geeks intro to CNNs, PyKinect and Tensorfloe documentation

  • @user-od1tf7mz1w
    @user-od1tf7mz1w 4 месяца назад

    Hi, what are the specs of your laptop?

  • @mohammadsajida365
    @mohammadsajida365 5 месяцев назад

    Can you share the git link of your project?

    • @mitch7w
      @mitch7w  5 месяцев назад

      Look on my GitHub

  • @mirriambango3574
    @mirriambango3574 10 месяцев назад

    Literally struggling with my final project 😢

    • @mitch7w
      @mitch7w  10 месяцев назад

      Shame it's tough hey! Don't feel shy to reach out to other final years - can all help each other a lot just by chatting about your problems

  • @oliverq8888
    @oliverq8888 Год назад

    Now you have a cube that's not exist in reality, how about taking further steps, for instance, moving the object (cube) in augment reality and the 'same object' (cube) will move in reality

    • @oliverq8888
      @oliverq8888 Год назад

      or, at 5:28 instead of colliding with the surface put some stuff (e.g a RC car) and when you collide the cube with right side of the car, it moves horizontally to the left, collide with left side it moves to the right, back side it moves forward, front side it moves backward, and at the edge the car spin around itself.

    • @oliverq8888
      @oliverq8888 Год назад

      This could do with Omni wheel

    • @mitch7w
      @mitch7w  Год назад

      Yeah maybe one day

  • @prajwalrao6381
    @prajwalrao6381 Месяц назад +1

    Can i get ur github id name

  • @Trust679
    @Trust679 6 месяцев назад

    Sorry G you had to have got a first honura in your degree