Deep Learning - Computerphile
HTML-код
- Опубликовано: 8 сен 2024
- Deep Learning with Convolutional Neural Networks - Dr Mike Pound explains.
CNN background: • CNN: Convolutional Neu...
Onion Routing (TOR): • How TOR Works- Compute...
/ computerphile
/ computer_phile
This video was filmed and edited by Sean Riley.
Computer Science at the University of Nottingham: bit.ly/nottsco...
Computerphile is a sister project to Brady Haran's Numberphile. More at www.bradyharan.com
"This one's got a cat in it.
This one's got a dog in it.
Well this one's got a cat and a dog in it, and that's very exciting."
Dr Mike Pound you are an excellent teacher please opt in for more computerphile videos! Big fan
We missed you! :D
I'm a simple man, I see Mike Pound, I pound that like button.
OwenMc1992 what a teerible pun. But then again. I'm a simple man, I see a simple pun, I punch the phumbs up
@@userou-ig1ze You are very Punning
@@ther701 YUCK
Dr Mike Pound is always my favourite. I'll be waiting for the follow up!
When I first watched the neural-network vids on computerphile, I didn't know what a neural network was, much less a CNN. Now, I've had to learn so much machine learning for my job that I know exactly what the next video is going to contain. Won't stop me watching it though
Pretty sure I drove past Mike Pound on the Derby ring road. I couldn't believe I saw such a celebrity, where I live!
Yay, he's my favorite one of the usual people.
smooth man, smooth. In internetz speak: Much sublte! Such smooth.
Love this guy. It would be an honor to be taught by him.
1:54 When I first looked into cnn I couldn’t understand why applying 32 filters to a 3 colour channel image would not result in 32 * 3 convoluted layers but rather 32. That « hidden dimension » explains a lot of things thanks.
I was always interested in Dr Pound videos, but I never understood them fully. How, when I have passed some courses by Andrew Ng it is much clearer, because of techincal knownleges I now have. It is so good to see that now everything makes sense. By the way, It would be great if you could make some videos with Andrew.
Coursera?
Yea. Free Machine Learning, and then deeplearning.ai courses.
I prefer Dr Kilo
Pound for Pound one of the best teaching on Deep learning
Dr Mike Pound if you are reading this, PLEASE we need and demand more content featuring your explanations. Please come on Computerphile atleast monthly, and talk about the weather i dont care. Anything privacy or security related will be fine. Just come on our screens more.
I’m a simple man. I see Dr. Pound, I like & watch.
One of the guys I look forward to looking at is Dr Mike Pound.
Don't forget to make that next video!
My favorite guy from computerphile talking about my favorite subject from computer science! awesome
THIS IS THE VIDEO I'VE BEEN WAITING FOR! I love all the guys on this channel but Mike Pound's content is super. Any chance he's looking for students for research? ;)
Was thinking the same thing! Unfortunately, my university does not exchange with Nottingham currently. Now I'm sad :(
We're always looking for students! Check out the Nottingham, CS and Computer vision lab website for opportunities.
Man: Left-handed.
Computerphile: Let's put the camera to his left
Frixion pens? Love them
Can we have this applied to Where's Wally? Basically a frivolous waste of time, but perhaps an interesting example.
Haha! Love the idea!
Instead of looking for him yourself, you'll write a CNN to find him for you!
If you code an already trained network for android, it would make for a funny app.
My favourite scientist on this channel
Nice! The return of Mike #
£
Confused. If you take off the neural net when/where's the learning done?
the convolutional layers are also part of the neural net and they are being trained
He meant taking out the last fully connected layer that does the actual categorization.
Simon Johansson bump. Author makes it sound as if convolutional layers are not trained and simply transform the data into some high dimensional statespace. Almost like liquid state machines. This is, to my knowledge, mostly wrong (probably a misunderstanding), the convolutional layers are trained as well
AFAIK: in this CNN, correct label for training is no longer number (class) but something like multidimensional feature vector. In the process of training, network learning how to mapping vector to another vector. So, inaccuracy of mapping may be computed from difference between output vector and correct, ground truth, vector.
The kernel that does a convolution is just another "neuron". The convolutional bit comes in because it is only connected to a few pixels/neurons in the previous layer(s), rather than the whole layer
Awesome! Brilliant! Marvellous! :D I love him and his style. I wish every teacher was like you and I wish I was your student.
what a cliffhanger
So is this why CAPTCHA uses these photographs divided into sets of squares, and you gotta pick which square contains a road sign or something? Because it's compared to the low resolution output of the CNN?
a companion video of a simplified version made in keras would be helpful
Color is a little weird this time
You are such a great teacher. Thank you for your videos!
I like how this guy explain things
Please post more such videos. Easy to understand concept with animation. Thank you
New to CNNetwork, so each kernel produce only one feature output out of three channels or the feature output is also in rgb.
Looking forward to next part
That one got a cat and dog in it, that is very exciting! 😂
gorgeous animation!
I enjoy your videos
keep on the amazing work guys! Thanks for the video!
I strive to be like him
keep on the amazing work guys! Thanks for the video!
Frixion pens? Love them
You’ll be happy to know that you don’t need to know how this works to use it.
But that makes you a computer user, not a computer scientist.
Olivier Nicole duh! You must be a genius.
black box?
Well, it's still in its very infancy. If you don't tweak the deep learning architecture, and just use a black-box library then you can't optimize the result. I've seen many data scientist jobs requirement and one of the important points is to be able to read research papers and create your own solution designed specifically for your problem.
MichaelKingsfordGray r/iamverysmart
No yellow on white? I think Prof Ed said something similar
merqyuri Nah, it was something told to him by Prof Tom Kibble.
Mike! Finally!
Convolutional Neural Networks, the kind of CNN you CAN learn something from.
Dr Mike Pound can you talk about how karnel works, please?
Spotted the reMarkable on the desk!
♥ Mike Pound
I wish Mike was my teacher
Well done!
Frixion pens? Love them
Confused. If you take off the neural net when/where's the learning done?
Mike Pound is back! Yasssssssss!
Could someone please link the follow up video here?
Absolutely love these videos, especially the ones with Mike, but I’m still not exactly sure I follow the whole “tip the picture on its side and scan like that” bit
Are you just scanning the top row of pixels?
Or scanning the picture row by row from the top? Or...
More videos on DL or ML please
I've been watching the Rubik's cube of Pound's office for a while now, and they're starting to get out of hand.
How does the network fully convolutional train? Without a NN at the end, what is actually getting trained here? How could you train a convolution?
How do you backpropagate here?
Can someone explain (in simple terms) why the image needs downsampling to learn stuff from it?
We missed you! :D
please make a channel on AI , may be name it Intelliphile - explicitly speaking on ML and DL.
Mike is so cute and smart I would love him to Pound me.
What is a convolution?
Try here ruclips.net/video/py5byOOHZM8/видео.html
I see a white ghost on the shelf.
what?
Peter Bočan a ghost cube on the shelf
ayee
+ for the (maybe involuntary ?) japanese reference
Did Tom leave the channel?
This wasn't very explained IMO, probably only people versed in Computer Science and Deep Learning would understand.
I agree, did he even explain what "looking at the image from the top" means ?
I want to know why captions are disabled for Computerphile?
Ahh the cliffhanger on Unets and other general semantic segmenters
I want to watch RUclips videos but I want to watch them and replace everybody else's voice with my own that way I can learn faster and watch the video faster. Is there some sort of plug-in for a modified RUclips APK where I can put my digital copied voice on top of captions or something? What I'm asking for is an AI to replace the in video voice with my own because since a person is used to their own voice they could understand themselves better than having to listen somebody else therefore I'll be able to learn this faster instead of trying to understand his thick English accent or anyone else who speaks non American English.
I wonder, why some of *phile videos don't have automatic subtitle? Maybe somebody forget to set the language of the video?
Ah, now I got it. Deep learning means, doing whatever and hoping something useful will come out.
another great vlog! btw, what's the name of those marker pens?
Think they're called frixion pens - bought them cause I hoped they'd be quieter... >Sean
woohooo! a Mike's video!!!
I totally understood everything.
:P me too
It was rather easy for people who know the matter, but not very well explained for thos who don't. But that's mostly just because Neural Networks are not easy to understand intuitively.
This guy is instant like.
How do you prepare the data for such a network?! I can't understand how it manages to learn if we don't provide the output "heat map" for a given input, or how do we prepare heat map for a given input if the network in fact needs one.
Several ways are possible. The method that is most commonly used is to train the network with fully-connected layers at the end and after you are done you can convert them to convolutions (By that I mean you use the weights from the fully-connected layers as filter coefficients for the convolution). Or you can directly train the network with a convolutional output. But in that case you will not only need annotations as to what can be seen on the image but also where it can be seen.
Thanks for the answer.
What does the convolution actually do on the photo. I googled some images and I saw that it takes the sum of the pixels surrounding the main pixel, multiplied with the filter pixels. (not so good explained) but I don't see the value of this? and in the end it just search for pixel patterns that could be a cat?
'Its gonna take a while cause the rubber is tiny' xD
“Alright it’s working but it’s just going to take a while because this rubber’s tiny” XD
This sounds similar to Geoff H. ‘s capsule network implementation with dynamic routing and encoder error function.
Why is no one talking about the fact that he erased permanent marker
4:25 Or "how is the cat"
I’m lost.
Rolling in the deep feat. Dr Mike Pound
Don't write in yellow :)
That ghost cube in the background......
Would this be a way of doing the not a robot captchas? Or would you just do something a lot simpler
wow an erasable marker :O first time seeing it for me
which industry will be more relevant in the next ten years - AI or Blockchain ?
Why it's so difficult.
The computer has to test millions of neural connections to see which ones produce the correct answer. It's sort of like evolution, but much faster. It's only practical at all because of new computer architectures.
More specifically, the computer uses an algorithm, such as gradient descent. For this, it needs to calculate the partial derivatives with respect to each weight value, which is an extremely CPU/GPU intensive task.
IP UNIVERSITY ETCS-301 These methods have been theorised for decades but it was only a decade ago when nvidia started making SIMD (single instruction multiple data) co processors for simultaneous pixel rendering (intended for gaming) - gpus - that computer scientists realised they could use this these co processors for NNs
I think it's important to mention for True historical keeping. that Crypto Mining greatly poured money in to GPU development. the whole reason go is 10 years ahead of schedule because of the GPUs. think about it a gamer buys what 1 medium end gaming GPU that he can afford you maybe sell 20 of these a month. a miner back in the day comes in to your shop buys the 10 top of the line GPUs, he ask you to order 15 of the model you don't even carry because you it was too expensive and you would never sell it. he comes back complains that they are not powerful enough and take to much electricity while he's complaining he buys your store out again. so you ask what are you using these for? he says don't worry about it. you know that is a supplier for the NSA or a hacker taking down a bank best not to know. the guy taking the orders at nvidia is getting orders like this from around the world. with the new found money development of more then simple gaming needs performance GPUs. fast forward to now a AI programmer comes in orders a bunch of GPUs. you say you must be one of those crypto miners. the guy says phif those guys are driving up the price of my GPUs. you say well if you ar'nt using them for mining what are you using them for. he says. don't worry about it. history repeats. I wonder what unintended market advances AI will lead to. I think clearing up the noise in quantum design.
but why so difficult man?
what?
The amazing part of this video is that he has an erasable marker!
what is the network he is referring to at the end? Wanna do some extra research on it since it kinda solves a problem im working on.
Is this how the CAPTCHA works when you have to "select all the boxes in the image that display a [object]"
Captcha actually is mainly used to train these networks. Because almost all users will choose (roughly) the same correct boxes Google can just take these inputs and use them as valid training data. So basically Google uses it for two things at the same time.
The older text-based captcha also had another purpose: One of the two words to be typed in was a random word from a book that Google scanned for Google Books. That way they got internet users to convert all their book scans into digital texts.
Huge rant incoming.
That's why I dislike Captchas other than click here to prove you're human. Why should I do work for Google if the only thing I am trying to do is login with the correct email and password. And the sites that use these annoying Captchas are paid by Google, so none of the parties that does the actual work is being paid.
There are few things they could do to make their information farming a bit more moral. They could hire cheap workforce in thirdworld countries, but probably the simplest fix of all times, make it possible to opt-out of it, meaning let the user choose other means of verification that aren't that user unfriendly. I don't want site operators to decide what's my time and brain activity worth.
"They could hire cheap workforce..."
Lol, are you serious? You want Google to hire people just because you don't want to do 3-4 clicks more in order to use many websites for free? Laziness level over 9000.
Hiring people for work is strange concept? In that case, there is really no point in this conversation, take your baits where people might appreciate them.
Hey
He’s so cute
Does this work on svg or vector graphics , this has lots of opportunities
Could you get errors if you merge a dog and a cat
In the future you'll get catdog
1. Since the input space of convolutional NN is "raster-like", then the short answer is no, it would not work on vector images. The long answer depends on what do you want your neural network to accomplish.
2. Output of these kinds of NN is almost always just a probability distribution of what the network "thinks" is in the image, so in an ideal case it would be just 50/50.
thevoodooninja it could theoretically work on vector images if you get the images to look for points rather than individual points and join them together , the more fascinating thing would be polygons
Cliffhanger!
What is the difference between this and a neural network in a human body
the difference is we understand what the computer does ;)
Why does it seem like he's sitting in front of a green screen?
This dude doesn't work in the private sector, right? What do these kinds of people do?
He's a lecturer at the University of Nottingham. Most of the people on this channel are.
Sam Booth doubt!
Never in doubt. Always self-assured.
Sam Booth a quote by many 'smart' people
Oh that's pretty cool! He looks so young, it didn't even cross my mind that he does lectures.
British Jared Dunn?