So.. You basically divide the workload through multiple threads. It's like instead of one person counting stones in the ground, dividing them and get multiple people to count them. Am I right?
TrisT That's mostly how it works. It's more like sorting the stones by its color and pattern and counting each variety. Using the CPU way, you would need to count each variety separately. If you have 100 different colors and patterns, that would take a long time to count (even if you could count extremely accurate and fast, similar to how the CPU makes up for it's lack of parallelism). The GPU way lets many people count them. Given 100 people (like the GPU), each person would count each variety at the same time.
worldlinerai So, if I use cuda for say rendering, I could leave the heavy lifting for it while the processor could be doing something else, maybe even another render. Right?
Technically, Yes. However, CUDA isn't designed to give you an extra processor to use. It's just to give you the option of using a different type of processor to do your work. GPUs have lots of processing cores (100-1000+) which helps a lot with rendering. Each core can process 1 pixel allowing 100+ pixels to processed at once. CPUs have a small number of cores (2 - 18 in the Xeons) so only 2 - 18 pixels can be processed at once. The Hyper-Threading technology can double that number, but 36 is small compared to 100. What makes the CPU better than the GPU is that each core is clocked at a faster speed and has many built-in instructions like SSE, allowing data to be processed faster. This provides a tremendous benefit to programs that only run on 1 core. In rendering where multiple cores can be used, you would need the CPU to process pixels about 5+x faster to match the GPU's performance.
So is CUDA essentially a sort of API that allows a user to more efficiently communicate with NVIDIA cards? Or is it also an actual hardware modification, where CUDA could not be physically possible on previous cards?
@@abhishekrai48 CUDA also is in the form of an API (i.e. using NVIDIA's CUDA library in C) to abstract away parallel computation tasks to the GPU - but yes its both, the API is the software side but the GPU must be CUDA compatible (have CUDA cores) to take advantage of this.
Ref comments about CPU versus GPU (parallel) processing, I can recall reading an article in Scientific American that showed parallel processing will outrun CPU type processing hands down... (back in the 80's or 90's)...Laurie
I wanna record my desktop/games/etc I have these 3 video encoding stuff and i don't know much about them Intel quick sync video sounds pretty self explanatory making quick videos I don't know which one is faster for recording videos help? 1.intel quick sync video 2.nvidia cuda 3.nvidia NVENC Which one should i use?
wow we are in 2011 and nvidia decide to show us how and what cuda is by using PEN AND PAPER, i woudl have been more interrested by seeing visual demostration, especially with cuda at work compared to cpu and not just a stick figues and box shapes .
im just an avid enthuasts that has no need for actual programming. I just use it for daily tasks like typical hobbysts, like gaming, encoding, rendering, and converting files. How to I get use out of CUDA? more specifically, how do i turn it on and tell my computer to use CUDA instead of CPU?
CUDA is only usefull for CUDA optimized programs (since each run of a loop needs to be told to be split into a different thread). Some rendering softwares have the ability to render using CUDA instead of just the CPU... You wont be able to use CUDA instead of just your CPU all the time, unless you have an OS designed for it (although these kind of operating systems usually have only single uses, such as only computing weather simulations). Anyway, that's how i understand it... I could be wrong
thumbs up if you didn't have a clue what the hell he was talking about from 3:03 onwards, all that matters to me is that CUDA rocks for folding@home!!!
That was pretty easy to see what he was getting at.. CPU process steps down the the list of data GPU process takes the whole left one at one and moves across ...?? Back to the supermarket checkot idea... CPU means all the customers go through one chck out.. GPU means they spread out over several checkouts at once.. ??????? Regards Laurie
My cuda sample can't run maybe because the CUDA version is not compatible with my GPU type. Official documentation did not specify COMPUTE CAPABILITY of each GPU. When I search on GPU setting on my PC and even google it, I can't find this information too. Now I need to install all version of CUDA to test on. It takes time.
Ok, so is is this saying that AddFunction(a, b), with defined, tells Cuda to add the vectors at the same instant and to use all available cores with one i being processed in each core?
to my primitive level of understanding, CPU is deep but narrow, GPU is broad but shallow. What's better for future computing? broadening and increasing threads in CPU while maintaining its depth in individual threads, or deepening the computations in GPU like in CPU while maintaining massive parallel cores?
@youssef0eddoumali theres a major diffferewnce between say the gtx590 and the tesla's, the teslas are biult specifically for the scientific nature, so video editing and gamign certainyl would gain nothign from these cards. and its a reason why becuase of what the teslas can achieve for sceientic nature aswell as 3d biulding as to why they are very expensive. but most of us dont need those cards
Thanks...it was interesting to see an explanation of changing a from a CPU type of process to parallelism....from my amateaur point of view I liken parallel processing to the check out counters in a grocery shop, or big store check out...??....Laurie
Guys I have 2 GTX 590s and whenever I go into Nvidia Control Panel and turn SLi on, my screen goes black and stays black. Could you please thumbs this up so Nvidia can hopefully see this and help me out?
what hes doing on the board is the exact reason i didnt like school, and its simply becuase my dyslexia made my brain switch off from the info neede to be read, especially when after they have written all the garbble on the board they actually expect the people readign it to instantly know what the hell it all means
Incredible. This production - from NVIDIA no less - purports to answer the question "what is CUDA" but fails to even define the acronym. A perfect example illustrating why normal humans believe engineers are incapable of straightforward communication.
@youssef0eddoumali i love cuda itself, doesnt mean anythign this guys showed me or even tried to explain, allowed me to understand anythign he said in the video. which is a shame.
Gert VAN DER PAELT once whe're at the point where AI interprets our intent by reading our notes it could code much better software the us much faster based on our concepts.
@metoxys well you really can not compare other gpu makers to nvisdia , simply becuase you mentioned cuda, and the other gpus dont have cuda on them, which for many reasons renders the questiona dn comment useless. how ever the 590 is justfieid with its price sadly lol becuase of the 2 cards in one and the 1024 cores (of which hardly any software can actually use at this time)
Haha :D Now that would be a peculiar programming language! He was talking about Fortran, an old programming language used for high-performance computing.
@youssef0eddoumali well dyslexia and add aswell as adhd are the same in respects to the underdevloped brain, so i understand where you are coming from. im just shocked that its all this garbel, and not another version which is with visuals and showing like previusly cpu vs cuda etc. who ever thought of this video needs to understand that not everybody in life has it easy to understand stuff like this in this fashion
hence the Reason why I got a 9800GT for 64 cores. 16 Cores on the 8400GS was slooow. If you want some Tutorials google This: dr dobbs cuda There are many Articles right now and falls under HPC. Problems like the Traveling Sales man can be done quicker.
@nvidia lol seriously you give that response to the pen and paper, yet completely leave the comment about dyslexia and people not havent a grand ole time od watching this becuase of whats shown. i do wonder at times how intelligent intellgent poeple are, becuase it seems some blatantly obvious things in life some "intelligent2 people and i deffinately count nvidia as part of that, really are.
After this presentation he went to his local fight club, don't let the voice fool you this guy is Brutal
Link proof please
💀
You have violated the first rule. 😮
It only took me 12 years to get interested on this topic. Thanks to the hype on AI. Also, this guy is prob filthy rich at this point lol.
@Mathewmartialart thanks for the feedback. We'll definitely keep this in mind for future CUDA educational vids
cuda vids where?
this guy would be rich now
Bro is now a Millionaire!
Excellent example of vector addition of using for loop and using CUDA
An intro to Cuda video should start with "CUDA stands for ....." 😎
Compute Unified Device Architecture
@nvidia I personally think the way you did the demonstration was perfectly sufficient. IMO, fancy graphics are unnecessary. Good job.
@Prismarine Man 10 years later lol
Ohh, yes, Thank you, and the documentation at nvidia site about CUDA is highly professionally written. Thank you.
the people that say his voice doesnt match his body have never attended a technical university XD
I don't hear the problem with his voice
I actually don't mind the "PEN AND PAPER". I thought this was a nice basic intro and I'm hoping there is more.
Such a futuristic presentation. UUUUAUUUU
So.. You basically divide the workload through multiple threads. It's like instead of one person counting stones in the ground, dividing them and get multiple people to count them. Am I right?
TrisT That's mostly how it works. It's more like sorting the stones by its color and pattern and counting each variety. Using the CPU way, you would need to count each variety separately. If you have 100 different colors and patterns, that would take a long time to count (even if you could count extremely accurate and fast, similar to how the CPU makes up for it's lack of parallelism). The GPU way lets many people count them. Given 100 people (like the GPU), each person would count each variety at the same time.
worldlinerai So, if I use cuda for say rendering, I could leave the heavy lifting for it while the processor could be doing something else, maybe even another render. Right?
Technically, Yes. However, CUDA isn't designed to give you an extra processor to use. It's just to give you the option of using a different type of processor to do your work. GPUs have lots of processing cores (100-1000+) which helps a lot with rendering. Each core can process 1 pixel allowing 100+ pixels to processed at once. CPUs have a small number of cores (2 - 18 in the Xeons) so only 2 - 18 pixels can be processed at once. The Hyper-Threading technology can double that number, but 36 is small compared to 100.
What makes the CPU better than the GPU is that each core is clocked at a faster speed and has many built-in instructions like SSE, allowing data to be processed faster. This provides a tremendous benefit to programs that only run on 1 core. In rendering where multiple cores can be used, you would need the CPU to process pixels about 5+x faster to match the GPU's performance.
worldlinerai Well just built a new rig with a 980ti and a 4790k so I'm gonna put that to test. Thank you for your wonderful explanation :D
This reminds me a lot of the computer tutorial tapes from the 90s
Hey, thanks for explanation! Very well done 👍 I am downloading CUDA 💪
thank for simple explaination
I'd like to see a demo that combines CUDA with Ada Programming.
So is CUDA essentially a sort of API that allows a user to more efficiently communicate with NVIDIA cards? Or is it also an actual hardware modification, where CUDA could not be physically possible on previous cards?
It's modified hardware indeed. Not all modern GPUs support CUDA . In fact from what I know these come exclusively with NVIDIA hardwares.
@@abhishekrai48 CUDA also is in the form of an API (i.e. using NVIDIA's CUDA library in C) to abstract away parallel computation tasks to the GPU - but yes its both, the API is the software side but the GPU must be CUDA compatible (have CUDA cores) to take advantage of this.
Ref comments about CPU versus GPU (parallel) processing, I can recall reading an article in Scientific American that showed parallel processing will outrun CPU type processing hands down... (back in the 80's or 90's)...Laurie
I wanna record my desktop/games/etc
I have these 3 video encoding stuff and i don't know much about them Intel quick sync video sounds pretty self explanatory making quick videos
I don't know which one is faster for recording videos help?
1.intel quick sync video
2.nvidia cuda
3.nvidia NVENC
Which one should i use?
@XiAlleniXHi we don't have tech support on this video, could you please report this within the nvidia forums? forums.nvidia.com
wow we are in 2011 and nvidia decide to show us how and what cuda is by using PEN AND PAPER, i woudl have been more interrested by seeing visual demostration, especially with cuda at work compared to cpu and not just a stick figues and box shapes .
Hyper V + Remote FX + Cuda Server = the perfection, u .u
i want to ask about, is CUDA surely do a parallel? or can do a serial like CPU's work?
Linus: "Nvidia, Love you!"
Would you reserve a set number of Cuda cores, so the rest continue with normal graphic tasks?
im just an avid enthuasts that has no need for actual programming. I just use it for daily tasks like typical hobbysts, like gaming, encoding, rendering, and converting files. How to I get use out of CUDA? more specifically, how do i turn it on and tell my computer to use CUDA instead of CPU?
CUDA is only usefull for CUDA optimized programs (since each run of a loop needs to be told to be split into a different thread). Some rendering softwares have the ability to render using CUDA instead of just the CPU... You wont be able to use CUDA instead of just your CPU all the time, unless you have an OS designed for it (although these kind of operating systems usually have only single uses, such as only computing weather simulations).
Anyway, that's how i understand it... I could be wrong
it was clear to the point, good.
thumbs up if you didn't have a clue what the hell he was talking about from 3:03 onwards, all that matters to me is that CUDA rocks for folding@home!!!
That was pretty easy to see what he was getting at..
CPU process steps down the the list of data
GPU process takes the whole left one at one and moves across ...??
Back to the supermarket checkot idea...
CPU means all the customers go through one chck out..
GPU means they spread out over several checkouts at once..
???????
Regards
Laurie
the voice is unsettling but still a good explanation
My cuda sample can't run maybe because the CUDA version is not compatible with my GPU type. Official documentation did not specify COMPUTE CAPABILITY of each GPU. When I search on GPU setting on my PC and even google it, I can't find this information too. Now I need to install all version of CUDA to test on. It takes time.
Does CUDA help when it comes to Illustrator or rendering videos with Premiere Pro ? Can't decide to go with green team or red team
The man has glasses. somethin must know...
Ok, so is is this saying that AddFunction(a, b), with defined, tells Cuda to add the vectors at the same instant and to use all available cores with one i being processed in each core?
Interesting that they have not mentioned Neural Nets :)
@XiAlleniXHi do you have sli connector?
to my primitive level of understanding, CPU is deep but narrow, GPU is broad but shallow. What's better for future computing? broadening and increasing threads in CPU while maintaining its depth in individual threads, or deepening the computations in GPU like in CPU while maintaining massive parallel cores?
When will Nvidia release web drivers for MacOS Mojave?
@youssef0eddoumali theres a major diffferewnce between say the gtx590 and the tesla's, the teslas are biult specifically for the scientific nature, so video editing and gamign certainyl would gain nothign from these cards. and its a reason why becuase of what the teslas can achieve for sceientic nature aswell as 3d biulding as to why they are very expensive. but most of us dont need those cards
Thanks...it was interesting to see an explanation of changing a from a CPU type of process to parallelism....from my amateaur point of view I liken parallel processing to the check out counters in a grocery shop, or big store check out...??....Laurie
Guys I have 2 GTX 590s and whenever I go into Nvidia Control Panel and turn SLi on, my screen goes black and stays black. Could you please thumbs this up so Nvidia can hopefully see this and help me out?
He is an engineer, forget about his face. His voice is quite good.
great explanation, thanks
@TheTheFons i believe you will find that games will benefit more from a much faster cpu than cuda cores.
Cuda is samed as max shared memory?
@XiAlleniXHi why 2 x gtx590's?
what hes doing on the board is the exact reason i didnt like school, and its simply becuase my dyslexia made my brain switch off from the info neede to be read, especially when after they have written all the garbble on the board they actually expect the people readign it to instantly know what the hell it all means
I don't get programming. I'm a simple budget gamer, i just wanna know if cuda can run games and if it's at least on par with gt740m
lol
CUDA! When I was 13, I had my first love
huh?
I love Nvidia :)
12 years ago still at the core of it
How can I learn this
Incredible. This production - from NVIDIA no less - purports to answer the question "what is CUDA" but fails to even define the acronym. A perfect example illustrating why normal humans believe engineers are incapable of straightforward communication.
Why do you need to define the acronym? It's irrelevant to anyone implementing the library.
will the gtx 1080 upscale 1080p monitors to 1440p like what amd does with vsr?.....i'm with amd and saving to buy the 1080 but i like using vsr.
No it just squeezes the image
The math part confused me, he should of broken it down more as to what each part exactly is.
low budget video demostracion
So, lots of cores make it go faster?
Not faster. Just many tasks at the same time
@youssef0eddoumali i love cuda itself, doesnt mean anythign this guys showed me or even tried to explain, allowed me to understand anythign he said in the video. which is a shame.
yeah.. what he said!
I have a nvidia geforce g210. Yes this is not enough. I don't blame nVidia, I blame the guy at the supermarket who made me buy this graphics card.
I just wanna play Crysis 2 ...
Computer science is best done with pen and paper. It frees you of the hassle of actually having to program a computer. (I'm not being sarcastic.)
Gert VAN DER PAELT once whe're at the point where AI interprets our intent by reading our notes it could code much better software the us much faster based on our concepts.
@@copypaste3526 in 80-100 years if humanity is not extinct by that time
@metoxys well you really can not compare other gpu makers to nvisdia , simply becuase you mentioned cuda, and the other gpus dont have cuda on them, which for many reasons renders the questiona dn comment useless. how ever the 590 is justfieid with its price sadly lol becuase of the 2 cards in one and the 1024 cores (of which hardly any software can actually use at this time)
MY GPU GT 610 CAUSES MY COMPUTER MAKE A NOISE AND MONITOR SHOWS NO SOURCE SIGNAL
lmao
I have a GTX1080. Can i also have an nvidia shirt?
don't know what any of it means 😎👍
2:37 "4chan and so on"?
Haha :D Now that would be a peculiar programming language!
He was talking about Fortran, an old programming language used for high-performance computing.
@youssef0eddoumali well dyslexia and add aswell as adhd are the same in respects to the underdevloped brain, so i understand where you are coming from. im just shocked that its all this garbel, and not another version which is with visuals and showing like previusly cpu vs cuda etc. who ever thought of this video needs to understand that not everybody in life has it easy to understand stuff like this in this fashion
@youssef0eddoumali troll troll who said you need Tesla for CUDA ?
Oh, and can I please get a shirt just like the one that Cliff Woolley has??
or maybe 2 ..... XXL BTW xD
CUDA WUDA SHUDA bought their shares.....Never too late
hence the Reason why I got a 9800GT for 64 cores.
16 Cores on the 8400GS was slooow.
If you want some Tutorials google This:
dr dobbs cuda
There are many Articles right now and falls under HPC.
Problems like the Traveling Sales man can be done quicker.
Sounds like supercomputing on a card.
The video starts bere 4:57
first view and comment.. now wheres my gtx 590 ^^
i really like Nvidia and Cuda they used to be voodoo
Radeon HD :)
You need a better power supply.
i didn't understand any shit but Nvidia rocks :D
@XiAlleniXHi Man, don't be silly, get these Cards back to your dealer and let repair them...!
@johnolazabal Whats that :D
@XiAlleniXHi join nvidia forum.
@nvidia lol seriously you give that response to the pen and paper, yet completely leave the comment about dyslexia and people not havent a grand ole time od watching this becuase of whats shown. i do wonder at times how intelligent intellgent poeple are, becuase it seems some blatantly obvious things in life some "intelligent2 people and i deffinately count nvidia as part of that, really are.
I am 12 and what is this?
you are 24 now and i guess you are into computers now?
@@AndresLeonRangel yes
lol
How come all the school bullies watch programming videos
what the hell did he try to tell us
Just show us the FU@^ing demo !
2:37 4chan lol
@XiAlleniXHi Someones rich :]
Multi billion dollar company
Can't afford phototherapy light
lol
Release mike.boxer under code UN pass 53942 code key rio fbo
#20140709 #11pm
I still have no idea what CUDA is.
The longest ~5 minutes video I've ever watched. Boring, yet informative.