Data Analysis 0: Introduction to Data Analysis - Computerphile

Поделиться
HTML-код
  • Опубликовано: 11 янв 2025

Комментарии • 185

  • @Computerphile
    @Computerphile  5 лет назад +45

    Check out the full Data Analysis Learning Playlist: ruclips.net/p/PLzH6n4zXuckpfMu_4Ff8E7Z1behQks5ba

  • @TheChondriac
    @TheChondriac 5 лет назад +202

    Mike is definitely my favorite from Computerphile. As a college computer science student, these videos are amazing for me. I definitely think that this channel should host a niche playlist of more involved programming videos for those of us that are aspiring programmers! Thanks for all of this great content.

    • @kuhluhOG
      @kuhluhOG 5 лет назад +3

      He is my second favourite. (My favourite is Professor Brailsford )

    • @benanderson3701
      @benanderson3701 5 лет назад +2

      Big up mike, he's my favourite

    • @megumi_0
      @megumi_0 4 года назад

      agree

  • @TheFoosie
    @TheFoosie 5 лет назад +247

    10 part series with mike pound yes plz

    • @JesusisAlive_33
      @JesusisAlive_33 5 лет назад +19

      i love this guy, the way he explains things so clearly and his voice

    • @leonhardeuler9839
      @leonhardeuler9839 5 лет назад +1

      With open source datasets

    • @chethelesser
      @chethelesser 5 лет назад +2

      >computerphile
      >Starting counting from 1
      Yeah right

    • @theinnominatoidk3821
      @theinnominatoidk3821 3 года назад +1

      @@JesusisAlive_33 his accent is cool too

  • @RubiconDota
    @RubiconDota 5 лет назад +31

    I love it when someone who is actually a Dr explains complex topics to me in an accent I can understand.

  • @israelcyabukombe2267
    @israelcyabukombe2267 5 лет назад +11

    When RUclips recommends you a useful data analysis video, to help you understand, how you always get recommended the other stuff.

  • @spockfan2000
    @spockfan2000 5 лет назад +35

    Numberphile, NetFlix style: whole season marathon! :) Love it!
    (hehe... I meant Computerphile!)

  • @rialyandriamiseza9814
    @rialyandriamiseza9814 5 лет назад +1

    Beginning my thesis on Learning Analytics. "LA is the measurement, collection, analysis, and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs" - Siemens, G., & Gašević, D. (2012). Special issue on learning and knowledge analytics. Educational Technology & Society, 15(3), 1-163. Your videos are very helpfiul :) Thanks a lot

  • @xnossisx5950
    @xnossisx5950 5 лет назад +3

    yay two series in one day extending over 2 1/2 hours each
    how wonderful

  • @tamnguyentri6405
    @tamnguyentri6405 5 лет назад +1

    Love for counting the episodes from 0. It helps me a lot with the terms as well. Thank you.

  • @Plan36c
    @Plan36c 5 лет назад +1

    You have a talent for teaching and technology. I’m currently interviewing for my first analysis position so this is very reassuring information. Thank you for sharing.

  • @ninja_goose4360
    @ninja_goose4360 5 лет назад +5

    The instance I hear 'data mining' in is usually finding data where it is not easily accessible. For example, you can data mine the console log of a video game to figure out how the game works and whatnot.

  • @brantwedel
    @brantwedel 5 лет назад +110

    Using R for the explanations, but using a 0 based index for the series titles ... That's not going to be confusing at all 😆

    • @caughtbynothing
      @caughtbynothing 5 лет назад +4

      Nope, not confusing at all. 0 ist the first index of EVERY enumeration, makes sense for all of us ;)

    • @RIURIU4
      @RIURIU4 5 лет назад +20

      @@caughtbynothing R is not zero indexed

    • @andre9897
      @andre9897 5 лет назад +1

      @@caughtbynothing really?

    • @MaximilianBerkmann
      @MaximilianBerkmann 5 лет назад +2

      @@RIURIU4 Literally every computer language aside from R, Matlab and Fortran are zero-indexed.

    • @BrunoCarlin
      @BrunoCarlin 5 лет назад +1

      @@MaximilianBerkmann Lua

  • @adityamankar8723
    @adityamankar8723 5 лет назад +3

    Thank you so much for this amazing playlist. As a CS student, this was very helpful.

  • @crystalsoulslayer
    @crystalsoulslayer Год назад

    I absolutely love the product descriptions for the saws.

  • @wandersgion4989
    @wandersgion4989 5 лет назад +6

    Is computerphile transitioning into being a tutorial channel? I like it.

  • @RamkrishanYT
    @RamkrishanYT 5 лет назад +79

    When you realize that it's a 10 part series, but it uses R
    *A small price to pay for salvation*
    When you see that R indexes from 1
    *Reality is often disappointing*

    • @sherwinparvizian2414
      @sherwinparvizian2414 5 лет назад

      @@krakensoup7439 Mostly convention. A lot of languages use 0-based indexing.

    • @caughtbynothing
      @caughtbynothing 5 лет назад +4

      ​@@sherwinparvizian2414 Have never worked with a programming language that does not start the enumeration at 0. Once more you see that R was developed by statisticians

    • @VandalIO
      @VandalIO 5 лет назад

      @Matthias Julia also indexes from 1 , there are other languages out there which index from 1 too , R is built up on FORTRAN and FORTRAN also indexes arrays from 1

  • @matzeh3498
    @matzeh3498 5 лет назад +302

    ARE YOU SERIOUS, I CANNOT WATCH THIS AND TOM SCOTT AT THE SAME TIME

  • @mohammaddawas481
    @mohammaddawas481 5 лет назад +1

    This is the series I always waited from Mike Pound! Thank you!
    But I have a note, at 13:16, high dimensional data (samples with large number of variables) is not necesserily a big data, it's just a very high dimensional data.

  • @PasselivreEdicoes
    @PasselivreEdicoes 5 лет назад +7

    Was looking forward for this playlist :`). Thanks Mike and Computerphile.

  • @raadwan
    @raadwan 5 лет назад +98

    Feel bad for all the people that skipped this video and went to Part 1. lol

    • @nonaviandino8387
      @nonaviandino8387 5 лет назад +11

      R index starts at 1 lol

    • @Wolves2314
      @Wolves2314 5 лет назад +2

      Just Being Socially Awkward no it's not

    • @Wolves2314
      @Wolves2314 5 лет назад +5

      @Just Being Socially Awkward you don’t know what you’re talking about and you should feel bad

    • @Elite7555
      @Elite7555 5 лет назад +1

      @@Wolves2314 But R can suffer from really bad performance; often it is even much worse than CPython. So in that sense I would just use Python or C++. There are some great libraries out there for statistical analysis. Or use Julia which serves the same purpose as R but is much faster and also has awsome tools for plotting.

    • @MaximilianBerkmann
      @MaximilianBerkmann 5 лет назад +1

      @@nonaviandino8387 True and it shouldn't be the case. But aye, it was designed for statisticians who don't count from 0.

  • @kalebjuliu7944
    @kalebjuliu7944 5 лет назад +1

    You have no idea how much i need this, Thanks!

  • @skydrow4523
    @skydrow4523 5 лет назад +8

    I see Dr. Mike, I click.

  • @znull3356
    @znull3356 4 года назад

    Doing this in R instead of Python probably won't age well, but I'll still watch it because of Dr. Pound.

  • @Jupiter__001_
    @Jupiter__001_ 5 лет назад +1

    Lol the text on the DIY website is really funny! The chainsaw even had The Lumberjack Song xD

  • @faustin289
    @faustin289 5 лет назад +1

    An intelligent model is the one that would predict what I NEED; not what is similar to what I looked at in the past.

    • @chloem.872
      @chloem.872 4 года назад

      Are you ready for that? Tell me, truly, are you ready for an algorithm to predict what you need? Imagine the data they need in order to do that. Smart houses coming to a neighborhood near you...

  • @teekanne15
    @teekanne15 5 лет назад +1

    just had a course "introduction into data analysis in R" at uni a few weeks ago. This is a nice revisit :D

    • @rag3r926
      @rag3r926 5 лет назад

      Birkbeck, UOL?

  • @garmands
    @garmands 5 лет назад +9

    And then another series with Robert Miles

  • @zohebdholakia3782
    @zohebdholakia3782 5 лет назад +1

    Beautifully explained

  • @sepgorut2492
    @sepgorut2492 5 лет назад +4

    This tutorial might not be in Python but Python appears at 11:23 with the lumberjack song. Anyone else notice this?

    • @matthewrussell5448
      @matthewrussell5448 3 года назад

      I'm a lumberjack and I'm OK, I sleep all night and I work all day...

  • @chandrahasaroori317
    @chandrahasaroori317 5 лет назад +3

    Can you guys do a machine learning series as well? This is really amazing!

  • @KUBKO17
    @KUBKO17 4 года назад

    Dr Mike is Bear Grills of the IT 👍

  • @andrarias
    @andrarias 5 лет назад +1

    I always thought that Data Mining was acquiring raw data from 3rd parties, like Twitter, Facebook and the like, using their API. For example I once knew of someone trying to predict earthquakes in Japan with Twitter (I don't know how successful this attempt was), but I makes sense to me that this is what Data Mining is -in opposition to working with data you or your company collect, or the cleaner data that other organizations publish.

  • @iraklismoutidis204
    @iraklismoutidis204 5 лет назад +1

    Amazing series.

  • @EliteGamerpk
    @EliteGamerpk 5 лет назад

    Man I Can't miss any of these videos, ringing those bells :D

  • @hiqwertyhi
    @hiqwertyhi 5 лет назад +1

    A+ product descriptions for those saws

  • @dudeguy8864
    @dudeguy8864 5 лет назад +6

    god bless mike pound 🙏🏾

  • @DominicGo
    @DominicGo 4 года назад

    love this guy (i could listen to his voice all day 🤣)

  • @TheSam1902
    @TheSam1902 5 лет назад

    13:00 I wouldn't agree with your definition of data mining. In a company setting, it's hard to get your hands on a lot of data to start preprocessing, analysing etc, that's when data mining is required: you ask around each department what data they have lying around on hard drives, collect that or spam an API to get more data. So that's prior to preprocessing (because you need the raw material first).

    • @BiancaAguglia
      @BiancaAguglia 4 года назад

      I think most of us make that mistake when we first hear the term "data mining". 😁Once we learn what data mining actually is, then the term makes sense: we "mine" the data we already have to discover valuable information in it.
      The process of getting data from other departments or other sources is called, prosaically enough, data gathering or data collection. 😊

  • @zerokelvin3626
    @zerokelvin3626 5 лет назад

    I will binge watch this

  • @heksqer1022
    @heksqer1022 5 лет назад +1

    To think this and Tom's playlist come out at the same time :D

  • @gooadam
    @gooadam 5 лет назад

    We were using "data mining" in place of scraping in the early 2000's. That's likely where that got fuzzed into analyzing and finding use for data.

  • @AndreAmorim-AA
    @AndreAmorim-AA 5 лет назад +2

    Data Analysis is important but... Is it possible to have some talk about the boundaries of data analysis regards to personal privacy?

    • @Youtuber111-p2x
      @Youtuber111-p2x 5 лет назад

      your personal privacy is protected. the names and IPs would be data that would not be used, just the purchases.

    • @ricma9710
      @ricma9710 5 лет назад

      @@RUclipsr111-p2x yes but they still get to know all about you while you don't know nothing about people that analyse you, your privacy might be protected from other civilians but not from companies that crunch your data

  • @alexgarratt5693
    @alexgarratt5693 5 лет назад

    10 part series with Dr Mike, sign me up

  • @JemMawson
    @JemMawson 5 лет назад +2

    I always knew "Data Mining" to be about sourcing data (e.g. web scraping), not pre-processing your existing data.

    • @StvnTheFuzzy
      @StvnTheFuzzy 5 лет назад +1

      I suppose data sourcing would imply categorizing the actual data you're scraping, right? So in a sense you're pre-processing the data that has yet to be sourced, which of course in turn you're able to (pre-)process further for analysis. Come to think of it, using 'mining' as a definition for it would imply you're digging for gold in land that you might or might not own, hence the ambiguity and why Mike describes it as a buzz word.

  • @beautyofsylence
    @beautyofsylence 5 лет назад +7

    >starts series at episode zero
    >uses program for series which starts arrays at 1

  • @tallwaters9708
    @tallwaters9708 5 лет назад

    Jasus... this is a great idea for a series, but even an introduction is going to take a year of videos lol. Good luck.

  • @NF-ru8on
    @NF-ru8on 5 лет назад +4

    11:20 "...and then you end up having 10 saws...don't know how to use any of the saws, but you know, the retailer's job is done..."
    lol I'm excited about learning how to analyse data using tools like R; but capitalism sure is depressing.

  • @subschallenge-nh4xp
    @subschallenge-nh4xp 5 лет назад +7

    Peter Parker:like
    Datacamp comment

  • @exm3266
    @exm3266 5 лет назад +3

    If the first part of the actual series is episode [0], then what number do we give the introduction without some people interpreting it as the last episode in the list?

  • @palmpixiplus
    @palmpixiplus 5 лет назад

    ❤️ loved this!!!

  • @bruinflight
    @bruinflight 5 лет назад

    BRILLIANT. THANK YOU!!!

  • @4.0.4
    @4.0.4 5 лет назад +21

    Buzzword soup: "data mining big data with AI-based cloud computing"

  • @Jamie-st6of
    @Jamie-st6of 5 лет назад

    these videos should REALLY have subtitles

  • @marcinszubryt2088
    @marcinszubryt2088 5 лет назад

    There will be subtitles for this series? On what it depends if YT will generated it. Automatically generated are fine.

  • @samuelposejpal2983
    @samuelposejpal2983 5 лет назад

    What program did you use to create Browserisor(fake browser)? Thanks

  • @rodrigolara6733
    @rodrigolara6733 3 года назад

    How can I get him to teach me more about computers? Is there a place we can go so that he can specifically teach us or pay for his classes?

  • @pureatheistic
    @pureatheistic 2 года назад +1

    I would let Dr. Mike POUND, take me to POUND town any day.

  • @nashaut7635
    @nashaut7635 5 лет назад +1

    I thought it was just me until I checked another audio source: sound seems to be «deaf», i.e. lacking a fair amount of treble. I seem to encounter this with more and more youtube videos/channels although I haven't done exhaustive nor detailed analysis, just an observation. Anyway it feels a bit uncomfortable to listen to. Is it also perceived that way by anyone else?

    • @wiez543
      @wiez543 4 года назад

      Maybe get your ears checked?

    • @nashaut7635
      @nashaut7635 4 года назад

      @@wiez543 Sorry, can't hear you.

    • @wiez543
      @wiez543 4 года назад

      @@nashaut7635 🙉

  • @vhz04
    @vhz04 5 лет назад

    Great content. Is there a repository where we can get the data files?

  • @juliavanderkris5156
    @juliavanderkris5156 5 лет назад +2

    Eyyyy Mike uses a thinkpad! My man!

  • @leonhardeuler9839
    @leonhardeuler9839 5 лет назад

    Mike, what are you going to do with that saw?

  • @CasualProfundity
    @CasualProfundity 5 лет назад

    Forgive my noob question but how does it know the dimensions of the matrix without a header file?

    • @chloem.872
      @chloem.872 4 года назад

      This is my best answer, someone more knowledgable please feel free to correct me if I'm wrong.
      read.csv() automatically returns a data frame, which is very similar to a matrix, but has additional properties and operations that can be performed on it. If you pass a data frame with higher dimensions, then the function will automatically treat each element in it as 2D unless told otherwise.
      Judging by how difficult it is to figure out just how to assign higher dimensions to data frames, I'm going to guess that most csv files are 2D and that this isn't a common problem.
      I'm not sure what you mean by header file, unless you're coming from C++ where header files are a sort of prototype for classes you'd like to implement. C++ is a compiled language, and these header files are preprocessed by the compiler (all lines are gotten from the files) and IIRC, they are not included in the compiled object files. The compiler refers to these files for class and function definitions, so it can know how the class or function is supposed to be structured. It's considered a 'strongly typed' language, where arguments given to a function or class are checked for validity and rejected if invalid according to the definition.
      R is in contrast to this, because it's an interpreted language and is much more relaxed about type checking. In such languages, types are automatically assumed unless told otherwise. For example, you may need to frequently convert between "factor" and "character" data types in R, because characters are often assumed to be factors (at least, in RStudio they are). Beyond this, you can leave arguments out or explicitly state which argument you're passing to it by name, making the number and order of arguments irrelevant, eliminating the purpose of a header entirely.
      I hope this helped answer your question! :)

  • @marin.aldimirov
    @marin.aldimirov 5 лет назад

    4:38 - vectrices?!

  • @daanielacosta2395
    @daanielacosta2395 5 лет назад

    Why all the professors or scientists in the videos of CF use the same kind of sheet? Are you recycling or something?

  • @ruairihair
    @ruairihair 5 лет назад

    No mention of sas?

  • @Afdac247
    @Afdac247 5 лет назад

    i think 'you may also like' works horribly because its data related to the number of people who bought the item not on data about what they see as missing in their lives. its not peer pressure to have a webpage say 'people also bought" but companies should pay each other to advertise based on tht missing concept

  • @AnythingGoesCodes
    @AnythingGoesCodes Год назад

    In this series, we will explain how to get people to buy things they'll never use for profit.

  • @balping
    @balping 5 лет назад

    What about FORTRAN?

  • @jaffreyjoy
    @jaffreyjoy 5 лет назад

    What does this guy not know about 🙌

  • @chickenshieee
    @chickenshieee 5 лет назад

    Great teacher

  • @wiez543
    @wiez543 4 года назад

    Somehow I feel like RUclips wants me to become a data scientist.

  • @daft_punker
    @daft_punker 5 лет назад

    I'm Mike, and you've just been Pounded

    • @kkslidersnan
      @kkslidersnan 3 года назад

      Why doesn't this comment have more likes?!

  • @postmodernist1848
    @postmodernist1848 3 года назад +1

    Of course you start counting from 0

  • @nimagameroil1099
    @nimagameroil1099 3 года назад +1

    Challenge: take a shot Everytime he says Data

  • @samirz7
    @samirz7 4 года назад

    "We as a species produce a lot of data."

  • @Smile8924
    @Smile8924 5 лет назад

    ML|AI == Rectangle|Squares

  • @M1cr0p47
    @M1cr0p47 5 лет назад +1

    I usually say data mining when I can't think of the word parsing.

  • @satoshinakamoto171
    @satoshinakamoto171 5 лет назад

    please make more on AI and ML and data science

  • @bahtiyarozdere9303
    @bahtiyarozdere9303 2 года назад

    This is beautifull 🤩

  • @Littellittel1
    @Littellittel1 5 лет назад +2

    The Egss with ai on it are secretly brilliant in germany.
    In german 'e'i means egg and it is pronunced just like 'I'

  • @andrestone
    @andrestone 5 лет назад +4

    "Big data", "Machine Learning", "Data mining", "AI": Good old computer science and statistics rebranded so Silicon Valley can market old tech as new tech. And investors are buying like Apple fans.

  • @o0December0o
    @o0December0o 5 лет назад +1

    Thumbs up for using R!

  • @Dusk-MTG
    @Dusk-MTG 4 года назад +1

    How big is big? I don't know.

  • @AshishAgrawal-br1ji
    @AshishAgrawal-br1ji 5 лет назад

    Which IDE is that?

    • @Iknash
      @Iknash 5 лет назад

      RStudio

  • @charlieangkor8649
    @charlieangkor8649 3 года назад

    "sponsorship from by Google" - was this piece of English generated by Google's AI?

  • @wiez543
    @wiez543 4 года назад

    R right?

  • @mileswilliams527
    @mileswilliams527 5 лет назад

    Who gave this a dislike?
    Why?

  • @silentinferno2382
    @silentinferno2382 5 лет назад +2

    Google: let's sponsor computerphile and Tom Scott to make long playlists that you have to watch, and make people spend more hours on RUclips than 24/day.

  • @wouldntyaliktono
    @wouldntyaliktono 5 лет назад +4

    Lol, an example in R indexed at zero

  • @dijoxavier
    @dijoxavier 5 лет назад

    Excellent, I am python guy, should I learn R ? Is it a good investment of time to learn R ?

    • @LordOfTheBing
      @LordOfTheBing 5 лет назад +2

      No. With python, you get everything R can do with pandas, matplotlib, and numpy, but faster, and with ML with tensorflow/keras. And it's an actual programming language, you can do some actual process with your data then.

  • @Slarti
    @Slarti 5 лет назад

    I did a Python AI course and realised half way through that what I was being taught was statistical modelling.
    AI? Pffffft!

  • @DarshanSenTheComposer
    @DarshanSenTheComposer 5 лет назад +1

    Spider-boy has grown up!

  • @FAKETV96
    @FAKETV96 5 лет назад

    Visualization*

  • @Ankit-vc3gx
    @Ankit-vc3gx 5 лет назад +1

    Expecting in python ....

  • @perschistence2651
    @perschistence2651 5 лет назад +1

    What is data? Am I data?

  • @maximussnow
    @maximussnow 5 лет назад

    I have no idea why people would dislike it ?

  • @JonnyRobbie
    @JonnyRobbie 5 лет назад +2

    Ok, R does not equal rstudio. rstudio is one of many IDEs for R and you don't have to use it. I kinda got triggered by the list at the beginning.

  • @JesusisAlive_33
    @JesusisAlive_33 5 лет назад

    i like the 3d effect

  • @Catastropheshe
    @Catastropheshe 3 года назад

    0:47 you mean pics from vacations? 😁

  • @grainfrizz
    @grainfrizz 5 лет назад

    Here's a tip: Learn Splunk, get certified, get some experience and earn freaking boat load of cash. Trust me ;)