What’s the most advanced math you’ve used with data? Also, thank again to Coursera for sponsoring this video and Thu Vu for helping me out with this video! 🙌🏼
When you pointed the outliers it reminded me that I once worked on a product that used IQR to detect outliers for fraud and actually worked really well despite not being fancy data science-y magic. Thanks for the great vid!
I think people in our beautiful data field tend to forget that it's not about the most-complex and detailed algorithm, it's about the most functional one. On another note: IQR, you son of a gun that's exactly what I needed for my project - thanks for the reminder. Ha!
Great video Luke. I just want to say that your channel has helped through grad school. Everytime I was so stressed about school projects, your videos made me laugh and gave me motivation to keep working towards my degree. Just graduated this spring and will start my first job soon in the data analyst field. Thanks for reading this comment.
Thanks Luke and Thu Vu. Wish you guys all the best. I used to be a Marketer, and since last year I've moved further to a new job as a Data analyst. I've been working on almost 15 projects. You know, at my very first project I was so nervous because the team they are nerds for real. Sometimes in the meeting, I feel like they speak another language 🤣. But the interesting point is that when you are on-job-learning, especially something related to math, you can learn then apply and practice them in real cases. The more you apply to your job the more it grows on you. I approve those math tools works really well in most case.
@@LukeBarousse Hey, got a question for you. How do you balance your work with side hustles and studying? I'm trying to make changes to my weekly habit and would love hear back from a busy individual on their weekly schedule looks like. Thank you
Great video, Luke! I had never been able to visualize data analytics as learnable until I saw this video, it has really put me at ease to pursue data analytics. Thank you
Thank you very much ! I'm not that good at mathematics, but I want to learn more and become better. I will practice and practice, and I hope to have good results
yo Luke, just wanted to say thanks again lol! i got my 3rd internship in business intelligence / data analytics and it all started last year. i just remember watching your videos in the car on lunch breaks, and it really helped me get serious and guide me to where i am now. appreciate you!
Another sweet video my dude. One thought: on the distribution plot, it marks 50% at the peak of the curve. While this is true on a normal distribution (where mean=median=mode), your specific distribution was skewed to the right. So the 50th percentile would have been to the right of the mode (peak of curve). Unless I'm wrong, then you should thoroughly pwn me lol
Nope I think you are completely right. I had to make that animation in my video software. So it was done by hand (and not to scale). Thanks for pointing this out! 🙌🏼🙌🏼
The most advanced math I've used with data is the Naive Bayes Algorithm, or maybe statistical significance testing. Gathering the data is usually more involved than the analysis.
I loved ur equation: "DataAnalytics - Fun = Mathematics" As I have a "Pure" Math degree and i want to be DA, so the only thing that i need to learn is the FUN part ❤️❤️
There is a lot of integral calculus hidden within statistical distributions. The area under a normal distribution (the integral of that curve) is equal to 1 and a z-score of 1.96 (Z = 1.96) corresponds to the alternative hypothesis being in the first 0.95 of the integral, where 1.96 in the upper limit of integration on the interval of x under the curve. Z=1.68 is the upper limit of integration for 0.9 of the integral, etc. I get that this is formal calculus and probably isn't used by too many data analysts but I find that learning integral calculus first really helps people have a better intuition and understanding of statistical distributions. (Edit: formatting)
Very interesting! I agree that the most important part is Statistics and Probability rather than "raw Mathematics" Moreover you can apply the Pareto rule and probably with the 20% of the mathematical knowledge you need you can obtain the 80% of the results. Carlos.-
Can you do a video of the steps you take to learn about a database and tables when you encounter a new one that you have to work with for the very first time? What's the quickest way to get productive when dealing with a new database and understanding the relationships, etc...?
Great video Luke ! Big thanks to Thu ( subscribed ) for joining and I cracked at the mean joke lol ( especially the awkward explanation after .. I like awkwardness I think it's funny )
Knowing the various data distributions is essential to the job as arithmetic if you're looking to be more than be a chart farmer. It's important for troubleshooting your dataset and provide that analysis that stakeholders really want. Cuz your bosses don't want just a chart. They want the answer to the question the chart supports. The story (or context for decisions) requires a firm understanding of data sampling, biases, and distributions and how that relates to the business. This part of stats is IMHO so much more vital than knowing probabilities. Like if youre a new hire, prepare to be shocked the number of times bosses make decisions around an "average" from a data set when the distribution isn't gaussian (e.g. ARPU is good for budgetary forecasting but not for detailed sales measurements)
Luke you know Excel has a neat tool called Data Analytics tool. All it takes is few clicks and you get results within seconds. I used it on a data with 10 million records and it works fine.
Keep doing what you do Luke. I appreciate how you mix technical concepts with light natured segments. Please never go down the route of Full-on influencer.
In the root of all of that you need good logical thinking. My biggest fear when I try to perform some calculations is if the results is correct, if my logic was correct.
I took the Statestic course in Coursera. As a math teacher i must say , find an exercise book and solve as much as you can. The course is great in content but lacks practices.
Hey Bouseux, Appreciate you so much for checking in on me during these breaks. 🙏🏼 I know I can always expect to hear from you! Unfortunately, my mother passed away last week, so I had to take a pause in content. Hoping to get back to it soon
What are the possibilities that the whole of the data analysis will be made 'automated' in the near future and data scientists will no longer be required?
Really enjoyed the video Luke! Helping me quell my new grad worries of finding a job 😆 One thing though, about the R-squared, isn’t it “what percentage of the variability in salaries (observed data/target/‘y’) is explained by the years of experience (model/independent variable/‘x’). To me it sounded like you said the reverse, I could have just misinterpreted though
I would agree that your definition is more precise, so let's go with that one. I was trying to say it as simplistic as possible in this video so that may have caused the confusion
I did my graduation in computer science and then i am not interested in that field but now i wanted to grow my career in development . My ques is where to start in this field and grow in this that one.
@@LukeBarousse Glad to have you back , while you were gone ,I enrolled and completed Udacity Nanodegree Data Analysis Programme and came out with 3 projects, I will appreciate it if you can give my LinkedIn account a review or perhaps my resume .
@@LukeBarousse great thank you i really struggle with the model part of the project, i am really good at preparing, extracting and cleaning and splitting the data to train and test sets but i always struggles to build the model especially if params needs to be tweaked like the alpha param and the number of clusters, etc and more please if you can help us in the future like understand how to take good decisions concerning these topics, please and thank you very much for all of your help and support
Out of the maths concepts you mentioned in the video, which concepts are the must ?? I heard that Probability and Statistics are the must for data analytics and rest are either optional or considered as added advantages.
It’s more about creative not math in data analysis. First of all when u are researching (the most important part) u are always hearing peewee math. So u will satisfy most companies expectations. Just give them what they ask for and your research will show your limit.
Hello Luke I need your help. I have one question about Power BI. I make one sales report everyweek with one excel as data source. How can I save all these weekly report in the same power BI report so I could look back previous report by clicking the filter.
DANGIT!!! I missed that on the multiplication!!! 🤦🏼♂️ And I love calculator watches, except when our good friend Alex is locking them away in safe's he doesn't know how to access...
Hi Luke unfortunately Goldman Sachs denied my application for internal audit but I’m going for a quantitative finance master degree, with stocastic ect and eventually some courses of signal processing. I think becoming a quant would be my path, let’s see...
Hey Konstantin, so sorry to hear about Goldman Sachs. That’s interesting about the quant path I haven’t researched this much so curious to see where this takes you. Keep up the hard work my dude! 🤙🏼
Hi luke , i have done masters in statistics ,i want to start my career as data analyst but i am so confused about how and where to start . Please help me out
What’s the most advanced math you’ve used with data?
Also, thank again to Coursera for sponsoring this video and Thu Vu for helping me out with this video! 🙌🏼
Generalized linear models 🙃
Luke, you do realize all of what you just did can be done much faster and cleaner in Spss, right?
@@roymcpherson1639 potentially, but the goal of this video was to show how multiple tools utilize math
@@LukeBarousse I see what you mean. I really love your content. Keep them coming
@@roymcpherson1639 Thanks, Roy!!
Thanks so much for having me in this video, Luke!! Omg it is actually fun! Nerd ** 2 🙌🏽🤓
Heck yeah!! So glad we teamed up on this one! 🙌🏼
#Nerd^2
"I hate statistics jokes, they are all mean! I regress" really smooth one there 😀😀. I loved your appearances and countenance all through. Nice video
“I regress.” Well done Thu
woah🤯 woah🤯 woah🤯 how can someone make Math videos at this fun level to watch
This is one of the must see videos for everyone who's new to data science! Thanks Luke & Thu Vu!
Aw thank you so much for this Ezaz!
I know all of the mentioned stuff quite well actually. Does that Mean I'm gonna be fine? Sounds too good to be true
When you pointed the outliers it reminded me that I once worked on a product that used IQR to detect outliers for fraud and actually worked really well despite not being fancy data science-y magic. Thanks for the great vid!
Always gotta be identifying those outliers!! And thanks Ben!
I think people in our beautiful data field tend to forget that it's not about the most-complex and detailed algorithm, it's about the most functional one. On another note: IQR, you son of a gun that's exactly what I needed for my project - thanks for the reminder. Ha!
sometimes I forget how to arithmetic 🙃
I've def counted on my fingers (and toes) for some basic math before 🥹
Hi mamacita 😘 . I love you Tina ❤️.
Funny comments from data scientists 😂
Great video Luke.
I just want to say that your channel has helped through grad school. Everytime I was so stressed about school projects, your videos made me laugh and gave me motivation to keep working towards my degree. Just graduated this spring and will start my first job soon in the data analyst field.
Thanks for reading this comment.
Oscar thanks so much for sharing this and awesome to hear of your progress through grad school! Keep up the hard work my friend!!
Thanks Luke and Thu Vu. Wish you guys all the best. I used to be a Marketer, and since last year I've moved further to a new job as a Data analyst. I've been working on almost 15 projects. You know, at my very first project I was so nervous because the team they are nerds for real. Sometimes in the meeting, I feel like they speak another language 🤣. But the interesting point is that when you are on-job-learning, especially something related to math, you can learn then apply and practice them in real cases. The more you apply to your job the more it grows on you. I approve those math tools works really well in most case.
Thanks for sharing this perspective, Pete!! I've felt the same way in some of the teams I've been on!
I love the fact that your videos are short and very resourceful. Thank you
Heck yeah, thanks for noticing this!
Thank you, Luke. Exactly what I was looking for and thank you for recommending the coursera course.
No probs Nayeem! Thanks for tuning in!
@@LukeBarousse Hey, got a question for you. How do you balance your work with side hustles and studying? I'm trying to make changes to my weekly habit and would love hear back from a busy individual on their weekly schedule looks like. Thank you
I don't think I've ever seen Luke without his calculator 🤓
Wears it on his wrist Dwight Schrute style
I don’t leave home without it!!! 🧮
Happy birthday Luke! I hope it’s full of hefty and nerdy data!!!
Just saw this! Ha, thank you Dave! 😘
Great video, Luke! I had never been able to visualize data analytics as learnable until I saw this video, it has really put me at ease to pursue data analytics. Thank you
Thanks for this, my confidence in pursuing data analytics went through the roof
As a data analyst myself this was really accurate to the role I am working with.
I am an Econ student from Malawi 🇲🇼🇲🇼 with a passion for Data Analytics.. Your channel is now one of my favorites. Thanks for the video(s)
Awesome, thank you so much for the positive vibes!
Great content as always. I'm currently taking your Power BI case study course in Datacamp. Wonderful so far
Heck yeah, hope you enjoy it!
Thank you very much ! I'm not that good at mathematics, but I want to learn more and become better. I will practice and practice, and I hope to have good results
yo Luke, just wanted to say thanks again lol! i got my 3rd internship in business intelligence / data analytics and it all started last year. i just remember watching your videos in the car on lunch breaks, and it really helped me get serious and guide me to where i am now. appreciate you!
My dude, this is awesome to hear on the follow on internship!! So stoked for you, keep up the hard work and I appreciate the positive vibes! 🙌🏼
3rd internship position? Just curious... Why haven't aren't you in a full-time position yet?
@@ftrkngfspn im not full time because i have to get my degree. once i get my degree i wont need to take any more classes and ill be able to go FT
Loved the video, thank you very much!
I love Thu Vu! Thanks for bringing her on!
Love her content too!!
Another sweet video my dude.
One thought: on the distribution plot, it marks 50% at the peak of the curve. While this is true on a normal distribution (where mean=median=mode), your specific distribution was skewed to the right. So the 50th percentile would have been to the right of the mode (peak of curve).
Unless I'm wrong, then you should thoroughly pwn me lol
Nope I think you are completely right. I had to make that animation in my video software. So it was done by hand (and not to scale). Thanks for pointing this out! 🙌🏼🙌🏼
That animation looked great! Love how it slid over from the tails
your videos give me a lot of motivation
This vid length is 10:05, I spent about 15mins to complete it because I spent the extra time from min 7:30-7:45. Thanks Luke and Thu Vu.
The most advanced math I've used with data is the Naive Bayes Algorithm, or maybe statistical significance testing. Gathering the data is usually more involved than the analysis.
Can very much agree about the data gathering being one of the most tedious steps! 😔
Thanks to both of you this was an interesting and fun explanation
Thank you!!
I loved ur equation:
"DataAnalytics - Fun = Mathematics"
As I have a "Pure" Math degree and i want to be DA, so the only thing that i need to learn is the FUN part ❤️❤️
Luke, I don't know how to explain this, but your videos make me smile!
Keep it up man!
Aw my dude! Thanks so much for this! 🙌🏼
Perfect 10 minute #ad for Coursera, gj you did great
There is a lot of integral calculus hidden within statistical distributions. The area under a normal distribution (the integral of that curve) is equal to 1 and a z-score of 1.96 (Z = 1.96) corresponds to the alternative hypothesis being in the first 0.95 of the integral, where 1.96 in the upper limit of integration on the interval of x under the curve.
Z=1.68 is the upper limit of integration for 0.9 of the integral, etc.
I get that this is formal calculus and probably isn't used by too many data analysts but I find that learning integral calculus first really helps people have a better intuition and understanding of statistical distributions.
(Edit: formatting)
Yeah I can agree with this. It def can help provide a deeper understanding of statistical distributions!
Super informative...thank you for making this video
Thanks, Ajinkya!!
A very informative channel and great contens I enjoyed watching most of your videos Thanks for sharing .
great video dude, i´m starting in data analyst and your channel always motives me , thanks a lot
Aw thanks for this Jose!
Great Video Luke!
Thanks, James!!
0:16 It's been real 🤙
Very interesting!
I agree that the most important part is Statistics and Probability rather than "raw Mathematics"
Moreover you can apply the Pareto rule and probably with the 20% of the mathematical knowledge you need you can obtain the 80% of the results.
Carlos.-
Very much agree with the Pareto rule for this!!
Great content luke keep it up
Thank you Ashutosh
Can you do a video of the steps you take to learn about a database and tables when you encounter a new one that you have to work with for the very first time? What's the quickest way to get productive when dealing with a new database and understanding the relationships, etc...?
Let me see what I can do on this topic. Thanks for suggesting this! 🙌🏼
Great video Luke ! Big thanks to Thu ( subscribed ) for joining and I cracked at the mean joke lol ( especially the awkward explanation after .. I like awkwardness I think it's funny )
ha, thanks Ibraheem! Well as long as it was interpreted as funny! 😂🤦🏼♂️🤣
Thank you so much for subscribing! I was not exactly sure if that awkward joke came across as funny but as you said this, phewww.. 😂
Influencer.
@@seekerj1643 Hahah I see you're here as well .. ENTREPRENEUR
@@Ibraheem_ElAnsari 🙃
1:17 what is the name of the metric?
Is there any reference to study Sales&marketing metrics?
My math fear gone away in this 10 min, your the best. Thanks🤸
heck yeah!
This is an excellent video!
it's sad for the course not being part of Plus :(
Luke you make our lives nicer!
Thank you!!
Knowing the various data distributions is essential to the job as arithmetic if you're looking to be more than be a chart farmer.
It's important for troubleshooting your dataset and provide that analysis that stakeholders really want. Cuz your bosses don't want just a chart. They want the answer to the question the chart supports. The story (or context for decisions) requires a firm understanding of data sampling, biases, and distributions and how that relates to the business. This part of stats is IMHO so much more vital than knowing probabilities.
Like if youre a new hire, prepare to be shocked the number of times bosses make decisions around an "average" from a data set when the distribution isn't gaussian (e.g. ARPU is good for budgetary forecasting but not for detailed sales measurements)
Thanks for sharing this Eric! 🙌🏼
Dude we missed you. We need more data videos.
I'll be back soon!
Luke you know Excel has a neat tool called Data Analytics tool. All it takes is few clicks and you get results within seconds. I used it on a data with 10 million records and it works fine.
Thanks for sharing this!
so great Luke
Right now i m 18 and in future i wanna pursue data science and day by day im improving my maths 😄
Always love your new videos! Thank you for always inspiring me to grind harder, whether at work or on YT. Cheers!
Thanks Felix!
Thanks for informative video.
Man, I sincerely thank you,
Through you I discovered a whole new ecosystem :)
Keep doing what you do Luke. I appreciate how you mix technical concepts with light natured segments. Please never go down the route of Full-on influencer.
In the root of all of that you need good logical thinking. My biggest fear when I try to perform some calculations is if the results is correct, if my logic was correct.
I can appreciate this!
"What's a croissant distribution?" xD. Good one Luke!
I still don’t know… 🤦🏼♂️
Sweet content as always 😁✨
Okay 2:35 is gold 😂
Referencing from a source that's been claimed not to be a good reference. Okay that's meta!! 😂
"Is that true"?
"It should be" 🤣
Thank you so much Faruq! 😁 Glad you enjoyed our humor!
7:38. Haha...Thu is such a data nerd!
I regress.. 😂🤣
Stats student who works in analytics right now! Totally agree with everything in this video 🤓🤓
Thanks for this perspective Chris! 🙌🏼
Oh my goodness I finally understand what boxplots are. My professor just had me confused most of the time😭
Heck yeah! Glad I could help!
Is nosql still worth to learn in 2022 ?
You're excellent!
No you are!
I took the Statestic course in Coursera. As a math teacher i must say , find an exercise book and solve as much as you can. The course is great in content but lacks practices.
This is good to know, I appreciate this perspective Saman!
To get into jobs with minimal experience, it helps to look at nascent industries, like crypto, etc.
Wow what an amazing video
Thank you!
You sir just got a new sub
Thanks for subbing Rafael!
1:09 Data Analytics = Mathematics + Fun 🌟🌟
🙌🏼
Thanks!
what about having a basic sample project you work on it live from scratch?
I think this is a good option as well
you must be having well deserved holidays Luke...or preparing the next series of videos ;) all the best and see you soon
Hey Bouseux, Appreciate you so much for checking in on me during these breaks. 🙏🏼 I know I can always expect to hear from you!
Unfortunately, my mother passed away last week, so I had to take a pause in content. Hoping to get back to it soon
@@LukeBarousse Condolences Luke. All my prayers to your mom and family. Take care!
What are the possibilities that the whole of the data analysis will be made 'automated' in the near future and data scientists will no longer be required?
Really enjoyed the video Luke! Helping me quell my new grad worries of finding a job 😆
One thing though, about the R-squared, isn’t it “what percentage of the variability in salaries (observed data/target/‘y’) is explained by the years of experience (model/independent variable/‘x’). To me it sounded like you said the reverse, I could have just misinterpreted though
I would agree that your definition is more precise, so let's go with that one. I was trying to say it as simplistic as possible in this video so that may have caused the confusion
@@LukeBarousse remembering “x explains y” or “y is explained by x” is a safe bet
I'm almost scared to watch this!! Took my college algebra for my bachelor DEAD LAST!!
I almost failed my math course in college so I feel ya
Every time I watch Luke's videos I realize how little do I know in this field haha 😅
Great video Luke, thanks for sharing!
Trust me. I feel the same when I watch other peoples videos. You aren’t alone.
I did my graduation in computer science and then i am not interested in that field but now i wanted to grow my career in development .
My ques is where to start in this field and grow in this that one.
Great video as always , i would like to add linear algebra that is very useful for multivariate data or things like PCA or factor analysis
Covariance matrix/eigenvalues/eigenvector/ lagrange multiplier.
I have a request Luke, can you make a video on test driven development in Data Science/Analytics or maybe the normal testing?
Nice one Luke
Thanks 👍 Samuel
hey luke where are you??Why are you not making any video
Had to take a personal break, but I'm BACK!!
5:45 was boxplot done in python?
yes it was!
Hey Luke ,been quite a while your content has appeared on my feed ,I Hope all is well with you and looking forward to have you back.
Had to take a personal break, but I'm BACK!!
@@LukeBarousse Glad to have you back , while you were gone ,I enrolled and completed Udacity Nanodegree Data Analysis Programme and came out with 3 projects, I will appreciate it if you can give my LinkedIn account a review or perhaps my resume .
That's it lol. This is all I need hahaha explained in one video accurately. Thanks Luke!!
Aw thanks Jannon!
we need more Data Science/ Machine Learning topics please and some tuts can be really helpful keep going and thank you
Was actually going to do a video on ML in the near future. So stay tuned
@@LukeBarousse great thank you i really struggle with the model part of the project,
i am really good at preparing, extracting and cleaning and splitting the data to train and test sets but i always struggles to build the model especially if params needs to be tweaked like the alpha param and the number of clusters, etc and more please if you can help us in the future like understand how to take good decisions concerning these topics, please and thank you very much for all of your help and support
@@michelchaghoury9629 no problem at all Michel!!
Out of the maths concepts you mentioned in the video, which concepts are the must ?? I heard that Probability and Statistics are the must for data analytics and rest are either optional or considered as added advantages.
I'd say all the ones I covered in this video as I use them the majority of the time
@@LukeBarousse Isn't there any online course that covers or revises that data analytics related maths completely ??
It’s more about creative not math in data analysis. First of all when u are researching (the most important part) u are always hearing peewee math. So u will satisfy most companies expectations. Just give them what they ask for and your research will show your limit.
Btw imma lookin for work
The bad jokes are my favorite part of this video
They weren't supposed to be bad! 🤣😜
croissant distributions are my favorite
🤪
Hello Luke I need your help.
I have one question about Power BI. I make one sales report everyweek with one excel as data source. How can I save all these weekly report in the same power BI report so I could look back previous report by clicking the filter.
Please say some Domain knowledge best for data analyst
Is a business analyst need to know programming skill or sql?
How is wlb in data science? Is it better or worse than software engineering in general?
I’m pretty sure Data*Data = Pretty Hefty Data!
How do you feel about calculator watches?
DANGIT!!! I missed that on the multiplication!!! 🤦🏼♂️
And I love calculator watches, except when our good friend Alex is locking them away in safe's he doesn't know how to access...
mind blowing
Hey Luke! Love those videos! Do you know were to find python projects for beginners?
Can we make data analytics project only using ms excel and SQL. I am not finding any topic or idea
Yeah, I feel you can checkout Kaggle for potential ideas;
Hi Luke unfortunately Goldman Sachs denied my application for internal audit but I’m going for a quantitative finance master degree, with stocastic ect and eventually some courses of signal processing. I think becoming a quant would be my path, let’s see...
Hey Konstantin, so sorry to hear about Goldman Sachs. That’s interesting about the quant path I haven’t researched this much so curious to see where this takes you. Keep up the hard work my dude! 🤙🏼
Hey, Luke. Where'd ya get the Salaries dataset? Thanks!
It’s data I pulled from LinkedIn. I have a few videos on it on my channel
Hi luke , i have done masters in statistics ,i want to start my career as data analyst but i am so confused about how and where to start . Please help me out
Hey don't scare me already before I start with data analysis
👻 Boo!
Another great video, thanks Luke! You're really good at keeping my attention. 7:09 made me laugh too hard
Hello sir , can you please post a video about how to get a remotely job using Google data analyst certificate ?