Power BI Project For Beginners | Sales Insights Data Analysis Project - 4 - Data Cleaning & ETL
HTML-код
- Опубликовано: 25 июн 2020
- In this video, we will plug mysql database with Power BI. In power BI we will do data cleaning and ETL (Extract, transform, load). This process is also known as data munging or data wrangling. We will do currency normalization, handle invalid values, etc.
To download all the resource files: codebasics.io/resources/sales...
(You can find the SQL queries, setup instructions, and Power BI formula in the Readme file)
Previous video: • Power BI Project For B...
Next video: • Power BI Project For B...
How to learn data analyst skills for free: • Skills required for da...
Machine learning tutorial playlist: • Machine Learning Tutor...
Entire playlist for this project: • Power BI Project For B...
Special thanks to my friend, Hemanand Vadivel ( / hemanand-vadivel-0b34aab5 ) who is an experienced data analyst manager working for a company in UK. He has a major contribution in this project.
Basics of DAX & Data Modelling are the two fundamental technical skills required to author Power BI reports - There are the free courses I recommend from SQLBI.com
DAX: www.sqlbi.com/p/introducing-d...
Data Modelling: www.sqlbi.com/p/introduction-...
#️⃣ Social Media #️⃣
🔗 Discord: / discord
📸 Dhaval's Personal Instagram: / dhavalsays
📸 Instagram: / codebasicshub
🔊 Facebook: / codebasicshub
📝 Linkedin (Personal): / dhavalsays
📝 Linkedin (Codebasics): / codebasics
📱 Twitter: / codebasicshub
🔗 Patreon: www.patreon.com/codebasics?fa...
The sequel of this playlist is available in form of a video course here codebasics.io/courses/power-bi-data-analysis-with-end-to-end-project If you like this playlist you would absolutely love the course as it is 50X better in terms of quality and content.
Your link to download the resource isn't working.
Can you please provide CSV files for all the tables.
Please share the csv file
Wow. I just discovered this channel yesterday and i couldnt be happier bro. Thank you so much for doing this
The best, Honest, Authentic person in tech era...
Your are one of the few channels that bring this amount of value. Please keep posting this kind of series, its helped me a lot in a project! Thank you so much!
yes couple of more project series are coming up soon. I am working on tableau series at the moment.
@@codebasics First i would like to thank you for making this project. And then Kindly make me clear the same thing we can do by using Python Pandas too right?? and if posible could you states the difference between please. Thanks
How to convert CSV or excel files to SQL files for uploading into MySQL?
I am so grateful for this tutorial. You have explained everything so well. I should have started with this tutorial instead of doing others. Great stuff.
Hey codebasics I missed two of the videos series but I will watch it offline before your next live stream, thanks for your time. You are a good teacher, keep it up.
I know am late to this... But I have recently learned power bi... But this video brings the best value to it... Very clear in explaining as it is like real time scenarios.. Appreciate it sir
your chanel is my first channel that i refer to for learning data science ,greaaaaaaat job thank u sooo much
DUDE! Just discovered your channel a couple of weeks ago. You are 1 of 2 of my favorite YT channels right now! Such a great job. Great teacher. I am enjoying this series right now. I love how you bring your actual business experience into it to give it context. KEEP IT UP, PLEASE!
which is the other favorite channel ?
@@syedkamran4121 reminder Todd.
this series is a pure gem👍 following this series as my first data analyst practice project. Thank you so much for such a great explanation👌!!!
Thanks Yash, I am doing same series in tableau now. It will be uploaded in next few weeks.
Thank you sincerely! The entire series is a useful step by step guide. Subscribed!
Glad it was helpful!
Thank you soo much for making it Ad free ❤️
Best teacher with a high value of information
Amazing work brother, May Ganesh shower more success and progress to you. Keep educating people with your amazing skills and god bless you.
Thank you so much sir, this course is what I need.
Clear and well explained! Best lecture I've watched on MySQL and Power BI. There are links on the comments section on how to clone the repository but got help from Mr. Google for the importation of data from a different MySQL version. Will need to learn power BI syntax before proceeding to the next video!
Thanks for your kind words Jo and most importantly your self effort. Many times people ask my obvious questions such as how to clone git repo etc and I just don't have time to respond to all. I love your attitude of putting effort to get things done.
Great Video sir , Thanks , Love the series till now
The way u put it simply is the best way one can teach.
2:15 importing to PowerBI
3:55 Power query
5:15 data modeling
Thank you so much sir. Your explanations are easy to grasp and this playlist helped me a lot.
I've Started learning @ 12/04/2021
nice progress as started with the project directly
The data cleaning process which you teaching here are excellent and step by step. It's understandable easily. Thanks a lot Dhaval sir for this series.
Glad it was helpful!
i swear i love this project
If I've an option to like each video in this playlist 10 times, I'd surely do it. Such a clear and concise explanation sir. My sincere thanks!
10 id bana lo
Great Lecture series sir, I request u to if u have a time then plz Add other Project Series also on "Object Detection".
I think you forgot to remove duplicates from the Data (USD and INR the ones with special characters)
It is always a good practice to remove duplicates at the begining while cleaning the data.
Your videos are very helpful and valuable.
Thank you very much for your time.
you have noticed it, thank you for that.
Great video!! I follow one by one, play and pause a lot! May you be showered by prosperities and happiness sir!
I am happy this was helpful to you.
Put ads in I want you make money. Just keep on adding value to your videos. Benefiting from them right now. Thank you.
Its such a good startup video for those who are getting handson for the first time❤❤❤❤❤
Thank you for sharing!
thank you for the tutorial, im wondering how PowerQuery stands next to well known ELT tools like Oracle ODI or infomratica or so, is it recommended to use PQ or ETL specialized tools?
Really feeling gr8 after doing so as u told in this video series till now
I am happy this was helpful to you.
Sir really good class 👍👍👍 .expecting more vedios
Thanks a lot... 🙏 It's really helpful...
Explanation was very clear. Thank You Sir. If u could share the data source would be very helpful
Instead of creating a custom column, we can also use a trigger in MySQL workbench to convert USD to INR, and change value from sales_amount column
20.48 ; why we are having such USD repetition, they both are representing same values?
Thank you for your effort sir
May you prosper always
Thank you 🙏🏾
really loved it
Thank you , very helpful tutorial !
Glad it was helpful!
Any sources to find a similar kind of data for building dashboards. So that it won't be a copy-paste of work. Would like to apply the same on some other data set. Would appreciate your quick response
really good case study
This is very helpful information.. Thank you!!!
Glad it was helpful!
hello sir, in last you are trying to solve issue of two USD in currency, hence it is duplicate can we remove it?
same goes with INR ,some of them is also two times , so there are also duplicate values.
can you please explain it? thank you
Sir the values you converted to INR was related to the conversion rate of 2020 but the data column depicts the year 2017.. I think we should use the conversion rate of 2017 to for accurate calculation
your explanation is damn good sir
after loading the data in the PBI desktop, why did the original values of sales_amount and norm_sales amount changes?
Thank you very much sir,for making such videos
Glad it was helpful!
Thank you so much for this project specially making add free. I have learnt a lot because of this. So simple and easy way to present.
Very clear and excellent video to learn power bi query
Glad you liked it
Thank you sir, 😍😍😍
i am currently doing internship at infosys. this is the exact playlist that a student must look at. thanks for your efforts to bring quality content on yutube.
Glad you liked it. You will be glad to know I am launching a sequel of this series, a paid course with lot of practical learning, fun and almost like a virtual internship experience. I will be launching this in May, this year (2022). Stay tuned, will announce on my channel soon
Hello sir, your videos are greatly helpful. I am learning Data Analysis as a beginner, and I have a mac. Can you please suggest some alternative to Power BI as it is not available? Thank you
Amazing playlist. 'One stop solution' for learners! Keep it up, Dhaval and team.
Sequel of this series is coming up in form of a paid course in may 2022, stay tuned
Thank you sir ....
thank u so much...
@codebasics In the data, I am getting the sales qty as 102, 65 etc. I am unable to identify how to correct it. The values are correct though. Data type is Decimal Numbers. How do I rectify this?
This project playlist is the best thing I've come across. Thank you sir.
Glad it was helpful!
YOU ARE AMAZING TEACHER. I learnt alot from you. but can you please tell why you did not remove duplicate data in the starting? the reason for these two INR and USD is because the data is duplicate
Awesome
anybody who's facing connection issues with mysql.. Install everything with v8.0.32. It worked for me!
Do we have to install some mysql connector I was not able to connect to MySQL
Finally I succeed to connect Power BI with SQL database. Thanks
How ?
how
HOW ? after installing the new mySQl connector then also i am not able to connect the SQLdatabase with power BI
nice tutorial
Hi, shouldn't the USD to INR conversion be based on the order_date?
thank you i just finished the project i have a question how this kind of garbage data get inside the tables like negative amount sales
is it a software development issue because if the software is well written it should not allowed this kind of negative number to be in the first place
i well developed software help reducing the cleaning process
I am unable to connect sql with power bi. error is "This connector requires one or more additional components to be installed before it can be used". Already tried youtube tutorials and installed sql connector but issue is still persists. Need Help
sir, at the final transformed data why all the INR values are shown as 102 INR?
I think there is extra character might be white space in Currency column i.e USD and INR so removing duplicates and using trim funtion will solve that issue.
sir your playlist is really helpful for learners. I started powerbi with you sales project. but in part 04 facing issue to get data from mysql to powerbi. its showing ..'character not supported by .net while connecting to Mysql in powerbi. please help!!
Awesome & Just Love the way of your explanation !!!! Can Power BI work with live data , can it update when database is modified ?
yes it can work with live data
Can I make the same project and showcase as portfolio on freelancing website?
Sir sales product table having less no of product code as compared to the product code present in a sales transaction table.
Hi ,
can you share the excel document of db_dump.sql and db_dump_version_2.sql . i would like to try by connecting as excel
hi anyone tell me please how he calculated here profit margin , percentage , etc last three column? whats the formulae, i googled but cannot match with this table. revenue divided by cost. what is the cost here? any idea
what did the code "USD#(cr)" @ 20:22 acually mean when can and how do you use it?
Why is it showing 102 instead of the transformed value in the power Bi desktop, after closing and applying?
@codebasics
PowerBI desktop version is not allowing for personal account sign in . Please advice for other alternatives to sign in
were the USD rows duplicaed at 20:40?
Hello everyone i just started this amazing series and everyone who has recently started will get an error while connecting to my sql server from power bi as one or more connector required.....i researched and found out that the problem is with the connector versions....just install previous connector version for my sql and it should work...i installed 8.0.24 and it is now working fine....thanks sir dhaval patel for providing such informative content for free .cheeers
Thanks man. I had the same issue. But i choose same version 8.0.24 and it is working
Hey! I have installed 8.0.24, still facing the same issue. Any idea on this?
I still have issues. I could not complete mySQL installation. The product configuration stage is having an error and in the next stage i need to provide the root password. But the password is not even created during this installation. It seems due to the previous installations. Can anybody help?
Hello
while doing the transform data section most of the data are not visible and it shows list may be incomplete and when we click on load more its not getting loaded can u help me to fix it
I couldn't follow along this tutorial. First I encountered problems with connecting to MySQL, and when I resolved that, I have authentication problems "we couldnt authenticate with the credential provided". The solutions I found in the internet were hard to understand. : (
Thank you 😊 sir
Glad it was helpful!
can we put this project on our LinkedIn, Github profile etc?
i am unable to connect to my SQL server using hostname=localhost please suggest me a way to connect it
PowerBI desktop application is not MAC OS supportive. While for tableau there is a requirement to install Tableau prep builder and Tableau Desktop application. Could you suggest an alternative so that it is easier to follow the tutorial ??
We can use excel file to upload the data in powerBI why we are using mysql as a source...?
I am struggling to connect with MYSQL.
how to link the PowerBI to the database, through the ODBC, .NET connector, or what? Please help.
the part about the USD n stuff I just replaced the text of USD(#) or whatever to USD then did the conversion
Unable to connect with database, requires additional connection what to do please help ?
How to connect with Mysql server while we are using powerBI app in a different system?
I'm unable to connect MySQL to Power BI; it says I need to install a connector; please assist.
Where can I get this data set sir?
The reason for the double INR and USD @18:58 is white space. By using Trimming, it will be fine
Sir i want to ask one question that...is certification is necessary for data analyst or data scientist career...??? Without certificate it is tough to get these positions...????
Nothing can stop you if you have good amount of knowledge even withoutout certificate.just do some practice and projects on data analysis.dont go into the trap of certification.good luck.
I am unable to connect mysql server with powerbi. It shows the error: "A network related or instance specific error occured while establishing a connection to sql server. The server was not found or was nit accessible...."
Please help me I am getting messages require connect while connecting database with mysql