Hope you enjoyed this video! I forgot to mention one thing important, please remove your API key in the notebook before you post your project to Github. This is to prevent other people from using your API keys without your consent 🙂
For anyone that got an error at the 11:30 mark, this is the solution i used The issue in the code is that the while loop that is intended to fetch additional pages of playlist items is not using the next_page_token to request the next page. Instead, it is making the same request repeatedly without updating the pageToken parameter. This leads to an infinite loop, as it keeps fetching the same page repeatedly. Here's the corrected version of the code: playlist_id = 'UUMki_UkHb4qSc0qyEcOHHJw' def get_video_ids(youtube, playlist_id): video_ids = [] request = youtube.playlistItems().list( part="snippet, contentDetails", playlistId=playlist_id, maxResults=50 ) response = request.execute() for item in response['items']: video_ids.append(item['contentDetails']['videoId']) next_page_token = response.get('nextPageToken') while next_page_token is not None: request = youtube.playlistItems().list( part="snippet, contentDetails", playlistId=playlist_id, maxResults=50, pageToken=next_page_token # Add pageToken to request the next page ) response = request.execute() for item in response['items']: video_ids.append(item['contentDetails']['videoId']) next_page_token = response.get('nextPageToken') return video_ids In this corrected version, the pageToken=next_page_token parameter is added to the subsequent requests inside the while loop. This ensures that each iteration of the loop fetches the next page of playlist items instead of repeating the same request.
Please add more of this kind of projects, your way of explanation, information gathering is simply superb where we won't be able to find from others instructors and RUclips videos
Finally done with my project. I learned so much. Rewatched this video many times. It's true that you learn by doing and not just by watching. Thank you so much.
hey !can u help me out I don't know y but the code is not showing output when i wrote the first def function also json to beautify it is also not working
Thanks for this video! Your content is well-explained & I like that you talk through your process as you go along. I haven’t worked with API keys yet, but look forward to doing a project similar to this one some time.
this video helped so much! honestly the analytic skills i learned through this video is way more helpful than a whole semester of my python course at uni. thanks a lot!!
For anyone that got an error at the 15:58 mark, this is the solution I used The apply function in the second line is correctly using the isodate.parse_duration function to convert the duration string to a timedelta object. However, when you try to convert the resulting timedelta object to seconds using astype('timedelta64[s]'), it won't work as expected. You should modify the code as follows: # convert duration to seconds import isodate video_df['durationSecs'] = video_df['duration'].apply(lambda x: isodate.parse_duration(x).total_seconds()) In this modification, the total_seconds() method is used to convert the timedelta object to the total duration in seconds. This should give you the correct result for the video durations in seconds.
I've been having an issue with this video. Because I'm trying to give millions of likes, but it allows me one like (that's absurd)!!!! It's a shame because your content deserves a lot of love. Thank you for your dedication!
I’d say that this is the first Python project video I watched til the end, also my first comment for a DA content on YT:)) Though there are ton lines of code that look intimidating to me (as a intermediate Python learner), I finally got the idea of how a real analytic project was made from scratch. Can’t believe that! From Git to API request to EDA to visualization, everything I’d learnt or heard about before is now brought together in this high-level tutorial, so inspiring! Shout out to you ThuVu! Keep up your good work! I hope to see many more contents like this on your channel!
This is very good quality content! the project is very interesting! thanks for sharing with us here! good luck with your channel. Already subscribed to this channel!
If you are using Jupyter Notebook and getting output as : "" instead of importing JSON from IPython.display Use this import json ... .. formatted_response = json.dumps(response, indent=2) print(formatted_response)
Awesome video thank you! I loved learning about this library through your video. If possible, please make another video on how to deploy this dashboard so we can share it. I tried following the user guide but i got stuck, so it would be awesome if you could do a walk through. thanks again!
Fantastic video. I'm just starting to look into API's and this was very helpful. I thought I'd do a project that might benefit my girlfriend's RUclips channel. It's a small channel with a big heart and deserve more eyes. Wish me luck
such an interesting video. So many concept covered. I will be sure to apply this project on another youtuber and get some cool insights but I'm sure I will stumble across to many error and hope you will be here to help haha. Thank you sm
Hey, thanks for commenting! Hope you’ll have a lot of fun applying this project to your favorite RUclipsr!! Of course you can always reach out to me if there are problems, I love solving errors 😉
I really like this video, and the way you made it look easy! Heres an idea, I wonder if you can ceate.. Explain how to download video captions and store them in a dictionary, where the key is the a word and the value is an array that contains the video ID and the time in that video!
Thanks so much for your guidelines! As an absolute beginner in Python (and just get to know API from codecamp), your instruction is so easy to follow, yet it covers different perspectives and layers when it comes to analyze data. I just stood in awe watching your inspiring video!! I'm trying to practice following your github code and I have a question. If I analyze 10 channels at a time, then I have to repeat the "get videos IDs from upload playlist IDs" 10 times, am I right? I see you used the variable -playlist_id- in your codes. I tried to make use of the -join- command to see if it can retrieve all upload videos ID from 10 channels but it didn't seem to work :( For now I just repeat the codes and I already had my first ever data project! Thank you so so much!
This is the best video ever. Thanks to that, I was able to try the RUclips API with Python. But I have a question. How do I get traffic sources? Should I use the RUclips Reporting API at this time?
Love this video, it was very helpful! My only thing is I'm stuck in an infinite loop and can't get out in terms of video IDs :( My code looks exactly like yours
content you provided are just awesome, Thank you Thu vu, I thought of storing the data to azure cloud and build a data pipeline to further present my data in tabluae, I have no experience with data pipelines, Would you please provide your review on how this can be accomplished... Thanks Again
Hi Madam, Your explanation is awesome. I need full Road map and guidance to become data analyst in 30 days. Could you please provide learning content, where can I get all the details. Thanks in advance.
@@Thuvu5 To be honest I dont understand much, I just run the code and change the API to use mine, I would love to connect with you to show you my work on RUclips API if you-re into that
hey thu i really enjoy with ur vides thank u so much, i wanna ask something after we got this channel's data how to make this dataset into csv? thanks before!
Great video, thanks! I try to repeat your project for crochet channels and I have an error on the counting number of tags. type object 'str' has no attribute 'len'.
@@Thuvu5 I actually found your channel a few days ago through the algorithm and then I saw your name on Luke's channel today. You have great high quality content and your channel will grow a lot, wish you the best!
I was playing with the notebook and ended up with almost 10k video ids then I realize how the api request did not run fully to grab all the ids that I had to run a few times to get it right. 😂😂
So I know I am about a mont late but I essentially copied exactly what you did up until the the retreiving the number of videos and even copied and pasted your number of videos ID function from your github and its not counting all the videos there are like close to 100 missing what could be the reason?
I got stuck in my project at the next page token park. The channel I'm analyzing has 86 total videos. By default I get 50 video_ids but I need all 86. The while loop with "is not None" loops Infinitely 😭😭
Hi Karabo, I think I know what caused it to go into infinite loop, I had it once 😅. Please make sure you include ‘page_token = next_page_token’ in the request within the is not None loop.
@@Thuvu5 @Karabo Moremi Guys I'm having the same problem, but when I include 'page_token = next_page_token' in the request list within the is not None loop I got an error 'got an unexpected argument 'page token''. Also, great video, thanks for sharing all this!!!
Hello, great video. I have a problem with the playlist id. I tried making a list of different playlist ids and using them in the code, but the code crashed. Although when i tried each code separately they all worked?
Hi Mahesh, thanks for watching! Good to know that this method no longer applies. But it's actually quite simple to obtain channel id otherwise. On any video of a channel you want to get channel ID, open developer console (Ctrl+Shft+I on Windows or Command+Option+I on Mac). Then go to the Element tab and search (Ctrl+F) for "/channel/", then you should find some results of the href of the channel link. Then the long weird string after "/channel/" in the href should be the channel ID. Hope this helps. Good luck!
for some reason when I get all the video stats with video_df I only get 250 results (250 X 13 columns). I'm using the same code as you but you get thousands so I'm confused. (there are definitely more than a thousand videos) I think the next page thing isn't working for me...
If I create a project using youtube api and in my project I show youtube videos and put ads or subscription on website. Or will some copyright come.What if I don't want copyright issue to appear on my website?
Hi , It is really usefull, I am new to DS & I want help on RUclips Data Harvesting and Warehousing using SQL, MongoDB and Streamlit by creating a Streamlit application. Can you help on the details on how should I start as it is my first project.
i dont know how yall found this tutorial doable, I'm stuck at the first cell and i haven't made progress since, even StackOverflow and chatgpt cant solve my errors, like idk perplex timeout, idk
![Working with APIs in Python [For Your Data Science Project]](/img/1.gif)
Hope you enjoyed this video! I forgot to mention one thing important, please remove your API key in the notebook before you post your project to Github. This is to prevent other people from using your API keys without your consent 🙂
Please I can't find the Items when I run the JSON response , It only shows kind , etag and pageInfo
Hi , I want to know how to scrape video ids using multiple playlist ids as a code coz you showed only for one id
For anyone that got an error at the 11:30 mark, this is the solution i used
The issue in the code is that the while loop that is intended to fetch additional pages of playlist items is not using the next_page_token to request the next page. Instead, it is making the same request repeatedly without updating the pageToken parameter. This leads to an infinite loop, as it keeps fetching the same page repeatedly.
Here's the corrected version of the code:
playlist_id = 'UUMki_UkHb4qSc0qyEcOHHJw'
def get_video_ids(youtube, playlist_id):
video_ids = []
request = youtube.playlistItems().list(
part="snippet, contentDetails",
playlistId=playlist_id,
maxResults=50
)
response = request.execute()
for item in response['items']:
video_ids.append(item['contentDetails']['videoId'])
next_page_token = response.get('nextPageToken')
while next_page_token is not None:
request = youtube.playlistItems().list(
part="snippet, contentDetails",
playlistId=playlist_id,
maxResults=50,
pageToken=next_page_token # Add pageToken to request the next page
)
response = request.execute()
for item in response['items']:
video_ids.append(item['contentDetails']['videoId'])
next_page_token = response.get('nextPageToken')
return video_ids
In this corrected version, the pageToken=next_page_token parameter is added to the subsequent requests inside the while loop. This ensures that each iteration of the loop fetches the next page of playlist items instead of repeating the same request.
Thas why I love fkin programming community. Thanks !
Wow, I have been stuck on this part for like 2 days. I don't know why I didn't come to the comments sooner. Thanks so much!
Please add more of this kind of projects, your way of explanation, information gathering is simply superb where we won't be able to find from others instructors and RUclips videos
Finally done with my project. I learned so much. Rewatched this video many times.
It's true that you learn by doing and not just by watching.
Thank you so much.
Aww well done! Congratulations! 🎉 I’m happy to hear you learned a thing or two from this project 😀
hey !can u help me out I don't know y but the code is not showing output when i wrote the first def function also json to beautify it is also not working
This channel is an absolute gem!
Aw that's so kind of you to say! 😇 I really appreciate it!
Your channel is obviously going to be big, only 800+ subscribers right now but the quality is clear. Thanks for the video.
Aww thank you for such an encouraging comment!! I’m so happy to hear that 🥲💛
Haha you were right
Thanks for this video! Your content is well-explained & I like that you talk through your process as you go along.
I haven’t worked with API keys yet, but look forward to doing a project similar to this one some time.
this video helped so much! honestly the analytic skills i learned through this video is way more helpful than a whole semester of my python course at uni. thanks a lot!!
For anyone that got an error at the 15:58 mark, this is the solution I used
The apply function in the second line is correctly using the isodate.parse_duration function to convert the duration string to a timedelta object. However, when you try to convert the resulting timedelta object to seconds using astype('timedelta64[s]'), it won't work as expected.
You should modify the code as follows:
# convert duration to seconds
import isodate
video_df['durationSecs'] = video_df['duration'].apply(lambda x: isodate.parse_duration(x).total_seconds())
In this modification, the total_seconds() method is used to convert the timedelta object to the total duration in seconds. This should give you the correct result for the video durations in seconds.
This is what I am looking for
This video was recommend to me out of the blue, and I am really glad it did! Really enjoyed it, thank you!
I’m so glad to hear that! Thanks for watching 😀
i've just started work on my github profile to be a data scientist, this project gonna be a great project idea
I've been having an issue with this video. Because I'm trying to give millions of likes, but it allows me one like (that's absurd)!!!! It's a shame because your content deserves a lot of love. Thank you for your dedication!
Aw thank you for being so kind!!! 💜
Wow!! well explained
WooooW , great effort, Thank you so much, All the best and waiting for more videos
This is exactly how this kind videos are supposed to be.🎉
Thanks for this incredible video, I have learned a lot while following these steps.
Hope you all well and look forward for upcoming videos, cheers!
Thank you so much for watching, Robert! 🙌
Love the details in the video Thu, Thanks
This was my first proper data science project, and I absolutely loved every minute of making this! Thank you so much!
I’d say that this is the first Python project video I watched til the end, also my first comment for a DA content on YT:))
Though there are ton lines of code that look intimidating to me (as a intermediate Python learner), I finally got the idea of how a real analytic project was made from scratch. Can’t believe that! From Git to API request to EDA to visualization, everything I’d learnt or heard about before is now brought together in this high-level tutorial, so inspiring!
Shout out to you ThuVu! Keep up your good work! I hope to see many more contents like this on your channel!
Thank you BaoPhuc! I’m so glad you liked the video and found it useful 🔥🙌
Great repository you made. Excellent job.💫
If u could demonstrate cloud environment that data scientist to deploy project, that would be wonderful. Great content! Thanks.
Hey, that’s a good idea! Thank you for the suggestion, I’ll keep it in mind for future videos!
fantastic explanation, precise and to the point, I'm happy that I found this channel
Glad to hear it! 🙌
That's great, your style and speed is perfect for me. I will be looking at more. And I did sub.
Awesome video and awesome content. Definitely deserves way more views. Thank you for sharing this with us!!
Your video was the perfect introduction to RUclips's API. Thank you for this.
Glad you enjoyed it!
Thank you Thu Vu for the project I can add this to my own data portfolio and resume show off! New Subscriber here!
That’s awesome to hear! Good job 🎉
Great video! Love your authenticity. :) Keep it up!
Hey Andrey, thank you for the compliment! Haha I’m trying to be more authentic in the videos and that’s great to hear!
This is very good quality content! the project is very interesting! thanks for sharing with us here! good luck with your channel. Already subscribed to this channel!
Aw that's so kind of you 😇. Really glad you liked the video and thanks for subscribing! 👋
You are the best! 🔥
This video was sooo good. I really learned a lot. I will go over it a couple more times just to see it in more detail.
So great to hear Karabo! That really warmed my heart 😄. Have fun with the project!!
Great video again Thu Vu! I'm going to do this in coming week. Thank you for such quality content.
Thank you Deepa! I'm glad it was helpful 🤩
If you are using Jupyter Notebook and getting output as : "" instead of importing JSON from IPython.display
Use this
import json
...
..
formatted_response = json.dumps(response, indent=2)
print(formatted_response)
okay, fine. You've earned my like and subscribed lol This was excellent. Perfect flow, descriptions, and all meat. Thank you
Awesome video thank you! I loved learning about this library through your video. If possible, please make another video on how to deploy this dashboard so we can share it. I tried following the user guide but i got stuck, so it would be awesome if you could do a walk through. thanks again!
Thanks Patrick for the suggestion! Deploying and sharing dashboard is definitely high on my list for upcoming videos 🙌
Thank you for this video, very well explained. All the best for your channel.
Thank you for leaving these kind words Deepak! 🙌
Thank you, really learning from this, especially when making mistakes!
Fantastic video. I'm just starting to look into API's and this was very helpful. I thought I'd do a project that might benefit my girlfriend's RUclips channel. It's a small channel with a big heart and deserve more eyes. Wish me luck
Aw that’s awesome! Good luck 🍀
Great project, thank you so much!
First one here 😃! Greetings from Slovakia.
Haha you were the one who unboxed this video 🤩
@@Thuvu5 yay 😊!
I like your new unique and intresting content , very helpful for me learning data science
I am from Taiwan. Thank you so much🙏
Sending a lot of love ❤️
If some of you are getting this kind of ugly output () when running JSON(response), use Jupyter lab instead of notebook as she advised 🙂
such an interesting video. So many concept covered. I will be sure to apply this project on another youtuber and get some cool insights but I'm sure I will stumble across to many error and hope you will be here to help haha. Thank you sm
Hey, thanks for commenting! Hope you’ll have a lot of fun applying this project to your favorite RUclipsr!! Of course you can always reach out to me if there are problems, I love solving errors 😉
@@Thuvu5 thank you so much, thats so motivating for me.
Thank you soooooooooo much this is awesome!!! 💕💕💕💕
This channel is goin to get big
Thank you so much Akhil! 😇
@@Thuvu5 I told you your channel is going to get big and I am glad it did get big
Very really work. I like this challenge.
Thanks for sharing.
Glad to hear you liked it!! 🙌
Wow super interesting Thu Vu!
I might and try to replicate it to my own little channel!
Thanks for sharing the project with us!
Carlos.-
on
So clear, thank you chị ❤❤
Thank u ! Thats awesome
Thanks for this video.
Thanks , that was helpful.
If you get an error at 15:20...that's because we need to import parse library..
here is the code:
from dateutil import parser
Very clear code and well explained, Great job! 😎
you are a lifesaver!! thank you
Thank you so much for this awesome video!
Even tho I use JavaScript, your explanation was fairly simple and easy to understand.
Glad it helped!
quality content, thank you so much
Thank you for commenting! Glad to hear you enjoyed it 😄
I really like this video, and the way you made it look easy!
Heres an idea, I wonder if you can ceate.. Explain how to download video captions and store them in a dictionary, where the key is the a word and the value is an array that contains the video ID and the time in that video!
Eye opener...You are pro
Thanks so much for your guidelines! As an absolute beginner in Python (and just get to know API from codecamp), your instruction is so easy to follow, yet it covers different perspectives and layers when it comes to analyze data. I just stood in awe watching your inspiring video!!
I'm trying to practice following your github code and I have a question. If I analyze 10 channels at a time, then I have to repeat the "get videos IDs from upload playlist IDs" 10 times, am I right?
I see you used the variable -playlist_id- in your codes. I tried to make use of the -join- command to see if it can retrieve all upload videos ID from 10 channels but it didn't seem to work :(
For now I just repeat the codes and I already had my first ever data project! Thank you so so much!
weldone and thank you!
This is the best video ever. Thanks to that, I was able to try the RUclips API with Python. But I have a question. How do I get traffic sources? Should I use the RUclips Reporting API at this time?
Hey, I’m not sure about how to get the traffic sources.. so I can’t helpmuch with this one..
@@Thuvu5 Thank you for your reply. It's all right. Still, the video helped me a lot. I appreciate it!
Great, more reviews like this. Greetings from Russia!!!
Great video again , thank you thu vu
Thank you Amine for always supporting me! 🤗
@@Thuvu5 you deserve all support for your all efforts to help us
Just love lovee
Love this video, it was very helpful! My only thing is I'm stuck in an infinite loop and can't get out in terms of video IDs :( My code looks exactly like yours
This was a great video. I enjoyed it even though I just know R
Haha nice!! Thanks so much Angel 😁
Thanks
content you provided are just awesome, Thank you Thu vu, I thought of storing the data to azure cloud and build a data pipeline to further present my data in tabluae,
I have no experience with data pipelines, Would you please provide your review on how this can be accomplished... Thanks Again
Great video!!! How many time did it take you to program it?
Hi Oracio, thanks! 👋 It took me about 15 hours for data extraction and about 3 hours for data preprocessing and EDA
What are some concepts we should learn abt so we can do this project?
nice) more videos on how to retrieve data from the API please)
Yes! That sounds like a great idea 😊. Thank you for commenting!
please can you make a video about google keyword planner API using python?
Hi Madam,
Your explanation is awesome.
I need full Road map and guidance to become data analyst in 30 days.
Could you please provide learning content, where can I get all the details.
Thanks in advance.
I need this, I got a code that works a bit =) but I don't like how the outcome looks like; I will look at this video to learn more
Hey Rapha! Thanks for commenting 👋 Hope you’ll get some nice outcome from the video!
@@Thuvu5 To be honest I dont understand much, I just run the code and change the API to use mine, I would love to connect with you to show you my work on RUclips API if you-re into that
hey thu i really enjoy with ur vides thank u so much, i wanna ask something after we got this channel's data how to make this dataset into csv? thanks before!
chị giỏi quá
Pls Suggest such Job Oriented & Good Quality Projects on Power BI Data Analyst which are Highly Relevant For Getting a Job Immidiately
Great video, thanks!
I try to repeat your project for crochet channels and I have an error on the counting number of tags.
type object 'str' has no attribute 'len'.
@Thu Vu FYI Luke Barousse mentioned you in his latest video about SQL.
Thanks Steven for letting me know! I just saw his video, I’m so flattered 😂
@@Thuvu5 I actually found your channel a few days ago through the algorithm and then I saw your name on Luke's channel today. You have great high quality content and your channel will grow a lot, wish you the best!
Aw I’m glad you found my channel! 👋 Thank you so much for your kind words, I really appreciated it 😃
I was playing with the notebook and ended up with almost 10k video ids then I realize how the api request did not run fully to grab all the ids that I had to run a few times to get it right. 😂😂
So I know I am about a mont late but I essentially copied exactly what you did up until the the retreiving the number of videos and even copied and pasted your number of videos ID function from your github and its not counting all the videos there are like close to 100 missing what could be the reason?
Hi! thank you for this video its really helpful. Can you plz provide the code for fetching comments, your repo doesn't have that
very good video
I got stuck in my project at the next page token park. The channel I'm analyzing has 86 total videos. By default I get 50 video_ids but I need all 86. The while loop with "is not None" loops Infinitely 😭😭
Hi Karabo, I think I know what caused it to go into infinite loop, I had it once 😅. Please make sure you include ‘page_token = next_page_token’ in the request within the is not None loop.
IT WOOORRRKKKEEED🏅🏅🏅😭😭😭🤝🏽🤝🏽🤝🏽
@@KaraboMoremi Yay!!!!
@@Thuvu5 @Karabo Moremi Guys I'm having the same problem, but when I include 'page_token = next_page_token' in the request list within the is not None loop I got an error 'got an unexpected argument 'page token''. Also, great video, thanks for sharing all this!!!
I’ve been developing similar code and came across a limitation: you cannot get more than 500 results from the RUclips Data API.
I'm trying to move videos from one playlist to another but it says I don't have permissions.
Hello, great video.
I have a problem with the playlist id. I tried making a list of different playlist ids and using them in the code, but the code crashed. Although when i tried each code separately they all worked?
Hey you've done a great job making this video, but is there any other way to get channel id, since this method doesn't work any more.Please help
Hi Mahesh, thanks for watching! Good to know that this method no longer applies. But it's actually quite simple to obtain channel id otherwise. On any video of a channel you want to get channel ID, open developer console (Ctrl+Shft+I on Windows or Command+Option+I on Mac). Then go to the Element tab and search (Ctrl+F) for "/channel/", then you should find some results of the href of the channel link. Then the long weird string after "/channel/" in the href should be the channel ID. Hope this helps. Good luck!
Chị có mở khóa học không ạ?
How do we hide our API keys from our GitHub repo
for some reason when I get all the video stats with video_df I only get 250 results (250 X 13 columns). I'm using the same code as you but you get thousands so I'm confused. (there are definitely more than a thousand videos)
I think the next page thing isn't working for me...
Hi, i tried to get the id for other channels just the way you did for your example, it didn't worked , plz help!!!!
If I create a project using youtube api and in my project I show youtube videos and put ads or subscription on website. Or will some copyright come.What if I don't want copyright issue to appear on my website?
Hi , It is really usefull, I am new to DS & I want help on RUclips Data Harvesting and Warehousing using SQL, MongoDB and Streamlit by creating a Streamlit application. Can you help on the details on how should I start as it is my first project.
i dont know how yall found this tutorial doable, I'm stuck at the first cell and i haven't made progress since, even StackOverflow and chatgpt cant solve my errors, like idk perplex timeout, idk
👍
How did you get the id in video statistics? @11:39
Mam please say, how to fix "quota exceeded" error