Very Nice Ahmed, Just it is worth mentioning that is way is somehow illegal according to Twitter guidelines, for researchers who aims to mention data collection from Twitter, their papers could get Ethical comments if they reported not using the official Twitter API. Keep posting such amazing things, Ahmed!
Thanks for the tutorial. Is it possible to gather all the tweets on a certain hashtag instead of setting n=1000 or a certain number? For example, If I want to collect all the historical tweets on a hashtag like ''climate change'', where should I make a change in the script?
Hello,Would you mind if ask if you can demonstrate how to use a crawler to capture twitter space cations. If the audio file is very long (more than ten or twenty hours), how to quickly capture it?
getting this error when trying to install as instructed "ERROR: Directory '.' is not installable. Neither 'setup.py' nor 'pyproject.toml' found" both in Jupyter notebooks and Colab
Thanks for the A++ tutorial. I can execute a search via colab, the python shell, and vs code, but don't know how you ran it directly from the terminal. How did you do that?
Merci bcp pour cet outils performant j avais un grand soucis pour collecter un dataset relatif à une thematique bien precise pour un cas d étude pour mon PFE. J essaie de remplacer tweepy avec cet API. Si j px vous contacter en cas de souci c est sur quel plateforme.
i got this error: CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 1.0 secs do you know how can i fix it?
Thank you for the video. I seem to have limitation with the tweets extracted. I seem to get only 3000 tweets for #WFH. Can you help with what might be wrong?
How can I do boolean filter here Just like in tweeter search bar "Nigeria" ("music" OR "musician" ) this will give all the values includes nigeria with music or nigeria with musician
@@AhmedBesbes I want to create an web application which daily refreshes whenever we make request and it gets the latest data containing nigeria and music and returns sentimental analysis in the visualization form. Any tips and hints
Hello, Ahmed! First of all, I will tell you that your video tutorial is amazingly easy, but as person who is not from IT industry, I'm in big trouble on following the guide. I already downloaded jupyterlab notebook and tried to copy the repo, but still didn't work at all. Can you point out which things I did it wrong? Hope you reply this soon since my final project is soon ended next week and I'm still in difficult on scrapping the Twitter data.
Hello Have you installed twint as well? if not, here are the commands: git clone --depth=1 github.com/twintproject/twint.git cd twint pip3 install . -r requirements.txt
im facing a issue CRITICAL:root:twint.get:User:Cannot connect to host twitter.com:443 ssl:True [Connect call failed ('104.244.42.65', 443)] can you help on this?
Fantastic package! I've noticed though that when I want to scrape tweets starting from, say, 1 month ago, it finds much fewer tweets the farther back you go. For example, I searched for "covid" tweets around NYC in the past month and from the 35000 tweets it found, 30000 were for the past week and only 5000 where from earlier, which shouldn't be the case. Have you noticed a similar issue with finding old tweets?
Bonne vidéo, Je cherche à faire un bot qui est capable de trier des news/tweets importants en temps réel. Est-ce que je dois forcément passer par un bot twitter ou puis-je le faire avec cette méthode?
thanks for this video , i would like to ask you if it is possible with Twint to get Tweets from users who are between 16 and 26 years old and in a specific month for example in April 2021? if not is there any solution?
Thanks a lot Ahmed. I am using Windows so I have installed Git Bash and could git clone the twint using Git-Bash. But when trying the code on jupyter, I got error `AttributeError: module 'twint' has no attribute 'Config' . Although I tried these three lines with no problem at all : import twint import nest_asyncio nest_asyncio.apply() `
Strange. I reinstalled Twint on my machine and could call the Config attribute without any issue. Did you make sur the kernel that's running your jupyter notebook has the same version of Twint you installed?
all this data is available for each tweet once you load the output file in either csv or json. Plase have a look at the way I read the exported data in Jupyter
hey! I faced this error while importing nest_asyncio. ModuleNotFoundError Traceback (most recent call last) in 1 import twint ----> 2 import nest_asyncio 3 nest_asyncio.apply() ModuleNotFoundError: No module named 'nest_asyncio' can you please tell what is the issue?
@@AhmedBesbes Thank you so much for the response. I appreciate that. yes I am playing with them. I have a few questions. May I contact you in faster way? regards
@@AhmedBesbes git clone --depth=1 github.com/twintproject/twint.git cd twint pip3 install . -r requirements.txt I am installing it by using this code by after the first line Python returns me an error in particular below "clone" I get "syntax error". How can I fix it? I am using Visual Studio Code with Python 3.9.0, but I have tried to use as well as the Jupiter online platform.
Thank you so much for the informative video! Is there any way to use Twint with the user id instead of username? I can't figure it out for some reason. Getting errors like URL, or empty even though the user exists.
`AttributeError: module 'twint' has no attribute 'Config' --> I have no Idea what I am doing wrong I followed all of your steps. Deleted and desinatlled everything, installed anaconda from scratch, opened Juypter for the first time again, same problem
it seems its not working anymore in a consistent manner. idk if that's because a block from twitter but there are a lot of comments at twint project with the same issue.
Hey Ahmed, very helpful video. I am able to load all the tweets I want. However, when I want to see the head of the dataframe all the output is ‘NaN’ - not an number. I tried changing it to a string but it doesn’t work. Do you have any idea how I can solve this?
can execute this command from the terminal and tell what you get? head -n 3 ** this prints the three first rows. maybe there's something corrupt in the data.
Hi nice video, I am getting this problem while trying to save the data in json file "[Errno 2] No such file or directory: '../data/covid_demo_1.jason'" though i have typed all the commands as shown in the tutorial, if someone can help me it would be really greatful.
Yes, you can. By terminal something like: twint -g="48.880048,2.385939,1km". And on Python with .Geo or with .Near. Take a look at the wiki page: github.com/twintproject/twint/wiki/Configuration
@@AhmedBesbes twint critical:root:twint.run:twint:feed:nodataexpecting value: line 1 column 1 (char 0) It is working with me last year but now the msg above appears. So, I think maybe I change something. Because I tried to install it on another computer
Hi Ahmed, thank you for the clear presentation of this code! I am wondering whether it is possible to only scrape tweets by location and for a specific time period, for example tweets about 'covid' in the United States from July, 2021 until August, 2021. Do you have a solution for this? Thanks in advance.
Honestly i'm noob for this thing, but I've got the data cause your tutorial 😁, it's very helpfull👍 , but i can't move any further, i got some problem with the output script (c.Output =) . Could you tell me what is going on, please? i do exactly with what you do, but its doesn't work. What i miss? I'm running in jupyter with powershell prompt . Or is it just open with anaconda?
@@AhmedBesbes hy, thanks for the respond. i got more progress today actually. Now the problem is when i start run data = pd.read_json(. In the end output says the value eror: expected object or value.
Thanks. However, l am getting this Error RuntimeError: This event loop is already running Expecting value: line 1 column 1 (char 0) [x] run.Feed [!] if get this error but you know for sure that more tweets exist, please open an issue and we will investigate it! Kindly assist
everything works fine form ne but i got problem when i read the json file. i also write the parameter lines=true yet I'm still getting error. the tweets are there but error says," ValueError: Expected object or value" hope you could help me. thanks
Question: I installed twint by cloning the repo into my command prompt and everything installed ( after using pip list i see twint on my list of packages) however when i try to import it into my jupyter notebook , I'm seeing an error saying no "module named twint." Do i still need to install using pip on the jupyter notebook? Great tutorial btw!
hi, not sure if you are still facing this issue now since this is an old comment. but in case it helps anyone: i used the line below to directly install twint to my notebook, and it worked :) !pip install git+github.com/twintproject/twint.git
Hi Is it possible to check how many of the followers are having less then 5 followers using twint? Because ij twitter api i always exceed rate limit. Thanks. Edit: suppose an account has 100k followers so it it possible for me to do it? I'm waiting for your reply thanks. Great video and subscribed.
yes , for each of the followers you have to run the following command based on their usernames twint -u username --followers then you do a count and filter
@@AhmedBesbes wow Ahmed, this is super awesome. I'm glad i found your video. So one more question suppose a person has 15 million followers and I want to check how many of the followers are having less then 5 followers. Do you think will there be any limitations of doing this big amount of scrapping?
@@AhmedBesbes ok bro twint follower method is not working. Is there any alternative to extract thousands of followers because twitter api sucks and I'm working on my final year project in university.
Yesterday It was working fine but today facing the following issue: CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 1.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 1.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 8.0 secs
I used the following command: git clone --depth=1 github.com/twintproject/twint.git cd twint pip3 install . -r requirements.txt But it shows me this error: Usage: pip install [options] [package-index-options] ... pip install [options] -r [package-index-options] ... pip install [options] [-e] ... pip install [options] [-e] ... pip install [options] ... no such option: --depth And if I still continue with #configue and #run, I get this error: CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 1.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 8.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 27.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 64.0 secs CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0) sleeping for 125.0 secs Please help me to solve it
Hey i have been trying to extract 5 years of data on BSE500 but when i run the code it is only extracting data from past 10day and no more. any advice please.
Very Nice Ahmed, Just it is worth mentioning that is way is somehow illegal according to Twitter guidelines, for researchers who aims to mention data collection from Twitter, their papers could get Ethical comments if they reported not using the official Twitter API.
Keep posting such amazing things, Ahmed!
Unable to extract data using Twint. Error: No data expecting value. Could you please help
did you figure it out?
Thanks for the tutorial. Is it possible to gather all the tweets on a certain hashtag instead of setting n=1000 or a certain number? For example, If I want to collect all the historical tweets on a hashtag like ''climate change'', where should I make a change in the script?
I managed to scrape tweets after solving some issues
But the question here, how can I set a limit of retrieved tweets?
Hello,Would you mind if ask if you can demonstrate how to use a crawler to capture twitter space cations. If the audio file is very long (more than ten or twenty hours), how to quickly capture it?
getting this error when trying to install as instructed "ERROR: Directory '.' is not installable. Neither 'setup.py' nor 'pyproject.toml' found" both in Jupyter notebooks and Colab
Thank you very much Ahmed. May I ask a question? How to identify the date or time frame that I want to scrape? maybe 5-10 years period back.
got this error ..need ur help
module 'twint' has no attribute 'Config'
Thanks so much for posting this video Ahmed! Great job and very helpful!
Its working really good, thank you. How can we extract data from perticular region. Is the below correct ?
"c.g="48.880048,2.385939,1km" ?
i think this is imposable
how can i use location and keywords togather
????
Thanks for the A++ tutorial. I can execute a search via colab, the python shell, and vs code, but don't know how you ran it directly from the terminal. How did you do that?
Instablaster.
Hello, friend
How to Determine Whether Two Different People's Tweet Reactions Persons Match or not
when installing twint should i use command prompt
Merci bcp pour cet outils performant j avais un grand soucis pour collecter un dataset relatif à une thematique bien precise pour un cas d étude pour mon PFE. J essaie de remplacer tweepy avec cet API. Si j px vous contacter en cas de souci c est sur quel plateforme.
i got this error: CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0)
sleeping for 1.0 secs do you know how can i fix it?
is twint allow historical data to be scraped?
Thank you for the video. I seem to have limitation with the tweets extracted. I seem to get only 3000 tweets for #WFH. Can you help with what might be wrong?
Why do i have an error?
AttributeError: module 'twint' has no attribute 'Config'
I had the same Error, could you solve it?
@@lorenavalencia3431 Yes, I just used command string.
Check special command to use it
@@lorenavalencia3431 Check this video out. It helped me:
Mine Twitter for Targeted Information Using Twint [Tutorial]
@@ЕгорТкачев-н7я i still cant solve it, can you help me?
i want to confirm that i can safely collect data per month around 3200 tweets only right?
can the scraping results from github twin in excel form be used? Or need dor permission first?
hi, i have question, im using python 3.6 but im not allow to install jupyter notebook :/ do you know why? can u suggest me the solution ? thank you.
I am getting the following error
[!] No more data! Scraping will stop now. Can you please suggest how to resolve this
can you take tweets from certain date in twinch ?
Can I scrape Twitter data of a specific user profile using Twint?
Hi im still new with github, how do i clone the repo and install it locally?
How can I do boolean filter here
Just like in tweeter search bar "Nigeria" ("music" OR "musician" ) this will give all the values includes nigeria with music or nigeria with musician
I don't think that's possible. what you can do, however, is search tweets containing all these terms and then do additional post processing
@@AhmedBesbes I want to create an web application which daily refreshes whenever we make request and it gets the latest data containing nigeria and music and returns sentimental analysis in the visualization form. Any tips and hints
What if we need gender and age of each ID?
can we see private account's tweets also?
Hi, I get error ModuleNotFoundError Traceback (most recent call last)
in
----> 1 import twint
ModuleNotFoundError: No module named 'twint'
Hello, Ahmed! First of all, I will tell you that your video tutorial is amazingly easy, but as person who is not from IT industry, I'm in big trouble on following the guide.
I already downloaded jupyterlab notebook and tried to copy the repo, but still didn't work at all. Can you point out which things I did it wrong?
Hope you reply this soon since my final project is soon ended next week and I'm still in difficult on scrapping the Twitter data.
Hello
Have you installed twint as well?
if not, here are the commands:
git clone --depth=1 github.com/twintproject/twint.git
cd twint
pip3 install . -r requirements.txt
Hi
Is it possible to get the notification of some keywords matching ?
hello! I'm afraid no. you have to implement such a system yourself by designing a notification server.
does anybody have CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0)
sleeping for 125.0 secs?
Same problem here
Value error
Same error
same error
Same
Hi Ahmed, i try it and it works! but i think that the q of tweets that we are able to extract is capped. How can we loop it by date?
Thanks mate ..You have helped me in my project
You’re welcome!
im facing a issue
CRITICAL:root:twint.get:User:Cannot connect to host twitter.com:443 ssl:True [Connect call failed ('104.244.42.65', 443)]
can you help on this?
Fantastic package! I've noticed though that when I want to scrape tweets starting from, say, 1 month ago, it finds much fewer tweets the farther back you go. For example, I searched for "covid" tweets around NYC in the past month and from the 35000 tweets it found, 30000 were for the past week and only 5000 where from earlier, which shouldn't be the case. Have you noticed a similar issue with finding old tweets?
Interesting. I ve not noticed this issue to be honest. don’t hesitate to submit an issue on github
Bonne vidéo, Je cherche à faire un bot qui est capable de trier des news/tweets importants en temps réel. Est-ce que je dois forcément passer par un bot twitter ou puis-je le faire avec cette méthode?
Vous pouvez collecter les tweets avec cette méthode
Bien fait! C'est pas mon domaine mais j'avais une idée! Will have to come back to this but this is great!
Getting this error any idea to fix?
CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0)
sleeping for 1.0 secs
Same error I am also getting
Plz help some one
Great input, thanks!
Would like to ask, whether you get blocked using it too often/intense? Do you know how a proxy rotation would work?
from my experience, I did not face any blocking. I've used proxies so far.
@@AhmedBesbes how do you use the proxies? I don't get any response
Thank You So Much for the tutorial !
thanks for this video , i would like to ask you if it is possible with Twint to get Tweets from users who are between 16 and 26 years old and in a specific month for example in April 2021? if not is there any solution?
I don’t think this is possible : twitter will most likely don’t give access to such personal data
Thanks a lot Ahmed. I am using Windows so I have installed Git Bash and could git clone the twint using Git-Bash. But when trying the code on jupyter, I got error `AttributeError: module 'twint' has no attribute 'Config'
. Although I tried these three lines with no problem at all : import twint
import nest_asyncio
nest_asyncio.apply()
`
Strange. I reinstalled Twint on my machine and could call the Config attribute without any issue.
Did you make sur the kernel that's running your jupyter notebook has the same version of Twint you installed?
Update Tornado to latest version
Really great, Thanks a lot Ahmed. I just have a question. Can this tool also be used with Stocktwits?
Sorry I'm not familiar with Stockwits
how do I get tweets that must have two words in the same tweet?
config.search='first_word and second_word'
Very good library. I was using the Twitter API but the 250 request/month killed me. I can't believe Twitter charges $150 for 500 search per month.
i need tweets between 2019 to 2021 but " since and until" didnt work. kindly guide me or provide me code to scrape those tweets
me too
Hello ,i want to ask, in this case we got all data, how to get tweet data,username and created_at tweet only ?
all this data is available for each tweet once you load the output file in either csv or json.
Plase have a look at the way I read the exported data in Jupyter
Thank you for the tutorial. I wanted to ask, is there a way to automate the process of extracting tweets with TWINT?
yes absolutely. you'll have to schedule your scraper with a scheduler. if you're using a linux server, you have to look at crontab.
That is amazing. Really really appreciate
Thanks !
hey! I faced this error while importing nest_asyncio.
ModuleNotFoundError Traceback (most recent call last)
in
1 import twint
----> 2 import nest_asyncio
3 nest_asyncio.apply()
ModuleNotFoundError: No module named 'nest_asyncio'
can you please tell what is the issue?
you'll have to install it : pip install nest-asyncio
I have problems to use Twint with R R reticulate package :( do you know what is happening?
I have no experience using R, sorry :/
Thank you so much for the video. I had a question if I can extract data between two given dates with this method?
yes - you can specify the date range within the arguments of the script. You'll have to play with the *year* and *since* arguments
@@AhmedBesbes Thank you so much for the response. I appreciate that. yes I am playing with them. I have a few questions. May I contact you in faster way? regards
Very useful tutorial ! Keep going
will it let me download over 27K tweets?
I am having problems as well. I don't get any tweet. Is it possible to provide a step by step video including the proper installation?
it's working for me on Mac OS.
I installed twint by cloning the repo, not using pip.
@@AhmedBesbes git clone --depth=1 github.com/twintproject/twint.git
cd twint
pip3 install . -r requirements.txt
I am installing it by using this code by after the first line Python returns me an error in particular below "clone" I get "syntax error".
How can I fix it? I am using Visual Studio Code with Python 3.9.0, but I have tried to use as well as the Jupiter online platform.
@@grazianodicapua7380 Can you please print the full error message?
I have installed twint but the results when I run it it like this AttributeError Traceback (most recent call last)
Can you help me with it?
can you print the full error message?
Thank you so much for the informative video! Is there any way to use Twint with the user id instead of username? I can't figure it out for some reason. Getting errors like URL, or empty even though the user exists.
I don't think it's possible to search tweets by user id.
Tell me please, is this library working now?
I get an error like: CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0)
Make sur to install it using git. Clone the repo, then do pip install -r requirements.
I've just retried it now. it's still working. (MacOS)
Great Video. It was helpful, thanks.
You're welcome
`AttributeError: module 'twint' has no attribute 'Config' --> I have no Idea what I am doing wrong I followed all of your steps. Deleted and desinatlled everything, installed anaconda from scratch, opened Juypter for the first time again, same problem
it seems its not working anymore in a consistent manner. idk if that's because a block from twitter but there are a lot of comments at twint project with the same issue.
hello have you been able to resolve the issue?
@@devinaarnachellum yes actually, here: github.com/twintproject/twint/issues/1229
Hey Ahmed, very helpful video. I am able to load all the tweets I want. However, when I want to see the head of the dataframe all the output is ‘NaN’ - not an number. I tried changing it to a string but it doesn’t work. Do you have any idea how I can solve this?
can execute this command from the terminal and tell what you get?
head -n 3
** this prints the three first rows. maybe there's something corrupt in the data.
Hi nice video, I am getting this problem while trying to save the data in json file "[Errno 2] No such file or directory: '../data/covid_demo_1.jason'" though i have typed all the commands as shown in the tutorial, if someone can help me it would be really greatful.
Great tutorial. Thanks much!
you're welcome!
Is it possible to scrape a tweet by location?
Yes, you can. By terminal something like: twint -g="48.880048,2.385939,1km". And on Python with .Geo or with .Near. Take a look at the wiki page: github.com/twintproject/twint/wiki/Configuration
can i scrape emails from tweets with this method ??
you can apply a regex on top of the tweets you collect
It is amazing tools but could you please upload video how to install the required because I tried but still there’s error
What's the error you're facing?
@@AhmedBesbes twint critical:root:twint.run:twint:feed:nodataexpecting value: line 1 column 1 (char 0)
It is working with me last year but now the msg above appears. So, I think maybe I change something. Because I tried to install it on another computer
@@bdooali8287 ok. I tried installing it today. works fine
Hi Ahmed, thank you for the clear presentation of this code! I am wondering whether it is possible to only scrape tweets by location and for a specific time period, for example tweets about 'covid' in the United States from July, 2021 until August, 2021. Do you have a solution for this? Thanks in advance.
yes, it is possible , see the documentation of the twint
Honestly i'm noob for this thing, but I've got the data cause your tutorial 😁, it's very helpfull👍 , but i can't move any further, i got some problem with the output script (c.Output =) . Could you tell me what is going on, please? i do exactly with what you do, but its doesn't work. What i miss? I'm running in jupyter with powershell prompt . Or is it just open with anaconda?
could you give more details about your error?
@@AhmedBesbes hy, thanks for the respond. i got more progress today actually. Now the problem is when i start run data = pd.read_json(. In the end output says the value eror: expected object or value.
@@walangurban4796 try adding orient='records' in pd.read_json :
--> data = pd.read_json(, orient="records")
@@AhmedBesbes i was do your suggest. But the output still came up with the same error
@@walangurban4796 can you open the file with json instead of pandas ?
Thanks for the excellent presentation, you are life safer.
Is Twint blocked by Twitter now? That's what i am hearing
it's working for me on Mac OS.
I installed twint by cloning the repo, not using pip.
@@AhmedBesbes i have WIn 10. Do you think it will work?
@@charlesgross4893 it should normally work. try installing by cloning the repo (as explained in the readme)
@@charlesgross4893 i have Win 10 Pro and it was work. First of all, you must install twint on BASH.
@ Hello Huseyin. Can I contact you? If so, would you please give me your email address?
Awesome man, you saved my life but i have a question. Is it allowed yo do it according to twitter policies???? I hope you understand my question...
Thanks. However, l am getting this Error
RuntimeError: This event loop is already running
Expecting value: line 1 column 1 (char 0) [x] run.Feed
[!] if get this error but you know for sure that more tweets exist, please open an issue and we will investigate it!
Kindly assist
It’s frowned upon :)
everything works fine form ne but i got problem when i read the json file. i also write the parameter lines=true yet I'm still getting error. the tweets are there but error says," ValueError: Expected object or value" hope you could help me. thanks
What I usually do when the file seems corrupted, is opening it (if possible) with vscode and cleaning some trailings commas or brackets
@@AhmedBesbes thanks ^_^
Question: I installed twint by cloning the repo into my command prompt and everything installed ( after using pip list i see twint on my list of packages) however when i try to import it into my jupyter notebook , I'm seeing an error saying no "module named twint." Do i still need to install using pip on the jupyter notebook?
Great tutorial btw!
I'd say that your jupyter notebook is not using the same environment where you installed Twint.
hi, not sure if you are still facing this issue now since this is an old comment. but in case it helps anyone: i used the line below to directly install twint to my notebook, and it worked :)
!pip install git+github.com/twintproject/twint.git
@@shadowhawk5511 thanks that works!
Hi Is it possible to check how many of the followers are having less then 5 followers using twint? Because ij twitter api i always exceed rate limit. Thanks.
Edit: suppose an account has 100k followers so it it possible for me to do it? I'm waiting for your reply thanks. Great video and subscribed.
yes , for each of the followers you have to run the following command based on their usernames
twint -u username --followers
then you do a count and filter
@@AhmedBesbes wow Ahmed, this is super awesome. I'm glad i found your video. So one more question suppose a person has 15 million followers and I want to check how many of the followers are having less then 5 followers. Do you think will there be any limitations of doing this big amount of scrapping?
@@ai.201 I can't really tell you . I haven't scraped that amount of followers
@@AhmedBesbes ok, still thanks man.
@@AhmedBesbes ok bro twint follower method is not working. Is there any alternative to extract thousands of followers because twitter api sucks and I'm working on my final year project in university.
Thank you so so much!!
Yesterday It was working fine but today facing the following issue:
CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0)
sleeping for 1.0 secs
CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0)
sleeping for 1.0 secs
CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0)
sleeping for 8.0 secs
Please give the solution
im getting the same error as many many other users as well.
woow you are the best!
donnt what u re doing at 1:47
Twint is so powerful... it almost feels like an illegal script😂😂
How can I install twint in anaconda?? Thanks!!!
U can use anaconda prompt
Twint required python version 3.6
I used the following command:
git clone --depth=1 github.com/twintproject/twint.git
cd twint
pip3 install . -r requirements.txt
But it shows me this error:
Usage:
pip install [options] [package-index-options] ...
pip install [options] -r [package-index-options] ...
pip install [options] [-e] ...
pip install [options] [-e] ...
pip install [options] ...
no such option: --depth
And if I still continue with #configue and #run, I get this error:
CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0)
sleeping for 1.0 secs
CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0)
sleeping for 8.0 secs
CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0)
sleeping for 27.0 secs
CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0)
sleeping for 64.0 secs
CRITICAL:root:twint.run:Twint:Feed:noDataExpecting value: line 1 column 1 (char 0)
sleeping for 125.0 secs
Please help me to solve it
Nice explanation. Sometime Twint is not working
Make sure to install it properly by cloning the repo, not using pip install :)
nice!
Noice, can't wait to cancel more people using this tool!!!!!1!!! sksksksksk and i oop-
Shit. You didn't even show us how to install it.
i love trump cause i am gay!!!!
Hey i have been trying to extract 5 years of data on BSE500 but when i run the code it is only extracting data from past 10day and no more. any advice please.
I get the error Could not find the Guest token in HTML, how can I solve this?
and [!] No more data! Scraping will stop now.
found 0 deleted tweets in this search.
@@hibaqomar4656 same!! did you manage to get along?