How to Import (use) Kaggle datasets in Google Colab?

In this session, we can understand how do we import the Kaggle datasets into Colab.

[@akhilam2217]

Thanks for the tutorial but what if the chosen dataset doesn't contain the API command to copy into the colab..?

[@adnaneaboutalib5595]

Very Helpful ! Thank you !
Summary commands :
1- Install kaggle
!pip install kaggle
2- Upload you API token kaggle.json:
from google.colab import files
files.upload()
3- Create a directory kaggle , move the kaggle.json to kaggle directory , change permissions to the file :
!mkdir ~/.kaggle
!mv kaggle.json ~/.kaggle/
!chmod 600 ~/.kaggle/kaggle.json
4- Copy API command in dataset section in Kaggle , (ADD '!' at the first of the command)
Enjoy the ride as your data models take flight! 😍

[@ShriramVasudevan]

Thanks

[@goutamdas641]

Perfect tutorial for Kaggle--->Colab. Thank you

[@ShriramVasudevan]

Thanks and glad u found it useful

[@ms.mousoomibora9526]

I was struggling for this for quite a long time..Thank you very much for the video..it helps a lot for the new researcher in the DL field.

[@ShriramVasudevan]

Thanks and glad u liked it

[@shroukmohamed5664]

@@ShriramVasudevan
Could you help me?
I stopped at 7:55. I can't find this point in Kaggle.
I didn't find the file in the description could you send again

[@kalpanayadav1142]

Very efficient, helpful and easy to understand
Thank you!

[@ShriramVasudevan]

Thanks.

[@sidindian1982]

@@ShriramVasudevan Sir Word file , pls

[@MeMonarch]

For those who are starting in the updated Kaggle site. The API command might not be available on the "Data" card so what you have to do is click on 3 dots, right after the "Download" button on top right of your dataset. Once you click that you will see an option "Copy API command". Click that and you are good to go!

[@aegisds1094]

Very simple video, very nicely explained. The task which seemed impossible to me, you made it very simple. Jai Shriram

[@ShriramVasudevan]

Thanks brother

[@kinuthiasteve4505]

Shriram! This tutorial is undefeated. Thanks

[@durgaprasadmurapaka3965]

sir, but when i am creating a direc it shows you can not creat any direc, now what should i do for this

[@user-ub4db5bq4i]

Your tutorial is really so much helpful to me. It means a lot. Thanks for sharing such wonderful content to us

[@sukanya4498]

Crisp & Precise explanation, Thank you! 👌🙌

[@ShriramVasudevan]

Thanks sukanya .glad u liked

[@aadarshkumar2257]

Thank You so so much.
I can't explain how much irritated and lost i was feeling before watchin this video.
Now it's clear to me and i can explain to anyone else.
Once again Thanks a lot.....

[@honest_review2492]

Great work simple and to the point very basic steps are addressed which are not found in many videos.you have solved my big problem.thank you sir

[@ShriramVasudevan]

Glad it helped

[@onesaditya3689]

Such a clear and efficient explanation..!!
Thanks man..!!

[@ShriramVasudevan]

Glad it helped!

[@AllAboutBI]

Sir, you have made it simple. It is very useful for the beginners like.me

[@ShriramVasudevan]

Thanks

[@mwarnsle]

It appears Kaggle's interface has changed a bit already since January, and I'm at loss at where the command line for this dataset it...
Edit: never mind, found it(on side, 3 dots["copy API command"])!

[@ShriramVasudevan]

😀

[@himahimbimba1513]

thanks dude

[@vishnupriyasivaramanr5248]

thank you

[@arvinlukekottarathil3745]

Thanku brother🙏

[@shireenkhan2105]

Thank you so much sir.... U made me understand this method in such a easy way.🙏🏻

[@ShriramVasudevan]

Thanks

[@zooltechno7065]

after running command " ! kaggle competitions download -d 'name-of-dataset'"
it is generating
Error 403: forbidden

[@chittithotiakhila9280]

Hi sir thank you so much for this information
But while I am running the step 2 that is "*from google.colab import files
files.upload" I can't get "Choose Files" option in my laptop what I can do? and error raised it's shown

[@archanas8463]

Very nice explanation, easy to understand and where is the code in the description.? I couldn't find

[@jantojanistdio]

Thank you Sir. U save my life❤

[@bardandhakal7300]

colab tends to disconnect when not used for a longtime. Do we have to run all the commands and upload the api every single time the colab notebook disconnects?

[@mekkicharfi5454]

Thank you very much . And how to carry out the reverse process, that is to say convert a Colab application to Kaggle? That's what's important, because notebooks are not the same.

[@ngwemo]

Please do another one now setting it inside the Kaggle notebook itself any directions would be appreciated.

[@lee_badda]

Thank you so much sir! It is my first time participating on a competition in Kaggle

[@ShriramVasudevan]

Keep it up

[@unnimayanarayanan2503]

Very interesting... something very useful for beginners in coding

[@ShriramVasudevan]

Thanks

[@anandhuramesh3462]

chmod: cannot access '/root/.kaggle/kaggle.json': Not a director not getting this

[@sachindubey7560]

That's made my day. Thank you so much sir. Worked smoothly.
💙

[@ShriramVasudevan]

Glad u liked.

[@souradippaul7466]

Sir I have question, I was trying to create a kaggle directory, but I was unable to generate it. Could you please suggest me how I can generate it ?

[@CricketTube9905]

Couldn't download the dataset. i'm getting 403 - Forbidden as the output. can you please explain why?

[@joekanaan2548]

I'm getting the same thing

[@dharshiniravikumar6383]

Very nice session sir.
Thankyou for your detailed video.

[@ShriramVasudevan]

Thank you 🙏

[@archanaramesh9118]

It appears cannot create directory '/root/.kaggle ' : file exists
Help me sir what may be the reason???

[@JoshKonoff1]

What if the chosen dataset doesn't contain the API command to copy into the colab..?

[@abhishekpatil406]

Saved my day, 💕

[@ShriramVasudevan]

Thank u

[@plavali_znaem]

God bless you Shriram, brilliant!

[@ShriramVasudevan]

Thanks :)

[@ASUSPC-yh5cy]

Very Nice Sir ..Very Nice

[@iabdulwahablearning]

Thanks a lot for this helpful information...

[@imroze8840]

Thanks a lot sir, this is very helpful

[@chaitanyaravi4482]

Love this video
Thankyou so much Shriram garu

[@ShriramVasudevan]

Thanks brother

[@sagarpadhiyar3666]

Superb video. so so so much helpful. thank you

[@ShriramVasudevan]

So glad!

[@shahabasmuhammed7523]

Should we do all the steps again in other collab file to download another dataset or can we directly copy the API command and run it to download another set of data ?

[@eswaranbalamurugan8526]

Hi I am facing "403 forbidden"
How can i resolve. ? I tried !pip install kaggle --upgrade
and !pip install --upgrade --force-reinstall --no-deps kaggle.... Still same

[@eswaranbalamurugan8526]

@Watch you grow Thank you

[@sn__sn]

Thank you for your time, help me a lot!

[@ShriramVasudevan]

Thanks.

[@dheerajnalapatdheerajnalap8226]

what if the data set does not have the code needed for download

[@sachinmathew6809]

nice work sir !

[@narangfamily7668]

AWESOME! THANKS ❤

[@anissaa1017]

great tutorial, thank you!

[@ShriramVasudevan]

Thank you

[@jyothsnasarvadevabhatla1870]

Thank you. Well explained.

[@datacodedesign]

ut this is for a competition, what about normal datasets?

[@luisaraujo6824]

Thank you so much!! Very well explained👊

[@ShriramVasudevan]

Thanks and glad you like it

[@ngwemo]

Thanks for insights bro.
Notes for the commands , can't seem to find it. Will be great to have
😊

[@santhoshs8373]

Thank you so much!!

[@abdullahalfahad4634]

Thanks for the great session

[@ShriramVasudevan]

Thanks bro.

[@abhijeet6431]

I want to import great barrier reef (GBR) dataset into colab , GBR dataset has few folders of different types of data files like images ,videos, csv, apis , zip files .. I used your method but in my colab I am only able to see few 100 images but in dataset there are 23000 images, what should I do to get entire data in colab?

[@bharatns598]

for each seperate file we need to do this it is one time and we can create n no of new python files

[@musicalvlogs4418]

very helpful,thank you

[@ShriramVasudevan]

Glad u liked

[@arjavjain8338]

I'm getting the problem while using this dataset. I'm getting this error "403 - Forbidden - You must accept this competition's rules before you'll be able to download files.". How to solve this problems anyone can tell to me

[@jasdeo5652]

Hello Sir, I got this message for the last command to get data in collab Kernel log downloaded to /path/to/dest/eda-to-prediction-dietanic.log instead of data in the file folder. can you tell me why so

[@Wurfenkopf]

Thank you very much for the explanation... Actually, I came here for a problem that's probably trivial with respect to all this, but I couldn't solve it.
In a Kaggle code I found the initial instruction:
from shutil import copyfile
copyfile(src = "../input/lrp-scripts/utils.py", dst = "../working/utils.py")
For sure I have to update those paths, but how can I do it?
Thank you very much!

[@lisandrodelfino5106]

Excuse me Mr Vasudevan.
Any chance you could share that word with the step by step in the description of this video?
Thanks!

[@lisandrodelfino5106]

You know what? Never mind.
Following your tutorial works just fine. Thanks

[@mohanks7144]

thank u sir. very much needed and useful

[@ShriramVasudevan]

Thanks and glad u liked

[@MahmoudSheliel--]

perfect video thank you

[@vishalisharma3883]

i am not able to see my dataset when i try to get it from kaggle

[@krishnapisudde9593]

great work sir

[@ShriramVasudevan]

Thanks

[@asinusmurtareed4038]

thank you so much. it's really working!!!!!

[@ShriramVasudevan]

Glad 😊

[@onnm1981]

Thanks a lot, it helped me a lot !!

[@ShriramVasudevan]

Glad.

[@biggusmaximus1651]

Great video sir, from tamil

[@ShriramVasudevan]

Thanks

[@atulsain6170]

Thanks. That was very helpful. If I had watched it 1 day ago, it would save from wasting 2 gb data and a day of headache. 😄

[@ShriramVasudevan]

Thanks..

[@est.camilo.ballest5941]

excelent video!

[@sakthi1192]

I have copied the API and pasted it in the code section. After execution, kernel log downloaded to '.log'. Like this, it is showing. Sir, please comment how to solve this?

[@tonihullzer1611]

thanks man, very helpful, have a nice day:)

[@ShriramVasudevan]

Thanks brother

[@mahrokhebrahimi6863]

perfect, thanks for the explanation

[@ShriramVasudevan]

Glad u liked

[@angelferhati]

You deserve more credit

[@ShriramVasudevan]

Thanks brother

[@user-tl1gr1ic1q]

love you!

[@abdulrahmanalsaka1345]

after unzipping the folders how could i import this to be used in my model?

[@techforall9859]

This is so useful!

[@ShriramVasudevan]

Thanks

[@user-zl8bl3ui1s]

what happens if the process doesn´t code successfully

[@liyasimon7742]

Thank you so much for this great tutorial, You tell that to paste the commands in the description box, I could not get it. I got some errors in it please paste the commands if you can.

[@ShriramVasudevan]

Let me check

[@mohitchouksey6707]

@@ShriramVasudevan please make code file available

[@IsraelMolina1997]

Thanks so much!

[@ShriramVasudevan]

You're welcome!

[@dmoriasi]

Perfect!! Thank you!

[@ShriramVasudevan]

You're welcome!

[@faizanrana9049]

how much data set can we upload my data set is 42GB is it work for me

[@saurabhk6004]

do we have to use ( ! ) this before importing datasets

[@NadinMagdy]

Why can I not find an API command for datasets, only competitions? I want to use a dataset

[@keremdogan5792]

Same here. Any advice or solution?

[@FuriaKKK]

@@keremdogan5792 ! kaggle datasets download [UserName/DatasetName]

[@paroleoleon9654]

Man, thank you very much!

[@ShriramVasudevan]

Thanks

[@jatinmor4216]

very helpful video brother

[@ShriramVasudevan]

Glad u liked

[@jatinmor4216]

@@ShriramVasudevan bro could you please tell how to give path of that downloaded file ...I want to build a model of gender recognition with the help of cv2 but I am unable to give the path so that I can read every image of that folder

[@Kashish-hw9gd]

Do i have to go through all these steps everytime i want to import datasets from kaggle in colab ?? or just doing it for one time is enough for using datasets

[@iitianritesh5961]

In every new sheet, you have to do again

[@robharris3269]

Any suggestions for : 401 - Unauthorized

[@aravindvalsarajan3284]

thank you sir!

[@ShriramVasudevan]

Welcome brother

[@AshishKumar-qt1rk]

Sir can you tell me "How can I unzip the CSV files downloaded when the .zip file is not present"

[@daktilo_]

you are amazing thank you very much

[@ShriramVasudevan]

Thanks

[@prasadshiva8075]

while creating folder i am getting msg like mkdir: cannot create directory ‘/root/’: File exists. please suggest sir

[@ShriramVasudevan]

Create it in the /home

[@pratibhagoudar6817]

thankful to u sir .. .. it's helps

[@ShriramVasudevan]

Glad.

[@monalisabanra2733]

cp: cannot create regular file '/root/.kaggle/': Not a directory its showing this what should I do?

[@dattanidumukkala8178]

Cannot stat kaggle.json no such file or directory

[@lakshmikanthagc607]

Hello Sir, very helpful video you have done. Can you share that word document ?

[@greeshmaaeligeti6179]

7:56 im getting 403 forbidden for this statement
!kaggle competitions download - dogs-vs-cats-redux-kernels-edition
please help me out

[@zeshn100]

really helpful

[@Rahul_Singh_Rajput_04]

sir , please also show us how to submit data in kaggle through google colab

[@RajeshYadav-xw7tn]

Could you please provide the installation step guide that is used in video .

[@raghus8535]

Thank you sir, appreciate it

[@ShriramVasudevan]

Thanks