I heard about vaex for the first time in this video...I heard about dask...as mentioned please do the video on dask as well...Thank you Krish...for everything you are doing for community...
When the data is too large like 4GB, it saves it in chunks of hdf5 files. Any idea how to read these? Should we read one by one and concatenate them? Also, how to deal with object datatype when it comes to hdf5 files?
While converting a text file to hdf5 using VAEX, it will not maintain the same precision for each column as in text file, and I can not modify it. Please help me.
Hi Krish, I want to concatenate two CSV files I also want to edit a column value in each of the files before I concatenate. The file size of each file is about 200 MB with 1200 columns and 35000 rows. There are about 90 such pairs of csv files that I want to concatenate. Can this be done faster with Vaex than pandas? I did not see any improvement when I tried using dask. Thanks
This is close to madness. Wonderful library 👏
pro trick : you can watch series on flixzone. Been using them for watching all kinds of movies during the lockdown.
Vaex , first listen from your vedio sir , awsome sir , thanks sir to provide such usefull knowledge
I heard about vaex for the first time in this video...I heard about dask...as mentioned please do the video on dask as well...Thank you Krish...for everything you are doing for community...
Thanks Krish...u r my idol..to interest towards data science...just because of u...
Great explanation .Need to practice in Jupiter notebook.Thanks
waiting
Hi ! Can You Make One Video On Dask For Extracting 40gb+ dataset ?
Dear Krish Naik, I have tried to sorting data but I am getting error 'Hdf5MemoryMapped' object has no attribute 'sort_values'.
Can we further pass this data into model training.
Thanks Krish! What do you hate about this library? That you think could be possibly improve.
Will discuss while comparing with dask
Hi please create a detailed playlist on pyspark, thanks in advance
PLS TALK ABOUT IMP OF COMPETITVE PROGRAMMING!
Sir please complete docker remaining tutorials
Please sir ,why your book still not available in amazon..I really need to buy it ..thank you
When the data is too large like 4GB, it saves it in chunks of hdf5 files. Any idea how to read these? Should we read one by one and concatenate them?
Also, how to deal with object datatype when it comes to hdf5 files?
Hey! I have already installed Vaex successfully but when I try to convert the csv file it shows error that " No module named 'vaex.hdf5' ".
While converting a text file to hdf5 using VAEX, it will not maintain the same precision for each column as in text file, and I can not modify it. Please help me.
Pip install vaex does not work on my windows 10 computer (with python 3.8). It gives me errors. Any body else who had hard time to install Vaex ?
I get the error message as "numpy.core.multiarray failed to import" after running the first set of codes
For comparison, you could've used %time in each cell
Great!
👍😊 but why we have to install in virtual environment ?
Install in your base environment.
But I think that would fill up your C drive.
So it's better to do so in some other drive.
what is chunk_size meaning?
Hi Krish, I want to concatenate two CSV files I also want to edit a column value in each of the files before I concatenate. The file size of each file is about 200 MB with 1200 columns and 35000 rows. There are about 90 such pairs of csv files that I want to concatenate. Can this be done faster with Vaex than pandas? I did not see any improvement when I tried using dask. Thanks
shout out
sir, modin also... It makes pandas faster. Make a video on that.
Sir, This library does not import in colab.
I have the same problem in Jupiter Notebook windows 10 python 3.8. it gives me dependencies issues.
Will it read file from hadoop
But how can i drop column or row in veax Library
When will be next batch of Advance DL & NLP going to start ,since I want to join that batch.i am currently in ML Master course of ineuron.
It will be announced soon
It wont work with vectorization
how come it is possible ?
Could you do video on lux-api
Did anyone get error message as "numpy.core.multiarray failed to import" ? can someone help to solve this error?
Can we read file resides on remote desktop using vaex.open?
why is there no internship directly?
can it used to read 1M image dataset????
CAN SOMEBODY EXPLAIN PRE-PROCEESING & WHAT STEPS DOES IT INVLOLVE ??
sir please videos in hindi..
why you are vibrating??
It's the phone