Good one! Simple and to-the-point explanation for beginners. I have a question. Is it possible to write our own transformers (o estimators) in Spark? Appreciate if you can throw more light on it. Thanks.
Thanks Gayatri... Yes you can write custom transformers by extending org.apache.spark.ml.Transformer in scala or pyspark.ml.pipeline.Transformer in python
Apart from the traditional Machine Learning algorithms, can we run Deep Learning models as well on top of Spark?.. Do we have the support for Deep Learning estimators ?
Your explanations without using any buzz words and without leaving anything as a Black box makes it very easy to consume. Waiting for the hands on...
Thanks Sourabh.. Hands on in couple of days..
I am thoroughly enjoying your videos. The process of edification is on. Thank you so much.
Amazing introduction to Spark. Thanks so much!!
Thank you! Appreciate, for making it as a free service.
useful information.thakns for making good content
Very Precise and concise video!!
Thanks Gururajan
Thanks. Informative.
Is the benefit of using pipeline from Spark the fact that you can do it faster especially for data from multiple sources?
Good one! Simple and to-the-point explanation for beginners. I have a question. Is it possible to write our own transformers (o estimators) in Spark? Appreciate if you can throw more light on it. Thanks.
Thanks Gayatri... Yes you can write custom transformers by extending org.apache.spark.ml.Transformer in scala or
pyspark.ml.pipeline.Transformer in python
Apart from the traditional Machine Learning algorithms, can we run Deep Learning models as well on top of Spark?.. Do we have the support for Deep Learning estimators ?
Manohar we can run tensorflow on Spark by adding dependency to spark. Databricks has support for tensorframes
What is the spark playlist video sequence ?
Data Engineering followed by ML in this playlist - ruclips.net/p/PL3N9eeOlCrP5PfpYrP6YxMNtt5Hw27ZlO
Kindly share the link of these slides as well.
Will try to put it on slide share in couple of weeks
@@AIEngineeringLife Kindly share the link of these slides.