Machine Learning using Apache Spark - Overview (Spark ML)

[@biku1998]

Your explanations without using any buzz words and without leaving anything as a Black box makes it very easy to consume. Waiting for the hands on...

[@AIEngineeringLife]

Thanks Sourabh.. Hands on in couple of days..

[@ijeffking]

I am thoroughly enjoying your videos. The process of edification is on. Thank you so much.

[@mohamedhanifansari9224]

Amazing introduction to Spark. Thanks so much!!

[@kadhirn4792]

Thank you! Appreciate, for making it as a free service.

[@bharathpreetham2840]

useful information.thakns for making good content

[@gururajangovindan7766]

Very Precise and concise video!!

[@AIEngineeringLife]

Thanks Gururajan

[@Azureandfabricmastery]

Thanks. Informative.

[@user-or7ji5hv8y]

Is the benefit of using pipeline from Spark the fact that you can do it faster especially for data from multiple sources?

[@gayatrisubramanian9513]

Good one! Simple and to-the-point explanation for beginners. I have a question. Is it possible to write our own transformers (o estimators) in Spark? Appreciate if you can throw more light on it. Thanks.

[@AIEngineeringLife]

Thanks Gayatri... Yes you can write custom transformers by extending org.apache.spark.ml.Transformer in scala or
pyspark.ml.pipeline.Transformer in python

[@manohar_marri]

Apart from the traditional Machine Learning algorithms, can we run Deep Learning models as well on top of Spark?.. Do we have the support for Deep Learning estimators ?

[@AIEngineeringLife]

Manohar we can run tensorflow on Spark by adding dependency to spark. Databricks has support for tensorframes

[@gurumhase2198]

What is the spark playlist video sequence ?

[@AIEngineeringLife]

Data Engineering followed by ML in this playlist - ruclips.net/p/PL3N9eeOlCrP5PfpYrP6YxMNtt5Hw27ZlO

[@uskhan7353]

Kindly share the link of these slides as well.

[@AIEngineeringLife]

Will try to put it on slide share in couple of weeks

[@sgrsgr5663]

@@AIEngineeringLife Kindly share the link of these slides.