What is Spark, RDD, DataFrames, Spark Vs Hadoop? Spark Architecture, Lifecycle with simple Example

Поделиться
HTML-код
  • Опубликовано: 20 дек 2024

Комментарии • 55

  • @martynaskir7852
    @martynaskir7852 7 лет назад +1

    Most useful video about spark I have seen so far, very informative. In short time covers all main idea of it. Much appreciated.

  • @cs.beauty.debasis
    @cs.beauty.debasis 6 лет назад

    @5:06 graphX, it's graphical(visualization) or graph related algorithms (storing, querying etc.)

  • @kevinzhang8974
    @kevinzhang8974 7 лет назад +4

    very clear and simple explained .... thanks!

    • @TechPrimers
      @TechPrimers  7 лет назад

      my pleasure kevin. Glad that was useful

  • @ted2101977854
    @ted2101977854 6 лет назад +2

    Very nice! More videos plz.

  • @rajeshhize
    @rajeshhize 6 лет назад +3

    How can Spark replace Hadoop man? Did Spark have its own File System? . I think you are wrong about it. Spark always added advantage to Hadoop, its not a replacement.

    • @shakthivelcr7
      @shakthivelcr7 2 года назад

      youre right

    • @shakthivelcr7
      @shakthivelcr7 2 года назад

      I think he meant -> instead of using mapreduce on data present in hdfs, we use spark context and RDDs

  • @dhivyaraj85
    @dhivyaraj85 6 лет назад +2

    Thank you. Great explanation. Appreciate the effort.

  • @aashishpundir3019
    @aashishpundir3019 6 лет назад +1

    Content explaination and presentation is very nice.... Easy to get it..

  • @atmiksoni5859
    @atmiksoni5859 2 года назад

    Pease create series of apache spark

  • @UmaPinninti94
    @UmaPinninti94 7 лет назад

    Can I do some action on data as part of map function??
    Something like reading data from s3 and training a model using that data.
    sparkcontext.parallelize([[file1, file2], [file3, file4]]).map(function)
    here fuction will take s3 file objects as input and it will use that data to train a model and save that model to s3.

  • @ereshthekbr7659
    @ereshthekbr7659 7 лет назад +1

    could you define what is a cluster computing and how it works in spark ??

    • @TechPrimers
      @TechPrimers  7 лет назад

      Sure Eresh.

    • @harjeetkumar9087
      @harjeetkumar9087 6 лет назад

      Cluster computing is generic concept... spark is one implementation of this... hadoop is another etc... ruclips.net/video/ZirbI1355B8/видео.html

  • @rishabh1671
    @rishabh1671 7 лет назад +1

    Hi Sir, thank u for your good explanation. I want to know what all things i need to know before i start Spark because I am working as java developer with 1 year exp. and I have done work on front end like Angular , Bootstrap , J query , XSLT < HTML etc and web services like REST web services , Servlet , Spring MVC etc . So please provide guideline how to start learning spark because I want to learn this technology.

    • @TrackMyPhones
      @TrackMyPhones 7 лет назад

      Unix and Scala is enough to start with Spark.

  • @rishisharma3910
    @rishisharma3910 7 лет назад +1

    Very nice explanation

  • @randeepjohar5585
    @randeepjohar5585 6 лет назад +2

    Great video,wonderful presentation and to the point ,that's what everyone needs.Thanks a lot

    • @TechPrimers
      @TechPrimers  6 лет назад +1

      Thanks Randeep. Glad that was helpful

  • @kiraneranki5295
    @kiraneranki5295 7 лет назад +3

    Hello bro,
    Your explanation is flawless and amazing. Even though i knew spark, your video was well edited and crisp to the point. Will look forward for more videos from you.
    Thanks.

    • @TechPrimers
      @TechPrimers  7 лет назад

      +kiran eranki thanks Kiran. Glad you liked it..

    • @harjeetkumar9087
      @harjeetkumar9087 6 лет назад

      Here are some more videos ruclips.net/video/ZirbI1355B8/видео.html

  • @ajaysamdyan
    @ajaysamdyan 5 лет назад +1

    very well explain spark
    please explain mlib and pyspark as well

  • @anjaiahseggam8703
    @anjaiahseggam8703 7 лет назад +4

    hi friend your explanation is super ...

    • @TechPrimers
      @TechPrimers  7 лет назад

      +Anjaiah Seggam thank you Anjaiah

    • @harjeetkumar9087
      @harjeetkumar9087 6 лет назад

      Here are some spark interview questions, if you are intrested
      ruclips.net/video/ZirbI1355B8/видео.html

  • @prashanthr130482
    @prashanthr130482 4 года назад

    what s the difference between dataframes and dataset.. you didnt say pls

  • @aneksingh4496
    @aneksingh4496 4 года назад

    just like you created compilation of playlists for spring , do u have for spark ?

  • @emanmoussa673
    @emanmoussa673 7 лет назад +1

    Thank you very much! This is very helpful

    • @TechPrimers
      @TechPrimers  7 лет назад

      +Eman Moussa Thank you Eman. Glad it helped you

  • @RohitLad
    @RohitLad 7 лет назад +1

    Really Nice ... Thanks ...

  • @mutturajds2675
    @mutturajds2675 5 лет назад +2

    Still the session could have been better, no explanation on dataframes even still the video title has.

  • @paramitamukherjee2162
    @paramitamukherjee2162 6 лет назад +1

    Very nice

  • @MultiRamboss
    @MultiRamboss 6 лет назад +1

    Best for a beginner like me

    • @harjeetkumar9087
      @harjeetkumar9087 6 лет назад

      Hi, here are some spark interview questions . ruclips.net/video/ZirbI1355B8/видео.html

  • @ddhanigond
    @ddhanigond 7 лет назад +1

    Simple and good

    • @TechPrimers
      @TechPrimers  7 лет назад

      +Deepak Dhanigond thanks Deepak. Glad you liked it

  • @sachinarora6111
    @sachinarora6111 7 лет назад

    thanks a lot, waiting for loading with java part.

  • @akshaynangude2601
    @akshaynangude2601 5 лет назад

    What is something like that.....

  • @avinash7003
    @avinash7003 Год назад

    why ppl tell scala is more powerful than python in streaming sense?

  • @cogoden
    @cogoden 6 лет назад +2

    you have saved me :)

  • @hitenraheja4972
    @hitenraheja4972 7 лет назад +2

    Thanks alot!!!

    • @TechPrimers
      @TechPrimers  7 лет назад

      Thanks Hiten. Glad that was useful

  • @no_more_free_nicks
    @no_more_free_nicks 6 лет назад

    DRR are depricated.

  • @MisterKhash
    @MisterKhash 5 лет назад +1

    I don't undertand