End to End Spark Architecture : What is spark core , Pyspark RDD.

Поделиться
HTML-код
  • Опубликовано: 15 янв 2025

Комментарии • 31

  • @inbaraj206
    @inbaraj206 Месяц назад +1

    Very well explained

  • @krishnachaitanyareddy2781
    @krishnachaitanyareddy2781 Год назад +1

    excellent video. thanks for sharing sir

  • @Ayaz786ayaz
    @Ayaz786ayaz Год назад +2

    Amazingly Explained..!!!

  • @KhaleequrRahman15
    @KhaleequrRahman15 11 месяцев назад +1

    explication belle, claire, concise et nette. Merci frère

  • @CRT26
    @CRT26 5 месяцев назад

    Good explanation about spark core. Thanks 👍🏻

  • @SrikanthReddyMaddi
    @SrikanthReddyMaddi 2 года назад +1

    Thanks for the spark videos

  • @swtannie19
    @swtannie19 Год назад +2

    Thank you so much for the explanation. You have explained in so much detail and with so much clarity. This will definitely help everyone.

  • @srinivasreddyd1069
    @srinivasreddyd1069 2 года назад +1

    Nice explanation Bro..Thanks for sharing

    • @TRRaveendra
      @TRRaveendra  2 года назад

      Thank you 👍

    • @dataengineerazure2983
      @dataengineerazure2983 2 года назад

      @@TRRaveendra Thank you very much! Can you share with us the documents in pdf or word? Thank you.

  • @yogeshrunthla9350
    @yogeshrunthla9350 Год назад +1

    loved it!

  • @shreyasbugad4086
    @shreyasbugad4086 Год назад +1

    Thank You Sir, Your Explanation is Fabulous...
    🙏

  • @sandhyavenkat8342
    @sandhyavenkat8342 Год назад +1

    Clear explanation. Thankyou!!

  • @dolla_shrey
    @dolla_shrey Год назад +1

    THANKYOU SIR , THIS WAS WHAT I NEEDED

  • @007fanvinoth
    @007fanvinoth Год назад

    Thanks

  • @syam-t3f
    @syam-t3f 8 месяцев назад

    thanks brother its really helped for beginner's

  • @SumanAmara
    @SumanAmara Год назад +1

    Thanks you sir very nice explained... Please share any live session to meeting 🤝

  • @suryateja5323
    @suryateja5323 Год назад +1

    Helped my interview .thanks ❤

  • @MANGESH_AHIRE
    @MANGESH_AHIRE 8 месяцев назад

    If we have 4 cores then 8 task can run in parallel right ?

  • @azhar1618
    @azhar1618 Год назад

    I have 1 question, at 6:25 you have mentioned 1core = 2vcPU, But at 43:00 You mentioned 4core = 4vCPU means 1core = 1vCPU. Can you please clear that for me. Thanks

    • @TRRaveendra
      @TRRaveendra  Год назад

      if it is onpremises 1 core = 2 Vcpu
      if it is cloud everything is Vcpu. if it is showing as 1 cpu means 1vcpu in cloud.
      And note: some cores can have 1 Thread and come cores can have 2 threads. just check intel documentation. u will get more clarity

    • @bharathraj4545
      @bharathraj4545 Год назад

      @@TRRaveendra THANKS

    • @pavanm9169
      @pavanm9169 Год назад

      core vs vCPU depends on 2 factors.(for VMs)
      1) Hyper-Threading support of CPU
      2) Virtualization Platform
      ex : for Quad-core CPU
      scenario - CPU supports Hyper-Threading and you are using modern Virtualization Platform (e.g., VMware, VirtualBox, Hyper-V, KVM) then
      No of cores - 4
      No of threads - 4*2 = 8 (Hyper threading means 1 Core = 2 Threads)
      No of Vcpus - 1 per each thread - so total 8
      Scenario - CPU supports Hyper-Threading or you are a Virtualization Platform that does not support Hyper-Threading (could n't find examples) then
      No of cores - 4
      No of threads - 4*1 = 4
      No of Vcpus - 4

  • @s.211
    @s.211 Год назад

    Hi can you please please make video of spark executor memory calculation in depth

  • @ravisamal3533
    @ravisamal3533 Год назад

    but why to create an rdd

  • @someshmanda405
    @someshmanda405 Год назад

    I am from US having 25 years exp. New to spark. Excellent session. Only question is what is databricks to do with spark here? Also is there a tutorial explain various topics within databricks (hive, spark, cluster, et...) Thank you

    • @bermagot9238
      @bermagot9238 Год назад

      Spark is the underlying distributed computing system that Databricks runs on top of