All about partitions in spark

Поделиться
HTML-код
  • Опубликовано: 7 сен 2024
  • All about partitions in spark
    - Input Partitions
    - Output partitions
    - Shuffle partitions

Комментарии • 7

  •  8 месяцев назад

    Thats great work!! , Thank you

  • @sandippatel6999
    @sandippatel6999 Год назад +1

    Good Explanation 👍

  • @narayanankm4298
    @narayanankm4298 Год назад +2

    good session. Can also add tutorial for bucketing ?

  • @9292suresh
    @9292suresh Год назад +1

    Each task acts on each core and each partition is assigned to a core , not executors . Is this correct ?

  • @TotuBabyBird
    @TotuBabyBird Год назад +1

    😍

  • @evreddy461
    @evreddy461 Год назад

    Can we avoid shuffle partition when input partition is opted for wide transformation like join operation 8:52

  • @BishalKarki-pe8hs
    @BishalKarki-pe8hs 3 месяца назад

    this is not excatly asnwer