AWS re:Invent 2017: Building Serverless ETL Pipelines with AWS Glue (ABD315)

Поделиться
HTML-код
  • Опубликовано: 8 янв 2025

Комментарии • 18

  • @MichaelYinger_Beginner
    @MichaelYinger_Beginner 6 лет назад +1

    I've watched parts of this three times over the last couple of days. I just now started it from the beginning by accident and realized I had to pay my respects. I chuckled when I heard Mr. Shah say, 'I'm going to get started now'. He may as well have said fasten your seat belts. I'd already spent a week getting my data read into Glue and ETL'd with a lot of lessons learned the hard way before I stopped and watched this video. I found this to be a brilliant talk. I am grateful for the breadth and depth of insight into the intentions of Glue and the fields (spark, dynamic data structures, and more) in which is plays. Glue has the functions I need to move our data into play for Athena, QuickSite and SageMaker. It's gonna hurt, but I can dump a lot of low level python code I wrote, and with the dev endpoint use pycharm at a higher level of abstraction. Has anyone written anything in Jetbrains's MPS for Glue? - Thank you Mr. Shah for Glue and this great overview.

  • @varunsood8509
    @varunsood8509 6 лет назад

    How to do incremental loading while reading the data from database? Is there a way to create a filter on date while reading from source database? Thank you!

  • @priyaranjandebata2090
    @priyaranjandebata2090 5 лет назад

    Can you please explain user defined function api given in AWS glue api document, because once I created one function by api call(createUserDefinedFunction()), it is not showing in AWS glue catalog

  • @greyreynyn
    @greyreynyn 4 года назад +1

    11:40 it's not really that hard to build a schema detecting tool, i did it with an intern in a day or two at my company.

    • @TheUMESH34
      @TheUMESH34 4 года назад

      Yup correct amount of sampling and a sound logic backed by experience should usually do it.

  • @samiahmadkhan2865
    @samiahmadkhan2865 6 лет назад +1

    11:05 Epic !! My left and your left too.. Really ! :p

  • @KristianOye
    @KristianOye 6 лет назад +1

    We really don't need to speaker throughout the entire presentation :P It would be helpful if the slides were full screen so the text is legible.

    • @VikramSingh-vo6io
      @VikramSingh-vo6io 6 лет назад +1

      Stop watching them on your smartphone screen and cast it on your smart TV

    • @bbuggediffy
      @bbuggediffy 5 лет назад

      Lazy fuck, use a computer or a Smart TV not your phone when in bed.

  • @My-ToolKit
    @My-ToolKit 6 лет назад +1

    no one wants to see the background screen and the speaker. slides are very small

    • @bbuggediffy
      @bbuggediffy 5 лет назад +1

      No they are not. Are you watching this on your mobile, or what?

  • @turboFalcon777
    @turboFalcon777 6 лет назад +3

    I would rather the speaker give some demos instead of keeping talking...

    • @bbuggediffy
      @bbuggediffy 5 лет назад

      What are you talking about. @16:35, is this not a demo???

    • @peekguyy3194
      @peekguyy3194 5 лет назад

      Mehul did a great job explaining how Glue works, what more do you want? A full Udemy course?

  • @Buddhax1982
    @Buddhax1982 3 года назад

    The guy coughing so annoying

  • @peekguyy3194
    @peekguyy3194 5 лет назад

    The second guy was painful to listen to.

    • @vos72
      @vos72 5 лет назад

      Terrible speaker - that's all. He may be great as his job and leading a team, but not everyone is cut out to speak in front of large audiences.