Intro to Amazon EMR Toolkit

Поделиться
HTML-код
  • Опубликовано: 10 дек 2024

Комментарии • 11

  • @tysong9883
    @tysong9883 6 месяцев назад

    Hi Dacort, I can’t finish the “Reopen in Container” step, as after it downloads the docker image, an error pops up saying “yum doesn’t have enough cache data to continue” at step “RUN yum install -y sudo && “Hadoop ALL=(ALL) NOPASSWD:ALL”..
    Wondering if you might know any reason behind? Thank you so much!

  • @sahilbhatia2014
    @sahilbhatia2014 2 года назад +1

    Hi Decort. Thank you for the video but somehow I am unable to connect this with my aws account as we use the SSO (single Sing On) authentication. But I am able to connect via AWS toolkit using the 'aws configure sso' command. Could you please help what can I do in this case?

  • @atoz12325
    @atoz12325 2 года назад

    Thanks for the video Dacort..Please share how to connect my own S3 from Docker container. I try to add AWS keys in docker file as ARG. but it did not worked after rebuild the container. Please advise..

  • @panchao
    @panchao Год назад

    Thanks for creating this nice tool. In the Glue catalog view, can we also see the partition keys of a table?

    • @dacort
      @dacort  Год назад

      Unfortunately not yet!

  • @itzikpaz6796
    @itzikpaz6796 Год назад

    Hi, thanks for the great video 😊
    I am searching for an article or any direction to build a development pipeline on top of emr-eks from local/dev to production.

    • @dacort
      @dacort  Год назад

      Sorry for the delay - this article here is for CI/CD with EMR Serverless, but could be adapted to EMR on EKS fairly easily.

  • @arjunshah6594
    @arjunshah6594 2 года назад

    This is great Damon. Just a quick question. Does this need a connection to AWS similar to the AWS Toolkit in Visual Studio? Somehow even after having AWS local profile and the necessary permissions, the explorers does not load

    • @dacort
      @dacort  2 года назад

      It's not quite as robust as the AWS Toolkit authentication. It just uses the default profile from your environment. Do you get an error message or is there just nothing showing up? As long as you can run "aws emr list-clusters" or "aws emr-serverless list-applications" from your terminal, it should work in VS Code. There is also an "EMR: Select AWS Region" command to change regions.

    • @arjunshah6594
      @arjunshah6594 2 года назад +1

      @@dacort That's great. So the terminal commands used to work but not load up the explorer. But selecting the EMR:Select AWS Region solved the issue and now I can see all the explorers populated. Thank you so much. This is great :)

    • @dacort
      @dacort  2 года назад

      @@arjunshah6594 WOO HOO! Awesome. :) Thanks for giving it a try!