The best alternative to Airflow!? Mage.ai

Поделиться
HTML-код
  • Опубликовано: 17 ноя 2024

Комментарии • 40

  • @EMBrown801
    @EMBrown801 Год назад +3

    I've been using mage for about a week now. I'm blown away. It is so well thought out. Love how easy it is to get setup. Also the community has been great. Tommy is very responsive and helpful!

  • @coekush
    @coekush Год назад +10

    wow, truly an eye-opener! It seems like a powerful alternative to Apache Airflow. Thanks for all you do, and keep the insights coming. Cheers! 🚀🙌

    • @andreaskayy
      @andreaskayy  Год назад +3

      Thanks! It's a really interesting tool

  • @DANG3R0USS
    @DANG3R0USS Год назад +6

    This is such an awesome overview!!! Thank you so much for sharing!

  • @mage_ai
    @mage_ai Год назад +4

    Amazing video! Thank you so much for this overview!!

  • @gabrielpreciado5699
    @gabrielpreciado5699 Год назад +3

    Thank god for an airflow replacement. Even, data factory is better than airflow, we needed an open source alternative

    • @andreaskayy
      @andreaskayy  Год назад +2

      My feeling is that we will see a lot of movement on the tools front over the next years. Demand is constantly growing

  • @deenuy
    @deenuy Год назад +3

    That’s awesome! Can you talk about Kubernetes and scalability in detailed session?

  • @vittoriopolverino1889
    @vittoriopolverino1889 Год назад +3

    I'd like to see and better understand more on what the potential of this tool are if you want to use CDC or manage streaming pipelines

    • @andreaskayy
      @andreaskayy  Год назад +4

      I'll ask Tommy the CEO. I'll have him on my live show tomorrow

  • @MuhammadAsif-k4v2p
    @MuhammadAsif-k4v2p 11 месяцев назад +1

    Author! Let me know plz...
    Can I add "Data Exporter" block after "Data Transformer" using trial account. I am not been able to find any way to add that after transformer.
    However If I wish to add only "Data Exporter" block with out any upstream then I can do that without any problem.

  • @DATAcated
    @DATAcated Год назад +1

    Really cool video Andreas!

  • @andrewchang6954
    @andrewchang6954 Год назад +1

    If I have multiple projects, how do I go to a specific project I want to resume working on?

  • @sitrakaforler8696
    @sitrakaforler8696 Год назад +2

    DAM ! it's...; wow it's a great vidéo !
    I'll try it !
    Bravo for being so clear

    • @andreaskayy
      @andreaskayy  Год назад +2

      Thanks! Let me know if you know something you want me to review

  • @bakalula
    @bakalula Год назад +1

    hmmm... but how to setup a visualization of multiple pipelines... because 1 is dependant on the other.... still trying to find out

  • @mdmoniruzzaman703
    @mdmoniruzzaman703 Год назад +1

    Hi, Thanks for this great video. Are we bound to code in their default UI?

  • @AmantisAnalytics
    @AmantisAnalytics Год назад +1

    Great video. Thank you for sharing. Overall do you prefer Mage or Airflow?

    • @tommydang7682
      @tommydang7682 7 месяцев назад

      Depends on what you prefer. Mage’s top 3 design principles are: Easy developer experience, Engineering best practices built-in, Data is a first-class citizen.
      So in Mage, it works only with data and so it comes with a lot of native features that support data operations and passing data between blocks.

  • @tosinadekunle646
    @tosinadekunle646 6 месяцев назад

    Thank you for the video Mr Andreas, please can we do spark jobs in the transformation connector?
    Thanks.

  • @ryan7ait
    @ryan7ait 8 месяцев назад +1

    can i deploy it on a dedicated server?

  • @vijayrangan
    @vijayrangan 4 месяца назад

    Do you have rough estimates on how much a single pipeline costs to run on AWS, say?

  • @al-aminalvi5819
    @al-aminalvi5819 Год назад +1

    My Transformer takes eternity to run! Really would appreciate some advice!

    • @andreaskayy
      @andreaskayy  Год назад

      Get in touch with the guys at Mage.ai. They have a discord server where they 100% can help you :)

  • @tiago5a
    @tiago5a Год назад +1

    is there any data catalog that integrate with Mage?

    • @tommydang7682
      @tommydang7682 7 месяцев назад

      Not yet, but that’s on the roadmap to integrate with DataHub.

  • @gavinkalaher7314
    @gavinkalaher7314 Год назад +4

    I did add a comment, but it was auto-deleted by RUclips Andreas 🙁

    • @andreaskayy
      @andreaskayy  Год назад +5

      I actually saw that there were 4 comments, but I couldn't find it. Now I know why. Super annoying!

    • @gavinkalaher7314
      @gavinkalaher7314 Год назад +3

      @@andreaskayy detected as potential spam I think! Oh well.

  • @MikeOnlineable
    @MikeOnlineable 11 месяцев назад

    Hi All, what do you think about the adoption of Mage in the professional environment so far? I have been following for a while and to my feeling the real growth in user bases seems a bit lacking.

    • @tommydang7682
      @tommydang7682 7 месяцев назад

      How do you measure that?
      Stats as of March 2023:
      6.9k+ GitHub stars
      16.5k+ LinkedIn followers
      5.2k+ community Slack members
      1.5M+ Docker downloads
      33k+ developers using Mage
      17.2M+ runs
      1k+ companies using Mage in production

  • @TheNaive
    @TheNaive 8 месяцев назад +1

    Doesn't it support node, bun

    • @tommydang7682
      @tommydang7682 7 месяцев назад

      Not yet, but TypeScript blocks will be supported soon.

  • @neeraj_dama
    @neeraj_dama Год назад

    influencer should clearly mentioned if the streams are sponsored or not

    • @andreaskayy
      @andreaskayy  Год назад +2

      Did, there is a clear notification in the beginning. I marked that on RUclips. I also only do partnerships with companies who create products I like. This here is a prime example for that

    • @duanemilne8049
      @duanemilne8049 Год назад

      @@andreaskayy can you please clarify if this is sponsored? Being asked isn’t the same as being sponsored. Mage looks great, regardless of sponsorship or not.

    • @duanemilne8049
      @duanemilne8049 Год назад +1

      Ok, I see the “Includes paid…” banner popping up at beginning now, thanks.

  • @thedataguygeorge
    @thedataguygeorge 6 месяцев назад

    Bruh why'd you steal my thumbnail?