Data Factory Tutorial - How to create your first pipeline

Поделиться
HTML-код
  • Опубликовано: 16 окт 2024
  • НаукаНаука

Комментарии • 14

  • @abdulbaqui2363
    @abdulbaqui2363 2 года назад +5

    Please Upload more videos regarding Azure and Data Engineering tasks

    • @BeardedDevData
      @BeardedDevData  2 года назад +1

      Hi Abdul, many more coming over the next couple of weeks.

  • @boysenberrytoast
    @boysenberrytoast 11 месяцев назад

    Thank you so much for putting this together! My final project for one of my classes is to build a data pipeline and this made way more sense than any of the microsoft learn articles did. You did an amazing job, please continue making videos!!! :)

    • @BeardedDevData
      @BeardedDevData  11 месяцев назад +1

      Thanks so much, that means a lot, I do plan to return soon, early next year at the latest.

  • @DB-ml4ew
    @DB-ml4ew Месяц назад

    Hi BeardedDev,
    Many thanks for this video. It's my first one, I'm only starting with Azure multiverse - via your videos.
    I see some difference in the functions available nowadays, I guess they have changed in the last couple of years...
    Most of it is not so important, of course.
    However, I did get desperately stuck at the step of authentication when connecting to SQL server on my SSMS [Error 18456].
    After trying all possible trouble-shooting hints all over the internet, I (purely accidentally) discovered that my authentication method shuld be 'Entra MFI'.
    I was logged into my Azure account with my usual Microsoft account credentials...probably for that reason [how bad is this idea, btw?].
    As far, as I understand, this whole Entra thing is new and slightly differs from the previous options.
    This might be worse some update on this video in the future or might be just useful info for some other viewers. 🙃
    Once I overcame my authentication challenge, the rest went very smoothely - cause your video is really good! Thank you!!!

    • @BeardedDevData
      @BeardedDevData  Месяц назад

      Hi, a lot does change now at rapid pace in the cloud, UIs can change quite frequently. Entra used to be Active Directory, that's always best practice, the reason I use SQL Server Authentication which is still supported is because I'm working on a personal subscription, I don't have Entra setup but great call its something I should call out. Great work on starting with Azure, it's lots of fun.

  • @alno1
    @alno1 2 года назад +1

    Very interesting topic! Would love to know more about data pipelines. Is there a way to reach out if we have a career specific question? Thanks!

    • @BeardedDevData
      @BeardedDevData  2 года назад

      Sure, you can contact me at askbeardeddev@gmail.com.

  • @idoreshef9291
    @idoreshef9291 Год назад +1

    is there a way to set the username and password of the sql server through the azure sql ui ? and then just use those credentials to login through data factory without using sql server manager ?

    • @BeardedDevData
      @BeardedDevData  Год назад

      As far as I know can set only set Server Admin or Active Directory Admin when creating but you wouldn't want to use these. Don't have to use SSMS, can do it on the Azure portal on query editor, although I haven't tried this or Azure Data Studio or PowerShell.

    • @idoreshef9291
      @idoreshef9291 Год назад +1

      @@BeardedDevData I was thinking maybe if my transform in the pipeline is a python script i can use the mysql.connector to connect to the database through the script and query it but i am not sure if it will work but by my logic it should. you have any thoughts ?

    • @BeardedDevData
      @BeardedDevData  Год назад

      That sounds fine as your describing it, as you will be connecting to the database through the connector, Data Factory doesn't need to have access, it's only role would be to execute the script, let me know how it goes.

    • @houstonvanhoy7767
      @houstonvanhoy7767 Год назад

      @@BeardedDevData
      You mention PowerShell. Do you have any videos on that topic?

  • @aissaelmagharibia228
    @aissaelmagharibia228 2 года назад +1

    مفهمتش برايماري كي