Databricks for Beginners - Mount Azure DataLake in Databricks the correct way

Поделиться
HTML-код
  • Опубликовано: 4 окт 2024

Комментарии • 4

  • @meetezhilarasan
    @meetezhilarasan 17 дней назад

    Thx a lot for the video. Very informative.
    Question: I want to query from notebook the list of folders and files of Azure deltalake storage(i.e to see the delta files after a delta table is created). Can that be done? Can that be mounted?

    • @AthanasiouApostolos
      @AthanasiouApostolos  17 дней назад

      You can use %fs ls /mnt/../ to list all the files and folders and depending on the format of the files you query the data (whether it's delta, parquet, csv etc). You mount the top path of the container and then you navigate with %fs ls and query the nested files

    • @meetezhilarasan
      @meetezhilarasan 16 дней назад

      @@AthanasiouApostolos When a Databricks workspace is created an AzureGen2 Storage is getting created automtically with 'Deny Assignments' to 'All Principles'. Because of this I am not able to create a new app and give a read permission to that container (unity-catalog-storage). Are you able to see the individual files of the container (unity-catalog-storage) via Notebook/Azure-Storage-Explorer?