Synapse Analytics - Querying Delta Lake with Serverless SQL Pools

Поделиться
HTML-код
  • Опубликовано: 24 окт 2024

Комментарии • 17

  • @drummerboi4eva
    @drummerboi4eva 2 года назад

    nice video, clearly explains the value of serverless sql pools

  • @EngineerNick
    @EngineerNick 2 года назад +1

    Thankyou for the video :) I was super excited to try this feature, but turns out you cant do time travel queries from the SQL serverless ;( For me that really makes me question if delta is worth the extra complexity in synapse.

  • @ManishSingh-if9nj
    @ManishSingh-if9nj 2 года назад +2

    Hi Pal ..Thanks for such a informative video ..We are using serverless pool in Synapse platform ..Cost was one of the reason to choose serverless pool ..Now realizing it has got lot of limitation .1 Dynamic data masking not possible with serverless 2. all prebuild DMV you cant run on serverless ..3. Can't run script to do Workload Management ..Do you have any suggestion ..

    • @sashankpappu2773
      @sashankpappu2773 2 года назад

      That should be controlled and not be to considered beyond silver zone . This way we ignore those columns by being exposed

  • @madhur6504
    @madhur6504 3 года назад

    Hi Simon,Could you please advise if we should configure gateway when we are loading data from azure synapse (in cloud)

    • @lukasu-ski4325
      @lukasu-ski4325 2 года назад

      gateway between what? Synapse and ...? If you have an ADLS then just create a linked service.

  • @darryll127
    @darryll127 3 года назад

    How is this working or going to work with the Unity Catalog instead of reading from the Lake w/o it?
    Is the answer Delta Sharing? Or something else?

    • @AdvancingAnalytics
      @AdvancingAnalytics  3 года назад +1

      Hey Darryll! No sight yet of how Synapse will be able to integrate with Unity Catalog, Delta sharing could be an option, further things with Purview might be, fairly up in the air right now!
      Si

  • @bolisettysunil
    @bolisettysunil 3 года назад

    Hi @Simon - I have question, do you know if querying Delta Lake files using Synapse Analytics serverless sql pool is supported ?

    • @lukasu-ski4325
      @lukasu-ski4325 2 года назад

      Isn't it what he shows in the video?

  • @crazybauns
    @crazybauns 3 года назад

    hi Simon,
    can we use delta tables as source for SSAS?
    i want to build a tabular model but cant connect to delta tables
    Can this be done?

    • @lukasu-ski4325
      @lukasu-ski4325 2 года назад

      Maybe you could create views or external tables using Synapse serverless and build AAS on top of it? It wouldn't be so expensive I suppose.

  • @colinrippey1723
    @colinrippey1723 3 года назад

    Hi Simon, want to say again all of your videos are brilliant!
    Do you know if Synapse will add support for Delta ZOrdering and/or bloomfilter indexes? If Synapse does add support do you think that SQL On Demand will also make use of these additional Delta on disk artifacts?

  • @msr_atpeace
    @msr_atpeace 2 года назад

    hi simon , could you please explain about the creation of delta table / files which is generated from delta files by applying some sql over it.

  • @AndreasBergstedt
    @AndreasBergstedt 3 года назад +1

    1st again :)