I know its a bit late to comment on this given Synapse has evolved and so has Databricks . Nevertheless worth every second . Really comprehensive overview . Thank you for this great work Simon.
What a great video - really well put. Any chance of a rematch factoring in where we are now in 2022. Seriously though, when you work in an environment where your management don’t fully understand the technology and get swept away with the latest buzz words, it’s hard to keep their feet on the ground. I now feel more empowered to push back when appropriate. You’re a natural speaker and clearly very passionate about what you do. Cheers.
Hey! As this is from our last event Simon covered all things about 2022 updates at our most recent event (SQLBits), it's an event in the Uk that hosts all the data professionals and shares brand NEW updates and releases.
I don't have access to synapse at work yet but we've had access to databricks for a bit. My current thinking is to keep using databricks for spark, but to use synapse for the pipelines and the sql pools. Synapse also has powerbi integration and the pipelines can run databricks notebooks. The other question for me will be to see what works better to serve a Tableau report between synapse sql pools or sql endpoints in databricks. For small tables on very specific queries I'm thinking synapse might work well with its indexes. I've tried using zordering and bloom filters in Databricks but these don't seem to help much with relatively small data where each hive partition only has one file of about 100mb.
Hi @alexis ,can you please help with the azure databricks transformations.please let me know most used azure databricks realtime transformations by you
Brilliant stuff - the best introduction to Databricks and comparison to Synapse that I have ever seen. Thank you Simon!, looking forward to more videos from this channel.
Excellent comparison! I just wonder why in price comparison Synapse Spark Pools went with 2 instances vs 3 Databricks instances? What is more Databricks has job cluster, which are created for the given job and terminated after completing, and these clusters are much much cheaper :) 40:33
Great video! Have you considered making an update, now that Syapse is GA? Meanwhile it has R, it scales and what not. Also an updated cost comparison would be nice.
I know its a bit late to comment on this given Synapse has evolved and so has Databricks . Nevertheless worth every second . Really comprehensive overview . Thank you for this great work Simon.
It's easy to integrate both azure synapse and azure data bricks so instead of using spark pools in synapse you can use data bricks for azure
What a great video - really well put. Any chance of a rematch factoring in where we are now in 2022. Seriously though, when you work in an environment where your management don’t fully understand the technology and get swept away with the latest buzz words, it’s hard to keep their feet on the ground. I now feel more empowered to push back when appropriate. You’re a natural speaker and clearly very passionate about what you do. Cheers.
Hey! As this is from our last event Simon covered all things about 2022 updates at our most recent event (SQLBits), it's an event in the Uk that hosts all the data professionals and shares brand NEW updates and releases.
I don't have access to synapse at work yet but we've had access to databricks for a bit. My current thinking is to keep using databricks for spark, but to use synapse for the pipelines and the sql pools. Synapse also has powerbi integration and the pipelines can run databricks notebooks.
The other question for me will be to see what works better to serve a Tableau report between synapse sql pools or sql endpoints in databricks.
For small tables on very specific queries I'm thinking synapse might work well with its indexes. I've tried using zordering and bloom filters in Databricks but these don't seem to help much with relatively small data where each hive partition only has one file of about 100mb.
Hi @alexis ,can you please help with the azure databricks transformations.please let me know most used azure databricks realtime transformations by you
Brilliant stuff - the best introduction to Databricks and comparison to Synapse that I have ever seen. Thank you Simon!, looking forward to more videos from this channel.
Your distributed compute explanation is crystal clear thx
Really great content, hard to find such in depth comparison, respect and keep it up!
Excellent comparison! I just wonder why in price comparison Synapse Spark Pools went with 2 instances vs 3 Databricks instances? What is more Databricks has job cluster, which are created for the given job and terminated after completing, and these clusters are much much cheaper :) 40:33
excellent overview & comparison, thanks for that insights!
Excellent video - so much information packed in and very well presented!
Great video! Have you considered making an update, now that Syapse is GA? Meanwhile it has R, it scales and what not. Also an updated cost comparison would be nice.
Hey, if you reach out to the speakers on LinkedIn/Twitter i'm sure they'll be able to answer any questions you may have!
Another fantastic overview. Thank you so much
Glad you enjoyed it!
Great video, interesting stuff indeed, thanks
I thought synapse analytics including spark went GA on 3rd Dec 2020 am I incorrect? I'm confused that you videos is only a month old?
This is a replay from a session around September last year - I'd take the info with a pinch of salt as it's nearly a year out of date now :)
What has improve is Synapse?
Great comparison!
Do a showdown between Databricks and Snowflake.
Great videoo👏🏻
Wow - fab video!
Thanks so much!