I've watched parts of this three times over the last couple of days. I just now started it from the beginning by accident and realized I had to pay my respects. I chuckled when I heard Mr. Shah say, 'I'm going to get started now'. He may as well have said fasten your seat belts. I'd already spent a week getting my data read into Glue and ETL'd with a lot of lessons learned the hard way before I stopped and watched this video. I found this to be a brilliant talk. I am grateful for the breadth and depth of insight into the intentions of Glue and the fields (spark, dynamic data structures, and more) in which is plays. Glue has the functions I need to move our data into play for Athena, QuickSite and SageMaker. It's gonna hurt, but I can dump a lot of low level python code I wrote, and with the dev endpoint use pycharm at a higher level of abstraction. Has anyone written anything in Jetbrains's MPS for Glue? - Thank you Mr. Shah for Glue and this great overview.
How to do incremental loading while reading the data from database? Is there a way to create a filter on date while reading from source database? Thank you!
Can you please explain user defined function api given in AWS glue api document, because once I created one function by api call(createUserDefinedFunction()), it is not showing in AWS glue catalog
I've watched parts of this three times over the last couple of days. I just now started it from the beginning by accident and realized I had to pay my respects. I chuckled when I heard Mr. Shah say, 'I'm going to get started now'. He may as well have said fasten your seat belts. I'd already spent a week getting my data read into Glue and ETL'd with a lot of lessons learned the hard way before I stopped and watched this video. I found this to be a brilliant talk. I am grateful for the breadth and depth of insight into the intentions of Glue and the fields (spark, dynamic data structures, and more) in which is plays. Glue has the functions I need to move our data into play for Athena, QuickSite and SageMaker. It's gonna hurt, but I can dump a lot of low level python code I wrote, and with the dev endpoint use pycharm at a higher level of abstraction. Has anyone written anything in Jetbrains's MPS for Glue? - Thank you Mr. Shah for Glue and this great overview.
How to do incremental loading while reading the data from database? Is there a way to create a filter on date while reading from source database? Thank you!
Can you please explain user defined function api given in AWS glue api document, because once I created one function by api call(createUserDefinedFunction()), it is not showing in AWS glue catalog
11:40 it's not really that hard to build a schema detecting tool, i did it with an intern in a day or two at my company.
Yup correct amount of sampling and a sound logic backed by experience should usually do it.
11:05 Epic !! My left and your left too.. Really ! :p
?
We really don't need to speaker throughout the entire presentation :P It would be helpful if the slides were full screen so the text is legible.
Stop watching them on your smartphone screen and cast it on your smart TV
Lazy fuck, use a computer or a Smart TV not your phone when in bed.
no one wants to see the background screen and the speaker. slides are very small
No they are not. Are you watching this on your mobile, or what?
I would rather the speaker give some demos instead of keeping talking...
What are you talking about. @16:35, is this not a demo???
Mehul did a great job explaining how Glue works, what more do you want? A full Udemy course?
The guy coughing so annoying
The second guy was painful to listen to.
Terrible speaker - that's all. He may be great as his job and leading a team, but not everyone is cut out to speak in front of large audiences.