Thanks for sharing. Your channel has been very helpful. :) Quick ask ? Do we have any option to query old data incase we encounter change in message format. i.e. column rename, addition/deletion of a column. This will keep only latest column in catalogue schema and fail to query old data having old column name.
Not possible out of box because crawler will recognize schema change and create new version. The query has no option to select a schema version. There could be custom solution to create new table when schema changes but it would be complex to create.
Great video, I did the same on option "crawl all folders" but it is not again crawling the folders it already crawled. Simply saying it is also working as "crawl new folders only" . Am I making any mistakes ? Please advise
![AWS Glue Tutorial for Beginners [FULL COURSE in 45 mins]](http://i.ytimg.com/vi/dQnRP6X8QAU/mqdefault.jpg)
Thanks for sharing. Your channel has been very helpful. :)
Quick ask ? Do we have any option to query old data incase we encounter change in message format. i.e. column rename, addition/deletion of a column. This will keep only latest column in catalogue schema and fail to query old data having old column name.
Not possible out of box because crawler will recognize schema change and create new version. The query has no option to select a schema version. There could be custom solution to create new table when schema changes but it would be complex to create.
Great video, I did the same on option "crawl all folders" but it is not again crawling the folders it already crawled. Simply saying it is also working as "crawl new folders only" . Am I making any mistakes ? Please advise