Can we also do compute intensive aggregation on Athena? SQL functions. ? Also can i use Athena to schedule data transforms and send it to glue catalog and from there to rds?
Yes you can. Group bys etc are support as are common table expressions. You can use Athena to do transforms, same way you would run SQL code in a database to do ETL. One thing I would say about both use cases above is that it can get expensive. It’s $5 per TB of data scanned.
Yes, but it’s not the nicest solution. AWS recommend using a lambda function to run the Athena query and you can schedule the lambda using a trigger/cloud watch. I’ll grab the link and post below.
![Apache Iceberg on AWS with S3 and Athena [FULL COURSE IN 30MIN]](http://i.ytimg.com/vi/iGvj1gjbwl0/mqdefault.jpg)
![AWS Glue Tutorial for Beginners [FULL COURSE in 45 mins]](http://i.ytimg.com/vi/dQnRP6X8QAU/mqdefault.jpg)
Why has the youtube algorithm not highlighted these videos. Absolutely first rate!
Thanks for watching troy.
Excellent video - to the point. Greetings from Switzerland!
Thanks for watching!
Can we also do compute intensive aggregation on Athena? SQL functions. ?
Also can i use Athena to schedule data transforms and send it to glue catalog and from there to rds?
Yes you can. Group bys etc are support as are common table expressions.
You can use Athena to do transforms, same way you would run SQL code in a database to do ETL.
One thing I would say about both use cases above is that it can get expensive. It’s $5 per TB of data scanned.
@@JohnnyChivers also schedule? If so how?
Yes, but it’s not the nicest solution. AWS recommend using a lambda function to run the Athena query and you can schedule the lambda using a trigger/cloud watch. I’ll grab the link and post below.
aws.amazon.com/premiumsupport/knowledge-center/schedule-query-athena/