Hats off to you Johnny! Such a well explained video. Explanation was on point. Your videos are great help for beginners like me. Thank U. New subscriber!!
Great tutorial John, thank you for your effort! Gonna start working on my work project with AWS Spark and Athena from next week on. Can you suggest any tutorials or documentation for intermediate AWS sql?
1) Are we allowed to use managed table, which should be preferred Managed or external? Also, in case of Managed table on deletion of the table will Athena be allowed to delete the data from the S3 location which was loaded by another service ? 2) what is the relation between Athena, Hive and Presto?
Hi Vivek, 1) yes you can use governed tables with Athena. I don’t think it will delete the data if you drop the table as that would go against the general principles of working in these types of environments, but it should be double checked. 2) The high level answer is that Athena uses the presto engine to execute queries. And presto is a big data query engine. Hive is another type of big data query engine. However, the Hive meta store is a slightly different thing - and is a place where meta data such as table definitions are stored (I.e. the glue data catalog).
Hi Johnny, we love your video's, big thanks from South Africa! Quick question, we are currently landing all our data in S3 then crawling it to create or add to tales in our catalog. But your video got me wondering: Would it be easier to just write SQL queries in Athena to do this instead of crawlers? Because we find crawlers a bit of a "black box" (and does not work correctly all the time), Doing this in SQL seems like a much cleaner solution. Whats your thoughts on this ? Much appreciated . Jaco
Hi Jaco, yes I’ve managed table creation before using SQL statements via Athena to move away from crawlers. The only draw back is that if you add a column at a later date you either need to drop ecreate the table (and re add partitions if you are using them)…. Or write an alter table statement but to recreate the table from scratch you then need to multiple scripts. I’ve also used cloud formation to create tables as well.
Hi Jaco, yes I’ve managed table creation before using SQL statements via Athena to move away from crawlers. The only draw back is that if you add a column at a later date you either need to drop ecreate the table (and re add partitions if you are using them)…. Or write an alter table statement but to recreate the table from scratch you then need to multiple scripts. I’ve also used cloud formation to create tables as well.
Hey there, glad to meet again. I learned about timestamp as a date data type. My question is, if i where to record timestamps of every record entered into the database. Would the sql server generate two identical timestamps given the records where run simultaneously..is that case a hypothetical one or would it happen? Thanks for taking care of this.
Can we restrict specific commands in Athena for users. I mean commands like INSERT, DROP TABLE or DROP DATABASE are not allowed to be accessed by everyone. Do we have this command level security in Athena ?
How to use listagg in Aws athena ? For example the following code in SQL LISTAGG(column1,’,’)with in group(order by column1) over (partition by column2,column3) ? Can you please help me
I need a query in athena that i have 100 no of columns in my table. In that table i need to pic 99 columns except 1 column. Is there any possible to get data without mention 99 columns name in the query..?
![Apache Iceberg on AWS with S3 and Athena [FULL COURSE IN 30MIN]](http://i.ytimg.com/vi/iGvj1gjbwl0/mqdefault.jpg)
![Apache Iceberg on AWS with S3 and Athena [FULL COURSE IN 30MIN]](/img/tr.png)
![PySpark For AWS Glue Tutorial [FULL COURSE in 100min]](http://i.ytimg.com/vi/DICsZiwuHJo/mqdefault.jpg)
![AWS Glue Tutorial for Beginners [NEW 2024 - FULL COURSE]](http://i.ytimg.com/vi/ZvJSaioPYyo/mqdefault.jpg)
Your channel is where I go for all things AWS. Thank you for doing this for us!
Thanks for watching buddy!
Hats off to you Johnny! Such a well explained video. Explanation was on point. Your videos are great help for beginners like me. Thank U. New subscriber!!
Best channel ever, thank you so much 🤩🤩. From Paris ☺️
Thanks for watching buddy!
Love the explanations and the examples. +1
Great tutorial John, thank you for your effort! Gonna start working on my work project with AWS Spark and Athena from next week on. Can you suggest any tutorials or documentation for intermediate AWS sql?
Hi Johnny, great content. I wish you a lot of success. Can you please make a video on Redshift SQL as well.
Clear and detailed , Thank you !
Love you mate!!!
1) Are we allowed to use managed table, which should be preferred Managed or external? Also, in case of Managed table on deletion of the table will Athena be allowed to delete the data from the S3 location which was loaded by another service ?
2) what is the relation between Athena, Hive and Presto?
Hi Vivek,
1) yes you can use governed tables with Athena. I don’t think it will delete the data if you drop the table as that would go against the general principles of working in these types of environments, but it should be double checked.
2) The high level answer is that Athena uses the presto engine to execute queries. And presto is a big data query engine. Hive is another type of big data query engine. However, the Hive meta store is a slightly different thing - and is a place where meta data such as table definitions are stored (I.e. the glue data catalog).
Hi Johnny, we love your video's, big thanks from South Africa!
Quick question, we are currently landing all our data in S3 then crawling it to create or add to tales in our catalog. But your video got me wondering: Would it be easier to just write SQL queries in Athena to do this instead of crawlers? Because we find crawlers a bit of a "black box" (and does not work correctly all the time), Doing this in SQL seems like a much cleaner solution. Whats your thoughts on this ?
Much appreciated . Jaco
Hi Jaco, yes I’ve managed table creation before using SQL statements via Athena to move away from crawlers. The only draw back is that if you add a column at a later date you either need to drop
ecreate the table (and re add partitions if you are using them)…. Or write an alter table statement but to recreate the table from scratch you then need to multiple scripts. I’ve also used cloud formation to create tables as well.
Hi Jaco, yes I’ve managed table creation before using SQL statements via Athena to move away from crawlers. The only draw back is that if you add a column at a later date you either need to drop
ecreate the table (and re add partitions if you are using them)…. Or write an alter table statement but to recreate the table from scratch you then need to multiple scripts. I’ve also used cloud formation to create tables as well.
bro u help me alot with AWS u r 🥳
Thanks for watching!
Hey there, glad to meet again.
I learned about timestamp as a date data type.
My question is, if i where to record timestamps of every record entered into the database. Would the sql server generate two identical timestamps given the records where run simultaneously..is that case a hypothetical one or would it happen?
Thanks for taking care of this.
1) is creating data catalog (database and tables) essential for Athena & S3 interaction?
2) does creating data catalog in glue has pricing?
Your GitHub create table for Customers has a typo for firstname attribute. It says fistname. Other than that flawless execution of queries.
Exelente..... Para cuando los de EC2?
Can we restrict specific commands in Athena for users. I mean commands like INSERT, DROP TABLE or DROP DATABASE are not allowed to be accessed by everyone. Do we have this command level security in Athena ?
can you do a Case when?
How to use listagg in Aws athena ?
For example the following code in SQL
LISTAGG(column1,’,’)with in group(order by column1) over (partition by column2,column3) ?
Can you please help me
I need a query in athena that i have 100 no of columns in my table. In that table i need to pic 99 columns except 1 column. Is there any possible to get data without mention 99 columns name in the query..?
Have you got ans?
Hey 1 quick question, is there a way to use kms managed encrypted data in athena?
Yes it supports both s3 and client side encryption through KMS.
what is the point in making tNice tutorialngs on the channel rack when you have a soft roll?