The way you aligned your explanation with the snowflake environment is simply outstanding. Its just go wit the flow, so easy to understand & grasp. Simply superb. Keep doing the good work.
here in the final customer_data_table there are 100 records are these 100 came from combination of 3 stage file (or) are the 100 records repeated over the 3 stage files
Suppose if we are using Unix server and Windows server and if we need to process files from those servers we have to use internal stages only(mostly named internal stage). No you can't sftp files to internal stage directly, we have to use put command for that purpose..
@@mrjana520 Thank you for your quick reply. We are trying to integrate Mulesoft with Snowflake in streaming mode with no file or any third-party system in between. Is it possible?, your suggestions are highly appreciable, thanks.
First of without knowing what are all the concepts available in Snowflake why are you implementing them in real time.. Go through any videos available on snowflake, learn and implement. For the things I have explained clearly I can answer these questions. For now you can use Snowpipe for that streaming data loads
Thanks for the excellent videos. Is there a way to put / upload files into table stage or user stage using Snowsight? Due to some error I cannot use snowsql in my macbook.
Hello sir, I am able to run the queries in SnowSQL but when I tried to copy the put command with my file path then while trying to paste it in snowSQL then its not pasting !.. I had to write 'put file://' manually. Can you please let me know why copy & paste is not working in snowSQL for put command..
That may be dependent on the system, windows you are using. I always suggest people never copy paste, pls type the queries, so that you will get hands-on..
Hii Sir, I have tried too many times to connect through CMD, But i am getting this below error. Anything else need to be done please let me know 250001 (n/a): Could not connect to Snowflake backend after 2 attempt(s).Aborting If the error message is unclear, enable logging using -o log_level=DEBUG and see the log to find out the cause. Contact support for further help.
please try to post data (ex customer_data_table.csv)which you have used as well , when we are trying with different data set we are facing many errors and not able to proceed further
Hi It is not possible to share all the files to so many people every day, that is why I have uploaded complete course to Udemy and sharing that for just 500 rupees. You can get all snowflake Videos, PPTs, Queries, Interview questions and Practice files in my Udemy course for 499 rupees.. I will be updating this content and will be uploading all new videos in this course. And you will have lifelong access to these videos and materials. My Snowflake Udemy Course: www.udemy.com/course/snowflake-complete-course-for-clearing-interviews/?couponCode=0C8E557D4EB94D407F5A Use the coupon below to get it for 499 rupees. Coupon: 0C8E557D4EB94D407F5A
sir here in table stage you have given customer_data_table into customer_data_table stage am I correct. I mean here the customer_data_table is the file that we are uploading into the table stage please correct my view.
@@mrjana520 In user stage I was getting error because space is not taking in path but there was space in my user name. but now I am getting error in Table stage Shivani#COMPUTE_WH@PRACSTAGE.STAGEPRAC>put file://C:\Users\Public\simple.json @%simple; 002003 (02000): SQL compilation error: Stage 'PRACSTAGE.STAGEPRAC."%SIMPLE"' does not exist or not authorized.
sir put is giving an error that file doesn't exists in User Staging, Is it because I have spaces in my file path If you dont mind this is the error I have got for the following file path -- '' put file://C:\Users\Udata Pavan Kumar\OneDrive\Documents\ecdc_file_list_for_2_files.json @~/staged; " 001003 (42000): SQL compilation error: syntax error line 1 at position 26 unexpected 'Pavan'. parse error line 1 at position 38 near '79'. parse error line 1 at position 47 near '68'. parse error line 1 at position 57 near '101'. syntax error line 1 at position 58 unexpected 'cdc_file_list_for_2_files'. syntax error line 1 at position 83 unexpected '.'. syntax error line 1 at position 89 unexpected '@~/staged'.
Hi, your folder name contains spaces "Udata Pavan Kumar", please use another folder with the name that doesn't contain spaces. I think this is the issue.
That means your put command is wrong, like your file location on desktop Please watch video clearly and prepare commands. Paste full command and screenshot that contains the full path of file on your desktop
The way you aligned your explanation with the snowflake environment is simply outstanding. Its just go wit the flow, so easy to understand & grasp. Simply superb. Keep doing the good work.
Super explanation Bandi!
Thank you so much sir. Your explanation is un matchable.
hope helpfull everything you uploaded so far..!!🖤
Nice & Clear Explanation
Heartly Thankful
here in the final customer_data_table there are 100 records are these 100 came from combination of 3 stage file (or) are the 100 records repeated over the 3 stage files
from all 3 files
In real time, what is the use case of using local files for internal staging; can we use sftp for internal staging location?
Suppose if we are using Unix server and Windows server and if we need to process files from those servers we have to use internal stages only(mostly named internal stage). No you can't sftp files to internal stage directly, we have to use put command for that purpose..
@@mrjana520 Thank you for your quick reply. We are trying to integrate Mulesoft with Snowflake in streaming mode with no file or any third-party system in between. Is it possible?, your suggestions are highly appreciable, thanks.
First of without knowing what are all the concepts available in Snowflake why are you implementing them in real time.. Go through any videos available on snowflake, learn and implement. For the things I have explained clearly I can answer these questions. For now you can use Snowpipe for that streaming data loads
Very nice explanation
Thanks for the excellent videos. Is there a way to put / upload files into table stage or user stage using Snowsight? Due to some error I cannot use snowsql in my macbook.
No, Snowsight is a web interface you can't upload, that is why we go for snowsql.
Hello sir, I am able to run the queries in SnowSQL but when I tried to copy the put command with my file path then while trying to paste it in snowSQL then its not pasting !.. I had to write 'put file://' manually. Can you please let me know why copy & paste is not working in snowSQL for put command..
That may be dependent on the system, windows you are using.
I always suggest people never copy paste, pls type the queries, so that you will get hands-on..
Very good teaching sir
Hi,Good Evening ,you used 4 files ,from where can we get that files,for practice purpose.
I can be reachable on jana.snowflake2@gmail.com
Can we do same in snow site
I mean without using snow sql
There are other options like by using Visual studio code, but you can't do directly from snowsight
Hi ,you executed all put syntaxes into command prompt only byt is it possible to execute snowsql browser..?
You can't
Getting error on named staging while put file from local to snowflake as follows
403 client error : Forbidden for url
While doing badge 2 lesson 11
if you follow the instructions it should work as it is working for all others
Hii Sir,
I have tried too many times to connect through CMD, But i am getting this below error. Anything else need to be done please let me know
250001 (n/a): Could not connect to Snowflake backend after 2 attempt(s).Aborting
If the error message is unclear, enable logging using -o log_level=DEBUG and see the log to find out the cause. Contact support for further help.
Watch below video and then retry.
ruclips.net/video/Tx0R9mld9Vg/видео.html
please try to post data (ex customer_data_table.csv)which you have used as well , when we are trying with different data set we are facing many errors and not able to proceed further
Hi It is not possible to share all the files to so many people every day, that is why I have uploaded complete course to Udemy and sharing that for just 500 rupees.
You can get all snowflake Videos, PPTs, Queries, Interview questions and Practice files in my Udemy course for 499 rupees.. I will be updating this content and will be uploading all new videos in this course. And you will have lifelong access to these videos and materials.
My Snowflake Udemy Course:
www.udemy.com/course/snowflake-complete-course-for-clearing-interviews/?couponCode=0C8E557D4EB94D407F5A
Use the coupon below to get it for 499 rupees.
Coupon: 0C8E557D4EB94D407F5A
once the files are loaded from the stages to the tables? will they get deleted from the stages ?
By default, No
@@mrjana520 thanks so we have to use PURGE explicitly.
Hi sir can you explain about snow pipie
Will do very soon
sir here in table stage you have given customer_data_table into customer_data_table stage am I correct. I mean here the customer_data_table is the file that we are uploading into the table stage please correct my view.
yes
Super explination bro
can you please pleas make vedio on snowpipe and complete data pipeline using snowpipe ... i have an EY interview at Thursday
Your mail id
Hi Please tell me. Can we rename multiple files through snowflake?
Can we rename internal & external stage files?
No, you can just extract data from files, we can't modify files from snowflake
Amazing explanation and very useful
please help me I am getting error in user stage
Hi you have to make little changes to queries based on your user stage creation and folders, please understand the video first and try again
@@mrjana520
In user stage I was getting error because space is not taking in path but there was space in my user name. but now I am getting error in Table stage
Shivani#COMPUTE_WH@PRACSTAGE.STAGEPRAC>put file://C:\Users\Public\simple.json @%simple;
002003 (02000): SQL compilation error:
Stage 'PRACSTAGE.STAGEPRAC."%SIMPLE"' does not exist or not authorized.
have you created the table with name "simple" in snowflake? for table stage first we have to create table
@@mrjana520 it's solved .....can we rename multiple files through snowsql ? please guide me....
super explanation
Hi Laxman
Hi sir please explain replication of sharing
I don't understand
@@mrjana520 Database Replication and failover/ failback concept with examples
sir put is giving an error that file doesn't exists in User Staging, Is it because I have spaces in my file path
If you dont mind this is the error I have got for the following file path --
'' put file://C:\Users\Udata Pavan Kumar\OneDrive\Documents\ecdc_file_list_for_2_files.json @~/staged; "
001003 (42000): SQL compilation error:
syntax error line 1 at position 26 unexpected 'Pavan'.
parse error line 1 at position 38 near '79'.
parse error line 1 at position 47 near '68'.
parse error line 1 at position 57 near '101'.
syntax error line 1 at position 58 unexpected 'cdc_file_list_for_2_files'.
syntax error line 1 at position 83 unexpected '.'.
syntax error line 1 at position 89 unexpected '@~/staged'.
Hi, your folder name contains spaces "Udata Pavan Kumar", please use another folder with the name that doesn't contain spaces. I think this is the issue.
@@mrjana520 sir thats my Onedrive name sir can I change it
try enclosing in double quotes like
put file://C:\Users\"Udata Pavan Kumar"\OneDrive\Documents\ecdc_file_list_for_2_files.json @~/staged;
@@mrjana520 This is also not working sir
253006 (n/a): File doesn't exist:
Hi, retry after watching my video with the name "How to login to SnowSQL"
@@mrjana520after put file://C:\\Users\mayur\customer_1.csv I'm getting error for user
@@mrjana520 put file://C:\\Users\mayur\customer_1.csv
That means your put command is wrong, like your file location on desktop
Please watch video clearly and prepare commands.
Paste full command and screenshot that contains the full path of file on your desktop