Видео

really helpful, thank you for sharing

So far off! Scd type 2 requires a unique surrogate key to join with a fact FK!

Is this hue

Just finding your channel today. You are an AWSEOME teacher, presenter, and practitioner. Thanks much for sharing your knowledge!

Hey, Try to run merge query again and again. It will insert the records into Dim Table.. Beacuse of joinkey considering as null always EmoloyeeId from target not matched with null and keep on inserting records

Can we use this method to read excel file by placing files in gen2 and reading excel files using pyspark. Since iam not able to do same from storage account. Pls reply

Hi Bro How can I connect azure data studio from databricks and databricks to data lake then datalake to snowflake can you help me

Superb explanation 👌 👏 👍

How can I import a notebook along with visualization .actually I have created a notebook and visualization with the results and now I want to migrate them in prod

The cmd 4 did not work. I have the excel in Microsoft Azure storage

I think you should re-title this video as "Databricks credential pass through". This was specifically what I was seeking for and almost did not click on it because I did not think it was Databricks focused. ....just a thought. Thanks

if there is no change in source data and we try to run the merge code again as part of daily run then the mergeKey null records will be inserted again into target column as active and we will be ending with duplicates , how to solve it ?

Great Explaination. How do we decide which worker and driver type is to be selected. And how many instances of workers are to be used. Are there any set of rules or calculations to decide??

I need you’re help, possible to connect with you over call

is there a way to connect databricks from Oracle SQL Developer ?

this mathod not working in synapse notebook .

Hi sir, I am facing connectivity issue from power bi to Azure databricks. This is the error: Details: "ODBC : ERROR [HY000] [ Microsoft][ThriftExtension] (14) Unexpected response from server during a HTTP Connection: SSL_Connect: Certificate verify failed.". Can you please help me in above issue.

can you please write scd type 2 code in generic way currently you have written it only for the one column please and thank you.

It helpful. Thanks

can you share the file you have uploaded here the csv file

what if othet column updated apart from address

How did you get your dashboard to look like that? its not letting me write code in the dashboard

great but try to mention your linkedin try to share your notebook link on a repo so that we can get the code

Hi, can global view directly be accessible by powerBI?

Hi watched this video, it is really helpful one quick question. Once we shutdown logging the file is written to storage (ADLS in my case). After that i am unable to write data to same file throws an error. Can you please help with that

Is there a reason why you shouldn't do this? I am surprised this isn't encouraged as a best practice which makes me think I'm missing something

can we read pivot Excel connected to azure analysis services uding this method?

Hi can make video about auto loader and structured streaming

Thanks Jithesh for this video. Really helpfull

Hi sir , what if i want to fill the null columns in salary with the average of preceding and successive values ?

Thank you for this content

Hi, excelent video. I have a question, is there a way to schedule an email sending with the dashboard information? For example to receive everyday an email with a pdf or a link in which I can see the dashboard with its information updated.

Hi how do we troubeshoot spark driver error no parent missing and null pointer exception

import pandas as pd df=pd.read_excel("filename.xlsx")

Thank you so much for the realtime explanation of shallow vs deep clone - I have been searching for it - It's a great explanation!

this is top notch content!! Excellent!!

Hi..Thanks for the content! I am converting the pandas df to spark dataframe in databricks but getting an error cannot infer schema, I have used the parameter inferschema=True,.The pyspark version is 3.0 ...Can you please help me with this

Fantastic video, example and explanation. Thanks!

when I use direct query, query folding doesn't happen so it tries to import everything which can't happen because database is too large... how can I solve this?

Excellent topic and well explained

Thank you for the video. How I can create a function based on this example ? For example I have 100 columns in DataFrame1 and 100 columns in DataFrame2 now I want to replace null values in DataFrame1 with DataFrame2. Note: Both DataFrame1 and DataFrame2 have same column names. Thanks in advance!!

Nice video. clearly explained I have a blocker. While running the dbutils.fs.mount(), I'm getting the below error: Unsupported Azure Scheme: abfss

can you please explain how to write the data to xl sheet from pyspark dataframe

i have encounter an ssl issues could you help?

Is it only me or someone else have the same question, like while creating shareanalysis table first line is Drop table if exists, the How come data can be there unless we run the insert command?

Thank you so much...today I learn new concept I will add it into my resume.

how can i get the dataset for this example

Sir is it possible in community databricks?

Thank you, very well explained. I have an important question, as I saw in the Internet, the users have to pay charges for terminated clusters despite not being running, my question is if there is any way to delete the cluster once the execution is done, this way you can safe money, because I have to schedule a job to be done every day in a year, for example. Thank you.

Thank you very much