How to fill NA, NULL in dataframe using PySpark in Databricks? | Databricks Tutorial |

[@asfandyarsaeed6402]

Level 🎉🎉🎉

[@vishnuvardan1921]

We can use DROPMULFORMED mode to remove the null values

[@techproductowner]

can you pls tell me why we need to use pyspark for maupulation when we can do the same in ADF ?

[@GeekCoders]

Both uses spark

[@GeekCoders]

It is same as one problem can be solved via python and java … depends on the broader thinking

[@Gvfashontalks]

Hi Sagar.. I’m currently learning ADF
Only with ADF+SQL do we have job ..?

[@GeekCoders]

Jobs are there Ganesh. But you know SQL+ADF+ Spark then it would be very Great. You will have more chance to get good package

[@insane2093]

Using SQL magic command --how to replace null values like case when isnull((col,'na') then 0) how to replace isnull here %sql not supported isnull?

[@GeekCoders]

Use IFnull(col,replace value)

[@insane2093]

@@GeekCoders thank you for quick reply . I will try this .