Atomic Engineering
Atomic Engineering
  • Видео 53
  • Просмотров 104 918
If-Else Statements in Python: Making Decisions in Your Code
Learn the basics of if-else statements in Python, a fundamental concept for adding decision-making ability to your programs. This video covers:
What if-else statements are and why they're important
How to write a simple if statement
Adding else clauses for alternative actions
Using elif for multiple conditions
The importance of statement order
A practical example of temperature classification
Perfect for beginners and those looking to reinforce their understanding of Python's flow control. Join us as we explore how to make your code smarter and more responsive!
Below are the other videos in my channel if you are interested
Big Data Playlist - ruclips.net/p/PL6p9VwbuOT2MbpVLT_Dhb7Y3RZS-WANf9
AWS Pla...
Просмотров: 34

Видео

Flow Control in Python | Python Basics
Просмотров 452 месяца назад
In this introductory video on Python flow control, we break down the fundamental concepts that allow programs to make decisions and adapt. You'll learn: What flow control is and why it's crucial in programming The building blocks of flow control: Boolean values, comparison operators, and Boolean operators A brief introduction to if statements Perfect for beginners, this video lays the foundatio...
Understanding Python's Built-in Functions: len, input, and print
Просмотров 722 месяца назад
Hello Everyone! This video provides a clear and concise introduction to three fundamental Python functions: len, input, and print. It explains the purpose and usage of each function, demonstrating their applications through practical examples. len function: Learn how to use len to determine the length of various data structures, such as strings, lists, and tuples. input function: Discover how t...
Mastering String Manipulation in Python: Concatenation and Replication
Просмотров 662 месяца назад
Hi Everyone, In this quick tutorial, I break down two essential string operations in Python: concatenation and replication. You'll learn how to join strings together using the ' ' operator. I also cover string replication using the '*' operator, showing you how to easily repeat strings. With clear examples and practical tips, you'll be manipulating strings like a pro in no time! Whether you're ...
Datatypes in Python
Просмотров 422 месяца назад
Hi Everyone, This video provides a clear and concise explanation of the essential datatypes in Python, providing clear explanations and practical examples for beginners and intermediate programmers alike. Below are the other videos in my channel if you are interested Big Data Playlist - ruclips.net/p/PL6p9VwbuOT2MbpVLT_Dhb7Y3RZS-WANf9 AWS Playlist - ruclips.net/p/PL6p9VwbuOT2NrGPQKaLtRWHB1XE70P...
Variables in Python | Building Blocks of Python Code | Global and Local Variables | Dynamic Typing
Просмотров 263 месяца назад
Hi Everyone, This video provides a clear and concise explanation of what variables are, how to declare them, and the different data types they can hold (integers, floats, strings, booleans). You'll also discover best practices for naming variables and how to assign values to them. Whether you're a complete beginner or looking to refresh your knowledge, this video is a great starting point for y...
Meta SQL Interview Problem asked in Data Engineer Interviews | Uber | Amazon | Simple Solution
Просмотров 463 месяца назад
Hello Everyone! In this Video, I will talk about one of the SQL problems asked in Meta, Amazon and Uber for the Data Engineer Interviews. Below are the other videos in my channel if you are interested Big Data Playlist - ruclips.net/p/PL6p9VwbuOT2MbpVLT_Dhb7Y3RZS-WANf9 AWS Playlist - ruclips.net/p/PL6p9VwbuOT2NrGPQKaLtRWHB1XE70Pnb8 MinIO Playlist - ruclips.net/p/PL6p9VwbuOT2Pn4GV3tWtNuTNRsDSdIP...
SELECT and DROP functions in SPARK and SCALA
Просмотров 483 месяца назад
Hi Everyone! In this video, I have discussed about Dataframe Column Operations - SELECT and DROP using Spark and Scala. Here is the link to the Git Repo github.com/DineshGuduru/Apache-Spark-Demo Code File: github.com/DineshGuduru/Apache-Spark-Demo/blob/main/src/main/scala/atomic/engineering/SelectAndDrop.scala Below are the other videos on my channel related to Big Data, Python and SQL. Apache ...
Dataframe Column Magic | withColumn and withColumnRenamed in Spark and Scala
Просмотров 523 месяца назад
Hi Everyone! In this video, I have discussed about Dataframe Column Operations - withColumn and withColumnRenamed using Spark and Scala. Here is the link to the Git Repo github.com/DineshGuduru/Apache-Spark-Demo Code File: github.com/DineshGuduru/Apache-Spark-Demo/blob/main/src/main/scala/atomic/engineering/WithColumnAndWithColumnRenamed.scala Below are the other videos on my channel related to...
Uber Amazon Data Engineer Interview Problem | Move Zeroes
Просмотров 234 месяца назад
Hello Everyone! In this Video, I will talk about one of the problems asked in Amazon and Uber for the Data Engineer Interviews. Below are the other videos in my channel if you are interested Big Data Playlist - ruclips.net/p/PL6p9VwbuOT2MbpVLT_Dhb7Y3RZS-WANf9 AWS Playlist - ruclips.net/p/PL6p9VwbuOT2NrGPQKaLtRWHB1XE70Pnb8 MinIO Playlist - ruclips.net/p/PL6p9VwbuOT2Pn4GV3tWtNuTNRsDSdIPE9 Python ...
Map and FlatMap in Spark | Scala
Просмотров 924 месяца назад
Hi Everyone! In this video, I have discussed about Map and FlatMap in Spark using Scala along with the key differences. Here is the link to the Git Repo github.com/DineshGuduru/Apache-Spark-Demo Code File: github.com/DineshGuduru/Apache-Spark-Demo/blob/main/src/main/scala/atomic/engineering/MapAndFlatMap.scala Below are the other videos on my channel related to Big Data, Python and SQL. Apache ...
Reading and Writing Parquet Files using Spark | Compression | Advantages | Predicate Pushdown
Просмотров 1394 месяца назад
Hi Everyone! In this video, I have discussed about Parquet Files, It's advantages and shown how to READ / WRITE Parquet Files into Dataframe using Spark and Scala. Here is the link to the Git Repo github.com/DineshGuduru/Apache-Spark-Demo Code File: github.com/DineshGuduru/Apache-Spark-Demo/blob/main/src/main/scala/atomic/engineering/ParquetFiles.scala Below are the other videos on my channel r...
Introduction to Spark SQL | Temp View | Global Temp View
Просмотров 3406 месяцев назад
In this video, I have explained about Apache Spark SQL and executing SQL Queries on top of Spark Dataframe. Link to the code used in this video - github.com/DineshGuduru/Apache-Spark-Demo/blob/main/src/main/scala/atomic/engineering/SparkSql.scala Below are the other videos on my channel related to Big Data Apache Spark Playlist 👉 ruclips.net/p/PL6p9VwbuOT2PWYLXUVH3Lwvh48AMROmFL Big Data Hadoop ...
Transformations and Actions in Spark | Narrow and Wide Transformations | Lazy Evaluation
Просмотров 2147 месяцев назад
In this video, I have explained about Transformations and Actions in Apache Spark Below are the other videos on my channel related to Big Data Apache Spark Playlist 👉 ruclips.net/p/PL6p9VwbuOT2PWYLXUVH3Lwvh48AMROmFL Big Data Hadoop Playlist 👉 ruclips.net/p/PL6p9VwbuOT2MbpVLT_Dhb7Y3RZS-WANf9 AWS Playlist 👉 ruclips.net/p/PL6p9VwbuOT2NrGPQKaLtRWHB1XE70Pnb8 MinIO Playlist 👉 ruclips.net/p/PL6p9VwbuO...
Write Dataframe into JSON File using Spark and Scala
Просмотров 2467 месяцев назад
Hi Everyone! In this video, I have shown how to WRITE Dataframe into JSON File using Spark and Scala. Here is the link to the Git Repo github.com/DineshGuduru/Apache-Spark-Demo Code File: github.com/DineshGuduru/Apache-Spark-Demo/blob/main/src/main/scala/atomic/engineering/WriteToJson.scala Below are the other videos on my channel related to Big Data, Python and SQL. Apache Spark Playlist 👉 ruc...
Snowflake AWS S3 integration | Snowflake Stage | AWS Roles and Policies
Просмотров 7129 месяцев назад
Snowflake AWS S3 integration | Snowflake Stage | AWS Roles and Policies
Read JSON and JSON Lines using Spark and Scala
Просмотров 1 тыс.Год назад
Read JSON and JSON Lines using Spark and Scala
Write DataFrame to CSV in Spark | Scala | Write Modes in Spark
Просмотров 1 тыс.Год назад
Write DataFrame to CSV in Spark | Scala | Write Modes in Spark
Read Single or Multiple CSV files in Spark | IntelliJ
Просмотров 1,5 тыс.Год назад
Read Single or Multiple CSV files in Spark | IntelliJ
Setup and Run Apache Spark in IntelliJ IDEA using Maven
Просмотров 10 тыс.Год назад
Setup and Run Apache Spark in IntelliJ IDEA using Maven
SQL Interview Problem | Triangular Number Pattern | Recursion in SQL
Просмотров 137Год назад
SQL Interview Problem | Triangular Number Pattern | Recursion in SQL
DataFrame and Dataset in Apache Spark | Demo | REPL
Просмотров 479Год назад
DataFrame and Dataset in Apache Spark | Demo | REPL
Apache Spark Word Count Program using Scala | REPL | Demo
Просмотров 1,4 тыс.Год назад
Apache Spark Word Count Program using Scala | REPL | Demo
Create RDD in spark | Demo | Scala | REPL
Просмотров 1,1 тыс.Год назад
Create RDD in spark | Demo | Scala | REPL
Longest Palindromic Substring | Leetcode 5| Python Solution | Two Pointer Approach
Просмотров 1,5 тыс.Год назад
Longest Palindromic Substring | Leetcode 5| Python Solution | Two Pointer Approach
ChatGPT in Action | Real-world applications
Просмотров 323Год назад
ChatGPT in Action | Real-world applications
What is RDD in Apache Spark | Spark RDD Tutorial
Просмотров 660Год назад
What is RDD in Apache Spark | Spark RDD Tutorial
Leetcode 242 | Valid Anagram | Data Engineer Interview Problem | Python Solution
Просмотров 1 тыс.Год назад
Leetcode 242 | Valid Anagram | Data Engineer Interview Problem | Python Solution
Install Apache Spark in Mac using Homebrew
Просмотров 5 тыс.Год назад
Install Apache Spark in Mac using Homebrew
Apache Spark Architecture in less than 10 Minutes
Просмотров 4,2 тыс.Год назад
Apache Spark Architecture in less than 10 Minutes

Комментарии

  • @eajazahmed948
    @eajazahmed948 Месяц назад

    Make a Video , wherein you explain the RDD and Partitions difference in detail

  • @komaldubey3451
    @komaldubey3451 Месяц назад

    This code is not working for me, please can you help ?

  • @komaldubey3451
    @komaldubey3451 2 месяца назад

    Getting issue with Hadoop_home not set

  • @hoerica4988
    @hoerica4988 2 месяца назад

    Oh my god! You are the only one I followed the instructions and works!!!!!! Appreciate that bro!

    • @atomicengineering
      @atomicengineering Месяц назад

      Glad you were able to follow the instructions and get it working!

  • @abdulmannan-qi1ex
    @abdulmannan-qi1ex 3 месяца назад

    SIR , Very Nice explain better than others

  • @ManojKumar-cg7ft
    @ManojKumar-cg7ft 4 месяца назад

    Thank You , Helped me to setup first Scala project in my local machine.

  • @assouibenjellal
    @assouibenjellal 5 месяцев назад

    when i try the pull cloudera command, it tells me that it's no longer supported. What's the solution to that?

  • @Abhish9221
    @Abhish9221 6 месяцев назад

    Thank you ,I am able to connect

  • @dishasaxena7131
    @dishasaxena7131 7 месяцев назад

    thank you, this saved my life 2 hours before my practical exam

  • @sa2144
    @sa2144 7 месяцев назад

    Good video for starters.

  • @danistudycorner
    @danistudycorner 8 месяцев назад

    Thank you!!!

  • @VibavMahendran-hj4og
    @VibavMahendran-hj4og 8 месяцев назад

    Exception in thread "main" java.lang.ExceptionInInitializerError, bro I am getting this error while printing how to resolve this, I used the same code as you gave

  • @berkayates6254
    @berkayates6254 8 месяцев назад

    When i stopeed and started the aws ubuntu machines their ip addresses changes so hapoop does not know their new ip addresses, What is the solution for this situation

  • @shot_freeze
    @shot_freeze 9 месяцев назад

    What type of job description can we search for this hadoop with AWS ?

  • @ryan7ait
    @ryan7ait 10 месяцев назад

    how can i acces the cloudera manager interfaace?

  • @ganeshjaggineni4097
    @ganeshjaggineni4097 10 месяцев назад

    NICE SUPER EXCELLENT MOTIVATED

  • @msftora3
    @msftora3 10 месяцев назад

    thank very much, this solved my question on intellij/gradle/scala .

  • @raviyadav-dt1tb
    @raviyadav-dt1tb 11 месяцев назад

    Can any tell how solve this type question in interview? Where from u have to practice? Please tell me

  • @HemanthKumar-cm9lv
    @HemanthKumar-cm9lv 11 месяцев назад

    Why cant we do in just 1 line? print(sorted(s) == sorted(t))

  • @JayeshTank975
    @JayeshTank975 11 месяцев назад

    Thanks bro, very helpful for beginers

  • @balajikagiti6984
    @balajikagiti6984 Год назад

    Bro , can you make a one video how to write a spark scala dataframe into specific file instead of part files...or if you did already please provide me link

  • @hey_ashy
    @hey_ashy Год назад

    Great demo. Thank you.

  • @mohammedradman2756
    @mohammedradman2756 Год назад

    Hi, after I added the variables to the /.bashrc and ran the command source ~/.bashrc I couldn't run any other command except cd, the rest of the commands can't be identified by Ubuntu, any advice ?

  • @doseofdopamine2031
    @doseofdopamine2031 Год назад

    is it possible to install spark in there as well?

  • @arupanandaswain9581
    @arupanandaswain9581 Год назад

    nice one buddy its full of information...(#mostInformativeVideo )

  • @nandhuvenkat1198
    @nandhuvenkat1198 Год назад

    How to get the file in another server instead of local?

  • @sushantsawant6577
    @sushantsawant6577 Год назад

    I am getting this error, Caused by: java.lang.ClassNotFoundException: com.fasterxml.jackson.core.StreamReadConstraints at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:355) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ... 18 more package org.example.scala import org.apache.spark.sql.SparkSession; object SparkDemo { def main(args: Array[String]): Unit = { val spark= SparkSession.builder() .master("local[1]") .appName("Spark Demo") .getOrCreate(); println("session behaviour") println("app name " + spark.sparkContext.appName) println("Deployment mode "+spark.sparkContext.deployMode) println("master "+spark.sparkContext.master) val df=spark.read.json("C:\\Users\\sushants asus book\\Downloads\\tweets.json") df.printSchema() df.show(false) spark.stop(); } }

  • @undefin-ed
    @undefin-ed Год назад

    bhai aisa question nahi poochenge kabhi , easy se bhi neeche category main hai ye

  • @ajay_sn
    @ajay_sn Год назад

    Hi great video on docker for Hue , Could you tell me how to install Ambari on the same on Mac M1 ?

  • @sabesanj5509
    @sabesanj5509 Год назад

    # Create a list of numbers numbers = [5, 2, 8, 1, 5, 4, 9, 3, 2, 6, 7, 1, 8, 3, 6, 4, 9, 7] # Perform the bubble sort n = len(numbers) for i in range(n): for j in range(0, n - i - 1): if numbers[j] > numbers[j + 1]: # Swap the elements numbers[j], numbers[j + 1] = numbers[j + 1], numbers[j] # Print the sorted list print(numbers)

  • @vamsivegi
    @vamsivegi Год назад

    can you use scala 3.

  • @aurovindsahoo
    @aurovindsahoo Год назад

    Great post more

  • @amitkamble8493
    @amitkamble8493 Год назад

    Excellent logic bro

  • @reachrishav
    @reachrishav Год назад

    Hi Dinesh, Upon refactoring came up with this approach too: SELECT a.value FROM GENERATE_SERIES(1, (SELECT id FROM test)) a CROSS APPLY ( SELECT value FROM GENERATE_SERIES(1, a.value) ) b

  • @YogeshShinde-i3e
    @YogeshShinde-i3e Год назад

    Can you please create vedio on shell scripting to get and put files from Linux server to windows and Linux server to Linux server with creating logs files in brief explanation for Automation

  • @reachrishav
    @reachrishav Год назад

    Thank you for posting. Keep these videos coming. I tried a similar approach: with cte as ( select id, id as num from test union all select id - 1, id - 1 from cte where id > 1 ) , cte2 as( select * from cte union all select id - 1, num from cte2 where id > 1 ) select num from cte2 order by 1

  • @umamaheswaranj9890
    @umamaheswaranj9890 Год назад

    Thank you very much... I was able to successfully connect to Snowflake with the help from your demo.

  • @arvindynr
    @arvindynr Год назад

    can you make a video on running hotonworks on docker on m1 mac?

  • @arvindynr
    @arvindynr Год назад

    will this work on m1 mac?

  • @lightmyra2334
    @lightmyra2334 Год назад

    You saved me so much time! I've been trying other tutorials over and over, and this worked on first attempt! Thanks a bunch

  • @miggyjang4476
    @miggyjang4476 Год назад

    java version 6 error com.jcraft.jsch.JSchException: Algorithm negotiation fail at com.jcraft.jsch.Session.receive_kexinit(Session.java:582)

    • @monikaveeramalla3381
      @monikaveeramalla3381 10 месяцев назад

      How did you resolve the error I am also facing the same issue please help

  • @prasadpatil5397
    @prasadpatil5397 Год назад

    Very nice sir. Please add whole series of spark. Wating for whole series

  • @prasadpatil5397
    @prasadpatil5397 Год назад

    Very very very nice explanation sir. Please please add whole series of spark

  • @AkhilGupta2007
    @AkhilGupta2007 Год назад

    Just curious list.sort() function can do this right away. Am i missing something here?

    • @rathikarajeshkanna3354
      @rathikarajeshkanna3354 Год назад

      you're right. May be we can assume the interview question as sort without using sort function.

    • @praveenreddy9454
      @praveenreddy9454 Год назад

      with out using any predefined functions, methods. and also we have to check tricomplexity and space complexity of each DS

  • @davidfong7624
    @davidfong7624 Год назад

    Thanks so much. This was very helpful.

  • @professorpablo1465
    @professorpablo1465 Год назад

    why sometimes hue starts and work well and hive also start no error but sometime hue and hive both doesn't start what shouuld i do

  • @PaOne24T
    @PaOne24T Год назад

    Hi , How to handle the public DNS that changes everytime we stop and start the nodes

    • @brunocarvalho3229
      @brunocarvalho3229 Год назад

      You need to allocate an Elastic IP to each one of your instances before doing the Hadoop setup

  • @max003003003
    @max003003003 Год назад

    Thank you very verymuch i'm struggle with Cloudera installation for a while this quite very useful to me to get start with cloudera.

  • @perfectperfecto
    @perfectperfecto Год назад

    Thank you this will be a good starting foundation for helping me learn more

  • @ashutoshgadgil8407
    @ashutoshgadgil8407 Год назад

    it was previously gui based, have they removed it now?