Видео

If I close cmd rabbitmq site not working. How to fix it ?

Not working.

thank you

@Big Tech Talk , can you tell me how to handle this error . I have tried a lot to solve it but couldn't. can you look at ? error is here : 24/10/04 11:38:52 ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0)/ 1] org.apache.spark.SparkException: Python worker exited unexpectedly (crashed) at org.apache.spark.api.python.BasePythonRunner$ReaderIterator$$anonfun$1.applyOrElse(PythonRunner.scala:601) at org.apache.spark.api.python.BasePythonRunner$ReaderIterator$$anonfun$1.applyOrElse(PythonRunner.scala:583) at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38) at org.apache.spark.api.python.PythonRunner$$anon$3.read(PythonRunner.scala:772) at org.apache.spark.api.python.PythonRunner$$anon$3.read(PythonRunner.scala:749) at org.apache.spark.api.python.BasePythonRunner$ReaderIterator.hasNext(PythonRunner.scala:514) at org.apache.spark.InterruptibleIterator.hasNext(InterruptibleIterator.scala:37) at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:491) at scala.collection.Iterator$$anon$10.hasNext(Iterator.scala:460) at scala.collection.Iterator$$anon$10.hasNext(Iterator.scala:460) at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIteratorForCodegenStage1.processNext(Unknown Source) at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43) at org.apache.spark.sql.execution.WholeStageCodegenExec$$anon$1.hasNext(WholeStageCodegenExec.scala:760) at org.apache.spark.sql.execution.SparkPlan.$anonfun$getByteArrayRdd$1(SparkPlan.scala:388) 24/10/04 11:38:52 ERROR TaskSetManager: Task 0 in stage 0.0 failed 1 times; aborting job Traceback (most recent call last): (0 + 0) / 1] File "<stdin>", line 1, in <module> File "C:\Program Files\spark-3.4.3\python\pyspark\sql\dataframe.py", line 901, in show print(self._jdf.showString(n, 20, vertical)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Program Files\spark-3.4.3\python\lib\py4j-0.10.9.7-src.zip\py4j\java_gateway.py", line 1322, in __call__ File "C:\Program Files\spark-3.4.3\python\pyspark\errors\exceptions\captured.py", line 169, in deco return f(*a, **kw) ^^^^^^^^^^^ File "C:\Program Files\spark-3.4.3\python\lib\py4j-0.10.9.7-src.zip\py4j\protocol.py", line 326, in get_return_value py4j.protocol.Py4JJavaError: An error occurred while calling o56.showString. : org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in stage 0.0 (TID 0) (DESKTOP-DARCLVU executor driver): org.apache.spark.SparkException: Python worker exited unexpectedly (crashed) at org.apache.spark.api.python.BasePythonRunner$ReaderIterator$$anonfun$1.applyOrElse(PythonRunner.scala:601) at org.apache.spark.api.python.BasePythonRunner$ReaderIterator$$anonfun$1.applyOrElse(PythonRunner.scala:601) at org.apache.spark.api.python.BasePythonRunner$ReaderIterator$$anonfun$1.applyOrElse(PythonRunner.scala:583)

i am getting java.lang.UnsupportedOperationException: getSubject is supported only if a security manager is allowed

Setting default log level to "WARN". C:\Windows\System32>spark-shell Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 24/09/26 11:27:59 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 24/09/26 11:27:59 ERROR Main: Failed to initialize Spark session. java.lang.UnsupportedOperationException: getSubject is supported only if a security manager is allowed

i follow your step and facing this error when check spark-shell, please help . Error: Unable to initialize main class org.apache.spark.deploy.SparkSubmit Caused by: java.lang.NoClassDefFoundError: scala/MatchError

muchas gracias cawn

Thanks for crystal clear explanation

stuck at vi .bashrc cannot insert spark-home, any ideas?

nice!

this is for inserting data first time but how to handle insert and delete if some update in the database record

Amazing video. Thank you!

I found this error when trying to open pyspark I followed all the video steps is there anything wrong with the command? scala> SPARK_HOME/bin/pyspark <console>:23: error: not found: value SPARK_HOME SPARK_HOME/bin/pyspark ^ <console>:23: error: not found: value pyspark SPARK_HOME/bin/pyspark

THANK THANK THANK I FROM BRAZIL

'.\bin\windows\kafka-server.bat' is not recognized as an internal or external command, operable program or batch file. I'm getting this issue. Please make a video on how to change the path variables

I dont know much about these things, but you sound like a guy that knows what he is talking about. Keep it up !!

i want build without hadoop ? you can help me plz

I took time to follow another how to install Apache Kafka article but them not work such I wanted. Thank you so much for your guide, it's helped me so much because it's easy to do.

have done this too many time but still get error each time i try to install pyspark

Good explanation thanks

awsome work, thanks for the detailed example

It's working, thank you. In gerenal, when you precise Kafka localization, make sure that name of folder have not spaces like "Program Files". In this case throws "could not find: Files\Kafka\libs\..."

Very good video is Awesome! Thank you!!

Command 'shopt' not found, did you mean: command 'shout' from deb libshout-tools Try: apt install <deb name> Command 'shopt' not found, did you mean: command 'shout' from deb libshout-tools Try: apt install <deb name> Command 'shopt' not found, did you mean: command 'shout' from deb libshout-tools Try: apt install <deb name> Command 'shopt' not found, did you mean: command 'shout' from deb libshout-tools Try: apt install <deb name> complete: command not found complete: command not found complete: command not found complete: command not found complete: command not found complete: command not found complete: command not found complete: command not found complete: command not found complete: command not found /usr/share/bash-completion/bash_completion:1590: parse error near `|' \[\e]0;\u@\h: \w\a\]\[\033[;94m\]┌──(\[\033[1;31m\]\u㉿\h\[\033[;94m\])-[\[\033[0;1m\]\w\[\033[;94m\]] \[\033[;94m\]└─\[\033[1;31m\]$\[\033[0m\] sudo nano +1590 /usr/share/bash-completion/bash_completion----------------this is the error i got

Showing error like the system cannot find the path specified

Hello i get this error: The filename, directory name, or volume label syntax is incorrect.

Hi, many thanks for the installation steps, Could you plz confirm reason for adding "$SPARK_HOME/bin" in PATH variable twice ?

thank uu so mush

very well explianed without any time wasting

I got this error on running kafka server C:\kafka>.\bin\windows\kafka-server-start.bat .\config\server.properties 'wmic' is not recognized as an internal or external command, operable program or batch file. plz help

if i write this in pyspark or scala does the cde differ for delta lake?

What do I need to change in the configuration if I want to be able to produce a message from another machine over the internet?

good tutorial and to the point!

I could not start the zookeeper. I am getting an error on my terminal stating the command is too long, syntax of command isn't incorrect. Is there an alternative to starting the zookeeper?

The most usefull video I have seen. Thanks sir !

simple and clear illustration, however there is a no support for windows till this moment.

Thanks mate. Was stuck on a thing, your video gave me clue to solve it.

when i run the source ~/.bashrc i'm getting command not found error what to do to resolve this

Thank you from Brazil 🙏

C:\Users\srinivas reddy>spark-shell 'spark-shell' is not recognized as an internal or external command, operable program or batch file.

Nothing happens when I enter the command to start Zookeeper. The cursor just goes to the next line

Please add site links also for easy references. It's a hassle to look manually..

Gostei bastante, direto ao ponto, parabéns pelo conteúdo!

Great video! worked perfectly

Ohhhh, thank youuu, you help solve my problem with kafka, now its working!

You are amazing

Thanks a lot <3

Thank a lot! I succeed with your tutorial , the explanation was very detail and clear , thank a lot!

help me please, this paragraph val df = spark.read.fomat("csv").option("header",true).load("D:\\SampleData\\input\\country.csv") <console>:22: error: value fomat is not a member of org.apache.spark.sql.DataFrameReader