How to install Apache Hive on Ubuntu 22.04 OS | Data Engineering | Part 11 | DM | DataMaking
HTML-код
- Опубликовано: 8 сен 2024
- Download Code and Dataset from www.datamaking...
How to setup Data Engineering Development Environment | Step by Step Installation Guide: • How to setup Data Engi...
How to install Apache Hive on Ubuntu 22.04 OS | Data Engineering | Part 11 | DM | DataMaking
====================================================================
====================================================================
Create First PySpark App on Apache Spark 2.4.4 using PyCharm | PySpark 101 |Part 1| DM | DataMaking - • Create First PySpark A...
End to End Project using Spark/Hadoop | Code Walkthrough | Architecture | Part 1 | DM | DataMaking - • End to End Project usi...
Spark Structured Streaming with Kafka using PySpark | Use Case 2 |Hands-On|Data Making|DM|DataMaking - • Spark Structured Strea...
Running First PySpark Application in PyCharm IDE with Apache Spark 2.3.0 | DM | DataMaking - • Running First PySpark ...
Access Facebook API using Python in English | Hands-On | Part 3 | DM | DataMaking - • Access Facebook API us...
Real-Time Spark Project |Real-Time Data Analysis|Architecture|Part 1| DM | DataMaking | Data Making - • Real-Time Spark Projec...
Web Scraping using Python and Selenium | Scrape Facebook | Part 5 | Data Making | DM | DataMaking - • Web Scraping using Pyt...
End to End Project using Spark/Hadoop | Code Walkthrough | Kafka Producer | Part 2 | DM | DataMaking - • End to End Project usi...
Apache Zeppelin | Step-by-Step Installation Guide | Python | Notebook |DM| DataMaking | Data Making - • Apache Zeppelin | Step...
Create First RDD(Resilient Distributed Dataset) in PySpark | PySpark 101 | Part 2 | DM | DataMaking - • Create First RDD(Resil...
====================================================================
====================================================================
Join this channel to get access to perks:
/ @datamaking
Now, it's still working. Thank you for this video
I can see many insteresting about set up big data tool, I will see it in the future
Update: the command in 12:06 is wrong with me. I use CREATE USER '....'@'%' IDENTIFIED WITH mysql_native_password BY '....'; instead
Thanks for the video, and for being human! Keep making data!
Thanks, will do!
Thanks Brother, worked fine :)
You are welcome brother. Appreciate for trying out and providing your feedback.
Thank you so much for this video.
I FOLLOW all the steps but I still getting same error after using --verbose. Is there any alternative for this...😢
Let's sync up tomorrow evening and try to resolve it if you are free.
Share the error message if you captured it.
gunjan@Ubuntu2:~$ ${HIVE_HOME}/bin/schematool -initSchema -dbType mysql --verbose
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/gunjan/apache-hive-3.1.3-bin/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/gunjan/hadoop-3.2.4/share/hadoop/common/lib/slf4j-reload4j-1.7.35.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:mysql://localhost/metastore?createDatabaseIfNotExist=true&autoReconnect=true&useSSL=false
Metastore Connection Driver : com.mysql.cj.jdbc.Driver
Metastore connection User: hive
org.apache.hadoop.hive.metastore.HiveMetaException: Failed to get schema version.
Underlying cause: java.sql.SQLNonTransientConnectionException : Could not create connection to database server. Attempted reconnect 3 times. Giving up.
SQL Error code: 0
org.apache.hadoop.hive.metastore.HiveMetaException: Failed to get schema version.
at org.apache.hadoop.hive.metastore.tools.HiveSchemaHelper.getConnectionToMetastore(HiveSchemaHelper.java:94)
at org.apache.hive.beeline.HiveSchemaTool.getConnectionToMetastore(HiveSchemaTool.java:169)
at org.apache.hive.beeline.HiveSchemaTool.testConnectionToMetastore(HiveSchemaTool.java:475)
at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:581)
at org.apache.hive.beeline.HiveSchemaTool.doInit(HiveSchemaTool.java:567)
at org.apache.hive.beeline.HiveSchemaTool.main(HiveSchemaTool.java:1517)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
Caused by: java.sql.SQLNonTransientConnectionException: Could not create connection to database server. Attempted reconnect 3 times. Giving up.
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:111)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:98)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:90)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:64)
at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:74)
at com.mysql.cj.jdbc.ConnectionImpl.connectWithRetries(ConnectionImpl.java:885)
at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:810)
at com.mysql.cj.jdbc.ConnectionImpl.(ConnectionImpl.java:438)
at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:241)
at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:189)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:247)
at org.apache.hadoop.hive.metastore.tools.HiveSchemaHelper.getConnectionToMetastore(HiveSchemaHelper.java:88)
... 11 more
Caused by: com.mysql.cj.exceptions.CJException: Public Key Retrieval is not allowed
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:61)
at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:104)
at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:149)
at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122)
at com.mysql.cj.protocol.a.authentication.CachingSha2PasswordPlugin.nextAuthenticationStep(CachingSha2PasswordPlugin.java:154)
at com.mysql.cj.protocol.a.authentication.CachingSha2PasswordPlugin.nextAuthenticationStep(CachingSha2PasswordPlugin.java:49)
at com.mysql.cj.protocol.a.NativeAuthenticationProvider.proceedHandshakeWithPluggableAuthentication(NativeAuthenticationProvider.java:446)
at com.mysql.cj.protocol.a.NativeAuthenticationProvider.connect(NativeAuthenticationProvider.java:215)
at com.mysql.cj.protocol.a.NativeProtocol.connect(NativeProtocol.java:1428)
at com.mysql.cj.NativeSession.connect(NativeSession.java:133)
at com.mysql.cj.jdbc.ConnectionImpl.connectWithRetries(ConnectionImpl.java:829)
... 18 more
Caused by: com.mysql.cj.exceptions.UnableToConnectException: Public Key Retrieval is not allowed
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:61)
at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:85)
at com.mysql.cj.protocol.a.authentication.CachingSha2PasswordPlugin.nextAuthenticationStep(CachingSha2PasswordPlugin.java:131)
... 24 more
*** schemaTool failed ***
@@DataMaking I got this error.
@@DataMaking I got the same error message, did you get it fixed?
@@rainbowpanda7042 thank you for showing interest on my technical content. Please share your error message 🙏
@@DataMaking apparently the issue is with the hive-site.xml, hive isn't able to connect to my metastore for some reason. Where can I find the hive-site.xml configuration file you used in your video?
Also a big thank you for making these videos they helped a whole lot
please share that xml code
Hi, you should be able to get it if you sign up and sign in here: datamaking.com/download/
Getting the error after verbose please resolve it make a new video
@@DataMaking