Easy Hive Installation Guidelines: Step-by-Step Tutorial for Hadoop on Windows 10/11 | Kundan Kumar|
HTML-код
- Опубликовано: 15 июн 2024
- In this video, I will guide on installing Apache Hive for Hadoop 3.2.4! and we'll walk you through each step to set up Hive, including prerequisites, configuring Apache Derby, setting environmental variables, and more.
Download Essential Files:
1) Apache hive installation Guidelines on windows: drive.google.com/file/d/183F6...
2) To download derby : db.apache.org/derby/derby_dow...
3) To download HIVE : archive.apache.org/dist/hive/...
4) 2) To download hive-site.xml files: drive.google.com/file/d/1_h8d...
5) To download wget : eternallybored.org/misc/wget/
6) To Download Windows Version of Hive Bin folder command: wget -r -np -nH --cut-dirs=3 -R index.html svn.apache.org/repos/asf/hive...
Please you do subscribe my channel.
Thank you for watching this video.
Top-notch tutorial.I was able to successfully install HIVE👌Looking forward to other helpful tutorials, Thanks
Happy to know that this tutorial helped you to install and configure HIVE successfully. Enjoy your learning. Yes soon I will publish a new video on bigdtaa tools 🔥
This video tutorial is very easy to understand and all steps are well demonstrated. It is very helpful ❤
I am glad to know that this video is very easy to understand and it was helpful to you ❤️
Thank you for the good tutorial. I am facing this error "Missing hadoop installation: C:\hadoop-3.3.6\hadoop-3.3.6\bin must be set" after running this hive --service schematool --dbType derby -initSchema
I am glad to know that this tutorial is good❤️. As per error shared. I can see your Hadoop version is 3.3.6. I believe your Hadoop is working fine. But Hive is making an issue. Hive Version we are using is Hive 3.1.2 which is not compatible with the Hadoop 3.3.6 version it seems. For me I have used Hadoop 3.2.4 version which is compatible with Hive3.1.2 . This below link may help you to download Hadoop 3.2.4. otherwise you need to research Compatible Hive version of Hadoop 3.3.6. hope you got me well dear. archive.apache.org/dist/hadoop/common/
Addition to this, you can find on my channel video Easy Hadoop Installation on windows 10/11 (in this video, I am installing Hadoop 3.2.4 .
@@kundankumar011 I used Hive 4.0.0 which is compatible with hadoop 3.3.6 but still I am facing the same problem
@@ishimwejoshua2766 dear Joshua. If it's really compatible and Hadoop is well configured the same error should not be promoted. I really wonder.
Hello sir , when try to run StartNetworkServer -h 0.0.0.0 it displays an error message the command is not recognised as an internal or external command or operable program
Hi dear.
1) Ensure Apache Derby is installed on your system. If it is not installed, in this video it shown how to download and configure
2) Add Environmental variable DERBY_HOME : C:\derby (This based on my computer and shown in video)
3) Add C:\derby\bin to the Path of Environmnetal variable. This is because the StartNetworkServer script is typically located in the bin directory of the Derby installation.
N.B: It's always good practice to re-start all service. After making the change, don't forget to reopen Command prompt as Administrator
Hope this will help you.
This worked for me Thanks.
@@onem3929 Glad to know it worked for you as well ❤️
Thank you for the detailed and helpful video on installing HIVE, Sir! It was incredibly useful and made the installation process much clearer.
However, I encountered an issue where some Hadoop processes run successfully (like NodeManager and DataNode), but others do not (like NameNode and ResourceManager). Could this discrepancy be causing issues with creating databases in Hive? If so, what steps would you recommend to ensure all necessary Hadoop processes are running smoothly?
I am glad to know that this video tutorial is very helpful. Please provide me a few details before I guide you to fix.
1) check Hadoop demons by using jps command then check still namenode and resource manager running? I think it runs once then closes automatically??
@@kundankumar011 datanode is not running but everything else is running as well as hive!
The logs indicate an incompatible cluster ID error!
@@uweragisele1489 try to create ba database on hive. Use hive command "create database Gisele" Then use command "show databses;" just to confirm all is working. Because I am suspecting dear. Datanode is the storage of the hive databases and table based on hive configuration. Let me know after performing the above commands.
@@kundankumar011 All is working, Sir! show databases; create database; use database; create table; show tables; .... all these commands are working
@@uweragisele1489 cool. Then enjoy. Rest we will see later on
Sir, plz upload Hbase installation and table creation
Yes, dear. I will try to find the time to work on your requested topic: HBase installation and table creation. Thank you so much for the suggestion. ❤ If I’m not mistaken, have you subscribed to my channel? So that you cannot miss the new upload notifications.
Hello Sir, i was trying to run this command "hive --service schematool -dbType derby -initSchema" i am encountering this error: SLF4J: Class path contains multiple SLF4J bindings and Exception in thread "main" java.lang.UnsupportedOperationException: 'posix:permissions' not supported as initial attribute
Hello dear. this is warning it seems, not an error. if you want to fix this warning you need to navigate to C:\hadoop\share\hadoop\common\lib and remane slf4j-reload4j-1.7.35.jar as slf4j-reload4j-1.7.35.jar.bak (In short we are keeping as a backup)
@@kundankumar011 Thank you:)
@@PhilemonIransubije Welcome❤
@@kundankumar011 , Dear Sir , the file seem not to be editable since they are in use. any other procedures ?
@@EmmaBemmly Just shutdown/close all the services then open the file to edit thereafter restart the all the required services dear❤️
Hi @kundankumar011 , I am facing this error and I installed everything as you said but I'm facing this error , could you please explain this a bit and I have been trying this from yesterday , C:\hive\bin>hive --service schematool -dbType derby -initSchema
"Missing hadoop installation: C:\hadoop\bin must be set"
Dear Sai Nirmal. Sorry to know that you are facing error. The error "Missing hadoop installation: C:\hadoop\bin must be set" indicates that Hive is unable to locate the Hadoop installation. This usually happens because the Hadoop environment variables are not correctly set up, or Hadoop is not installed in the expected location. But i believe your Hadoop Deamons are running if its running then based on my experience it could be Hive Version Compatibility issues with Hadoop you have installed on your machine. I have used Hadoop 3.2.4 Version on my machine. Hope you get me well dear.
@@kundankumar011 Thank you for your response , I have done everything as in the video kumar but I cannot fix this and I checked other comment and "I change .jar to .bak file" , Now I am unable to run commands in HDFS, could you please tell me how to change the ".bak file to .jar file" again, and I used the same version from the Google Drive's which you used, please help , I am trying this from long time ..
@@SaiNirmalReddyGavini-k2oI am very sorry to know still you are experiencing issues. Just try to remove .bak extension and maintain .jar file. For example: Navigate to the directory where the .jar.bak file is located.
Right-click on the file and select Rename.
Remove the .bak extension and press Enter. Hope this simple way can help you if it is not working then you can go to zip file hadoop extract somewhere else and just copy the jar file you renamed and paste it here. Let me know which version of Hadoop you are using dear?
@@kundankumar011 Thankyou kumar, I resolved the jar error and I am using the same Hadoop 3.2.4 version which you shown in the video ,but I can't understand why I am unable to set the error of hive - C:\hive\bin>hive --service schematool -dbType derby -initSchema
"Missing hadoop installation: C:\hadoop\bin must be set"
do we have any other way , please tell me I will work on it until I get this , thankyou..
@@SaiNirmalReddyGavini-k2o Good to know that you managed to recover your jar file. To fix raised issue can you try this and see if it helps to you.
Set Variables Temporarily for the Session: Try setting the environment variables temporarily for the current command prompt session and then run the Hive schema tool command again. Run below commands:
set HADOOP_HOME=C:\hadoop
set PATH=%PATH%;%HADOOP_HOME%\bin
hive --service schematool -dbType derby -initSchema
if this also doesn't help you. Please share with me content of "hive-site.xml" file. Just copy paste the content of hive-site.xml file in comment box