hadoop、hbase、hive、zookeeper版本对应关系（转载）

hadoop hbase hive 版本

一些内容：

hive、hbase、zookeeper的关系

hadoop1.2+hbase0.95.0+hive0.11.0会产生hbase+hive的不兼容，创建hive+hbase的关联表就会报pair对异常。

hadoop1.2+hbase0.94.9+hive0.10.0 没问题，解决了上个版本的不兼容问题。hadoop hbase hive 版本

hadoop-1.0.3+hive-0.9.0+hbase-0.92.0兼容

hadoop2.2+hbase0.96+hive0.12兼容（有些小问题，可能需要一些补丁）

hadoop2.2+hbase0.96+hive0.13兼容（应该兼容）

Hadoop 与hbase支持版本

S = 支持并且测试, X = 不支持, NT = 应该可以，但是没有测试.

HBase-0.92.x HBase-0.94.x HBase-0.96.x HBase-0.98.x HBase-1.0.x Hadoop-0.20.205 S X X X X Hadoop-0.22.x S XX X X Hadoop-1.0.0-1.0.2 X X X X X Hadoop-1.0.3+ S S S X XHadoop-1.1.x NT S S X X Hadoop-0.23.x X S NT X X Hadoop-2.0.x-alphaX NT X X X Hadoop-2.1.0-beta X NT S X X Hadoop-2.2.0 X NT S S NT Hadoop-2.3.x X NT S S NTHadoop-2.4.x X NT S S S Hadoop-2.5.x X NT S S S Support for Hadoop 1.x is deprecated.

Hadoop 1.x is NOT supported

HBase requires hadoop 1.0.3 at a minimum;there is an issue where we cannot find KerberosUtil compilingagainst earlier versions of Hadoop.

To get 0.94.x to run on hadoop 2.2.0, youneed to change the hadoop 2 and protobuf versions in the pom.xml:Here is a diff with pom.xml changes:

$ svn diff pom.xml Index: pom.xml===================================================================--- pom.xml (revision 1545157) +++ pom.xml (working copy) @@-1034,7 +1034,7 @@ 1.4.3 1.2.16 1.8.5 - 2.4.0a + 2.5.0 1.0.1 0.8.03.4.5 @@ -2241,7 +2241,7 @@ - 2.0.0-alpha + 2.2.0 1.6.1 The nextstep is to regenerate Protobuf files and assuming that the Protobufhas been installed:

Go to the hbase root folder, using the command line;

Type the following commands:

srcdirs = ['src/main/libs', 'src/main/jnilibs']jni。add_executable(myprogram src/main.cpp src/some_file.cpp src/another_file.cpp)。deb hardy main restricted deb-src hardy main restricted deb hardy-updates main restricted deb-src hardy-updates main restricted deb hardy universe deb-src hardy universe deb hardy-updates universe deb-src hardy-updates universe deb hardy multiverse deb-src hardy multiverse deb hardy-updates multiverse deb-src hardy-updates multiverse deb hardy-security main restricted deb-src hardy-security main restricted deb hardy-security universe deb-src hardy-security universe deb hardy-security multiverse deb-src hardy-security multiverse。

Building against the hadoop 2 profile by running something like thefollowing command:

$ mvn clean install assembly:single -Dhadoop.profile=2.0-DskipTests

Replace the HadoopBundled With HBase! Because HBase depends on Hadoop, it bundles aninstance of the Hadoop jar under its lib directory. The bundled jaris ONLY for use in standalone mode. In distributed mode, it iscritical that the version of Hadoop that is out on your clustermatch what is under HBase. Replace the hadoop jar found in theHBase lib directory with the hadoop jar you are running on yourcluster to avoid version mismatch issues. Make sure you replace thejar in HBase everywhere on your cluster. Hadoop version mismatchissues have various manifestations but often all looks like itshung up.

更新内容：

Hadoop version support matrix

· 'S' = supported

· 'X' = not supported

· 'NT' = Not tested

HBase-0.92.x

HBase-0.94.x

HBase-0.96.x

HBase-0.98.x (Support for Hadoop 1.1+ is deprecated.)

HBase-1.0.x (Hadoop 1.x is NOT supported)

Hadoop-0.20.205

S

X

X

X

X

Hadoop-0.22.x

S

X

X

X

X

Hadoop-1.0.x

X

X

X

X

X

Hadoop-1.1.x

NT

S

S

NT

X

Hadoop-0.23.x

X

S

NT

X

X

Hadoop-2.0.x-alpha

X

NT

X

X

X

Hadoop-2.1.0-beta

X

NT

S

X

X

Hadoop-2.2.0

X

NT

S

S

NT

Hadoop-2.3.x

X

NT

S

S

NT

Hadoop-2.4.x

X

NT

S

S

S

Hadoop-2.5.x

X

NT

S

S

S

本文来自电脑杂谈，转载请注明本文网址：
http://www.pc-fly.com/a/jisuanjixue/article-97814-1.html