本文主要讲解如何编译安装配置 Hadoop2.x eclipse plugin插件的详细过程：
- 环境参数
- 编译过程
- 安装配置
[一]、环境参数
- Eclipse Juno Service Release 2
- Hadoop2.2.0
- Java 1.6.0_65
- Mac OXS 10.9.2
[二]、编译过程
目前Hadoop2.x的插件源码托管在github上，第一步肯定是下载源码
|
1 |
git clone https://github.com/winghc/hadoop2x-eclipse-plugin.git |
编译源码：
|
1 2 3 |
$cd src/contrib/eclipse-plugin $ant jar -Dversion=2.2.0 -Declipse.home=/Applications/eclipse -Dhadoop.home=/usr/local/share/hadoop |
但是在我的机器上第一次编译时失败了,类似下面的错误信息：
|
1 2 3 4 5 6 7 8 9 |
............ [javac] Compiling 45 source files to /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/build/contrib/eclipse-plugin/classes [javac] /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/src/contrib/eclipse-plugin/src/java/org/apache/hadoop/eclipse/MapReduceNature.java:35: package org.eclipse.jdt.core does not exist [javac] import org.eclipse.jdt.core.IClasspathEntry; [javac] ^ [javac] /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/src/contrib/eclipse-plugin/src/java/org/apache/hadoop/eclipse/MapReduceNature.java:36: package org.eclipse.jdt.core does not exist [javac] import org.eclipse.jdt.core.IJavaProject; [javac] ^ .............. |
初步判断估计是我的eclipse中没有 org.eclipse.jdt.core* 相关lib包，无法找到类引起的，后来去我的本机目录 /Applications/eclipse/plugins/ 下查看发现确实没有类似的lib包，证明了之前的判断。只好从其他同事电脑上找到一个 org.eclipse.jdt.core_3.7.3.v20120119-1537.jar copy到插件的源码目录 src/contrib/eclipse-plugin/lib 下，同时需要修改 src/contrib/eclipse-plugin/build.xml 文件，增加两处修改具体如下：
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
<import file="../build-contrib.xml"/> <!-- ex-jar 是需要增加的配置 micmiu.com--> <path id="ex-jars"> <fileset dir="./"> <include name="org.eclipse.jdt*.jar"/> </fileset> </path> ...... <!-- Override classpath to include Eclipse SDK jars --> <path id="classpath"> <pathelement location="${build.classes}"/> <!--pathelement location="${hadoop.root}/build/classes"/--> <path refid="eclipse-sdk-jars"/> <path refid="hadoop-sdk-jars"/> <!-- 需要增加的配置 micmiu.com--> <path refid="ex-jars"/> </path> ...... |
然后再执行编译命令，看到 BUILD SUCCESSFUL 表示编译成功：
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 |
micmiu-mbp:eclipse-plugin micmiu$ ant jar -Dversion=2.2.0 -Declipse.home=/Applications/eclipse -Dhadoop.home=/usr/local/share/hadoop Buildfile: /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/src/contrib/eclipse-plugin/build.xml check-contrib: init: [echo] contrib: eclipse-plugin init-contrib: ivy-download: [get] Getting: http://repo2.maven.org/maven2/org/apache/ivy/ivy/2.1.0/ivy-2.1.0.jar [get] To: /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/ivy/ivy-2.1.0.jar [get] Not modified - so not downloaded ivy-probe-antlib: ivy-init-antlib: ivy-init: [ivy:configure] :: Ivy 2.1.0 - 20090925235825 :: http://ant.apache.org/ivy/ :: [ivy:configure] :: loading settings :: file = /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/ivy/ivysettings.xml ivy-resolve-common: ivy-retrieve-common: [ivy:cachepath] DEPRECATED: 'ivy.conf.file' is deprecated, use 'ivy.settings.file' instead [ivy:cachepath] :: loading settings :: file = /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/ivy/ivysettings.xml compile: [echo] contrib: eclipse-plugin ...... [javac] Note: Some input files use or override a deprecated API. [javac] Note: Recompile with -Xlint:deprecation for details. [javac] Note: Some input files use unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. [javac] 7 warnings jar: [mkdir] Created dir: /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/build/contrib/eclipse-plugin/lib [copy] Copying 9 files to /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/build/contrib/eclipse-plugin/lib ...... [jar] Building jar: /Users/micmiu/no_sync/opensource_code/hadoop/hadoop2x-eclipse-plugin/build/contrib/eclipse-plugin/hadoop-eclipse-plugin-2.2.0.jar BUILD SUCCESSFUL Total time: 37 seconds micmiu-mbp:eclipse-plugin m |
编译成功后可以在 build/contrib/eclipse-plugin/hadoop-eclipse-plugin-2.2.0.jar 找到生成的jar包。
下载地址：http://yun.baidu.com/s/1o6K457c#dir/path=%2Fsourcecode%2Fbuilder
[三]、安装配置
1、复制生成的 hadoop-eclipse-plugin-2.2.0.jar 到 eclipse/plugins 路径下,重启eclipse即可。
2、在eclipse菜单依次点击 windows → show view → other… ，选择“Show View”对话框打开，搜索框输入“map”，会找到项“Map/Reduce Locations”，点击“确定”按钮：
3、控制台会多出一个“Map/Reduce Locations”的Tab页：
4、在“Map/Reduce Locations” Tab页 点击图标 
或者在空白的地方右键，选择“New Hadoop location…”，弹出对话框“New hadoop location…”，配置如下内容：
- Location name ：随便取个名字 比如 hadoop2.2.0
- Map/Reduce（V2） Master ：根据
hdfs-site.xml中配置dfs.datanode.ipc.address的值填写 - DFS Master： Name Node的IP和端口，根据
core-site.xml中配置fs.defaultFS的值填写
配置成功后可以看到类似如下信息：
5、打开“preferences”对话框，搜索“hadoop”，找到”Hadoop Map/Reduce”项，点击”Browse…” 配置hadoop的路径，比如我的路径是 /usr/local/share/hadoop-2.2.0
—————– EOF @Michael Sun —————–
0 条评论。