Ubuntu 11.10 上 Hadoop 环境搭建笔记
正在加载中...
资料简介：
目录
一、JDK的安装与环境变量配置 ...................................................................................... 2
Master机：（64位） .................................................................................................. 2
1.JDK安装......................................................................................................... 2
2.环境变量设置 .................................................................................................. 3
Slave机：（32位） .................................................................................................... 5
1.JDK安装......................................................................................................... 5
2.环境变量设置 .................................................................................................. 6
3.进行测试 ......................................................................................................... 6
二、配置NameNode和DataNode ..................................................................................... 8
Ubuntu 11.10 系统默认的hosts 文件内容如下： ..................................................... 8
修改为以下内容 ........................................................................................................ 8
三、安装配置SSH ........................................................................................................... 9
1.安装SSH................................................................................................................ 9
2.配置SSH.............................................................................................................. 11
3.测试SSH.............................................................................................................. 13
四、安装、配置Hadoop ................................................................................................. 13
1.安装Hadoop ......................................................................................................... 13
2.配置Hadoop ......................................................................................................... 14
（1）hadoop-env.sh........................................................................................... 14
（2）core-site.xml ............................................................................................ 14
（3）mapred-site.xml ........................................................................................ 15
（4）hdfs-site.xml ............................................................................................ 15
（5）masters和slaves文件 .............................................................................. 15
3.测试使用Hadoop .................................................................................................. 16
格式化HDFS ..................................................................................................... 16
启动hadoop ..................................................................................................... 17
查看运行状态................................................................................................... 18
一、JDK的安装与环境变量配置 ...................................................................................... 2
Master机：（64位） .................................................................................................. 2
1.JDK安装......................................................................................................... 2
2.环境变量设置 .................................................................................................. 3
Slave机：（32位） .................................................................................................... 5
1.JDK安装......................................................................................................... 5
2.环境变量设置 .................................................................................................. 6
3.进行测试 ......................................................................................................... 6
二、配置NameNode和DataNode ..................................................................................... 8
Ubuntu 11.10 系统默认的hosts 文件内容如下： ..................................................... 8
修改为以下内容 ........................................................................................................ 8
三、安装配置SSH ........................................................................................................... 9
1.安装SSH................................................................................................................ 9
2.配置SSH.............................................................................................................. 11
3.测试SSH.............................................................................................................. 13
四、安装、配置Hadoop ................................................................................................. 13
1.安装Hadoop ......................................................................................................... 13
2.配置Hadoop ......................................................................................................... 14
（1）hadoop-env.sh........................................................................................... 14
（2）core-site.xml ............................................................................................ 14
（3）mapred-site.xml ........................................................................................ 15
（4）hdfs-site.xml ............................................................................................ 15
（5）masters和slaves文件 .............................................................................. 15
3.测试使用Hadoop .................................................................................................. 16
格式化HDFS ..................................................................................................... 16
启动hadoop ..................................................................................................... 17
查看运行状态................................................................................................... 18
2014-12-11
浏览1592
下载31