栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 前沿技术 > 大数据 > 大数据系统

Hadoop之Hibench的安装配置(详细步骤)

Hadoop之Hibench的安装配置(详细步骤)

配置前准备

下载Hibench-master.zip的安装包并解压,将解压后的HiBench-master上传到XShell

或者直接将 Hibench-master.zip的安装包上传到xshell 并解压

解压安装包

输入解压命令:

unzip Hibench-master.zip

配置

cd /home/ZQ/HiBench-master/conf/

1、配置hadoop.conf

vim hadoop.conf

将配置文件改为: 

# Hadoop home
hibench.hadoop.home    /home/ZQ/hadoop-2.7.6

# The path of hadoop executable
hibench.hadoop.executable     ${hibench.hadoop.home}/bin/hadoop

# Hadoop configraution directory
hibench.hadoop.configure.dir  ${hibench.hadoop.home}/etc/hadoop

# The root HDFS path to store HiBench data
hibench.hdfs.master       hdfs://westgisB062:8020/home/ZQ/HiBench-master


# Hadoop release provider. Supported value: apache, cdh5, hdp
hibench.hadoop.release    apache

2、配置hibench.conf

vim hibench.conf

 

运行Hibench

1、启动集群和yarn

start-dfs.sh
start-yarn.sh

2、生成wordcount测试数据

cd HiBench-master/
bin/workloads/micro/wordcount/prepare/prepare.sh

3、运行 wordcount测试例子

bin/workloads/micro/wordcount/hadoop/run.sh

4、查看测试报告

cd report/
cat hibench.report

 (测试其他例子也同理)

运行所有在conf/benchmarks.lst和conf/frameworks.lst 配置的测试实例

 cd HiBench-master/
bin/run_all.sh

 

查看测试报告

cd report/
cat hibench.report

5、关闭yarn和集群

cd
stop-yarn.sh
stop-dfs.sh

转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/651306.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号