栏目分类:
子分类:
返回
名师互学网用户登录
快速导航关闭
当前搜索
当前分类
子分类
实用工具
热门搜索
名师互学网 > IT > 软件开发 > 后端开发 > Java

华为fusionInsight集群客户端安装

Java 更新时间: 发布时间: IT归档 最新发布 模块sitemap 名妆网 法律咨询 聚返吧 英语巴士网 伯小乐 网商动力

华为fusionInsight集群客户端安装

1.集群下载客户端

从FusionInsight Manager上下载Fusioninsight的客户端,服务管理->下载客户端->完整客户端,上传服务器解压

注意:客户端生成及下载时间都比较长

2.创建安装目录
$: sudo mkdir /opt/third

3.安装

3.1.解压安装包
$ tar -xvf  FusionInsight_Services_Client.tar

3.2.进入安装包执行:

$: ./install.sh  /opt/third/client

4.设置环境变量

$ : source /opt/third/client/bigdata_env

5.验证

5.1.执行:
$ spark-submit

结果:

```shell
Usage: spark-submit [options] [app arguments]
Usage: spark-submit --kill [submission ID] --master [spark://...]
Usage: spark-submit --status [submission ID] --master [spark://...]
Usage: spark-submit run-example [options] example-class [example args]

Options:
  --master MASTER_URL         spark://host:port, mesos://host:port, yarn,
                              k8s://https://host:port, or local (Default: local[*]).
  --deploy-mode DEPLOY_MODE   Whether to launch the driver program locally ("client") or
                              on one of the worker machines inside the cluster ("cluster")
                              (Default: client).
  --class CLASS_NAME          Your application's main class (for Java / Scala apps).
  --name NAME                 A name of your application.
  --jars JARS                 Comma-separated list of jars to include on the driver
                              and executor classpaths.
  --packages                  Comma-separated list of maven coordinates of jars to include
                              on the driver and executor classpaths. Will search the local
                              maven repo, then maven central and any additional remote
                              repositories given by --repositories. The format for the
                              coordinates should be groupId:artifactId:version.
  --exclude-packages          Comma-separated list of groupId:artifactId, to exclude while
                              resolving the dependencies provided in --packages to avoid
                              dependency conflicts.
  --repositories              Comma-separated list of additional remote repositories to
                              search for the maven coordinates given with --packages.
  --py-files PY_FILES         Comma-separated list of .zip, .egg, or .py files to place
                              on the PYTHonPATH for Python apps.
  --files FILES               Comma-separated list of files to be placed in the working
                              directory of each executor. File paths of these files
                              in executors can be accessed via SparkFiles.get(fileName).

  --conf PROP=VALUE           Arbitrary Spark configuration property.
  --properties-file FILE      Path to a file from which to load extra properties. If not
                              specified, this will look for conf/spark-defaults.conf.
```

5.2.如果集群开启了kerberos认证,则需要集群下载对应的keytab文件到服务器

执行:

$: kinit -kt   yours_keytabs  yoursprincpal

类似kinit -kt /opt/admin.keytab admin

$:klist 检查

验证 (出现结果即成功)

$:hdfs dfs -ls /user

6.常见错误解决

6.1.执行命令sudo ./install.sh /opt/third/client的时候遇到:
[19-07-15 16:06:58]: Pre-install check begin...
[19-07-15 16:06:58]: Checking necessary files and directory.
[19-07-15 16:06:58]: Checking NTP service status.
[19-07-15 16:06:58]: Error: Network time protocol(NTP) not running. Please start NTP first.

解决:启动ntp即可
$:sudo systemctl start ntpd
 

转载请注明:文章转载自 www.mshxw.com
本文地址:https://www.mshxw.com/it/681799.html
我们一直用心在做
关于我们 文章归档 网站地图 联系我们

版权所有 (c)2021-2022 MSHXW.COM

ICP备案号:晋ICP备2021003244-6号