hudi-0.10.0编译

一、系统环境二、编译过程三、小结

操作系统

Linux 3.10.0-862.el7.x86_64 #1 SMP 2018 x86_64 x86_64 x86_64 GNU/Linux

hadoop版本

hadoop-3.1.3 

maven版本

maven-3.8.4

maven的镜像源

    
      alimaven
      aliyun maven
      http://maven.aliyun.com/nexus/content/groups/public
      central
    

    
      alimaven
      *
      阿里云spring插件仓库
      http://maven.aliyun.com/repository/spring-plugin
    

    
      repo2
      central
      Mirror from Maven Repo2
      https://repo.spring.io/plugins-release
    

    
      UK
      central
      UK Central
      https://uk.maven.org/maven2
    

    
      jboss-public-repository-group
      central
      JBoss Public Repository Group
      https://repository.jboss.org/nexus/content/groups/public
    

    
      CN
      central
      OSChina Central
      https://maven.oschina.net/content/groups/public
    

    
      google-maven-central
      central
      GCS Maven Central mirror Asia Pacific
      https://maven-central-asia.storage-download.googleapis.com/maven2
    

    
      confluent
      confluent
      confluent maven
      http://packages.confluent.io/maven/
    

    
      nexus-aliyun
      central
      Nexus aliyun
      http://maven.aliyun.com/nexus/content/groups/public
    
    
      maven-default-http-blocker
      external:http:*
      Pseudo repository to mirror external repositories initially using HTTP.
      http://0.0.0.0/
      true
    
  

hudi-0.10.0的下载地址

https://archive.apache.org/dist/hudi/0.10.0/

hudi-0.10.0的官网地址

https://hudi.apache.org/

集成框架

hadoop-3.1-3、Scala-2.12、spark3、hive-3.1.2

编译 （在hudi安装包的根目录下执行该语句）

mvn clean install -DskipTests -DskipITs -Dcheckstyle.skip=true -Drat.skip=true -Dhadoop.version=3.1.3 -Dscala-2.12 -Dspark3 -Pflink-bundle-shade-hive3

编译完成

我已经编译好了，有想直接用的可以私我给你发。