centos7构建kylo-0.10.1

 

构建服务器使用centos7，8G内存。建议使用8G内存，因为内存不够失败了好几次。

系统需要提前安装一下组件：

yum install -y gcc bzip2 rpm-build rpmdevtools rpmlint

1.安装jdk1.8

vi /etc/profile

export JAVA_HOME=/opt/jdk/jdk1..0_161
export PATH=$JAVA_HOME/bin:$PATH
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar

2.安装maven

访问maven网站，找一个合适的版本

http://maven.apache.org/download.cgi

wget http://mirrors.tuna.tsinghua.edu.cn/apache/maven/maven-3/3.6.1/binaries/apache-maven-3.6.1-bin.tar.gz
tar zxvf apache-maven-3.6.-bin.tar.gz

解压后放在合适的目录，这里以/opt/maven/为例

vi /etc/profile

export M2_HOME=/opt/maven/apache-maven-3.6.
export PATH=$PATH:$JAVA_HOME/bin:$M2_HOME/bin

source /etc/profile

修改本地仓库位置

vi /opt/maven/apache-maven-3.6.1/conf/settings.xml

设置本地存储库

<localRepository>/opt/maven/localRepo</localRepository>

设置阿里云镜像

    <mirror>
       <id>nexus-aliyun</id>
       <mirrorOf>central</mirrorOf>
       <name>Nexus aliyun</name>
       <url>http://maven.aliyun.com/nexus/content/groups/public</url>
    </mirror> 

设置运行内存

vi /opt/maven/apache-maven-3.6.1/bin/mvn

MAVEN_OPTS="$MAVEN_OPTS -Xms512m -Xmx1024m"

mvn -v

Apache Maven 3.6. (d66c9c0b3152b2e69ee9bac180bb8fcc8e6af555; --05T03::+:)
Maven home: /opt/maven/apache-maven-3.6.
Java version: 1.8.0_161, vendor: Oracle Corporation, runtime: /opt/jdk/jdk1..0_161/jre
Default locale: en_US, platform encoding: UTF-
OS name: "linux", version: "3.10.0-693.el7.x86_64", arch: "amd64", family: "unix"

maven安装完成

编译kylo

参考文章

http://www.treselle.com/blog/kylo-setup-for-data-lake-management/

下载并使用maven进行编译

mkdir /opt/kylobuild
cd /opt/kylobuild
wget https://github.com/Teradata/kylo/archive/v0.10.1.tar.gz
tar zxvf v0.10.1.tar.gz
cd kylo-0.10.

设置npm代理

我本地的环境需要增加-/，才能下载npm.但在腾讯云上则不用

<npmDownloadRoot>https://registry.npm.taobao.org/npm/-/</npmDownloadRoot>

vi /opt/kylobuild/kylo-0.10.1/ui/ui-app/pom.xml

          <execution>
            <id>install node and npm</id>
            <goals>
              <goal>install-node-and-npm</goal>
            </goals>
            <configuration>
              <nodeVersion>${node.version}</nodeVersion>
              <npmVersion>${npm.version}</npmVersion>
              <nodeDownloadRoot>https://npm.taobao.org/mirrors/node/</nodeDownloadRoot>
              <npmDownloadRoot>https://registry.npm.taobao.org/npm/-/</npmDownloadRoot>
            </configuration>
          </execution>
          <execution>
            <id>npm install</id>
            <goals>
              <goal>npm</goal>
            </goals>
            <configuration>
              <arguments>install</arguments>
              <npmRegistryURL>https://registry.npm.taobao.org</npmRegistryURL>
            </configuration>
          </execution>

vi /opt/kylobuild/kylo-0.10.1/install/install-inspector/install-inspector-app/pom.xml

273行左右

                    <executions>
                            <execution>
                                <id>install node and yarn</id>
                                <goals>
                                    <goal>install-node-and-yarn</goal>
                                </goals>
                                <configuration>
                                    <nodeVersion>${node.version}</nodeVersion>
                                    <yarnVersion>${yarn.version}</yarnVersion>
                                    <nodeDownloadRoot>https://npm.taobao.org/mirrors/node/</nodeDownloadRoot>
                                    <npmDownloadRoot>https://registry.npm.taobao.org/npm/-/</npmDownloadRoot>
                                </configuration>
                            </execution>
                            <execution>
                                <id>webpack build dev</id>
                                <goals>
                                    <goal>yarn</goal>
                                </goals>
                                <phase>generate-resources</phase>
                                <configuration>
                                    <arguments>run webpack:build</arguments>
                                    <yarnInheritsProxyConfigFromMaven>false</yarnInheritsProxyConfigFromMaven>
                                    <npmRegistryURL>https://registry.npm.taobao.org</npmRegistryURL>
                                </configuration>
                            </execution>
                        </executions>

396行左右

 <execution>
                                <id>install node and yarn</id>
                                <goals>
                                    <goal>install-node-and-yarn</goal>
                                </goals>
                                <configuration>
                                    <nodeVersion>${node.version}</nodeVersion>
                                    <yarnVersion>${yarn.version}</yarnVersion>
                                    <nodeDownloadRoot>https://npm.taobao.org/mirrors/node/</nodeDownloadRoot>
                                    <npmDownloadRoot>https://registry.npm.taobao.org/npm/-/</npmDownloadRoot>
                                </configuration>
                            </execution>

开始编译

mvn clean install -DskipTests

构建十分漫长，可能需要一到两个小时。

查看打出的tar：

cd /opt/kylobuild/kylo-0.10.1/install/install-tar/target

查看打出的rpm

/opt/kylobuild/kylo-0.10.1/install/install-rpm/target/rpm/kylo/RPMS/noarch

构建失败的处理：

1.maven内存不足，执行过程中被kill

设置MAVEN_OPS

2.maven包下载慢或下载失败

设置阿里云maven镜像

3.ui工程构建失败（npm下载失败）

设置淘宝的npm代理

4.执行过程中提示命令失败

安装操作系统的工具包

5.其它

再构建一次