Kylin源碼編譯

一、下載源碼

git clone https://github.com/apache/kylin kylin

二、安裝maven、nodejs

1.maven的安裝參照百度，這裡不再贅述

2.nodejs的安裝

##添加 epel 源

rpm -ivh http://download.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm

導入 key:

rpm --import /etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-6

##添加 remi 源

rpm -ivh http://rpms.famillecollet.com/enterprise/remi-release-6.rpmrpm --import /etc/pki/rpm-gpg/RPM-GPG-KEY-remi

安裝完成後,執行

curl --silent --location https://rpm.nodesource.com/setup_5.x | bash -

yum -y install nodejs

注意：node npm版本需要符合kylin編譯要求

三、編譯kylin

環境準備：：

1.1下載PhantomJS參考：http://www.cnblogs.com/zengguowang/p/6911812.html

下載地址：https://bitbucket.org/ariya/phantomjs/downloads/phantomjs-2.1.1-linux-x86_64.tar.bz2

wget https://bitbucket.org/ariya/phantomjs/downloads/phantomjs-2.1.1-linux-x86_64.tar.bz2

1.2解壓

bzip2 -d phantomjs-2.1.1-linux-x86_64.tar.bz2

tar xvf phantomjs-2.1.1-linux-x86_64.tar -C /usr/local/

1.3安裝依賴

安裝依賴軟體

yum -y install wget fontconfig

mv /usr/local/phantomjs-2.1.1-linux-x86_64/ /usr/local/phantomjs

1.4環境變量設置

vim /etc/profile

#set for phantomjs

PHANTOMJS_HOME=/usr/local/phantomjs

PATH=$PATH:$PHANTOMJS_HOME/bin

export PHANTOMJS_HOME PATH

source /etc/profile

1.5驗證

phantomjs

vi ~/.bash_profile 中增加一行，不然執行sudo 命令編譯會有問題；

alias sudo="sudo env PATH=$PATH"

source ~/.bash_profile

開始編譯

cd kylin/build/script

sudo ./package.sh -P cdh5.7

出現以下界面，說編譯成功

注意：如果存在編譯權限問題，需要帶sudo，還要注意hadoop環境變量設置問題

cdh5.7不能輸錯，不然編譯 處理 kylin啟動不了，如下錯誤：

/kylin_metadata/lockException in thread "main" java.lang.IllegalArgumentException: Failed to find metadata store by url: kylin_metadata@hbase at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:89) at org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:101) at org.apache.kylin.rest.service.AclTableMigrationTool.checkIfNeedMigrate(AclTableMigrationTool.java:94) at org.apache.kylin.tool.AclTableMigrationCLI.main(AclTableMigrationCLI.java:41)Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:83) ... 3 moreCaused by: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.HTableDescriptor.addFamily(Lorg/apache/hadoop/hbase/HColumnDescriptor;)Lorg/apache/hadoop/hbase/HTableDescriptor; at org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:320) at org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:110) at org.apache.kylin.storage.hbase.HBaseResourceStore.<init>(HBaseResourceStore.java:91) ... 8 more2017-10-18 16:53:46,956 INFO [Thread-1] client.ConnectionManager$HConnectionImplementation:1705 : Closing zookeeper sessionid=0x35ec685fa8200192017-10-18 16:53:46,962 INFO [Thread-1] zookeeper.ZooKeeper:684 : Session: 0x35ec685fa820019 closed2017-10-18 16:53:46,962 INFO [main-EventThread] zookeeper.ClientCnxn:512 : EventThread shut down2017-10-18 16:53:46,971 INFO [Thread-6] zookeeper.ZooKeeper:684 : Session: 0x25ec685f9a60023 closed2017-10-18 16:53:46,971 INFO [main-EventThread] zookeeper.ClientCnxn:512 : EventThread shut downERROR: Unknown error. Please check full log.

四、安裝

解壓

cd dist

tar -xzvf apache-kylin-2.6.0-SNAPSHOT-bin.tar.gz -C /home/dw/proc

環境變量設置

kylin配置文件修改

參考集群安裝

五、升級

備份配置文件

$KYLIN_HOME/conf/*

$KYLIN_HOME/tomcat/conf/

覆蓋$KYLIN_HOME目錄

檢查配置文件，合併配置文件；最好不要直接覆蓋，可能會出現問題