离线安装Cloudera Manager 5和CDH5(最新版5.9.3) 完全教程（七）界面安装

一、安装过程

1.1　登录

1.2　接受许可协议

1.3　选择免费版本

1.4　选择下一步

1.5　选择当前管理的主机

1.6　选择使用Parcel安装，选择CDH版本，点击继续

1.7　等待安装

此处安装需要等待一段时间，请耐心等待，安装过程可能需要30分钟时间，这和物理机器的磁盘读写速度和机器性能有关，如果中断请继续之前的步骤重新操作，下图是安装成功界面

1.8　集群检测

检测全部通过

1.9　选择自定义服务，选择要安装的组件

1.10　分配角色

1.11　数据库设置

选择对应的数据库，点击测试连接，通过之后，继续

1.12　集群设置

使用默认设置即可

1.13　首次安装组件

1.14　安装Spark报错

查看stderr查看报错信息，发现找不到JAVA_HOME

解决方法：需要每个节点都操作

在以下文件中手工添加JAVA_HOME

[root@master soft]# cd /opt/cloudera-manager/cm-5.9./lib64/cmf/service/client/
[root@master client]# vi deploy-cc.sh 

保存之后

[root@master client]# cat /etc/environment

点击重试

1.15　安装Hive报错

查看stderr查看报错信息，发现hive初始化失败

处理过程：

（1）     拷贝jdbc驱动包

[root@master ~]# cp /root/soft/mysql-connector-java-5.1.-bin.jar /opt/cloudera/parcels/CDH-5.9.-.cdh5.9.3.p0./lib/hive/lib/

点击重试，仍旧报错

点击查看完整日志

点击链接

在搜索框中搜索hive.metastore.schema.verification，把勾选去掉，保存更改，返回安装界面点击重试

继续报错，查看完整日志

 Java HotSpot(TM) -Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0
 Java HotSpot(TM) -Bit Server VM warning: Using incremental CMS is deprecated and will likely be removed in a future release
 Java HotSpot(TM) -Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0
 javax.jdo.JDOUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it.
     at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:)
     at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:)
     at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:)
     at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:)
     at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:)
     at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:)
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:)
     at java.lang.reflect.Method.invoke(Method.java:)
     at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:)
     at com.sun.proxy.$Proxy6.verifySchema(Unknown Source)
     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:)
     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:)
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:)
     at java.lang.reflect.Method.invoke(Method.java:)
     at org.apache.hadoop.util.RunJar.run(RunJar.java:)
     at org.apache.hadoop.util.RunJar.main(RunJar.java:)
 NestedThrowablesStackTrace:
 Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it.
 org.datanucleus.exceptions.NucleusUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it.
     at org.datanucleus.store.rdbms.valuegenerator.TableGenerator.createRepository(TableGenerator.java:)
     at org.datanucleus.store.rdbms.valuegenerator.AbstractRDBMSGenerator.obtainGenerationBlock(AbstractRDBMSGenerator.java:)
     at org.datanucleus.store.valuegenerator.AbstractGenerator.obtainGenerationBlock(AbstractGenerator.java:)
     at org.datanucleus.store.valuegenerator.AbstractGenerator.next(AbstractGenerator.java:)
     at org.datanucleus.store.rdbms.RDBMSStoreManager.getStrategyValueForGenerator(RDBMSStoreManager.java:)
     at org.datanucleus.store.AbstractStoreManager.getStrategyValue(AbstractStoreManager.java:)
     at org.datanucleus.ExecutionContextImpl.newObjectId(ExecutionContextImpl.java:)
     at org.datanucleus.state.JDOStateManager.setIdentity(JDOStateManager.java:)
     at org.datanucleus.state.JDOStateManager.initialiseForPersistentNew(JDOStateManager.java:)
     at org.datanucleus.state.ObjectProviderFactoryImpl.newForPersistentNew(ObjectProviderFactoryImpl.java:)
     at org.datanucleus.ExecutionContextImpl.newObjectProviderForPersistentNew(ExecutionContextImpl.java:)
     at org.datanucleus.ExecutionContextImpl.persistObjectInternal(ExecutionContextImpl.java:)
     at org.datanucleus.ExecutionContextImpl.persistObjectWork(ExecutionContextImpl.java:)
     at org.datanucleus.ExecutionContextImpl.persistObject(ExecutionContextImpl.java:)
     at org.datanucleus.ExecutionContextThreadedImpl.persistObject(ExecutionContextThreadedImpl.java:)
     at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:)
     at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:)
     at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:)
     at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:)
     at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:)
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:)
     at java.lang.reflect.Method.invoke(Method.java:)
     at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:)
     at com.sun.proxy.$Proxy6.verifySchema(Unknown Source)
     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:)
     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:)
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:)
     at java.lang.reflect.Method.invoke(Method.java:)
     at org.apache.hadoop.util.RunJar.run(RunJar.java:)
     at org.apache.hadoop.util.RunJar.main(RunJar.java:)
 Exception in thread "main" javax.jdo.JDOUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it.
     at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:)
     at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:)
     at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:)
     at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:)
     at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:)
     at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:)
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:)
     at java.lang.reflect.Method.invoke(Method.java:)
     at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:)
     at com.sun.proxy.$Proxy6.verifySchema(Unknown Source)
     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:)
     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:)
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:)
     at java.lang.reflect.Method.invoke(Method.java:)
     at org.apache.hadoop.util.RunJar.run(RunJar.java:)
     at org.apache.hadoop.util.RunJar.main(RunJar.java:)
 NestedThrowablesStackTrace:
 Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it.
 org.datanucleus.exceptions.NucleusUserException: Could not create "increment"/"table" value-generation container hivedb.`SEQUENCE_TABLE` since autoCreate flags do not allow it.
     at org.datanucleus.store.rdbms.valuegenerator.TableGenerator.createRepository(TableGenerator.java:)
     at org.datanucleus.store.rdbms.valuegenerator.AbstractRDBMSGenerator.obtainGenerationBlock(AbstractRDBMSGenerator.java:)
     at org.datanucleus.store.valuegenerator.AbstractGenerator.obtainGenerationBlock(AbstractGenerator.java:)
     at org.datanucleus.store.valuegenerator.AbstractGenerator.next(AbstractGenerator.java:)
     at org.datanucleus.store.rdbms.RDBMSStoreManager.getStrategyValueForGenerator(RDBMSStoreManager.java:)
     at org.datanucleus.store.AbstractStoreManager.getStrategyValue(AbstractStoreManager.java:)
     at org.datanucleus.ExecutionContextImpl.newObjectId(ExecutionContextImpl.java:)
     at org.datanucleus.state.JDOStateManager.setIdentity(JDOStateManager.java:)
     at org.datanucleus.state.JDOStateManager.initialiseForPersistentNew(JDOStateManager.java:)
     at org.datanucleus.state.ObjectProviderFactoryImpl.newForPersistentNew(ObjectProviderFactoryImpl.java:)
     at org.datanucleus.ExecutionContextImpl.newObjectProviderForPersistentNew(ExecutionContextImpl.java:)
     at org.datanucleus.ExecutionContextImpl.persistObjectInternal(ExecutionContextImpl.java:)
     at org.datanucleus.ExecutionContextImpl.persistObjectWork(ExecutionContextImpl.java:)
     at org.datanucleus.ExecutionContextImpl.persistObject(ExecutionContextImpl.java:)
     at org.datanucleus.ExecutionContextThreadedImpl.persistObject(ExecutionContextThreadedImpl.java:)
     at org.datanucleus.api.jdo.JDOPersistenceManager.jdoMakePersistent(JDOPersistenceManager.java:)
     at org.datanucleus.api.jdo.JDOPersistenceManager.makePersistent(JDOPersistenceManager.java:)
     at org.apache.hadoop.hive.metastore.ObjectStore.setMetaStoreSchemaVersion(ObjectStore.java:)
     at org.apache.hadoop.hive.metastore.ObjectStore.checkSchema(ObjectStore.java:)
     at org.apache.hadoop.hive.metastore.ObjectStore.verifySchema(ObjectStore.java:)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:)
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:)
     at java.lang.reflect.Method.invoke(Method.java:)
     at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:)
     at com.sun.proxy.$Proxy6.verifySchema(Unknown Source)
     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:)
     at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:)
     at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:)
     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:)
     at java.lang.reflect.Method.invoke(Method.java:)
     at org.apache.hadoop.util.RunJar.run(RunJar.java:)
     at org.apache.hadoop.util.RunJar.main(RunJar.java:)

报错原因：

mysql数据库的binlog_format参数设置不正确，原来设置的是STATEMENT，修改为MIXED，修改方法，在/usr/my.cnf文件中加上binlog_format=MIXED

然后重启mysql数据库,再次点击重试，全部通过。点击继续

1.16　完成安装

二、调试

2.1　安装完成

2.2　HDFS配置报警告

点击黄色的扳手，查看是NameNode的Java堆栈大小

修改为4吉字节点击保存，框中全部改为4吉字节

重启过时服务

2.2　启用HDFS的高可用