工作需要，现在开始做大数据开发了，通过下面的配置步骤，你可以在win10系统中，部署出一套hadoop+hbase，便于单机测试调试开发。

准备资料:

1.

hadoop-2.7.2:

https://mirrors.tuna.tsinghua.edu.cn/apache/hadoop/common/stable/

2.

hadoop-common-2.2.0-bin-master:

https://github.com/srccodes/hadoop-common-2.2.0-bin/archive/master.zip

3.

hbase-1.2.3:

http://apache.fayea.com/hbase/stable/

4.

jdk1.8:

http://dl-t1.wmzhe.com/30/30118/jdk_1.8.0.0_64.exe

以上压缩包用winrar解压失败的话，请下载安装 Cygwin 然后用它下的命令提示符下输入：tar  -zxvf hadoop-2.7.2.tar.gz

将下载好的3个压缩包分别解压缩到

D:\HBase\hadoop-2.7.2

D:\HBase\hadoop-common-2.2.0-bin-master

D:\HBase\hbase-1.2.3

复制 D:\HBase\hadoop-common-2.2.0-bin-master\bin 的7个文件（注意：只复制这7个）  复制到 D:\HBase\hadoop-2.7.2\bin

hadoop.dll、hadoop.exp、hadoop.lib、hadoop.pdb、libwinutils.lib、winutils.exe、winutils.pdb

配置Hadoop：

D:\HBase\hadoop-2.7.2\etc\hadoop

hadoop-env.cmd 内容如下：

@echo off

@rem Licensed to the Apache Software Foundation (ASF) under one or more

@rem contributor license agreements.  See the NOTICE file distributed with

@rem this work for additional information regarding copyright ownership.

@rem The ASF licenses this file to You under the Apache License, Version 2.0

@rem (the "License"); you may not use this file except in compliance with

@rem the License.  You may obtain a copy of the License at

@rem

@rem     http://www.apache.org/licenses/LICENSE-2.0

@rem

@rem Unless required by applicable law or agreed to in writing, software

@rem distributed under the License is distributed on an "AS IS" BASIS,

@rem WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

@rem See the License for the specific language governing permissions and

@rem limitations under the License.

@rem Set Hadoop-specific environment variables here.

@rem The only required environment variable is JAVA_HOME.  All others are

@rem optional.  When running a distributed configuration it is best to

@rem set JAVA_HOME in this file, so that it is correctly defined on

@rem remote nodes.

@rem The java implementation to use.  Required.

set JAVA_HOME=%JAVA_HOME%

@rem The jsvc implementation to use. Jsvc is required to run secure datanodes.

@rem set JSVC_HOME=%JSVC_HOME%

@rem set HADOOP_CONF_DIR=

@rem Extra Java CLASSPATH elements.  Automatically insert capacity-scheduler.

if exist %HADOOP_HOME%\contrib\capacity-scheduler (

  if not defined HADOOP_CLASSPATH (

    set HADOOP_CLASSPATH=%HADOOP_HOME%\contrib\capacity-scheduler\*.jar

  ) else (

    set HADOOP_CLASSPATH=%HADOOP_CLASSPATH%;%HADOOP_HOME%\contrib\capacity-scheduler\*.jar

  )

)

@rem The maximum amount of heap to use, in MB. Default is 1000.

@rem set HADOOP_HEAPSIZE=

@rem set HADOOP_NAMENODE_INIT_HEAPSIZE=""

@rem Extra Java runtime options.  Empty by default.

@rem set HADOOP_OPTS=%HADOOP_OPTS% -Djava.net.preferIPv4Stack=true

@rem Command specific options appended to HADOOP_OPTS when specified

if not defined HADOOP_SECURITY_LOGGER (

  set HADOOP_SECURITY_LOGGER=INFO,RFAS

)

if not defined HDFS_AUDIT_LOGGER (

  set HDFS_AUDIT_LOGGER=INFO,NullAppender

)

set HADOOP_NAMENODE_OPTS=-Dhadoop.security.logger=%HADOOP_SECURITY_LOGGER% -Dhdfs.audit.logger=%HDFS_AUDIT_LOGGER% %HADOOP_NAMENODE_OPTS%

set HADOOP_DATANODE_OPTS=-Dhadoop.security.logger=ERROR,RFAS %HADOOP_DATANODE_OPTS%

set HADOOP_SECONDARYNAMENODE_OPTS=-Dhadoop.security.logger=%HADOOP_SECURITY_LOGGER% -Dhdfs.audit.logger=%HDFS_AUDIT_LOGGER% %HADOOP_SECONDARYNAMENODE_OPTS%

@rem The following applies to multiple commands (fs, dfs, fsck, distcp etc)

set HADOOP_CLIENT_OPTS=-Xmx512m %HADOOP_CLIENT_OPTS%

@rem set HADOOP_JAVA_PLATFORM_OPTS="-XX:-UsePerfData %HADOOP_JAVA_PLATFORM_OPTS%"

@rem On secure datanodes, user to run the datanode as after dropping privileges

set HADOOP_SECURE_DN_USER=%HADOOP_SECURE_DN_USER%

@rem Where log files are stored.  %HADOOP_HOME%/logs by default.

@rem set HADOOP_LOG_DIR=%HADOOP_LOG_DIR%\%USERNAME%

@rem Where log files are stored in the secure data environment.

set HADOOP_SECURE_DN_LOG_DIR=%HADOOP_LOG_DIR%\%HADOOP_HDFS_USER%

@rem The directory where pid files are stored. /tmp by default.

@rem NOTE: this should be set to a directory that can only be written to by

@rem       the user that will run the hadoop daemons.  Otherwise there is the

@rem       potential for a symlink attack.

set HADOOP_PID_DIR=%HADOOP_PID_DIR%

set HADOOP_SECURE_DN_PID_DIR=%HADOOP_PID_DIR%

@rem A string representing this instance of hadoop. %USERNAME% by default.

set HADOOP_IDENT_STRING=%USERNAME%

set JAVA_HOME=D:\Java\jdk1.8.0_31

set HADOOP_HOME=D:\HBase\hadoop-2.7.2

set HADOOP_PREFIX=D:\HBase\hadoop-2.7.2

set HADOOP_CONF_DIR=%HADOOP_PREFIX%\etc\hadoop

set YARN_CONF_DIR=%HADOOP_CONF_DIR%

set PATH=%PATH%;%HADOOP_PREFIX%\bin

　　

core-site.xml 内容如下：

<?xml version="1.0" encoding="UTF-8"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!--

  Licensed under the Apache License, Version 2.0 (the "License");

  you may not use this file except in compliance with the License.

  You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software

  distributed under the License is distributed on an "AS IS" BASIS,

  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

  See the License for the specific language governing permissions and

  limitations under the License. See accompanying LICENSE file.

-->

<!-- Put site-specific property overrides in this file. -->

<configuration>

	<property>

		<name>fs.default.name</name>

		<value>hdfs://0.0.0.0:19000</value>

	</property>

</configuration>

　　 hdfs-site.xml 内容如下：

<?xml version="1.0" encoding="UTF-8"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!--

  Licensed under the Apache License, Version 2.0 (the "License");

  you may not use this file except in compliance with the License.

  You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

  Unless required by applicable law or agreed to in writing, software

  distributed under the License is distributed on an "AS IS" BASIS,

  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

  See the License for the specific language governing permissions and

  limitations under the License. See accompanying LICENSE file.

-->

<!-- Put site-specific property overrides in this file. -->

<configuration>

	<property>

		<name>fs.default.name</name>

		<value>hdfs://0.0.0.0:19000</value>

	</property>

</configuration>

　　创建mapred-site.xml 内容如下：中文名字处换成阁下的WINDOWS当前登录账户名

<?xml version="1.0"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<configuration>

  <property>

      <name>mapreduce.job.user.name</name>

      <value>冯明刚</value>

  </property>

  <property>

      <name>mapreduce.framework.name</name>

      <value>yarn</value>

  </property>

  <property>

      <name>yarn.apps.stagingDir</name>

      <value>/user/冯明刚/staging</value>

  </property>

  <property>

      <name>mapreduce.jobtracker.address</name>

      <value>local</value>

  </property>

</configuration>

　　

 yarn-site.xml 内容如下：
<?xml version="1.0"?>

<configuration>

  <property>

      <name>yarn.server.resourcemanager.address</name>

      <value>0.0.0.0:8020</value>

  </property>

  <property>

      <name>yarn.server.resourcemanager.application.expiry.interval</name>

      <value>60000</value>   

  </property>

  <property>

      <name>yarn.server.nodemanager.address</name>

      <value>0.0.0.0:45454</value>  

  </property> 

  <property>

      <name>yarn.nodemanager.aux-services</name>

      <value>mapreduce_shuffle</value>

  </property>

  <property>

      <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>

      <value>org.apache.hadoop.mapred.ShuffleHandler</value>

  </property>   

  <property>

      <name>yarn.server.nodemanager.remote-app-log-dir</name>

      <value>/app-logs</value>   

  </property>

  <property>

      <name>yarn.nodemanager.log-dirs</name>

      <value>/dep/logs/userlogs</value>

  </property>

  <property>

      <name>yarn.server.mapreduce-appmanager.attempt-listener.bindAddress</name>

      <value>0.0.0.0</value>   

  </property>

  <property>

      <name>yarn.server.mapreduce-appmanager.client-service.bindAddress</name>

      <value>0.0.0.0</value>

  </property>

  <property>

      <name>yarn.log-aggregation-enable</name>

      <value>true</value>

  </property>

  <property>

      <name>yarn.log-aggregation.retain-seconds</name>

      <value>-1</value>   

  </property>

  <property>

      <name>yarn.application.classpath</name>

      <value>%HADOOP_CONF_DIR%,%HADOOP_COMMON_HOME%/share/hadoop/common/*,%HADOOP_COMMON_HOME%/share/hadoop/common/lib/*,%HADOOP_HDFS_HOME%/share/hadoop/hdfs/*,%HADOOP_HDFS_HOME%/share/hadoop/hdfs/lib/*,%HADOOP_MAPRED_HOME%/share/hadoop/mapreduce/*,%HADOOP_MAPRED_HOME%/share/hadoop/mapreduce/lib/*,%HADOOP_YARN_HOME%/share/hadoop/yarn/*,%HADOOP_YARN_HOME%/share/hadoop/yarn/lib/*</value>   

  </property> 

</configuration>

　　

初始化Hadoop:

:>  cd D:\HBase\hadoop-2.7.2\etc\hadoop\

:> hadoop-env.cmd

:>%HADOOP_PREFIX%\bin\hdfs namenode -format

启动Hadoop:

:>%HADOOP_PREFIX%\sbin\start-dfs.cmd

停止Hadoop：

:>%HADOOP_PREFIX%\sbin\stop-all.cmd

配置Hbase：

编辑hbase-site.xml内容如下

<?xml version="1.0"?>

<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!--

/**

 *

 * Licensed to the Apache Software Foundation (ASF) under one

 * or more contributor license agreements.  See the NOTICE file

 * distributed with this work for additional information

 * regarding copyright ownership.  The ASF licenses this file

 * to you under the Apache License, Version 2.0 (the

 * "License"); you may not use this file except in compliance

 * with the License.  You may obtain a copy of the License at

 *

 *     http://www.apache.org/licenses/LICENSE-2.0

 *

 * Unless required by applicable law or agreed to in writing, software

 * distributed under the License is distributed on an "AS IS" BASIS,

 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

 * See the License for the specific language governing permissions and

 * limitations under the License.

 */

-->

<configuration>

  <property>

    <name>hbase.rootdir</name>

    <value>file:///D:/HBase/hbase-1.2.3/root</value>

  </property>

  <property>

    <name>hbase.tmp.dir</name>

    <value>D:/HBase/hbase-1.2.3/tmp</value>

  </property>

  <property>

    <name>hbase.zookeeper.quorum</name><value>127.0.0.1</value>

  </property>

  <property>

    <name>hbase.zookeeper.property.dataDir</name><value>D:/HBase/hbase-1.2.3/zoo</value>

  </property>

  <property>

    <name>hbase.cluster.distributed</name><value>false</value>

  </property>

</configuration>

　　编辑hbase-env.cmd内容如下：

@rem/**

@rem * Licensed to the Apache Software Foundation (ASF) under one

@rem * or more contributor license agreements.  See the NOTICE file

@rem * distributed with this work for additional information

@rem * regarding copyright ownership.  The ASF licenses this file

@rem * to you under the Apache License, Version 2.0 (the

@rem * "License"); you may not use this file except in compliance

@rem * with the License.  You may obtain a copy of the License at

@rem *

@rem *     http://www.apache.org/licenses/LICENSE-2.0

@rem *

@rem * Unless required by applicable law or agreed to in writing, software

@rem * distributed under the License is distributed on an "AS IS" BASIS,

@rem * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

@rem * See the License for the specific language governing permissions and

@rem * limitations under the License.

@rem */

@rem Set environment variables here.

@rem The java implementation to use.  Java 1.7+ required.

@rem set JAVA_HOME=c:\apps\java

@rem Extra Java CLASSPATH elements.  Optional.

@rem set HBASE_CLASSPATH=

@rem The maximum amount of heap to use. Default is left to JVM default.

@rem set HBASE_HEAPSIZE=1000

@rem Uncomment below if you intend to use off heap cache. For example, to allocate 8G of

@rem offheap, set the value to "8G".

@rem set HBASE_OFFHEAPSIZE=1000

@rem For example, to allocate 8G of offheap, to 8G:

@rem etHBASE_OFFHEAPSIZE=8G

@rem Extra Java runtime options.

@rem Below are what we set by default.  May only work with SUN JVM.

@rem For more on why as well as other possible settings,

@rem see http://wiki.apache.org/hadoop/PerformanceTuning

@rem JDK6 on Windows has a known bug for IPv6, use preferIPv4Stack unless JDK7.

@rem @rem See TestIPv6NIOServerSocketChannel.

set HBASE_OPTS="-XX:+UseConcMarkSweepGC" "-Djava.net.preferIPv4Stack=true"

@rem Configure PermSize. Only needed in JDK7. You can safely remove it for JDK8+

set HBASE_MASTER_OPTS=%HBASE_MASTER_OPTS% "-XX:PermSize=128m" "-XX:MaxPermSize=128m"

set HBASE_REGIONSERVER_OPTS=%HBASE_REGIONSERVER_OPTS% "-XX:PermSize=128m" "-XX:MaxPermSize=128m"

@rem Uncomment below to enable java garbage collection logging for the server-side processes

@rem this enables basic gc logging for the server processes to the .out file

@rem set SERVER_GC_OPTS="-verbose:gc" "-XX:+PrintGCDetails" "-XX:+PrintGCDateStamps" %HBASE_GC_OPTS%

@rem this enables gc logging using automatic GC log rolling. Only applies to jdk 1.6.0_34+ and 1.7.0_2+. Either use this set of options or the one above

@rem set SERVER_GC_OPTS="-verbose:gc" "-XX:+PrintGCDetails" "-XX:+PrintGCDateStamps" "-XX:+UseGCLogFileRotation" "-XX:NumberOfGCLogFiles=1" "-XX:GCLogFileSize=512M" %HBASE_GC_OPTS%

@rem Uncomment below to enable java garbage collection logging for the client processes in the .out file.

@rem set CLIENT_GC_OPTS="-verbose:gc" "-XX:+PrintGCDetails" "-XX:+PrintGCDateStamps" %HBASE_GC_OPTS%

@rem Uncomment below (along with above GC logging) to put GC information in its own logfile (will set HBASE_GC_OPTS)

@rem set HBASE_USE_GC_LOGFILE=true

@rem Uncomment and adjust to enable JMX exporting

@rem See jmxremote.password and jmxremote.access in $JRE_HOME/lib/management to configure remote password access.

@rem More details at: http://java.sun.com/javase/6/docs/technotes/guides/management/agent.html

@rem

@rem set HBASE_JMX_BASE="-Dcom.sun.management.jmxremote.ssl=false" "-Dcom.sun.management.jmxremote.authenticate=false"

@rem set HBASE_MASTER_OPTS=%HBASE_JMX_BASE% "-Dcom.sun.management.jmxremote.port=10101"

@rem set HBASE_REGIONSERVER_OPTS=%HBASE_JMX_BASE% "-Dcom.sun.management.jmxremote.port=10102"

@rem set HBASE_THRIFT_OPTS=%HBASE_JMX_BASE% "-Dcom.sun.management.jmxremote.port=10103"

@rem set HBASE_ZOOKEEPER_OPTS=%HBASE_JMX_BASE% -Dcom.sun.management.jmxremote.port=10104"

@rem File naming hosts on which HRegionServers will run.  $HBASE_HOME/conf/regionservers by default.

@rem set HBASE_REGIONSERVERS=%HBASE_HOME%\conf\regionservers

@rem Where log files are stored.  $HBASE_HOME/logs by default.

@rem set HBASE_LOG_DIR=%HBASE_HOME%\logs

@rem A string representing this instance of hbase. $USER by default.

@rem set HBASE_IDENT_STRING=%USERNAME%

@rem Seconds to sleep between slave commands.  Unset by default.  This

@rem can be useful in large clusters, where, e.g., slave rsyncs can

@rem otherwise arrive faster than the master can service them.

@rem set HBASE_SLAVE_SLEEP=0.1

@rem Tell HBase whether it should manage it's own instance of Zookeeper or not.

@rem set HBASE_MANAGES_ZK=true

set JAVA_HOME=D:\Java\jdk1.8.0_31

set HADOOP_HOME=D:\HBase\hadoop-2.7.2

set HADOOP_PREFIX=D:\HBase\hadoop-2.7.2

set HADOOP_CONF_DIR=%HADOOP_PREFIX%\etc\hadoop

set YARN_CONF_DIR=%HADOOP_CONF_DIR%

set PATH=%PATH%;%HADOOP_PREFIX%\bin

　　启动Hbase

:>  cd D:\HBase\hbase-1.2.3\conf

:> hbase-env.cmd

:>  cd D:\HBase\hbase-1.2.3\bin

:> start-hbase.cmd

以上就配置完了，用 Hbase Shell试一下是否能操作数据库

:>  cd D:\HBase\hbase-1.2.3\bin

:>hbase shell

创建表

创建一个名为 test 的表，这个表只有一个 列族 为 cf。可以列出所有的表来检查创建情况，然后插入些值。

>create 'test','cf'

插入记录

>put 'test','row1','cf:a','value1'

查询

>scan 'test'

完毕，有问题，请留言

WIN10下安装HBASE教程的更多相关文章

  1. 在win10下安装双系统ubuntu16.04.3教程

    闲暇了两天,终于想起来要装一个Liunx系统了.于是捣鼓了一番,实现了在Win10下安装Ubuntu16.04.3版本. 一.准备工作 下载Ubuntu 16.04.3镜像 准备一个2G以上的U盘 下 ...

  2. win10下安装ubuntu18.04

    在win10下安装Ubuntu18.04,双系统共存.Ubuntu 18.04 使用的是Gnome桌面. 查看系统的启动模式: Win+R打开运行,输入msinfo32,回车查看系统信息.在BIOS模 ...

  3. Win10下安装MySQL5.6

    Win10下安装MySQL5.6 我分了两种下载安装的方式给大家看,注意数据库这个东西不在乎版本是不是最新,在乎的是够稳定,现在公司中常用的是mysql5.5和mysql5.6的版本,我现在就用mys ...

  4. win10下安装Ubuntu + 修复Ubuntu引导

    如何在已安装 Windows 10 的情况下安装 Linux(Ubuntu 15.04)双系统? - Microsoft Windows - 知乎http://www.zhihu.com/questi ...

  5. DELPHI7在WIN8和WIN10下安装和运行

    DELPHI7在WIN8下安装后可以打开运行,但发现设置断点DEBUG运行DLL工程时会卡死(IDE长时间无反应,不报错). DELPHI7在WIN10下安装后打开的时候会报错,无法运行. 以上两种情 ...

  6. Mac下安装HBase及详解

    Mac下安装HBase及详解 1. 千篇一律的HBase简介 HBase是Hadoop的数据库, 而Hive数据库的管理工具, HBase具有分布式, 可扩展及面向列存储的特点(基于谷歌BigTabl ...

  7. vs2017 在win10下安装后开始运行asp.net core 项目时出错

    vs2017 在win10下安装后开始运行asp.net core 项目时出错 报找不到什么 解决方法: 下载 asp.net 2.2 安装好,重新启动电脑问题解决.

  8. win10下安装vs2013无法安装解决方案

    win10下安装vs2013无法安装解决方案 win+r,输入cmd进入命令行 进入界面后选择修复 进入vs_ultimate文件所在目录,输入: vs_ultimate /Uninstall    ...

  9. win10下安装GLPK

    认识GLPK GLPK是一个解决线性规划问题的工具.是GNU计划下一个用于解线性规 划(Linear Programming)的工具包.它可以方便的描述线性规划问题,并给出相应解. 因此在linux系 ...

随机推荐

  1. Apworks框架实战（四）：使用Visual Studio开发面向经典分层架构的应用程序：从EasyMemo案例开始

    时隔一年,继续我们的Apworks框架之旅.在接下来的文章中,我将逐渐向大家介绍如何在Visual Studio中结合Apworks框架,使用ASP.NET Web API和MVC来开发面向经典分层架 ...

  2. JSONP的诞生、原理及应用实例

    问题: 页面中有一个按钮,点击之后会更新网页中的一个盒子的内容. Ajax可以很容易的满足这种无须刷新整个页面就可以实现数据变换的需求. 但是,Ajax有一个缺点,就是他不允许跨域请求资源. 如果我的 ...

  3. LinqToDB 源码分析——生成与执行SQL语句

    生成SQL语句的功能可以算是LinqToDB框架的最后一步.从上一章中我们可以知道处理完表达式树之后,相关生成SQL信息会被保存在一个叫SelectQuery类的实例.有了这个实例我们就可以生成对应的 ...

  4. JavaScript 垃圾回收

    在公司经常会听到大牛们讨论时说道内存泄露神马的,每每都惊羡不已,最近精力主要用在了Web 开发上,读了一下<JavaScript高级程序设计>(书名很唬人,实际作者写的特别好,由浅入深)了 ...

  5. DropDownList实现可输入可选择

    1.js版本 <div style="z-index: 0; visibility: visible; clip: rect(0px 105px 80px 85px); positio ...

  6. wamp 服务器安装问题 及cmd常用命令 和 php mysql数据库常用cmd命令集

    1   官网下载wamp软件包,根据提示安装 2   目录结构:   wamp:   bin/为套件目录 包括mysql apache php log   日志记录 alias 配置 apps 数据库 ...

  7. css_03之文本、浮动

    1.字体属性:①字体格式:font-family:取值:“microsoft yahei”/Arial……:②字体大小:font-size:取值:pt/px:③字体加粗:font-weight:取值: ...

  8. gulp-uglify 与gulp.watch()配合使用时遇到的重复压缩问题

    今天学习gulp时候,用到gulp-uglify压缩js模块,遇到的一个问题-当用gulp.watch来监听js文件的变动时出现重复压缩的问题 目录结构如下: gulpfile.js代码如下: var ...

  9. SharePoint 2010/2013/2016内容数据库与网站集的关系

    总得来说,内容数据库和网站集的关系是: 一个内容数据库里可以有多个网站集,但是一个网站集只能存在于一个内容数据库. 那么问题来了 问题1:我能否在创建网站集时指定内容数据库呢?或者说我能在指定的内容数 ...

  10. 阶段一：用Handler和Message实现计时效果及其中一些疑问

    “阶段一”是指我第一次系统地学习Android开发.这主要是对我的学习过程作个记录. 本来是打算继续做天气预报的优化的,但因为某些原因,我要先把之前做的小应用优化一下.所以今天就插播一下用Handle ...