Spark集群安装MySQL环境
1.修改yum源
鉴于用国外的Yum源,速度比较慢,所以想到将国外的yum源改为国内的Yum源,这里选择使用比较多的阿里云源。具体修改方法可以参考此连接
我们先新建一个新的文件用来存放Yum源:
[kfk@bigdata-pro01 ~]$ cd /etc/yum.repos.d/
[kfk@bigdata-pro01 yum.repos.d]$ ll
total
-rw-r--r--. root root Nov CentOS-Base.repo
-rw-r--r--. root root Nov CentOS-Debuginfo.repo
-rw-r--r--. root root Nov CentOS-Media.repo
-rw-r--r--. root root Nov CentOS-Vault.repo
[kfk@bigdata-pro01 yum.repos.d]$ sudo touch CentOS-Base
下载新的CentOS-Base.repo 到/etc/yum.repos.d/:
[kfk@bigdata-pro01 yum.repos.d]$ sudo wget -O /etc/yum.repos.d/CentOS-Base.repo http://mirrors.aliyun.com/repo/Centos-6.repo
---- ::-- http://mirrors.aliyun.com/repo/Centos-6.repo
Resolving mirrors.aliyun.com... 183.232.170.189, 183.232.170.182, 111.29.22.220, ...
Connecting to mirrors.aliyun.com|183.232.170.189|:... connected.
HTTP request sent, awaiting response... OK
Length: (.5K) [application/octet-stream]
Saving to: “/etc/yum.repos.d/CentOS-Base.repo”
%[===================================================================================================================>] , --.-K/s in 0s
-- :: ( MB/s) - “/etc/yum.repos.d/CentOS-Base.repo” saved [/]
[kfk@bigdata-pro01 yum.repos.d]$ cd /etc/yum.repos.d
[kfk@bigdata-pro01 yum.repos.d]$ ls
CentOS-Base CentOS-Base.repo CentOS-Debuginfo.repo CentOS-Media.repo CentOS-Vault.repo
[kfk@bigdata-pro01 yum.repos.d]$ yum makecache //生成缓存
Loaded plugins: fastestmirror, refresh-packagekit, security
Determining fastest mirrors
* base: mirrors.aliyun.com
* extras: mirrors.aliyun.com
* updates: mirrors.aliyun.com
base | 3.7 kB :
extras | 3.4 kB :
extras/filelists_db | kB :
extras/prestodelta | 1.7 kB :
extras/primary_db | kB :
extras/other_db | kB :
updates | 3.4 kB :
updates/filelists_db | 2.4 MB :
updates/prestodelta | kB :
updates/primary_db | 3.2 MB :
updates/other_db| 179 kB 00:00
然后在notepad++里打开我们下载的文件,然后将其中的内容拷贝到我们刚才新建的文件中去。
[kfk@bigdata-pro01 yum.repos.d]$ sudo vi CentOS-Base
粘贴内容,然后保存退出。
# CentOS-Base.repo
#
# The mirror system uses the connecting IP address of the client and the
# update status of each mirror to pick mirrors that are updated to and
# geographically close to the client. You should use this for CentOS updates
# unless you are manually picking other mirrors.
#
# If the mirrorlist= does not work for you, as a fall back you can try the
# remarked out baseurl= line instead.
#
# [base]
name=CentOS-$releasever - Base - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/os/$basearch/
http://mirrors.aliyuncs.com/centos/$releasever/os/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=os
gpgcheck=
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-6 #released updates
[updates]
name=CentOS-$releasever - Updates - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/updates/$basearch/
http://mirrors.aliyuncs.com/centos/$releasever/updates/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=updates
gpgcheck=
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-6
#additional packages that may be useful
[extras]
name=CentOS-$releasever - Extras - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/extras/$basearch/
http://mirrors.aliyuncs.com/centos/$releasever/extras/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=extras
gpgcheck=
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-6
#additional packages that extend functionality of existing packages
[centosplus]
name=CentOS-$releasever - Plus - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/centosplus/$basearch/
http://mirrors.aliyuncs.com/centos/$releasever/centosplus/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=centosplus
gpgcheck=
enabled=
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-6 #contrib - packages by Centos Users
[contrib]
name=CentOS-$releasever - Contrib - mirrors.aliyun.com
failovermethod=priority
baseurl=http://mirrors.aliyun.com/centos/$releasever/contrib/$basearch/
http://mirrors.aliyuncs.com/centos/$releasever/contrib/$basearch/
#mirrorlist=http://mirrorlist.centos.org/?release=$releasever&arch=$basearch&repo=contrib
gpgcheck=
enabled=
gpgkey=http://mirrors.aliyun.com/centos/RPM-GPG-KEY-CentOS-6
2.在线安装mysql
[kfk@bigdata-pro01 yum.repos.d]$ yum clean all
Loaded plugins: fastestmirror, refresh-packagekit, security
Cleaning repos: base extras updates
Cleaning up Everything
Cannot remove rpmdb file /var/lib/yum/rpmdb-indexes/file-requires
Cannot remove rpmdb file /var/lib/yum/rpmdb-indexes/version
Cannot remove rpmdb file /var/lib/yum/rpmdb-indexes/conflicts
Cannot remove rpmdb file /var/lib/yum/rpmdb-indexes/pkgtups-checksums
Cleaning up list of fastest mirrors
[kfk@bigdata-pro01 yum.repos.d]$ sudo yum install mysql-server
Loaded plugins: fastestmirror, refresh-packagekit, security
Loading mirror speeds from cached hostfile
* base: mirrors.aliyun.com
* extras: mirrors.aliyun.com
* updates: mirrors.aliyun.com
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package mysql-server.x86_64 :5.1.-.el6_8 will be installed
--> Processing Dependency: mysql = 5.1.-.el6_8 for package: mysql-server-5.1.-.el6_8.x86_64
--> Processing Dependency: perl-DBI for package: mysql-server-5.1.-.el6_8.x86_64
--> Processing Dependency: perl-DBD-MySQL for package: mysql-server-5.1.-.el6_8.x86_64
--> Processing Dependency: perl(DBI) for package: mysql-server-5.1.-.el6_8.x86_64
--> Running transaction check
---> Package mysql.x86_64 :5.1.-.el6_8 will be installed
--> Processing Dependency: mysql-libs = 5.1.-.el6_8 for package: mysql-5.1.-.el6_8.x86_64
---> Package perl-DBD-MySQL.x86_64 :4.013-.el6 will be installed
---> Package perl-DBI.x86_64 :1.609-.el6 will be installed
--> Running transaction check
---> Package mysql-libs.x86_64 :5.1.-.el6 will be updated
---> Package mysql-libs.x86_64 :5.1.-.el6_8 will be an update
--> Finished Dependency Resolution
Dependencies Resolved
=============================================================================================================================================================
Package Arch Version Repository Size
=============================================================================================================================================================
Installing:
mysql-server x86_64 5.1.-.el6_8 base 8.6 M
Installing for dependencies:
mysql x86_64 5.1.-.el6_8 base k
perl-DBD-MySQL x86_64 4.013-.el6 base k
perl-DBI x86_64 1.609-.el6 base k
Updating for dependencies:
mysql-libs x86_64 5.1.-.el6_8 base 1.2 M
Transaction Summary
=============================================================================================================================================================
Install Package(s)
Upgrade Package(s)
Total download size: M
Is this ok [y/N]: y
Downloading Packages:
(/): mysql-5.1.-.el6_8.x86_64.rpm | kB :
(/): mysql-libs-5.1.-.el6_8.x86_64.rpm | 1.2 MB :
(/): mysql-server-5.1.-.el6_8.x86_64.rpm | 8.6 MB :
(/): perl-DBD-MySQL-4.013-.el6.x86_64.rpm | kB :
(/): perl-DBI-1.609-.el6.x86_64.rpm | kB :
-------------------------------------------------------------------------------------------------------------------------------------------------------------
Total 4.3 MB/s | MB :
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Updating : mysql-libs-5.1.-.el6_8.x86_64 /
Installing : perl-DBI-1.609-.el6.x86_64 /
Installing : perl-DBD-MySQL-4.013-.el6.x86_64 /
Installing : mysql-5.1.-.el6_8.x86_64 /
Installing : mysql-server-5.1.-.el6_8.x86_64 /
Cleanup : mysql-libs-5.1.-.el6.x86_64 /
Verifying : perl-DBD-MySQL-4.013-.el6.x86_64 /
Verifying : mysql-server-5.1.-.el6_8.x86_64 /
Verifying : perl-DBI-1.609-.el6.x86_64 /
Verifying : mysql-5.1.-.el6_8.x86_64 /
Verifying : mysql-libs-5.1.-.el6_8.x86_64 /
Verifying : mysql-libs-5.1.-.el6.x86_64 /
Installed:
mysql-server.x86_64 :5.1.-.el6_8
Dependency Installed:
mysql.x86_64 :5.1.-.el6_8 perl-DBD-MySQL.x86_64 :4.013-.el6 perl-DBI.x86_64 :1.609-.el6
Dependency Updated:
mysql-libs.x86_64 :5.1.-.el6_8
Complete! [kfk@bigdata-pro01 yum.repos.d]$ which mysql
/usr/bin/mysql
3.mysql 服务启动并测试
1)查看mysql服务状态
[kfk@bigdata-pro01 yum.repos.d]$ service mysqld status
mysqld is stopped
2)启动mysql服务
[kfk@bigdata-pro01 yum.repos.d]$ sudo service mysqld start
Initializing MySQL database: Installing MySQL system tables...
OK
Filling help tables...
OK To start mysqld at boot time you have to copy
support-files/mysql.server to the right place for your system
PLEASE REMEMBER TO SET A PASSWORD FOR THE MySQL root USER !
To do so, start the server, then issue the following commands:
/usr/bin/mysqladmin -u root password 'new-password'
/usr/bin/mysqladmin -u root -h bigdata-pro01.kfk.com password 'new-password'
Alternatively you can run:
/usr/bin/mysql_secure_installation which will also give you the option of removing the test
databases and anonymous user created by default. This is
strongly recommended for production servers. See the manual for more instructions. You can start the MySQL daemon with:
cd /usr ; /usr/bin/mysqld_safe &
You can test the MySQL daemon with mysql-test-run.pl
cd /usr/mysql-test ; perl mysql-test-run.pl
Please report any problems with the /usr/bin/mysqlbug script!
[ OK ]
Starting mysqld: [ OK ]
3)设置mysql密码
[kfk@bigdata-pro01 yum.repos.d]$ /usr/bin/mysqladmin -u root password 'root'
4)连接mysql
[kfk@bigdata-pro01 yum.repos.d]$ mysql -u root -proot Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is Server version: 5.1. Source distribution Copyright (c) , , Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql>
查看数据库
mysql> show databases; +--------------------+ | Database | +--------------------+ | information_schema | | mysql | | test | +--------------------+ rows in set (0.00 sec)
数据库安装成功!
以上就是博主为大家介绍的这一板块的主要内容,这都是博主自己的学习过程,希望能给大家带来一定的指导作用,有用的还望大家点个支持,如果对你没用也望包涵,有错误烦请指出。如有期待可关注博主以第一时间获取更新哦,谢谢!同时也欢迎转载,但必须在博文明显位置标注原文地址,解释权归博主所有!
Spark集群安装MySQL环境的更多相关文章
- CentOS6安装各种大数据软件 第十章:Spark集群安装和部署
相关文章链接 CentOS6安装各种大数据软件 第一章:各个软件版本介绍 CentOS6安装各种大数据软件 第二章:Linux各个软件启动命令 CentOS6安装各种大数据软件 第三章:Linux基础 ...
- [bigdata] spark集群安装及测试
在spark安装之前,应该已经安装了hadoop原生版或者cdh,因为spark基本要基于hdfs来进行计算. 1. 下载 spark: http://mirrors.cnnic.cn/apache ...
- spark集群安装配置
spark集群安装配置 一. Spark简介 Spark是一个通用的并行计算框架,由UCBerkeley的AMP实验室开发.Spark基于map reduce 算法模式实现的分布式计算,拥有Hadoo ...
- 大数据技术之_19_Spark学习_01_Spark 基础解析 + Spark 概述 + Spark 集群安装 + 执行 Spark 程序
第1章 Spark 概述1.1 什么是 Spark1.2 Spark 特点1.3 Spark 的用户和用途第2章 Spark 集群安装2.1 集群角色2.2 机器准备2.3 下载 Spark 安装包2 ...
- Spark入门:第2节 Spark集群安装:1 - 3;第3节 Spark HA高可用部署:1 - 2
三. Spark集群安装 3.1 下载spark安装包 下载地址spark官网:http://spark.apache.org/downloads.html 这里我们使用 spark-2.1.3-bi ...
- 3 Spark 集群安装
第3章 Spark集群安装 3.1 Spark安装地址 1.官网地址 http://spark.apache.org/ 2.文档查看地址 https://spark.apache.org/docs/2 ...
- Spark 个人实战系列(1)--Spark 集群安装
前言: CDH4不带yarn和spark, 因此需要自己搭建spark集群. 这边简单描述spark集群的安装过程, 并讲述spark的standalone模式, 以及对相关的脚本进行简单的分析. s ...
- 大数据平台搭建-spark集群安装
版本要求 java 版本:1.8.*(1.8.0_60) 下载地址:http://www.oracle.com/technetwork/java/javase/downloads/jdk8-downl ...
- Spark集群安装和WordCount编写
一.Spark概述 官网:http://spark.apache.org/ Apache Spark™是用于大规模数据处理的统一分析引擎. 为大数据处理而设计的快速通用的计算引擎. Spark加州大学 ...
随机推荐
- 20169219 《Linux内核原理与分析》 第十周作业
进程地址空间 1.进程地址空间由进程可寻址的虚拟内存组成.Linux系统中的所有进程之间以虚拟方式共享内存. 2.进程只能访问有效内存区域内的内存地址. 内存区域可以包含各种内存对象: (1) 代码段 ...
- 对bookinfo.dat的说明
作者:马健邮箱:stronghorse_mj@hotmail.com发布:2008.08.03 现在论坛推出的下载工具五花八门,但是有不少都忽视了bookinfo.dat的生成,因此有必要说明一下这个 ...
- C#字符串拼接的三种方式
static void Main(string[] args) { string name = "asher"; //方法1 string str1 = "hello & ...
- 在GridView控件FooterTemplate内添加记录 Ver3
重构此篇<在GridView控件FooterTemplate内添加记录 Ver2> http://www.cnblogs.com/insus/p/3270644.html 这有些缺陷,怎样 ...
- 装饰器设计模式初探及Java中实际应用举例
本篇随笔主要介绍用Java实现简单的装饰器设计模式: 先来看一下装饰器设计模式的类图: 从图中可以看到,我们可以装饰Component接口的任何实现类,而这些实现类也包括了装饰器本身,装饰器本身也可 ...
- ReentrantReadWriteLock原理
原文链接:https://www.jianshu.com/p/9f98299a17a5 前言 本篇适用于了解ReentrantLock或ReentrantReadWriteLock的使用,但想要进一步 ...
- pf4j实例 插件框架
实现整个过程需要三个部分,第一就是根接口,第二是插件,第三是应用程序.这是3个java项目. 首先要下载jar包,百度搜索maven repository,然后搜索pf4j,如下图,下载第一个的相应版 ...
- maven部署Tomcat(出现空白页面,最终解决)
- 读经典——《CLR via C#》(Jeffrey Richter著) 笔记_运行时解析类型引用
public sealed class Program{ public static void Main() { System.Console.WriteLine("Hi"); } ...
- P2913 [USACO08OCT]车轮旋转Wheel Rotation
传送门 初始状态是 0,如果有 1 的连接,0 就变 1,如果还有 1 的连接,1 就变 0,如果是 0 的连接就不变 所以就是把答案异或上所有连接,不用考虑顺序,反正最终是一样的 #include& ...