Hive搭建教程-CentOS7

Hive搭建教程-CentOS7

1.Hive的下载

Hive官方 下载地址

2.Hive的安装与配置

1.Hive的derby模式的配置
(1)Hive的安装

安装Hive需要确保Hadoop集群处于运行的状态

将Hive上传至工作目录/opt/software

1
2
3
# 解压Hive
tar -zxf apache-hive-3.1.2-bin.tar.gz

配置环境变量

1
2
3
4
5
6
7
8
vi /etc/profile
# 文末添加以下内容
export HIVE_HOME=/opt/module/apache-hive-3.1.2-bin
export PATH=$PATH:$HIVE_HOME/bin

# 刷新环境变量
source /etc/profile

(2)替换Hive中版本落后的文件
1
2
3
cd $HADOOP_HOME/share/hadoop/common/lib
cp guava-27.0-jre.jar $HIVE_HOME/lib
rm -fr $HIVE_HOME/lib/guava-19.0.jar
(3)derby数据库的初始化
1
2
3
4
cd ~
# 避免/root路径下的文件对初始化产生干扰，首先删除所有内容
rm -fr *

1
schematool -initSchema -dbType derby

(4)启动hive
1
2
3
4
# 启动hive
hive
# 退出程序
exit;

(5)测试
1
2
3
4
5
6
7
show databases;
create databases testdb;
user testdb;
create table testtb(int id,int age);
insert into testtb (1,18);
select * from testtb
# 查看HDFS文件系统中的文件变化

2.Hive的Mysql模式的配置
(1)下载Mysql

Mysql5.7.40官方**下载地址**

(2)解压Mysql至工作目录
1
2
3
4
# Mysql的压缩包不是gzip格式，参数不用添加z
# Mysql的压缩包解压之后才是安装包
tar -xvf mysql-5.7.40-1.el7.x86_64.rpm-bundle.tar -C /opt/software/mysql_installer

(3)将yum源更换为阿里云镜像源

①备份yum源配置文件

1
mv /etc/yum.repos.d/CentOS-Base.repo /etc/yum.repos.d/CentOS-Base.repo_bak

②新建yum仓库配置文件

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
vi /etc/yum.repos.d/CentOS-Base.repo

# 添加以下内容
# CentOS-Base.repo
#
# The mirror system uses the connecting IP address of the client and the
# update status of each mirror to pick mirrors that are updated to and
# geographically close to the client.  You should use this for CentOS updates
# unless you are manually picking other mirrors.
#
# If the mirrorlist= does not work for you, as a fall back you can try the 
# remarked out baseurl= line instead.
#
#
 
[base]
name=CentOS-$releasever - Base - mirrors.aliyun.com
failovermethod=priority
baseurl=https://mirrors.aliyun.com/centos-vault/7.9.2009/os/$basearch/
gpgcheck=1
gpgkey=https://mirrors.aliyun.com/centos-vault/RPM-GPG-KEY-CentOS-7
 
#released updates 
[updates]
name=CentOS-$releasever - Updates - mirrors.aliyun.com
failovermethod=priority
baseurl=https://mirrors.aliyun.com/centos-vault/7.9.2009/updates/$basearch/
gpgcheck=1
gpgkey=https://mirrors.aliyun.com/centos-vault/RPM-GPG-KEY-CentOS-7
 
#additional packages that may be useful
[extras]
name=CentOS-$releasever - Extras - mirrors.aliyun.com
failovermethod=priority
baseurl=https://mirrors.aliyun.com/centos-vault/7.9.2009/extras/$basearch/
gpgcheck=1
gpgkey=https://mirrors.aliyun.com/centos-vault/RPM-GPG-KEY-CentOS-7
 
#additional packages that extend functionality of existing packages
[centosplus]
name=CentOS-$releasever - Plus - mirrors.aliyun.com
failovermethod=priority
baseurl=https://mirrors.aliyun.com/centos-vault/7.9.2009/centosplus/$basearch/
gpgcheck=1
enabled=0
gpgkey=https://mirrors.aliyun.com/centos-vault/RPM-GPG-KEY-CentOS-7
 
#contrib - packages by Centos Users
[contrib]
name=CentOS-$releasever - Contrib - mirrors.aliyun.com
failovermethod=priority
baseurl=https://mirrors.aliyun.com/centos-vault/7.9.2009/contrib/$basearch/
gpgcheck=1
enabled=0
gpgkey=https://mirrors.aliyun.com/centos-vault/RPM-GPG-KEY-CentOS-7

③清除缓存并重建元数据缓存

1
yum clean all && yum makecache

(4)安装Mysql

①卸载linux操作系统预装的mariadb

1
2
3
4
5
6
7
# linux操作系统预装了mysql的其他发行版本mariadb
rpm -qa|grep mariadb
# 卸载mariadb
rpm -e mariadb-libs-5.5.68-1.el7.x86_64 --nodeps
# 检查是否卸载完毕
rpm -qa|grep mariadb

②安装Mysql

1
2
3
4
5
6
7
8
9
10
# 安装Mysql必须严格按照以下顺序进行安装
rpm -ivh mysql-community-common-5.7.40-1.el7.x86_64.rpm
rpm -ivh mysql-community-libs-5.7.40-1.el7.x86_64.rpm
rpm -ivh mysql-community-client-5.7.40-1.el7.x86_64.rpm

# 安装server之前需要安装依赖库
yum -y install net-tools
yum -y install perl

rpm -ivh mysql-community-server-5.7.40-1.el7.x86_64.rpm

至此，Mysql安装完毕！

③启动Mysql

1
2
3
4
5
# 启动Mysql服务
systemctl start mysqld
# 如果启动失败，删除Mysql运行痕迹再启动
rm -fr /var/lib/mysql/*

④查看临时密码

1
cat /var/log/mysqld.log|grep password

1
2
3
4
# 登录Mysql
mysql -uroot -p
# 输入刚刚的临时密码

1
2
3
4
5
6
7
# 修改密码
# 设置密码的验证强度等级
set global validate_passsword_policy=LOW;
# 设置为6位的密码
set global validate_password_length=6;
# 设置密码
alter user 'root'@'localhost' identified by '123456';

1
2
# 在mysql中创建hive使用的数据库
create database hivedb CHARACTER SET utf8;

(5)安装Hive
1
2
3
4
5
6
7
8
9
10
# 解压Hive安装包
tar -zxvf /opt/software/apache-hive-3.1.2-bin.tar.gz -C /opt/module/
# 配置环境变量
export HIVE_HOME=/opt/module/apache-hive-3.1.2-bin
export PATH=$PATH:$HIVE_HOME/bin

# 替换Hive中落后的文件
cp $HADOOP_HOME/share/hadoop/common/lib/guava-27.0-jre.jar $HIVE_HOME/lib
rm -fr $HIVE_HOME/lib/guava-19.0.jar

(6)配置hive-site.xml
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
cd $HIVE_HOME/conf
vi hive-site.xml
# 添加以下内容
<configuration>
	<property>
		<name>javax.jdo.option.ConnectionURL</name>
		<value>jdbc:mysql://localhost:3306/hivedb?createDatabaseIfNotExist=true&amp;characterEncoding=UTF-8&amp;useSSL=false&amp;serverTimezone=GMT</value>
	</property>
	<property>
		<name>javax.jdo.option.ConnectionDriverName</name>
		<value>com.mysql.jdbc.Driver</value>
	</property>
	<property>
		<name>javax.jdo.option.ConnectionUserName</name>
		<value>root</value>
	</property>
		<name>javax.jdo.option.ConnectionPassword</name>
		<value>123456</value>
	</property>
	<property>
		<name>hive.metastore.schema.verification</name>
		<value>false</value>
	</property>
<configuration>

将驱动软件的jar包放到Hive的lib路径下

mysql-connecter-java官方下载地址

(7)初始化Mysql与Hive
1
2
3
4
schematool -initschema -dbType mysql

# 启动hive
hive
大数据平台搭建
#BigData #HIVE
Hive搭建教程-CentOS7
http://example.com/2025/10/20/Hive搭建教程-CenOS7/
作者
David
发布于
2025年10月20日
许可协议