ambari添加安装hive服务和Hbase服务

在非master节点，安装hive元存储。例：如图，如果选择了hdp-3，则在hdp-3上安装。然后点next，点hive，先不配置，等把数据库装好，配置完成再来该页面进行hive的配置此时我们先切换到xshell进行操作，在hdp-3节点安装mysql数据库，这里选择装的mariadbyum install -y mariadb-server将mariadb启动起来，并设置mariadb自启动s

Coca可口

5766人浏览 · 2022-04-01 16:12:27

Coca可口 · 2022-04-01 16:12:27 发布

在此处选择添加服务,我这里不光勾选了hive还勾选了hbase

后面两步一直next就行，会提醒需前置安装yarn+mapreduce2和tez，点右边的同意继续就行。忘记截图了，也不影响

到此处开始重点，在非master节点，安装hive元存储。

例：如图，如果选择了hdp-3，则在hdp-3上安装。

然后点next，点hive，先不配置，等把数据库装好，配置完成再来该页面进行hive的配置

此时我们先切换到xshell进行操作，在hdp-3节点安装mysql数据库，这里选择装的mariadb

yum install -y mariadb-server

将mariadb启动起来，并设置mariadb自启动

systemctl start mariadb && systemctl enable mariadb

执行初始化设置

mysql_secure_installation

NOTE: RUNNING ALL PARTS OF THIS SCRIPT IS RECOMMENDED FOR ALL MariaDB
      SERVERS IN PRODUCTION USE!  PLEASE READ EACH STEP CAREFULLY!

In order to log into MariaDB to secure it, we'll need the current
password for the root user.  If you've just installed MariaDB, and
you haven't set the root password yet, the password will be blank,
so you should just press enter here.

Enter current password for root (enter for none): 
OK, successfully used password, moving on...

Setting the root password ensures that nobody can log into the MariaDB
root user without the proper authorisation.
Set root password? [Y/n] 
New password: 
Re-enter new password: 
Password updated successfully!
Reloading privilege tables..
 ... Success!


By default, a MariaDB installation has an anonymous user, allowing anyone
to log into MariaDB without having to have a user account created for
them.  This is intended only for testing, and to make the installation
go a bit smoother.  You should remove them before moving into a
production environment.

Remove anonymous users? [Y/n] 
 ... Success!

Normally, root should only be allowed to connect from 'localhost'.  This
ensures that someone cannot guess at the root password from the network.

Disallow root login remotely? [Y/n] n
 ... skipping.

By default, MariaDB comes with a database named 'test' that anyone can
access.  This is also intended only for testing, and should be removed
before moving into a production environment.

Remove test database and access to it? [Y/n] 
 - Dropping test database...
 ... Success!
 - Removing privileges on test database...
 ... Success!

Reloading the privilege tables will ensure that all changes made so far
will take effect immediately.

Reload privilege tables now? [Y/n] 
 ... Success!

Cleaning up...
All done!  If you've completed all of the above steps, your MariaDB
installation should now be secure.

Thanks for using MariaDB!

进入mysql

mysql -uroot -proot

创建hive数据库，并设置编码utf-8

MariaDB [(none)]> CREATE DATABASE hive DEFAULT CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci;
Query OK, 1 row affected (0.00 sec)

创建hive用户，并设置密码为hive

MariaDB [(none)]> CREATE USER 'hive'@'%' IDENTIFIED BY 'hive';
Query OK, 0 rows affected (0.00 sec)

设置hive用户拥有所有数据库权限

MariaDB [(none)]> GRANT ALL ON hive.* TO 'hive'@'%';
Query OK, 0 rows affected (0.00 sec)

刷新权限表

MariaDB [(none)]> FLUSH PRIVILEGES;
Query OK, 0 rows affected (0.00 sec)

在master节点上设置mysql的驱动（“jdbc-driver=”后面接着驱动存放的位置，如果没有驱动，我准备好了下载地址"http://114.55.237.251/mysql-connector-java/"，存放到该目录即可）

ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar

然后回到hive配置页面，这里我们选择existing mysql ，即现有的mysql数据库

配置

其中jdbcurl

jdbc:mysql://XXX:3306/hive?useUnicode=true&characterEncoding=utf-8&serverTimezone=GMT%2B8

配置完next，一般会出现如图

这个意思就是hbase的堆内存大小，小于默认值1024，这里我们可以不管他，点击

proceed anyway

这个页面就是汇总报告，配置信息列出来给我们看，继续下一步就行

点 deploy部署

进入初始化加载页面，耐心等待会即可

这里报错了，咱们看看是什么原因

Traceback (most recent call last):
  File "arbbari-agent/cacheacks/HDP/3.0rvices/HBASE/package/scriptsase_client.py", line 69, in <module>
    HbaseClient().execute()
  File "/usrbbari-agentb/resource_managementbraries/script/script.py", line 353, in execute
    method(env)
  File "arbbari-agent/cacheacks/HDP/3.0rvices/HBASE/package/scriptsase_client.py", line 35, in install
    self.install_packages(env)
  File "/usrbbari-agentb/resource_managementbraries/script/script.py", line 836, in install_packages
    retry_count=agent_stack_retry_count)
  File "/usrbbari-agentb/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usrbbari-agentb/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usrbbari-agentb/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usrbbari-agentb/resource_management/core/providers/packaging.py", line 30, in action_install
    self._pkg_manager.install_package(package_name, self.__create_context())
  File "/usrbbari-agentbbari_commons/repo_manager/yum_manager.py", line 219, in install_package
    shell.repository_manager_executor(cmd, self.properties, context)
  File "/usrbbari-agentbbari_commonsell.py", line 749, in repository_manager_executor
    raise RuntimeError(message)
RuntimeError: Failed to execute command '/usr/bin/yum -y install phoenix_3_0_0_0_1634', exited with code '1', message: 'http://public-repo-1.hortonworks.com/HDP-GPL/centos7/3.x/updates/3.0.0.0/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden

看到最后一行，这里的意思就是镜像网址出问题了（http://public-repo-1.hortonworks.com/HDP-GPL/centos7/3.x/updates/3.0.0.0/repodata/repomd.xml）用的是别人的镜像，出问题很正常

RuntimeError: Failed to execute command '/usr/bin/yum -y install phoenix_3_0_0_0_1634', exited with code '1', message: 'http://public-repo-1.hortonworks.com/HDP-GPL/centos7/3.x/updates/3.0.0.0/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden

我们这里连接下master节点的数据库，即安装ambari-server节点的（一般ambari数据库都装到master节点，如果不是该节点，自行找到ambari库的节点，并连接），然后找到该表