如何搭建 MySQL 高可用高性能集群
MySQL NDB Cluster 是什麼
MySQL NDB Cluster 是 MySQL 的一個高可用、高冗餘版本,適用於分佈式計算環境。
文檔鏈接
搭建集群的前置工作
至少準備 3 臺服務器,一臺作為管理服務器,兩臺作為數據服務器和 SQL 服務器,當然有更多的服務器會更好。
管理服務器mgm:192.168.0.105
數據服務器ndb1:192.168.0.106
數據服務器ndb2:192.168.0.104
sql服務器:192.168.0.106
sql服務器:192.168.0.104
開始部署集群
首先下載 MySQL NDB Cluster二進制文件,解壓縮後開始下面的步驟。
部署管理服務器
更新系統
apt update -y && apt upgrade -y && apt install libncurses5 -y
復制 ndb_mgm 和 ndb_mgmd 到管理服務器
scp ./mysql-cluster-gpl-7.6.17-linux-glibc2.12-x86_64/bin/ndb_mgm* [email protected]:/home/mgm
在管理服務器復制 ndb_mgm 和 ndb_mgmd 到/usr/local/bin 文件夾
cp -rfv /home/mgm/ndb_mgm* /usr/local/bin
賦予 ndb_mgm 和 ndb_mgmd 可執行權限
chmod +x /usr/local/bin/ndb_mgm*
添加配置文件
mkdir /var/lib/mysql-cluster vi /var/lib/mysql-cluster/config.ini
config.ini
[ndbd default] # Options affecting ndbd processes on all data nodes: NoOfReplicas=2 # Number of fragment replicas DataMemory=98M # How much memory to allocate for data storage [ndb_mgmd] # Management process options: HostName=192.168.0.105 # Hostname or IP address of management node NodeId=1 # Node ID for this Management node DataDir=/var/lib/mysql-cluster # Directory for management node log files [ndbd] # Options for data node "A": # (one [ndbd] section per data node) HostName=192.168.0.104 # Hostname or IP address NodeId=2 # Node ID for this data node DataDir=/data/mysql-cluster/data # Directory for this data node's data files [ndbd] # Options for data node "B”: # (one [ndbd] section per data node) HostName=192.168.0.106 # Hostname or IP address NodeId=3 # Node ID for this data node DataDir=/data/mysql-cluster/data # Directory for this data node's data files [mysqld] # SQL node options: HostName=192.168.0.104 # Hostname or IP address # (additional mysqld connections can be # specified for this node for various # purposes such as running ndb_restore) [mysqld] # SQL node options: HostName=192.168.0.106 # Hostname or IP address # (additional mysqld connections can be # specified for this node for various # purposes such as running ndb_restore)
開啟防火墻,集群管理服務默認使用 1186 端口
ufw allow 22 ufw allow 1186 ufw enable
初始化並啟動管理服務器
cd /usr/local/bin/ ndb_mgmd --initial --configdir=/var/lib/mysql-cluster -f /var/lib/mysql-cluster/config.ini --ndb-nodeid=1
當出現以下結果的時候,表示管理服務器已經啟動成功瞭
root@mgm:/usr/local/bin# ndb_mgmd --initial --configdir=/var/lib/mysql-cluster -f /var/lib/mysql-cluster/config.ini --ndb-nodeid=1 MySQL Cluster Management Server mysql-5.7.33 ndb-7.6.17
我們再執行 ndb_mgm 命令,可以查看當前集群的狀態
root@mgm:/usr/local/bin# ndb_mgm -- NDB Cluster -- Management Client -- ndb_mgm> show Connected to Management Server at: localhost:1186 Cluster Configuration --------------------- [ndbd(NDB)] 2 node(s) id=2 (not connected, accepting connect from 192.168.0.104) id=3 (not connected, accepting connect from 192.168.0.106) [ndb_mgmd(MGM)] 1 node(s) id=1 @192.168.0.105 (mysql-5.7.33 ndb-7.6.17) [mysqld(API)] 2 node(s) id=4 (not connected, accepting connect from 192.168.0.104) id=5 (not connected, accepting connect from 192.168.0.106)
部署數據服務器
在所有數據服務器上執行以下操作
更新系統
apt update -y && apt upgrade -y && apt install libncurses5 -y
開啟防火墻
ufw allow 22 ufw allow 2202 ufw enable
復制 ndbd 和 ndbmtd 到數據服務器
#復制到192.168.0.106 scp ./mysql-cluster-gpl-7.6.17-linux-glibc2.12-x86_64/bin/ndbd [email protected]:/home/ndb1 scp ./mysql-cluster-gpl-7.6.17-linux-glibc2.12-x86_64/bin/ndbmtd [email protected]:/home/ndb1 #復制到192.168.0.104 scp ./mysql-cluster-gpl-7.6.17-linux-glibc2.12-x86_64/bin/ndbd [email protected]:/home/ndb2 scp ./mysql-cluster-gpl-7.6.17-linux-glibc2.12-x86_64/bin/ndbmtd [email protected]:/home/ndb2
在管理服務器復制 ndbd 和 ndbmtd 到/usr/local/bin 文件夾
#192.168.0.106 cp -rfv /home/ndb1/ndbd /usr/local/bin cp -rfv /home/ndb1/ndbmtd /usr/local/bin #192.168.0.104 cp -rfv /home/ndb2/ndbd /usr/local/bin cp -rfv /home/ndb2/ndbmtd /usr/local/bin
賦予 ndbd 可執行權限
chmod +x /usr/local/bin/ndbd chmod +x /usr/local/bin/ndbmtd
在/etc下加入my.cnf文件
vi /etc/my.cnf
my.cnf文件
[mysqld] # Options for mysqld process: ndbcluster # run NDB storage engine [mysql_cluster] # Options for NDB Cluster processes: ndb-connectstring=192.168.0.105 # location of management server
創建數據保存的目錄,必須與管理服務配置的路徑一致
mkdir -p /data/mysql-cluster/data
啟動數據服務
root@ndb1:/usr/local/bin# ndbd 2021-06-20 08:10:23 [ndbd] INFO -- Angel connected to '192.168.0.105:1186' 2021-06-20 08:10:23 [ndbd] INFO -- Angel allocated nodeid: 3
回到集群管理服務器查看集群狀態,此時可以看到數據服務已經連接成功
root@mgm:/usr/local/bin# ndb_mgm -- NDB Cluster -- Management Client -- ndb_mgm> show Connected to Management Server at: localhost:1186 Cluster Configuration --------------------- [ndbd(NDB)] 2 node(s) id=2 (not connected, accepting connect from 192.168.0.104) id=3 @192.168.0.106 (mysql-5.7.33 ndb-7.6.17, starting, Nodegroup: 0) [ndb_mgmd(MGM)] 1 node(s) id=1 @192.168.0.105 (mysql-5.7.33 ndb-7.6.17) [mysqld(API)] 2 node(s) id=4 (not connected, accepting connect from 192.168.0.104) id=5 (not connected, accepting connect from 192.168.0.106)
在另一臺服務器(192.168.0.104)重復 4、5、6、7 步驟的操作,結果可看到
root@ndb2:/usr/local/bin# ndbd 2021-06-20 08:20:10 [ndbd] INFO -- Angel connected to '192.168.0.105:1186' 2021-06-20 08:20:10 [ndbd] INFO -- Angel allocated nodeid: 2
回到集群管理服務器查看集群狀態,此時可以看到所有數據服務已經連接成功
root@mgm:/usr/local/bin# ndb_mgm -- NDB Cluster -- Management Client -- ndb_mgm> show Connected to Management Server at: localhost:1186 Cluster Configuration --------------------- [ndbd(NDB)] 2 node(s) id=2 @192.168.0.104 (mysql-5.7.33 ndb-7.6.17, Nodegroup: 0, *) id=3 @192.168.0.106 (mysql-5.7.33 ndb-7.6.17, Nodegroup: 0) [ndb_mgmd(MGM)] 1 node(s) id=1 @192.168.0.105 (mysql-5.7.33 ndb-7.6.17) [mysqld(API)] 2 node(s) id=4 (not connected, accepting connect from 192.168.0.104) id=5 (not connected, accepting connect from 192.168.0.106) 在目錄/data/mysql/data下面可以看到數據服務已經產生瞭數據 root@ndb1:~# ls /data/mysql/data/ ndb_3_fs ndb_3_out.log ndb_3.pid
部署 SQL 服務
復制 MySQL 到SQL服務器
scp ./mysql-cluster-gpl-7.6.17-linux-glibc2.12-x86_64.tar.gz [email protected]:/home/ndb2 scp ./mysql-cluster-gpl-7.6.17-linux-glibc2.12-x86_64.tar.gz [email protected]:/home/ndb1
解壓縮 MySQL, 然後復制到/usr/local目錄
tar -zxvf mysql-cluster-gpl-7.6.17-linux-glibc2.12-x86_64.tar.gz cp -rfv mysql-cluster-gpl-7.6.17-linux-glibc2.12-x86_64 /usr/local/ ln -snf /usr/local/mysql-cluster-gpl-7.6.17-linux-glibc2.12-x86_64 /usr/local/mysql cp /usr/local/mysql/support-files/mysql.server /etc/init.d/mysql.server export PATH=$PATH:/usr/local/mysql/bin source /etc/profile
開啟防火墻
ufw allow 22 ufw allow 3306 ufw enable
創建 MySQL 數據存放的目錄
mkdir -p /data/mysql/data mkdir -p /data/mysql/run mkdir -p /var/log/mysql
創建 mysql 用戶,創建相關目錄
groupadd mysql useradd -r -g mysql -s /bin/false mysql chown mysql:mysql /data/mysql/data chmod 750 /data/mysql/data chown mysql:mysql /data/mysql/run chmod 750 /data/mysql/run chown mysql:mysql /var/log/mysql chmod 750 /var/log/mysql
創建 MySQL 配置文件
mkdir -p /etc/mysql vi /etc/mysql/my.cnf my.cnf [mysqld] # Options for mysqld process: ndbcluster # run NDB storage engine pid-file = /data/mysql/run/mysqld.pid socket = /data/mysql/run/mysqld.sock datadir = /data/mysql/data # log-error = /var/log/mysql/error.log # By default we only accept connections from localhost bind-address = 192.168.0.106 # Disabling symbolic-links is recommended to prevent assorted security risks symbolic-links = 0 [mysql_cluster] # Options for NDB Cluster processes: ndb-connectstring = 192.168.0.105 # location of management server [client] socket = /data/mysql/run/mysqld.sock
初始化MySQL
/usr/local/mysql/bin/mysqld --defaults-file=/etc/mysql/my.cnf --initialize --user=mysql --basedir=/usr/local/mysql
記錄下 MySQL 初始化生成的 root 用戶密碼 sF#Hy,IuT6d#
root@ndb1:~# /usr/local/mysql/bin/mysqld --defaults-file=/etc/mysql/my.cnf --initialize --user=mysql --basedir=/usr/local/mysql 2021-06-20T12:23:26.874302Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details). 2021-06-20T12:23:27.102146Z 0 [Warning] InnoDB: New log files created, LSN=45790 2021-06-20T12:23:27.145317Z 0 [Warning] InnoDB: Creating foreign key constraint system tables. 2021-06-20T12:23:27.154405Z 0 [Warning] No existing UUID has been found, so we assume that this is the first time that this server has been started. Generating a new UUID: 50a15854-d1c2-11eb-9792-000c29681e23. 2021-06-20T12:23:27.155927Z 0 [Warning] Gtid table is not ready to be used. Table 'mysql.gtid_executed' cannot be opened. 2021-06-20T12:23:28.339372Z 0 [Warning] CA certificate ca.pem is self signed. 2021-06-20T12:23:28.624534Z 1 [Note] A temporary password is generated for root@localhost: sF#Hy,IuT6d#
啟動MySQL
/usr/local/mysql/bin/mysqld_safe --user=mysql &
修改 root 用戶密碼
mysqladmin -uroot -p'sF#Hy,IuT6d#' password '123456'
回到集群管理服務器查看集群狀態,此時可以看到有一個 SQL 服務已經連接上瞭
root@mgm:/usr/local/bin# ndb_mgm -- NDB Cluster -- Management Client -- ndb_mgm> show Connected to Management Server at: localhost:1186 Cluster Configuration --------------------- [ndbd(NDB)] 2 node(s) id=2 @192.168.0.104 (mysql-5.7.33 ndb-7.6.17, Nodegroup: 0, *) id=3 @192.168.0.106 (mysql-5.7.33 ndb-7.6.17, Nodegroup: 0) [ndb_mgmd(MGM)] 1 node(s) id=1 @192.168.0.105 (mysql-5.7.33 ndb-7.6.17) [mysqld(API)] 2 node(s) id=4 (not connected, accepting connect from 192.168.0.104) id=5 @192.168.0.106 (mysql-5.7.33 ndb-7.6.17)
在另一臺服務器(192.168.0.104)部署 SQL 服務,回到集群管理服務器查看集群狀態,此時可以看到所有 SQL 服務已經連接成功
root@mgm:/usr/local/bin# ndb_mgm -- NDB Cluster -- Management Client -- ndb_mgm> show Cluster Configuration --------------------- [ndbd(NDB)] 2 node(s) id=2 @192.168.0.104 (mysql-5.7.33 ndb-7.6.17, Nodegroup: 0, *) id=3 @192.168.0.106 (mysql-5.7.33 ndb-7.6.17, Nodegroup: 0) [ndb_mgmd(MGM)] 1 node(s) id=1 @192.168.0.105 (mysql-5.7.33 ndb-7.6.17) [mysqld(API)] 2 node(s) id=4 @192.168.0.104 (mysql-5.7.33 ndb-7.6.17) id=5 @192.168.0.106 (mysql-5.7.33 ndb-7.6.17)
所有集群服務部署完畢,我們來測試一下集群是否真的部署成功
在 192.168.0.106 的 MySQL 上創建數據庫和表
CREATE DATABASE `wechat`; CREATE TABLE wechat.user ( Column1 varchar(100) NULL, Column2 varchar(100) NULL ) ENGINE=ndbcluster DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_general_ci; 插入數據並查看 mysql> show databases; +--------------------+ | Database | +--------------------+ | information_schema | | mysql | | ndbinfo | | performance_schema | | sys | | wechat | +--------------------+ 6 rows in set (0.00 sec) mysql> select * from wechat.user; Empty set (0.02 sec) mysql> insert wechat.user (Column1, column2) value ('1', '2'); Query OK, 1 row affected (0.01 sec) mysql> select * from wechat.user; +---------+---------+ | Column1 | Column2 | +---------+---------+ | 1 | 2 | +---------+---------+ 1 row in set (0.00 sec)
在另一個 SQL 服務器查詢,結果是成功的
mysql> show databases; +--------------------+ | Database | +--------------------+ | information_schema | | mysql | | ndbinfo | | performance_schema | | sys | | wechat | +--------------------+ 6 rows in set (0.00 sec) mysql> select * from wechat.user; Empty set (0.07 sec) mysql> select * from wechat.user; +---------+---------+ | Column1 | Column2 | +---------+---------+ | 1 | 2 | +---------+---------+ 1 row in set (0.00 sec)
現在我們把其中一個數據節點關掉,在管理服務器我們看到 ndbd已經關閉一個瞭
root@mgm:/usr/local/bin# ndb_mgm -- NDB Cluster -- Management Client -- ndb_mgm> show Connected to Management Server at: localhost:1186 Cluster Configuration --------------------- [ndbd(NDB)] 2 node(s) id=2 @192.168.0.104 (mysql-5.7.33 ndb-7.6.17, Nodegroup: 0, *) id=3 (not connected, accepting connect from 192.168.0.106) [ndb_mgmd(MGM)] 1 node(s) id=1 @192.168.0.105 (mysql-5.7.33 ndb-7.6.17) [mysqld(API)] 2 node(s) id=4 @192.168.0.104 (mysql-5.7.33 ndb-7.6.17) id=5 @192.168.0.106 (mysql-5.7.33 ndb-7.6.17)
寫入一筆數據
mysql> select * from wechat.user; +---------+---------+ | Column1 | Column2 | +---------+---------+ | 1 | 2 | +---------+---------+ 1 row in set (0.01 sec) mysql> insert into wechat.user (Column1, column2) value ('3', '4'); Query OK, 1 row affected (0.00 sec) mysql> select * from wechat.user; +---------+---------+ | Column1 | Column2 | +---------+---------+ | 3 | 4 | | 1 | 2 | +---------+---------+ 2 rows in set (0.00 sec)
在另一臺 SQL 服務器查詢,結果還是一致的
mysql> select * from wechat.user; +---------+---------+ | Column1 | Column2 | +---------+---------+ | 3 | 4 | | 1 | 2 | +---------+---------+ 2 rows in set (0.00 sec)
我們再關閉 192.168.0.106 SQL服務
root@mgm:/usr/local/bin# ndb_mgm -- NDB Cluster -- Management Client -- ndb_mgm> show Connected to Management Server at: localhost:1186 Cluster Configuration --------------------- [ndbd(NDB)] 2 node(s) id=2 @192.168.0.104 (mysql-5.7.33 ndb-7.6.17, Nodegroup: 0, *) id=3 (not connected, accepting connect from 192.168.0.106) [ndb_mgmd(MGM)] 1 node(s) id=1 @192.168.0.105 (mysql-5.7.33 ndb-7.6.17) [mysqld(API)] 2 node(s) id=4 @192.168.0.104 (mysql-5.7.33 ndb-7.6.17) id=5 (not connected, accepting connect from 192.168.0.106)
在 192.168.0.104 的 SQL 服務寫入一筆數據
mysql> insert into wechat.user (Column1, column2) value ('5', '6'); Query OK, 1 row affected (0.00 sec) mysql> select * from wechat.user; +---------+---------+ | Column1 | Column2 | +---------+---------+ | 5 | 6 | | 3 | 4 | | 1 | 2 | +---------+---------+ 3 rows in set (0.00 sec)
啟動 192.168.0.106 的數據服務和SQL服務
root@mgm:/usr/local/bin# ndb_mgm -- NDB Cluster -- Management Client -- ndb_mgm> show Connected to Management Server at: localhost:1186 Cluster Configuration --------------------- [ndbd(NDB)] 2 node(s) id=2 @192.168.0.104 (mysql-5.7.33 ndb-7.6.17, Nodegroup: 0, *) id=3 @192.168.0.106 (mysql-5.7.33 ndb-7.6.17, Nodegroup: 0) [ndb_mgmd(MGM)] 1 node(s) id=1 @192.168.0.105 (mysql-5.7.33 ndb-7.6.17) [mysqld(API)] 2 node(s) id=4 @192.168.0.104 (mysql-5.7.33 ndb-7.6.17) id=5 @192.168.0.106 (mysql-5.7.33 ndb-7.6.17)
在 192.168.0.106 查詢數據庫發現,發生故障期間產生的數據已經同步瞭過來
root@ndb1:~# mysql -uroot -p Enter password: Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is 4 Server version: 5.7.33-ndb-7.6.17-cluster-gpl MySQL Cluster Community Server (GPL) Copyright (c) 2000, 2021, Oracle and/or its affiliates. Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql> select * from wechat.user; +---------+---------+ | Column1 | Column2 | +---------+---------+ | 1 | 2 | | 5 | 6 | | 3 | 4 | +---------+---------+ 3 rows in set (0.08 sec)
數據庫集群部署成功瞭,總結一下集群的註意事項
- 創建表的時候,需要設置ENGINE=ndbcluster,具體請看上面的建表腳本。
- 每個 SQL 服務需要創建一樣的用戶密碼
- 管理服務器不能全部發生故障,否則集群數據庫操作失敗。
- 數據服務器不能全部發生故障,否則集群數據庫操作失敗。
- SQL 服務器發生故障期間建立的數據庫,在恢復後不會自動同步新建數據庫過來,需要手動在故障恢復後的服務器上創建同名數據庫,之後數據才會自動同步過來。
- 隻要管理服務器和數據服務器越多,故障發生時,才能保證數據安全的寫入,才不會導致數據庫系統不可用。
- SQL 服務器越多,把數據庫訪問的請求通過負載均衡服務分攤到各個 SQL 服務器,才能承受更多的並發量。
- 集群啟動必須按照以下順序依次啟動,管理服務->數據服務->SQL服務。
以上就是如何搭建 MySQL 高可用高性能集群的詳細內容,更多關於搭建 MySQL 高可用高性能集群的資料請關註WalkonNet其它相關文章!
推薦閱讀:
- 詳細介紹windows下MySQL安裝教程
- ARM64架構下安裝mysql5.7.22的全過程
- Linux環境下安裝mysql5.7.36數據庫教程
- 如何解決MySQL5升級為MySQL8遇到的問題my.ini
- Linux環境下安裝MySQL8.0的完整步驟