目录
一、环境信息
二、博客链接
三、原集群状态
四、扩容步骤
0、创建操作系统用户
1、安装路径创建
2、foundationdb.conf配置
3、fdb.cluster配置
4、修改权限
5、拷贝文件
6、systemd服务配置
7、system重载配置文件
8、启动服务并开机自启
9、添加节点
10、拷贝fdb.cluster配置文件
11、重启服务
12、验证
一、环境信息
名称 | 值 |
CPU | Intel(R) Core(TM) i5-1035G1 CPU @ 1.00GHz |
操作系统 | CentOS Linux release 7.9.2009 (Core) |
内存 | 4G |
逻辑核数 | 4 |
FoundationDB版本 | 7.3.47 |
集群节点1IP | 192.168.142.10 |
集群节点2IP | 192.168.142.12 |
新集群节点3IP | 192.168.142.11 |
二、博客链接
1、《FoundationDB-学习-01-安装部署》
三、原集群状态
[foundationdb@czg0 ~]$ fdbcli
Using cluster file `/etc/foundationdb/fdb.cluster'.
The database is available.
Welcome to the fdbcli. For help, type `help'.
fdb> status details
Using cluster file `/etc/foundationdb/fdb.cluster'.
Configuration:
Redundancy mode - double
Storage engine - ssd-2
Log engine - ssd-2
Encryption at-rest - disabled
Coordinators - 2
Desired Commit Proxies - 3
Desired GRV Proxies - 1
Desired Resolvers - 1
Desired Logs - 3
Usable Regions - 1
Cluster:
FoundationDB processes - 8
Zones - 2
Machines - 2
Memory availability - 0.5 GB per process on machine with least available
>>>>> (WARNING: 4.0 GB recommended) <<<<<
Fault Tolerance - 0 machines
Server time - 07/19/24 10:59:48
Data:
Replication health - Healthy
Moving data - 0.000 GB
Sum of key-value sizes - 1 MB
Disk space used - 420 MB
Operating space:
Storage server - 19.1 GB free on most full server
Log server - 19.1 GB free on most full server
Workload:
Read rate - 11 Hz
Write rate - 0 Hz
Transactions started - 4 Hz
Transactions committed - 0 Hz
Conflict rate - 0 Hz
Backup and DR:
Running backups - 0
Running DRs - 0
Process performance details:
192.168.142.10:4500 ( 2% cpu; 1% machine; 0.000 Gbps; 0% disk IO; 0.1 GB / 0.5 GB RAM )
192.168.142.10:4501 ( 3% cpu; 1% machine; 0.000 Gbps; 1% disk IO; 0.2 GB / 0.5 GB RAM )
192.168.142.10:4502 ( 5% cpu; 1% machine; 0.000 Gbps; 1% disk IO; 0.0 GB / 0.5 GB RAM )
192.168.142.10:4503 ( 3% cpu; 1% machine; 0.000 Gbps; 0% disk IO; 0.1 GB / 0.5 GB RAM )
192.168.142.12:4500 ( 2% cpu; 1% machine; 0.000 Gbps; 0% disk IO; 0.2 GB / 0.6 GB RAM )
192.168.142.12:4501 ( 1% cpu; 1% machine; 0.000 Gbps; 0% disk IO; 0.1 GB / 0.6 GB RAM )
192.168.142.12:4502 ( 1% cpu; 1% machine; 0.000 Gbps; 0% disk IO; 0.1 GB / 0.6 GB RAM )
192.168.142.12:4503 ( 3% cpu; 1% machine; 0.000 Gbps; 0% disk IO; 0.1 GB / 0.6 GB RAM )
Coordination servers:
192.168.142.10:4500 (reachable)
192.168.142.12:4500 (reachable)
Client time: 07/19/24 10:59:48
四、扩容步骤
0、创建操作系统用户
扩容节点执行。
[root@czg0 package]# groupadd foundationdb -g 2002
[root@czg0 package]# useradd foundationdb -g 2002 -u 2002
1、安装路径创建
扩容节点执行。
[root@czg2 /]# su - foundationdb
[foundationdb@czg0 ~]$ mkdir -p /opt/GCDW/FoundationdDb
[foundationdb@czg0 ~]$ cd /opt/GCDW/FoundationdDb/
[foundationdb@czg0 FoundationdDb]$ mkdir Log
[foundationdb@czg0 FoundationdDb]$ mkdir Data
[foundationdb@czg0 FoundationdDb]$ mkdir Config
[foundationdb@czg0 FoundationdDb]$ mkdir Bin
[foundationdb@czg0 FoundationdDb]$ mkdir Libs
[foundationdb@czg0 FoundationdDb]$ mkdir Tmp
[foundationdb@czg0 FoundationdDb]$ ll
总用量 0
drwxr-xr-x 2 foundationdb foundationdb 89 6月 28 09:47 Bin
drwxr-xr-x 2 foundationdb foundationdb 50 6月 28 10:03 Config
drwxr-xr-x 2 foundationdb foundationdb 6 6月 27 18:06 Data
drwxr-xr-x 2 foundationdb foundationdb 25 6月 28 09:49 Libs
drwxr-xr-x 2 foundationdb foundationdb 6 6月 27 18:05 Log
drwxrwxr-x 2 foundationdb foundationdb 6 6月 28 10:07 Tmp
[foundationdb@czg0 FoundationdDb]$ pwd
/opt/GCDW/FoundationdDb
2、foundationdb.conf配置
扩容节点执行。
[foundationdb@czg0 Config]$ pwd
/opt/GCDW/FoundationdDb/Config
[foundationdb@czg0 Config]$ cat foundationdb.conf
[fdbmonitor]
user = foundationdb
[general]
cluster-file = /opt/GCDW/FoundationdDb/Config/fdb.cluster
restart-delay = 60
[fdbserver]
command = /opt/GCDW/FoundationdDb/Bin/fdbserver
datadir = /opt/GCDW/FoundationdDb/Data/$ID
logdir = /opt/GCDW/FoundationdDb/Log/
public-address = auto:$ID
listen-address = public
[fdbserver.4500]
class=stateless
[fdbserver.4501]
class=transaction
[fdbserver.4502]
class=storage
[fdbserver.4503]
class=stateless
3、fdb.cluster配置
扩容节点执行。
格式:
Description:Id@Ip:Port,Ip:Port,...
名称 | 描述 |
Description | 描述信息,包含数字和字母以及下划线。 |
Id | 集群ID,包含字母数字字符(A-Z、a-z、0-9)的任意值。 |
Ip | 地址。 |
Port | 端口。 |
配置:
[foundationdb@czg0 Config]$ pwd
/opt/GCDW/FoundationdDb/Config
[foundationdb@czg0 Config]$ cat fdb.cluster
MyFdb:Sun@192.168.142.11:4500
4、修改权限
扩容节点执行。
[root@czg0 FoundationdDb]# chown -R foundationdb:foundationdb /opt/GCDW/FoundationdDb
[root@czg0 FoundationdDb]# chmod -R 755 /opt/GCDW/FoundationdDb
5、拷贝文件
[foundationdb@czg0 ~]$ scp -r /opt/GCDW/FoundationdDb/Bin/* foundationdb@czg1:/opt/GCDW/FoundationdDb/Bin/
foundationdb@czg1's password:
fdbbackup 100% 26MB 2.1MB/s 00:12
fdbcli 100% 25MB 2.1MB/s 00:12
fdbdecode 100% 25MB 1.1MB/s 00:21
fdbmonitor 100% 790KB 1.1MB/s 00:00
fdbserver 100% 92MB 1.4MB/s 01:07
6、systemd服务配置
扩容节点执行。
[root@czg0 Release]# cat /etc/systemd/system/Foundationdb.service
[Unit]
Description=FoundationDB (KV storage for cnch metastore)
[Service]
User=foundationdb
Group=foundationdb
Restart=always
RestartSec=30
TimeoutStopSec=600
ExecStart=/opt/GCDW/FoundationdDb/Bin/fdbmonitor --conffile /opt/GCDW/FoundationdDb/Config/foundationdb.conf --lockfile /opt/GCDW/FoundationdDb/Tmp/fdbmonitor.pid
[Install]
WantedBy=multi-user.target
7、system重载配置文件
扩容节点执行。
[root@czg0 Release]# systemctl daemon-reload
8、启动服务并开机自启
扩容节点执行。
[root@czg0 Release]# systemctl enable Foundationdb.service
Created symlink from /etc/systemd/system/multi-user.target.wants/Foundationdb.service to /etc/systemd/system/Foundationdb.service.
[root@czg0 Release]# systemctl start Foundationdb.service
9、添加节点
原调度节点其中一个执行即可
fdb> coordinators 192.168.142.10:4500 192.168.142.12:4500 192.168.142.11:4500
Coordination state changed
10、拷贝fdb.cluster配置文件
上面执行命令的调度节点,将配置文件拷贝到其他节点。
[gbase@czg0 ~]$ scp /opt/GCDW/FoundationdDb/Config/fdb.cluster foundationdb@czg1:/opt/GCDW/FoundationdDb/Config/
foundationdb@czg1's password:
fdb.cluster 100% 176 156.0KB/s 00:00
[gbase@czg0 ~]$ scp /opt/GCDW/FoundationdDb/Config/fdb.cluster foundationdb@czg2:/opt/GCDW/FoundationdDb/Config/
foundationdb@czg2's password:
fdb.cluster 100% 176 240.6KB/s 00:00
11、重启服务
所有节点执行。
[root@czg0 ~]# systemctl restart Foundationdb.service
12、验证
为了方便,所以/etc/foundationdb/fdb.cluster也拷贝了一份。
[foundationdb@czg0 ~]$ fdbcli
Using cluster file `/etc/foundationdb/fdb.cluster'.
The database is available.
Welcome to the fdbcli. For help, type `help'.
fdb> status details
Using cluster file `/etc/foundationdb/fdb.cluster'.
Configuration:
Redundancy mode - double
Storage engine - ssd-2
Log engine - ssd-2
Encryption at-rest - disabled
Coordinators - 3
Desired Commit Proxies - 3
Desired GRV Proxies - 1
Desired Resolvers - 1
Desired Logs - 3
Usable Regions - 1
Cluster:
FoundationDB processes - 12
Zones - 3
Machines - 3
Memory availability - 0.5 GB per process on machine with least available
>>>>> (WARNING: 4.0 GB recommended) <<<<<
Retransmissions rate - 1 Hz
Fault Tolerance - 1 machines
Server time - 07/19/24 11:05:41
Data:
Replication health - (Re)initializing automatic data distribution
Moving data - unknown (initializing)
Sum of key-value sizes - unknown
Disk space used - 630 MB
Operating space:
Storage server - 19.1 GB free on most full server
Log server - 19.1 GB free on most full server
Workload:
Read rate - 10 Hz
Write rate - 0 Hz
Transactions started - 4 Hz
Transactions committed - 0 Hz
Conflict rate - 0 Hz
Backup and DR:
Running backups - 0
Running DRs - 0
Process performance details:
192.168.142.10:4500 ( 1% cpu; 1% machine; 0.000 Gbps; 0% disk IO; 0.0 GB / 0.5 GB RAM )
192.168.142.10:4501 ( 2% cpu; 1% machine; 0.000 Gbps; 0% disk IO; 0.0 GB / 0.5 GB RAM )
192.168.142.10:4502 ( 1% cpu; 1% machine; 0.000 Gbps; 0% disk IO; 0.0 GB / 0.5 GB RAM )
192.168.142.10:4503 ( 1% cpu; 1% machine; 0.000 Gbps; 0% disk IO; 0.0 GB / 0.5 GB RAM )
192.168.142.11:4500 ( 3% cpu; 2% machine; 0.000 Gbps; 0% disk IO; 0.0 GB / 0.7 GB RAM )
192.168.142.11:4501 ( 2% cpu; 2% machine; 0.000 Gbps; 0% disk IO; 0.0 GB / 0.7 GB RAM )
192.168.142.11:4502 ( 1% cpu; 2% machine; 0.000 Gbps; 0% disk IO; 0.0 GB / 0.7 GB RAM )
192.168.142.11:4503 ( 3% cpu; 2% machine; 0.000 Gbps; 0% disk IO; 0.0 GB / 0.7 GB RAM )
192.168.142.12:4500 ( 5% cpu; 2% machine; 0.000 Gbps; 1% disk IO; 0.1 GB / 0.6 GB RAM )
192.168.142.12:4501 ( 5% cpu; 2% machine; 0.000 Gbps; 1% disk IO; 0.1 GB / 0.6 GB RAM )
192.168.142.12:4502 ( 4% cpu; 2% machine; 0.000 Gbps; 1% disk IO; 0.1 GB / 0.6 GB RAM )
192.168.142.12:4503 ( 4% cpu; 2% machine; 0.000 Gbps; 1% disk IO; 0.0 GB / 0.6 GB RAM )
Coordination servers:
192.168.142.10:4500 (reachable)
192.168.142.11:4500 (reachable)
192.168.142.12:4500 (reachable)
Client time: 07/19/24 11:05:41