Linux 下 ElasticSearch 集群部署

news2024/9/21 0:33:40

1. ElasticSearch下载

2. 环境准备

3. ElasticSearch部署

3.1 修改系统配置

3.2 开放端口

3.3 安装 ElasticSearch

4. 验证

本文将以三台服务器为例，介绍在 linux 系统下ElasticSearch的部署方式。

1. ElasticSearch下载

下载地址：Past Releases of Elastic Stack Software | Elastic

选择需要的介质下载，这里以 elasticsearch-7.17.3 为例

2. 环境准备

部署 ElasticSearch 需要先部署JDK ，JDK部署可以参考Linux下JDK 安装-CSDN博客。

3. ElasticSearch部署

注：以下操作三台机器均需要修改

3.1 修改系统配置

（1）编辑 limits.conf文件

vi /etc/security/limits.conf

加入以下内容：

* soft nofile 65536
* hard nofile 131072
* soft nproc 4096
* hard nproc 4096

* soft memlock unlimited
* hard memlock unlimited

（2）编辑 sysctl.conf 文件

vi /etc/sysctl.conf

加入以下内容

vm.max_map_count=262144
vm.swappiness=0

（3）配置立即生效

sysctl –p

3.2 开放端口

ElasticSearch 默认需要开通节点 9200 和 9300 端口。

（1）查看防火墙状态

systemctl status firewalld

（2）开放端口

firewall-cmd --zone=public --add-port=9200/tcp --permanent

firewall-cmd --zone=public --add-port=9300/tcp --permanent

（3）防火墙重新加载配置

firewall-cmd --reload

（4）查看防火墙所有开放的端口

firewall-cmd --zone=public --list-ports

3.3 安装 ElasticSearch

（1）创建用户

adduser es

passwd es

（2）创建数据目录

mkdir -p /data/elasticsearch/data

mkdir -p /data/elasticsearch/logs

chown es:es -R /data/

（3）解压

上传elasticsearch介质（elasticsearch-7.17.3-linux-x86_64.tar.gz）到 /opt 目录

tar zxvf elasticsearch-7.17.3-linux-x86_64.tar.gz

（4）目录授权给 es 用户

chown es:es -R /opt/elasticsearch-7.17.3

（5）修改配置文件

vi /opt/elasticsearch-7.17.3/config/elasticsearch.yml

# ======================== Elasticsearch Configuration =========================
#
# NOTE: Elasticsearch comes with reasonable defaults for most settings.
#       Before you set out to tweak and tune the configuration, make sure you
#       understand what are you trying to accomplish and the consequences.
#
# The primary way of configuring a node is via this file. This template lists
# the most important settings you may want to configure for a production cluster.
#
# Please consult the documentation for further information on configuration options:
# https://www.elastic.co/guide/en/elasticsearch/reference/index.html
#
# ---------------------------------- Cluster -----------------------------------
#
# Use a descriptive name for your cluster:
#集群名
cluster.name: es 
#
# ------------------------------------ Node ------------------------------------
#
# Use a descriptive name for the node:
#节点名称,其余两个节点分别为node-2 和node-3
node.name: node-1
#
# Add custom attributes to the node:
#
# 指定该节点是否有资格被选举成为master节点，默认为true
node.master: true
# 允许该节点存储数据(默认开启)
node.data: true
#
# ----------------------------------- Paths ------------------------------------
#
# Path to directory where to store the data (separate multiple locations by comma):
#
# 索引数据的存储路径
path.data: /data/elasticsearch/data
# Path to log files:
#
# 日志文件的存储路径
path.logs: /data/elasticsearch/logs
#
# ----------------------------------- Memory -----------------------------------
#
# Lock the memory on startup:
#
#bootstrap.memory_lock: true
#
# Make sure that the heap size is set to about half the memory available
# on the system and that the owner of the process is allowed to use this
# limit.
#
# Elasticsearch performs poorly when the system is swapping the memory.
#
# ---------------------------------- Network -----------------------------------
#
# By default Elasticsearch is only accessible on localhost. Set a different
# address here to expose this node on the network:
#当前机器节点的IP地址
network.host: IP
#当前机器节点的IP地址
network.publish_host: IP
# By default Elasticsearch listens for HTTP traffic on the first free port it
# finds starting at 9200. Set a specific HTTP port here:
#设置对外服务的http端口
http.port: 9200
# 设置节点间交互的tcp端口,默认为9300
transport.tcp.port: 9300
#
# For more information, consult the network module documentation.
#
# --------------------------------- Discovery ----------------------------------
#
# Pass an initial list of hosts to perform discovery when this node is started:
# The default list of hosts is ["127.0.0.1", "[::1]"]
#集群的所有机器节点的IP地址
discovery.seed_hosts: ["IP1","IP2","IP3"]
#
# Bootstrap the cluster using an initial set of master-eligible nodes:
#
cluster.initial_master_nodes: ["node-1", "node-2", "node-3"]
#
# For more information, consult the discovery and cluster formation module documentation.
#
# ---------------------------------- Various -----------------------------------
#
# Require explicit names when deleting indices:
#
#action.destructive_requires_name: true
#
# ---------------------------------- Security ----------------------------------
#
#                                 *** WARNING ***
#
# Elasticsearch security features are not enabled by default.
# These features are free, but require configuration changes to enable them.
# This means that users don’t have to provide credentials and can get full access
# to the cluster. Network connections are also not encrypted.
#
# To protect your data, we strongly encourage you to enable the Elasticsearch security features. 
# Refer to the following documentation for instructions.
#
# https://www.elastic.co/guide/en/elasticsearch/reference/7.16/configuring-stack-security.html


#通过配置大多数节点(符合主节点数/ 2 + 1)来防止分裂。
discovery.zen.minimum_master_nodes: 2

#设置为true锁住内存。因为内存交换到磁盘对服务器性能是致命的
bootstrap.memory_lock: true

（6）配置 jvm.option

vi /opt/elasticsearch-7.17.3/config/jvm.options

配置ES占用物理内存大小

-Xms10g

-Xmx10g

修正CVE-2021-44228漏洞

-Dlog4j2.formatMsgNoLookups=true

（7）启动

一定要切换到 es 用户

su es

cd /opt/elasticsearch-7.17.3

bin/elasticsearch -d -p pid