elasticsearch数据备份恢复
admin
2023-03-23 11:00:52
0次
本文主要介绍elasticsearch集群数据备份及恢复，利用共享文件系统，通过快照方式备份。
集群的部署参考：http://hnr520.blog.51cto.com/4484939/1876467
一、配置修改
1.配置文件必须添加如下参数
path.repo: /mnt/backups/es_mybak
二、数据备份
1.创建备份仓库
curl -XPUT 'http://192.168.115.11:9200/_snapshot/EsBackup' -d '{
"type": "fs",
"settings": {
"location": "/mnt/backups/es_mybak"
}
}'
[root@node1 local]# curl -XPUT 'http://192.168.115.11:9200/_snapshot/EsBackup' -d '{
> "type": "fs",
> "settings": {
> "location": "/mnt/backups/es_mybak"
> }
> }'
{"acknowledged":true}给我们的仓库取一个名字，在本例它叫 EsBackup 。
我们指定仓库的类型应该是一个共享文件系统，这里采用nfs。
最后，我们提供一个已挂载的设备(/mnt/backups/es_mybak )作为目的地址。
注意：共享文件系统路径必须确保集群所有节点都可以访问到。
2.查询备份仓库
[root@node1 local]# curl -XGET 'http://192.168.115.11:9200/_snapshot?pretty'
{
"EsBackup" : {
"type" : "fs",
"settings" : {
"location" : "/mnt/backups/es_mybak"
}
}
}3.备份所有索引
curl -XPUT 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_all'
[root@node1 local]# curl -XPUT 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_all'
{"accepted":true}4.查看备份快照
curl -XGET 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_all?pretty'
[root@node1 elasticsearch6]# curl -XGET 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_*?pretty'
{
"snapshots" : [
{
"snapshot" : "snapshot_all",
"uuid" : "MRTYocxBT4qgwtpu_6jdpg",
"version_id" : 5000199,
"version" : "5.0.1",
"indices" : [
"els_student_hnr05",
"hnrtest",
"els_student_hnr03",
"els_student",
"els_student_hnr02",
"els_student_hnr04",
"els_python01",
"els_student_hnr01"
],
"state" : "SUCCESS",
"start_time" : "2017-05-17T10:00:46.860Z",
"start_time_in_millis" : 1495015246860,
"end_time" : "2017-05-17T10:00:54.209Z",
"end_time_in_millis" : 1495015254209,
"duration_in_millis" : 7349,
"failures" : [ ],
"shards" : {
"total" : 40,
"failed" : 0,
"successful" : 40
}
}
]
}5.备份部分索引
curl -XPUT 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05' -d '{ "indices": "els_student_hnr05" }'
[root@node1 elasticsearch6]# curl -XPUT 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05' -d '{ "indices": "els_student_hnr05" }'
{"accepted":true}6.查看备份快照
curl -XGET 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05?pretty'
查看快照的详细信息，可以看到每个shard的信息
curl -XGET 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05/_status?pretty'
[root@node1 elasticsearch6]# curl -XGET 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05?pretty'
{
"snapshots" : [
{
"snapshot" : "snapshot_els_student_hnr05",
"uuid" : "hsSkWa63Ss6MJjh0Eo4arA",
"version_id" : 5000199,
"version" : "5.0.1",
"indices" : [
"els_student_hnr05"
],
"state" : "SUCCESS",
"start_time" : "2017-05-18T00:58:35.699Z",
"start_time_in_millis" : 1495069115699,
"end_time" : "2017-05-18T00:58:36.396Z",
"end_time_in_millis" : 1495069116396,
"duration_in_millis" : 697,
"failures" : [ ],
"shards" : {
"total" : 5,
"failed" : 0,
"successful" : 5
}
}
]
}三、.部分索引数据恢复
1.查询索引
curl -XGET '192.168.115.11:9200/_cat/indices?v' health status index uuid pri rep docs.count docs.deleted store.size pri.store.size green open els_student_hnr05 mkvmTguZS4m1wGKbB8TOEw 5 1 99 0 124.7kb 62.3kb green open hnrtest Y-bjuEPLQTGGP88EafDlyg 5 1 0 0 1.5kb 795b green open els_student_hnr03 _UHB6P-fRfucH7lEyE-C7g 5 1 99 0 146.7kb 73.3kb green open els_student JC69IBEjTji8jU6bxCDE3A 5 1 999 0 495.9kb 247.9kb green open els_student_hnr02 k-aLl7tzRUyRfwJs8O0-kA 5 1 99 0 109.8kb 54.9kb green open els_student_hnr04 zAkj7GvfQ-CqmuFMJUTSuA 5 1 99 0 162.8kb 81.4kb green open els_python01 wmdREADVQmCX773_JDL46Q 5 1 0 0 1.5kb 795b green open els_student_hnr01 BJlcIp7mS0ii9nDYj8UDyQ 5 1 100 0 109.2kb 54.6kb
2.删除索引els_student_hnr05
[root@node1 elasticsearch6]# curl -XDELETE 'http://192.168.115.11:9200/els_student_hnr05'
{"acknowledged":true}3.根据snapshot_els_student_hnr05快照恢复索引
curl -XPOST 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05/_restore'
[root@node1 elasticsearch6]# curl -XPOST 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05/_restore'
{"accepted":true}4.再次查看索引
[root@node1 elasticsearch6]# curl -XGET '192.168.115.11:9200/_cat/indices?v' health status index uuid pri rep docs.count docs.deleted store.size pri.store.size green open hnrtest Y-bjuEPLQTGGP88EafDlyg 5 1 0 0 1.5kb 795b green open els_student_hnr05 S3AsHa4dRtuXXZ3uIDGvuQ 5 1 99 0 124.7kb 62.3kb
被删除的索引els_student_hnr05已经恢复回来
四、数据完全恢复
1.关闭所有节点，删除数据目录下的所有数据，重新启动集群
kill -9 $(ps -ef | grep -v grep | grep elasticsearch | awk '{print $2}')
2.重新启动集群
3.创建备份仓库
curl -XPUT 'http://192.168.115.11:9200/_snapshot/EsBackup' -d '{
"type": "fs",
"settings": {
"location": "/mnt/backups/es_mybak"
}
}'4.查看备份快照
curl -XGET 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_*?pretty'
{
"snapshots" : [
{
"snapshot" : "snapshot_all",
"uuid" : "MRTYocxBT4qgwtpu_6jdpg",
"version_id" : 5000199,
"version" : "5.0.1",
"indices" : [
"els_student_hnr05",
"hnrtest",
"els_student_hnr03",
"els_student",
"els_student_hnr02",
"els_student_hnr04",
"els_python01",
"els_student_hnr01"
],
"state" : "SUCCESS",
"start_time" : "2017-05-17T10:00:46.860Z",
"start_time_in_millis" : 1495015246860,
"end_time" : "2017-05-17T10:00:54.209Z",
"end_time_in_millis" : 1495015254209,
"duration_in_millis" : 7349,
"failures" : [ ],
"shards" : {
"total" : 40,
"failed" : 0,
"successful" : 40
}
},
{
"snapshot" : "snapshot_els_student_hnr05",
"uuid" : "hsSkWa63Ss6MJjh0Eo4arA",
"version_id" : 5000199,
"version" : "5.0.1",
"indices" : [
"els_student_hnr05"
],
"state" : "SUCCESS",
"start_time" : "2017-05-18T00:58:35.699Z",
"start_time_in_millis" : 1495069115699,
"end_time" : "2017-05-18T00:58:36.396Z",
"end_time_in_millis" : 1495069116396,
"duration_in_millis" : 697,
"failures" : [ ],
"shards" : {
"total" : 5,
"failed" : 0,
"successful" : 5
}
}
]
}5.恢复数据
curl -XPOST 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_all/_restore'
6.查询索引
[root@node1 elasticsearch6]# curl -XGET '192.168.115.11:9200/_cat/indices?v' health status index uuid pri rep docs.count docs.deleted store.size pri.store.size green open hnrtest LNkwevA2Sr2Jgue1oLRIGA 5 1 0 0 1.5kb 795b green open els_student 6aE8M7KMRN2EdievhDBXcw 5 1 999 0 495.9kb 247.9kb green open els_student_hnr04 8hXeVjXYRhS5POdy3hnMuQ 5 1 99 0 162.8kb 81.4kb green open els_student_hnr01 afVLqgxpTqii6pNObLC2sA 5 1 100 0 109.2kb 54.6kb green open els_student_hnr05 jzHPY_TlSEm-ZEXWz0sz4Q 5 1 99 0 124.7kb 62.3kb green open els_student_hnr02 f3hqeM1pQkWttZifnCCQDQ 5 1 99 0 109.8kb 54.9kb green open els_python01 4_vFwhn0RCi3SZbz2bORCw 5 1 0 0 1.5kb 795b green open els_student_hnr03 esFyZMwwTaeLf7YrKxyYjQ 5 1 99 0 146.7kb 73.3kb 至此所有索引已经完全恢复
五、从全部索引快照中恢复单个索引
1.删除索引els_student_hnr05
curl -XDELETE 'http://192.168.115.11:9200/els_student_hnr05'
2.恢复被删除的索引els_student_hnr05
curl -XPOST 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_all/_restore' -d '{
"indices": "els_student_hnr05",
"rename_replacement": "restored_index_$1"
}'六、删除快照
curl -XDELETE 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_els_student_hnr05' curl -XDELETE 'http://192.168.115.11:9200/_snapshot/EsBackup/snapshot_all'
相关内容
热门资讯
特朗普下令不打了，美国的“余粮...
可以说戛然而止，快得让很多人都无法适应。前两周，每一天美国都要打击伊朗一通。就在7月24日白宫会议前...
穆杰塔巴最新表态：支持黎真主党
△伊朗最高领袖穆杰塔巴·哈梅内伊（资料图）当地时间7月26日晚，伊朗最高领袖穆杰塔巴·哈梅内伊对黎巴...
美军瘫痪一艘驶向伊朗的油轮，特...
美国总统特朗普虽下令暂停打击伊朗，但美军仍在执行对霍尔木兹海峡的封锁任务。针对美军瘫痪一艘驶向伊朗油...
“小牌大耍”的底气到底是哪里来...
澎湃首席评论员 李平这两天，“艺人李权哲乘高铁占座事件”在网上引发热议，该艺人参加的活动主办方曾发布...
越南籍船舶南海遇险沉没，中方已...
据凤凰卫视报道，一艘越南船舶7月24日夜间在越南庆和以东220海里附近遇险沉没，船上共62名越南籍人...
李权哲占座、蒙面、装死：娱乐圈...
你买了一张高铁一等座的票，找到自己的位置，18A。有人坐着。你拿出手机看了眼购票记录——没错，18A...
杭州景区咖啡店闯入1条幼蛇，仅...
夏天气温高、湿度大，蛇类活动进入高峰期，千万别被“小蛇无害”的刻板印象骗了！有些幼蛇看着迷你可爱，实...
AI开源公开信签署企业增至50...
IT之家 7 月 26 日消息，英伟达、微软、IBM、Meta 等 25 家美国科技企业本周（7 月...
南阳快手短视频代运营企业的服务...
在短视频平台快速发展的背景下，企业通过快手等渠道进行内容运营已成为常见的市场动作。对于希望借助短视频...
普通人该如何跟上科技发展的步伐
这个被称作科技的词汇, 听起来既有宏大之感, 又颇为遥远, 好似仅仅归属于在实验室里专心致志钻研的科...