Linux Shell指令碼之GitLab遠端備份

註：Gitlab是一個Git服務程式，有Web圖形介面和一系列管理工具，具體詳細介紹可以Google it。

這一篇可以說是《Linux Shell指令碼之Atlassian confluence遠端備份方法》的姊妹篇。其說明和原理是和上一篇是一樣的，其核心原理都是core dump、scp、ssh和find+rm，但也有不同。

1.Gitlab本身提供了較好的備份方法，只是一個命令那麼簡單，並且它也支援遠端備份（遠端儲存和雲端儲存），例如它可以儲存到aws的s3上。

2.本指令碼執行在Gitlab伺服器上，不在備機上，上一篇的指令碼是與執行在備機上。

指令碼如下：

#!/bin/bash
# This shell script will execute on A Server
 
# SHELL=/bin/bash
# PATH=/sbin:/bin:/usr/sbin:/usr/bin
# MAILTO=root
# HOME=/
# For details see man 4 crontabs
# Example of job definition:
# .---------------- minute (0 - 59)
# |  .------------- hour (0 - 23)
# |  |  .---------- day of month (1 - 31)
# |  |  |  .------- month (1 - 12) OR jan,feb,mar,apr ...
# |  |  |  |  .---- day of week (0 - 6) (Sunday=0 or 7) OR sun,mon,tue,wed,thu,fri,sat
# |  |  |  |  |
# *  *  *  *  * user-name command to be executed
# m h  dom mon dow  command
# execute on 11:59 per sunday
# 59 11 * * */0 $0 >/tmp/gitlab_backup_$(date -d "yesterday" +"%Y%m%d%H%M%S").log
# execute on 23:59 per day
# 59 23 * * * $0 >/tmp/gitlab_backup_$(date -d "yesterday" +"%Y%m%d%H%M%S").log
 
#    xxx.xxx.xxx.xxx                xxx.xxx.xxx.xxx
#          |        ssh tunnel          |
#    xxx.xxx.xxx.xxx  <==========>  xxx.xxx.xxx.xxx
#          |                            |
# ----------+-----------------------------+-------
#          |                            |
#    +-----+-----+                +------+------+
#    |    A    |                |      B      |
#    +-----------+                +-------------+
#    gitlab server                backups clinet
#
# A and B passed ssh Authentication
# A-->B: ssh lan_ip
# A-->B: ssh wan_ip
# B-->A: ssh lan_ip
# B-->A: ssh wan_ip
# A-->A: ssh lan_ip
# A-->A: ssh wan_ip
# B-->B: ssh lan_ip
# B-->B: ssh wan_ip
 
# Run as root, of course.
[ $UID -eq 0 ] || ( echo "Must be root to run this script." && exit 1 )
save_days=5
[ $? -eq 1 ] && exit 1
gitlab_internal_backup_directory=/data/var/opt/gitlab/backups
# if you have both wan ip and lan ip, you can fill it with all, if you have one ip, you can fill it just with lan ip
backup_server_ipaddress_public=xxx.xxx.xxx.xxx
backup_server_ipaddress_private=xxx.xxx.xxx.xxx
# select lan ip first for transmission speed
backup_server_hostname=${backup_server_ipaddress_private:-$backup_server_ipaddress_public}
backup_server_ssh_username=root
#backup_server_ssh_port=$(awk '/Port/ {print $2}' /etc/ssh/sshd_config)
backup_server_ssh_port=$(netstat -anop | awk '/sshd/ && /LISTEN/ {print $4}' | awk -F ':' '{print $2}')
backup_server_ssh_hostname=$backup_server_hostname
backup_path=/data/gitlab_backup_directory
backup_path_time_uniq=$(date -d "yesterday" +"%Y%m%d")
[ -d $backup_path/$backup_path_time_uniq ] || mkdir -p $backup_path/$backup_path_time_uniq
# sudo -u gitlab_ci -H bundle exec rake backup:create RAILS_ENV=production
echo "GitLab is executing backup operation, please hold on! "
/data/opt/gitlab/bin/gitlab-rake gitlab:backup:create >$backup_path/$backup_path_time_uniq/$(date -d "yesterday" +"%Y%m%d").log 2>&1
[ $? -ne 0 ] && echo "Local backup failed! " && exit 1;echo "Local backup successfully! "
backuped_tar_file=`awk '/gitlab_backup.tar/ {print $4}' $backup_path/backup_path_time_uniq/$(date -d "yesterday" +"%Y%m%d").log`
[ -f $gitlab_internal_backup_directory/$backuped_tar_file ] && echo "Find backuped tar file successfully! "
ssh $backup_server_ssh_username@$backup_server_ssh_hostname [ -d $backup_path/$backup_path_time_uniq ] || mkdir -p $backup_path/$backup_path_time_uniq
[ $? -ne 0 ] && echo "Remote backup directory creation failed! " && exit 1;echo "Remote backup directory creation successfully! "
scp -P$port $gitlab_internal_backup_directory/$backuped_tar_file $backup_server_ssh_username@$backup_server_ssh_hostname:$backup_path/$backup_path_time_uniq
[ $? -ne 0 ] && echo "Remote backup transmission failed! " && exit 1;echo "Remote backup transmission successfully! "
find $gitlab_internal_backup_directory -mtime +$save_days -exec rm -rf {} ;
[ $? -ne 0 ] && echo "Local expired backup remove skipped! ";echo "Local expired backup remove successfully! "
find $backup_path -mtime +$save_days -exec rm -rf {} ;
[ $? -ne 0 ] && echo "Local expired tempdir remove skipped! ";echo "Local expired tempdir remove successfully! "
ssh  $backup_server_ssh_username@$backup_server_ssh_hostname find $backup_path -mtime +$save_days -exec rm -rf {} ;
[ $? -ne 0 ] && echo "Remote expired backup remove skipped! ";echo "Remote expired backup remove successfully! "

參考： 

參考：  
GitLab.org / GitLab Community Edition / Backup restore    https://gitlab.com/gitlab-org/gitlab-ce/blob/master/doc/raketasks/backup_restore.md    
GitLab.org / GitLab CI / Backup restore    https://gitlab.com/gitlab-org/gitlab-ci/blob/master/doc/raketasks/backup_restore.md

tag:Gitlab備份指令碼,Gitlab備份方法,如何備份Gitlab,遠端備份Gitlab,遠端備份指令碼

--end--

更多GitLab相關教學見以下內容：

在 Ubuntu 12.04 上安裝 GitLab http://www.linuxidc.com/Linux/2012-12/75249.htm

GitLab 5.3 升級注意事項 http://www.linuxidc.com/Linux/2013-06/86473.htm

在 CentOS 上部署 GitLab (自託管的Git專案倉庫) http://www.linuxidc.com/Linux/2013-06/85754.htm

在RHEL6/CentOS6/ScientificLinux6上安裝GitLab 6.0.2 http://www.linuxidc.com/Linux/2014-03/97831.htm

CentOS 6.5安裝GitLab教學及相關問題解決 http://www.linuxidc.com/Linux/2014-05/101526.htm