实战:ansible自动化部署nginx+keepalived+mysql负载均衡集群

一、目的

使用ansible自动化部署nginx+keepalived+mysql负载均衡集群。

二、拓扑规划

ansibletest1.png

三、详细步骤

  • 1、环境的搭建

        (1)安装ansible,同时配置私钥免密码进行通信

[root@localhost ~]# ssh-keygen  -t rsa #-t表示使用的加密类型,其中rsa1表示version1版本,rsa、dsa、ecdsa的加密对于的是version2版本
Generating public/private rsa key pair.
#这里询问你要把生成的密钥文件保存在哪里,默认是在家目录下的.ssh文件夹中,回车保存默认目录
Enter file in which to save the key (/root/.ssh/id_rsa):
Created directory '/root/.ssh'.
#这里是对密钥文件加密,不输入则表示不加密
Enter passphrase (empty for no passphrase):
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
04:9f:cb:9c:9d:1e:47:d7:e1:d4:c1:87:71:c3:a4:22 root@localhost.localdomain
The key's randomart image is:
+--[ RSA 2048]----+
|      .       =O+|
|       o .    ===|
|        +E .....o|
|       + +.o..   |
|        S + .    |
|         . o     |
|          .      |
|                 |
|                 |
+-----------------+

        (2)查看已经成功生成了一对密钥

[root@localhost ~]# ls /root/.ssh
id_rsa  id_rsa.pub#其中id_rsa为私钥,id_rsa.pub为公钥

        (3)在生成完密钥对之后将公钥上传给服务器对应用户的家目录

[root@localhost ~]# ssh-copy-id -i .ssh/id_rsa.pub root@10.1.252.215
[root@localhost ~]# ssh-copy-id -i .ssh/id_rsa.pub root@10.1.252.235
[root@localhost ~]# ssh-copy-id -i .ssh/id_rsa.pub 10.1.253.107
[root@localhost ~]# ssh-copy-id -i .ssh/id_rsa.pub root@10.1.249.75
[root@localhost ~]# ssh-copy-id -i .ssh/id_rsa.pub root@10.1.249.75

·

        (4)编辑ansible的hosts文件,定义后所有的主机

[19:05 root@centos6.8/etc/ansible]# cat hosts 
# This is the default ansible 'hosts' file.
#
# It should live in /etc/ansible/hosts
#
#   - Comments begin with the '#' character
#   - Blank lines are ignored
#   - Groups of hosts are delimited by [header] elements
#   - You can enter hostnames or ip addresses
#   - A hostname/ip can be a member of multiple groups

# Ex 1: Ungrouped hosts, specify before any group headers.
[web]
10.1.252.215
10.1.252.235
[nginx]
10.1.253.107 state=MASTER priority=100
10.1.249.75  state=BACKUP priority=90
[mysql]
10.1.252.36

·

        OK,环境已经搭配好,所有主机同步下时间:

[19:34 root@centos6.8/etc/ansible]# ansible all -a 'ntpdate 10.1.0.1'
10.1.252.215 | success | rc=0 >>
3 Nov 19:34:30 ntpdate[38293]: adjust time server 10.1.0.1 offset -0.003936 sec

10.1.252.36 | success | rc=0 >>
3 Nov 19:34:30 ntpdate[3291]: adjust time server 10.1.0.1 offset 0.200434 sec

10.1.252.235 | success | rc=0 >>
3 Nov 19:34:36 ntpdate[38723]: adjust time server 10.1.0.1 offset -0.001469 sec

10.1.253.107 | success | rc=0 >>
3 Nov 19:34:37 ntpdate[7161]: adjust time server 10.1.0.1 offset -0.001905 sec

10.1.249.75 | success | rc=0 >>
3 Nov 19:34:37 ntpdate[4951]: adjust time server 10.1.0.1 offset 0.018952 sec
  • 2、下面来进行ansible的roles和playbook的定义:
    在/etc/ansible/roles目录下创建相关的角色目录:

[19:56 root@centos6.8/etc/ansible/roles]# mkdir -pv {mysql,web,nginx}/{files,tasks,templates,variables,handlers,meta,defult}
mkdir: created directory `mysql'
mkdir: created directory `mysql/files'
mkdir: created directory `mysql/tasks'
mkdir: created directory `mysql/templates'
mkdir: created directory `mysql/variables'
mkdir: created directory `mysql/handlers'
mkdir: created directory `mysql/meta'
mkdir: created directory `mysql/default'
mkdir: created directory `web'
mkdir: created directory `web/files'
mkdir: created directory `web/tasks'
mkdir: created directory `web/templates'
mkdir: created directory `web/variables'
mkdir: created directory `web/handlers'
mkdir: created directory `web/meta'
mkdir: created directory `web/default'
mkdir: created directory `nginx'
mkdir: created directory `nginx/files'
mkdir: created directory `nginx/tasks'
mkdir: created directory `nginx/templates'
mkdir: created directory `nginx/variables'
mkdir: created directory `nginx/handlers'
mkdir: created directory `nginx/meta'
mkdir: created directory `nginx/default'
[19:58 root@centos6.8/etc/ansible/roles]# tree
.
├── mysql
│   ├── default
│   ├── files
│   ├── handlers
│   ├── meta
│   ├── tasks
│   ├── templates
│   └── variables
├── nginx
│   ├── default
│   ├── files
│   ├── handlers
│   ├── meta
│   ├── tasks
│   ├── templates
│   └── variables
└── web
   ├── default
   ├── files
   ├── handlers
   ├── meta
   ├── tasks
   ├── templates
   └── variables

24 directories, 0 files

说明:
files/:存储由copy或script等模块调用的文件;
tasks/:此目录中至少应该有一个名为main.yml的文件,用于定义各task;其它的文件需要由main.yml进行“包含”调用;
handlers/:此目录中至少应该有一个名为main.yml的文件,用于定义各handler;其它的文件需要由main.yml进行“包含”调用;
vars/:此目录中至少应该有一个名为main.yml的文件,用于定义各variable;其它的文件需要由main.yml进行“包含”调用;
templates/:存储由template模块调用的模板文本;
meta/:此目录中至少应该有一个名为main.yml的文件,定义当前角色的特殊设定及其依赖关系;其它的文件需要由main.yml进行“包含”调用;
default/:此目录中至少应该有一个名为main.yml的文件,用于设定默认变量;

下面就是添加playbook了,首先设置web:

  • 3、设置web的playbook

    (1)Tasks:任务

[17:27 root@centos6.8/etc/ansible]# cat roles/web/tasks/main.yml 
- name: install web pakgs
 yum: name={{ item }}
 with_items:
 - httpd
 - php
 - php-mysql
- name: config the web
 copy: src=httpd.conf dest=/etc/httpd/conf/httpd.conf
 notify: reload the service
- name: install wordpress
 copy: src=wordpress dest=/var/www/html/wordpress/
- name: restart the service
 service: name=httpd state=started

        (2)添加触发器:handlers

[20:26 root@centos6.8/etc/ansible]# cat roles/web/handlers/main.yml 
- name: relaod the service
 service: name=httpd state=restarted

        (3)添加需要的file:

[18:45 root@centos6.8/etc/ansible]# ll roles/web/files/
total 40
-rw-r--r--. 1 root   root      34419 Nov  2 20:23 httpd.conf  #主要是配置httpd的默认配置,要事先准备好
drwxr-xr-x. 5 nobody nfsnobody  4096 Nov  3 14:00 wordpress   #wordpres的安装程序,注意这里的配置文件已经更改了后面的连接数据库
[18:58 root@centos6.8/etc/ansible]#vim  roles/web/files/wordpress/wp-config.php  #修改数据库信息,信息已经在后面的mysql剧本已经定义好了
/** WordPress数据库的名称 */
define('DB_NAME', 'wp');

/** MySQL数据库用户名 */
define('DB_USER', 'wpuser');

/** MySQL数据库密码 */
define('DB_PASSWORD', 'wppass');

/** MySQL主机 */
define('DB_HOST', '10.1.252.109');

/** 创建数据表时默认的文字编码 */
define('DB_CHARSET', 'utf8');

        (4)添加主剧本:

[20:28 root@centos6.8/etc/ansible]# ll web.yml 
-rw-r--r--. 1 root root 51 Nov  2 20:22 web.yml
[20:28 root@centos6.8/etc/ansible]# pwd
/etc/ansible
[20:28 root@centos6.8/etc/ansible]# cat web.yml
- hosts: web
 remote_user: root
 roles:
 - web    

    

        检查语法没有问题:

[20:25 root@centos6.8/etc/ansible]# ansible-playbook --syntax-check web.yml 

playbook: web.yml

  • 4、下面来部署前端的nginx调度起和keepalived配置:

    (1)添加task任务:

[19:34 root@centos6.8/etc/ansible]# cat roles/nginx/tasks/main.yml 
- name: install keepalived
 yum: name=keepalived
- name: copy nginx
 copy: src=nginx-1.10.0-1.el7.ngx.x86_64.rpm dest=/tmp/nginx.rpm
- name: install nginx
 yum: name=/tmp/nginx.rpm
- name: delete the nginx pkg
 shell: "rm -f /tmp/nginx.rpm"
- name: config nginx&keepalived
 template: src=keepalived.j2 dest=/etc/keepalived/keepalived.conf
 notify: reload the service
- name: config nginx&keepalived
 template: src=nginx.j2 dest=/etc
/nginx/nginx.conf
 notify: reload the service
- name: start the service
 service: name={{ item }} state=started
 with_items:
 - keepalived
 - nginx

        (2)添加handlers:

[21:28 root@centos6.8/etc/ansible]#cat roles/nginx/handlers/mainx.yml 
- name: reload the service
 service: name={{ item }} state=restarted
 with_items:
 - nginx
 - keepalived

        (3)在hosts列表中复制变量:

[19:38 root@centos6.8/etc/ansible]# cat hosts 
# This is the default ansible 'hosts' file.
#
# It should live in /etc/ansible/hosts
#
#   - Comments begin with the '#' character
#   - Blank lines are ignored
#   - Groups of hosts are delimited by [header] elements
#   - You can enter hostnames or ip addresses
#   - A hostname/ip can be a member of multiple groups

# Ex 1: Ungrouped hosts, specify before any group headers.

[web]
10.1.252.215
10.1.252.235
[nginx]
10.1.253.107 state=MASTER priority=100
10.1.249.75  state=BACKUP priority=90
[mysql]
10.1.252.36

        (4)提供files文件:nginx的安装程序

[19:39 root@centos6.8/etc/ansible]# ll roles/nginx/files/
total 644
-rw-r--r--. 1 root root 655648 Apr 29  2016 nginx-1.10.0-1.el7.ngx.x86_64.rpm

        (5)在template中使用了变量:
nginx配置:

[21:33 root@centos6.8/etc/ansible]# cat roles/nginx/templates/nginx.j2 

user  nginx;
worker_processes  {{ ansible_processor_vcpus  }}; #使用变量,进程数为cpu数量:

error_log  /var/log/nginx/error.log warn;
pid        /var/run/nginx.pid;


events {
   worker_connections  1024;
}


http {
   include       /etc/nginx/mime.types;
   default_type  application/octet-stream;

   log_format  main  '$remote_addr - $remote_user [$time_local] "$request" '
                     '$status $body_bytes_sent "$http_referer" '
                     '"$http_user_agent" "$http_x_forwarded_for"';

   access_log  /var/log/nginx/access.log  main;

   sendfile        on;
   #tcp_nopush     on;

   keepalive_timeout  65;

   #gzip  on;

   include /etc/nginx/conf.d/*.conf;

   upstream web {
   server 10.1.24.113;
   server 10.1.24.114;
}
   location / {
   proxy_pass http://web;  
}

}

keepalived配置:

[21:33 root@centos6.8/etc/ansible]# cat roles/nginx/templates/keepalived.j2 
! Configuration File for keepalived

global_defs {
  notification_email {
    sysadmin@firewall.loc
  }
  notification_email_from Alexandre.Cassen@firewall.loc
  smtp_server 127.0.0.1
  smtp_connect_timeout 30
  router_id LVS_DEVEL
}

vrrp_instance VI_1 {
   state {{ state }}  #使用变量,变量在hosts中已经定义了
   interface eno16777746
   virtual_router_id 55
   priority {{ priority }} #使用变量,变量在hosts中已经定义了
   advert_int 1
   authentication {
       auth_type PASS
       auth_pass 232332
   }
   virtual_ipaddress {
       10.1.24.222
   }
}

        (6)添加主剧本:

[21:30 root@centos6.8/etc/ansible]# cat nginx.yml 
- hosts: nginx
 remote_user: root
 roles:
 - nginx

        (7)语法检测没有问题

[21:34 root@centos6.8/etc/ansible]#ansible-playbook --syntax-check nginxx.yml 

playbook: nginx.yml
  • 5、设置mysql:
    (1)设置mysql的task:

[18:46 root@centos6.8/etc/ansible]# cat roles/mysql/tasks/main.yml 
- name: install mysql
 yum: name=mysql-server
- name: copy sql file
 copy: src=mysql.sql dest=/tmp/mysql.sql
- name: start mysql service
 service: name=mysqld state=started
- name: config mysql
 shell: "mysql < /tmp/mysql.sql"

        (2)设置files文件

[18:47 root@centos6.8/etc/ansible]# ll roles/mysql/files/
total 4
-rw-r--r--. 1 root root 78 Nov  3 15:41 mysql.sql
[19:39 root@centos6.8/etc/ansible]# cat roles/mysql/files/mysql.sql #提供数据库的sql脚本,创建wordpres的用户和数据库
CREATE DATABASE wp;
GRANT ALL ON wp.* TO 'wpuser'@'%' IDENTIFIED BY 'wppass';

        (3)添加主剧本:

[18:48 root@centos6.8/etc/ansible]# cat mysql.yml 
- hosts: mysql
 remote_user: root
 roles:
 - mysql

        (4)语法检查没有问题:

[18:49 root@centos6.8/etc/ansible]# ansible-playbook --syntax-check mysql.yml 

playbook: mysql.yml

        mysql的ansible配置已经完成

  • 6、至此,web、nginx+keepalived、mysql的配置都已经完成,下面来依次执行剧本
    (1)来看下整个目录的结构:

[19:05 root@centos6.8/etc/ansible]# tree -L 4
.
├── ansible.cfg
├── ansible.cfg.bak
├── hosts
├── mysql.yml
├── nginx.yml
├── roles
│   ├── mysql
│   │   ├── default
│   │   ├── files
│   │   │   └── mysql.sql
│   │   ├── handlers
│   │   ├── meta
│   │   ├── tasks
│   │   │   └── main.yml
│   │   ├── templates
│   │   └── variables
│   ├── nginx
│   │   ├── default
│   │   ├── files
│   │   │   └── nginx-1.10.0-1.el7.ngx.x86_64.rpm
│   │   ├── handlers
│   │   │   └── main.yml
│   │   ├── meta
│   │   ├── tasks
│   │   │   └── main.yml
│   │   ├── templates
│   │   │   ├── keepalived.j2
│   │   │   └── nginx.j2
│   │   └── variables
│   └── web
│       ├── default
│       ├── files
│       │   ├── httpd.conf
│       │   └── wordpress
│       ├── handlers
│       │   └── main.yml
│       ├── meta
│       ├── tasks
│       │   └── main.yml
│       ├── templates
│       └── variables
├── test.yaml
└── web.yml

26 directories, 17 files

        (2)执行web的playbook:

[17:15 root@centos6.8/etc/ansible]# ansible-playbook  web.yml 

PLAY [web] ********************************************************************

GATHERING FACTS ***************************************************************
ok: [10.1.252.235]
ok: [10.1.252.215]

TASK: [web | install web pakgs] ***********************************************
ok: [10.1.252.215] => (item=httpd,php,php-mysql)
ok: [10.1.252.235] => (item=httpd,php,php-mysql)

TASK: [web
| config the web] **************************************************
ok: [10.1.252.215]
ok: [10.1.252.235]

TASK: [web
| install wordpress] ***********************************************
changed: [10.1.252.235]
changed: [10.1.252.215]

TASK: [web
| restart the service] *********************************************
ok: [10.1.252.215]
ok: [10.1.252.235]

PLAY RECAP ********************************************************************
10.1.252.215               : ok=5    changed=1    unreachable=0    failed=0  
10.1.252.235               : ok=5    changed=1    unreachable=0    failed=0        

        (3)执行mysql的playbook:

[18:52 root@centos6.8/etc/ansible]# ansible-playbook  mysql.yml 

PLAY [mysql] ******************************************************************

GATHERING FACTS ***************************************************************
ok: [10.1.252.36]

TASK: [mysql | install mysql] *************************************************
ok: [10.1.252.36]

TASK: [mysql
| copy sql file] *************************************************
ok: [10.1.252.36]

TASK: [mysql
| start mysql service] *******************************************
ok: [10.1.252.36]

TASK: [mysql
| config mysql] **************************************************
skipping: [10.1.252.36]
ok: [10.1.252.36]

PLAY RECAP ********************************************************************
10.1.252.36                : ok=4    changed=0    unreachable=0    failed=0

        (4)执行nginx的playbook:

[18:53 root@centos6.8/etc/ansible]# ansible-playbook nginx.yml 

PLAY [nginx] ******************************************************************

GATHERING FACTS ***************************************************************
ok: [10.1.249.75]
ok: [10.1.253.107]

TASK: [nginx | install keepalived] ********************************************
ok: [10.1.253.107]
ok: [10.1.249.75]

TASK: [nginx
| copy nginx] ****************************************************
changed: [10.1.249.75]
changed: [10.1.253.107]

TASK: [nginx
| install nginx] *************************************************
ok: [10.1.249.75]
ok: [10.1.253.107]

TASK: [nginx
| delete the nginx pkg] ******************************************
changed: [10.1.249.75]
changed: [10.1.253.107]

TASK: [nginx
| config nginx&keepalived] ***************************************
ok: [10.1.249.75]
ok: [10.1.253.107]

TASK: [nginx
| config nginx&keepalived] ***************************************
ok: [10.1.249.75]
ok: [10.1.253.107]

TASK: [nginx
| start the service] *********************************************
ok: [10.1.253.107] => (item=keepalived)
ok: [10.1.249.75] => (item=keepalived)
ok: [10.1.253.107] => (item=nginx)
ok: [10.1.249.75] => (item=nginx)

PLAY RECAP ********************************************************************
10.1.249.75                : ok=8    changed=2    unreachable=0    failed=0  
10.1.253.107               : ok=8    changed=2    unreachable=0    failed=0  

        

        执行完成后,下面就是验证效果的时候:

ansibletest.png

        

        激动的时刻,成功了!

中间本人遇到的问题:在每个task中的name任务中不能有过多的任务,必须要分为多个步骤进行,如此例中的copy nginx然后再yum nginx,不能写在同一个name中,否则会报错!此外,copy的模块拷贝目录时注意最后的“/” 问题。

        OK,更多文章请关注我的博客

原创文章,作者:麦德良,如若转载,请注明出处:http://www.178linux.com/57379

(1)
麦德良麦德良
上一篇 2016-11-11
下一篇 2016-11-11

相关推荐

  • Linux中的分区管理

    1. 磁盘分区类型 磁盘分区主要分为两种类型: MBR  MBR是一个比较古老的分区类型了,不支持2TB的大硬盘。在磁盘的0磁道0扇区的512字节存放的就是MBR的信息。前446字节为bootloader,后面64字节存放的是分区表,后面2字节存放的是55aa的分区标识符。MBR分区类型最多只能支持4个主分区和扩展分区,其余的分区只能是逻辑分区。 …

    2017-04-22
  • 马哥教育网络班21期+第六周课程练习

    第六周作业 1、复制/etc/rc.d/rc.sysinit文件至/tmp目录,将/tmp/rc.sysinit文件中的以至少一个空白字符开头的行的行首加#; cp /etc/rc.d/rc.sysinit /tmpvim /tmp/rc.sysinit # 命令模式下,输入一下内容:%s@\(^[[:space:]]…

    Linux干货 2016-10-17
  • lvs初探

    LVS 简述 HA基础知识 lvs配置 简述 什么是lvs? lvs是linux virtual server linux虚拟服务的缩写,通过一台调度服务器来调度收到的请求并分发给后端的real server。 lvs的功能是什么? lvs能够实现在大并发的情况下,将前端调度器收到的请求分发给后端服务器处理,实现了负载均衡集群的作用。 lb基础知识 lb集群…

    Linux干货 2016-05-31
  • shell脚本编程和文件查找及压缩

    shell脚本编程 read:使用read来把输入值分配一个或多个shell变量     -p 指定要显示的提示     -t TIMEOUT     read 从标准输入中读取值,给每个单词分配一个变量   &nbsp…

    Linux干货 2016-08-18
  • nginx实现代理服务器功能

    nginx实现代理服务器功能1: #环境: 172.16.253.223 #CentOS7.3,安装nginx作为代理服务器 172.16.253.224 #CentOS7.3,安装httpd作为服务器 172.16.253.188 #CentOS6.8,咱庄httpd作为图片服务器 #223主机: yum install nginx vim /etc/ng…

    Linux干货 2017-06-28
  • linux中的管道符

    管道符 less只能看文件 但是这样做会产生一个垃圾文件ls.txt,所以下面我们就会需要用到管道符 |只将传递正确结果传递给 而使用这两种方法可以传递正确和错误的结果[root@localhost ~]# ls /etc/passwd /cpp/passwd 2>&1|less   ,  (2>&1…

    2017-07-22