使用Nginx+Lua实现Web项目的灰度发布 Nginx编译安装Lua模块 一、安装LUA环境及相关库 官方网站:https://github.com/openresty/lua-nginx-module 1、LuaJIT wget http://luajit.org/download/LuaJIT-2.0.2.tar.gz make && make install PREFIX=/usr/local/LuaJIT # vim /etc/profile export LUAJIT_LIB=/usr/local/LuaJIT/lib export LUAJIT_INC=/usr/local/LuaJIT/include/luajit-2.0 # source /etc/profile 2、下载解压ngx_devel_kit和lua-nginx-module cd /usr/local/src wget https://github.com/simpl/ngx_devel_kit/archive/v0.3.0.tar.gz wget https://github.com/openresty/lua-nginx-module/archive/v0.10.9rc7.tar.gz 分别解压 tar xf v0.10.9rc7.tar.gz tar xf v0.3.0.tar.gz 3、重新编译编译Nginx cd /usr/local/src/ wget http://nginx.org/download/nginx-1.12.1.tar.gz [root@node1 src]# tar xf nginx-1.12.1.tar.gz [root@node1 src]# cd nginx-1.12.1 预编译 ./configure --prefix=/etc/nginx --sbin-path=/usr/sbin/nginx --modules-path=/usr/lib64/nginx/modules --conf-path=/etc/nginx/nginx.conf --error-log-path=/var/log/nginx/error.log --http-log-path=/var/log/nginx/access.log --pid-path=/var/run/nginx.pid --lock-path=/var/run/nginx.lock --http-client-body-temp-path=/var/cache/nginx/client_temp --http-proxy-temp-path=/var/cache/nginx/proxy_temp --http-fastcgi-temp-path=/var/cache/nginx/fastcgi_temp --http-uwsgi-temp-path=/var/cache/nginx/uwsgi_temp --http-scgi-temp-path=/var/cache/nginx/scgi_temp --user=nginx --group=nginx --with-compat --with-file-aio --with-threads --with-http_addition_module --with-http_auth_request_module --with-http_dav_module --with-http_flv_module --with-http_gunzip_module --with-http_gzip_static_module --with-http_mp4_module --with-http_random_index_module --with-http_realip_module --with-http_secure_link_module --with-http_slice_module --with-http_ssl_module --with-http_stub_status_module --with-http_sub_module --with-http_v2_module --with-mail --with-mail_ssl_module --with-stream --with-stream_realip_module --with-stream_ssl_module --with-stream_ssl_preread_module --with-cc-opt=‘-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -fPIC‘ --with-ld-opt=‘-Wl,-z,relro -Wl,-z,now -pie‘ --add-module=/usr/local/src/ngx_devel_kit-0.3.0 --add-module=/usr/local/src/lua-nginx-module-0.10.9rc7 # 并行编译 make -j 4 && make install 4、加载lua库，加入到ld.so.conf文件 echo "/usr/local/LuaJIT/lib"/etc/ld.so.conf ldconfig 报错： [root@node1 nginx-1.12.1]# nginx -v nginx: error while loading shared libraries: libluajit-5.1.so.2: cannot open shared object file: No such file or directory 解决： # ln -s /usr/local/LuaJIT/lib/libluajit-5.1.so /usr/lib64/libluajit-5.1.so.2 二、使用Nginx+Lua实现Web项目的灰度发布 灰度发布概念： 按照一定的关系区别，分部分的代码进行上线，使代码的发布能平滑过渡上线 1.使用用户的信息cookie等信息区别 2.根据用户的ip地址区分 灰度发布在百度百科中解释： 灰度发布（又名金丝雀发布）是指在黑与白之间，能够平滑过渡的一种发布方式。在其上可以进行A/B testing，即让一部分用户继续用产品特性A，一部分用户开始用产品特性B，如果用户对B没有什么反对意见，那么逐步扩大范围，把所有用户都迁移到B上面来。灰度发布可以保证整体系统的稳定，在初始灰度的时候就可以发现、调整问题，以保证其影响度。 灰度期：灰度发布开始到结束期间的这一段时间，称为灰度期。 这里用于WEB系统新代码的测试发布，让一部分（IP）用户访问新版本，一部分用户仍然访问正常版本，其原理如图：具体实现步骤： 1.部署两个tomcat实例： 分别监听 8080和9090 端口 tomcat8080作为灰度环境(升级以后的环境) tomcat9090作为生产环境(升级之前的环境) tomcat8080的测试页面代码： [root@node1 tomcat8080]# cat /data/tomcat8080/webapps/ROOT/java_test.jsp <%@ page language="java" import="java.util.*" pageEncoding="utf-8"%> <HTML> <HEAD> <TITLE>jsp Test Page</TITLE> </HEAD> <BODY> <% Random rand = new Random(); out.println("<h1>Random number:</h1>"); out.println("<h1>gray server:</h1>"); out.println(rand.nextInt(99)+100); %> </BODY> </HTML> [root@node1 tomcat8080]# cat /data/tomcat9090/webapps/ROOT/java_test.jsp <%@ page language="java" import="java.util.*" pageEncoding="utf-8"%> <HTML> <HEAD> <TITLE>jsp Test Page</TITLE> </HEAD> <BODY> <% Random rand = new Random(); out.println("<h1>shengchang xianshang server</h1>"); out.println("<h1>Random number:</h1>"); out.println(rand.nextInt(99)+100); %> </BODY> </HTML> 测试tomcat是否部署正常
2.安装memcached [root@node1 ~]# yum install -y memcached [root@node1 conf.d]# memcached -p11211 -u nobody -d [root@node1 conf.d]# ps -ef|grep memcached nobody 17177 1 0 18:12 ? 00:00:00 memcached -p11211 -u nobody -d root 17213 17150 0 18:12 pts/1 00:00:00 grep --color=auto memcached [root@node1 conf.d]# netstat -tnlp|grep 11211 tcp 0 0 0.0.0.0:11211 0.0.0.0:* LISTEN 17177/memcached tcp6 0 0 :::11211 :::* LISTEN 17177/memcached 修改nginx配置文件 [root@node1 conf.d]# pwd /etc/nginx/conf.d 修改nginx配置，引入lua脚本 经过测试，通过命令引入脚本文件的方式测试无法通过content_by_lua_file /opt/app/dep.lua; ①合并nginx写法，都写入nginx主配置文件： [root@node1 nginx]# cat nginx.conf worker_processes 1; events { worker_connections 1024; } http { include mime.types; default_type application/octet-stream; sendfile on; keepalive_timeout 65; proxy_next_upstream error timeout; proxy_redirect off; proxy_set_header Host $host; proxy_set_header X-Real-IP $http_x_forwarded_for; proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; client_max_body_size 100m; client_body_buffer_size 256k; proxy_connect_timeout 180; proxy_send_timeout 180; proxy_read_timeout 180; proxy_buffer_size 8k; proxy_buffers 8 64k; proxy_busy_buffers_size 128k; proxy_temp_file_write_size 128k; upstream sc_server { server 192.168.3.177:9090; } upstream gray_server { server 192.168.3.177:8080; } lua_package_path "/usr/local/share/lua/5.1/memcached.lua"; server { listen 80; server_name localhost; location / { content_by_lua ‘ clientIP = ngx.req.get_headers()["X-Real-IP"] if clientIP == nil then clientIP = ngx.req.get_headers()["x_forwarded_for"] end if clientIP == nil then clientIP = ngx.var.remote_addr end local memcached = require "resty.memcached" local memc, err = memcached:new() if not memc then ngx.say("failed to instantiate memc: ", err) return end local ok, err = memc:connect("127.0.0.1", 11211) if not ok then ngx.say("failed to connect: ", err) return end local res, flags, err = memc:get(clientIP) if err then ngx.say("failed to get clientIP ", err) return end if res == "1" then ngx.exec("@gray_server") return end ngx.exec("@sc_server") ‘; } location @sc_server{ proxy_pass http://sc_server; } location @gray_server{ proxy_pass http://gray_server; } location /hello { default_type ‘text/plain‘; content_by_lua ‘ngx.say("hello, lua")‘; } location /myip { default_type ‘text/palin‘; content_by_lua ‘ clientIP = ngx.req.get_headers()["x_forwarded_for"] if clientIP == nil then clientIP = ngx.var.remote_addr end ngx.say("IP:",clientIP) ‘; } location = /50x.html { root html; } } } ②主配置和lua配置文件分开写 主配置文件 [root@node1 conf.d]# cat /etc/nginx/nginx.conf user nginx; worker_processes 2; error_log /var/log/nginx/error.log warn; pid /var/run/nginx.pid; events { worker_connections 1024; } http { include /etc/nginx/mime.types; default_type application/octet-stream; log_format main ‘$remote_addr - $remote_user [$time_local] "$request" ‘ ‘$status $body_bytes_sent "$http_referer" ‘ ‘"$http_user_agent" "$http_x_forwarded_for" "$request_uri"‘; access_log /var/log/nginx/access.log main; sendfile on; #tcp_nopush on; keepalive_timeout 65; #gzip on; include /etc/nginx/conf.d/*.conf; } lua的配置文件 [root@node1 conf.d]# cat /etc/nginx/conf.d/gray_lua.conf upstream sc_server { server 192.168.3.177:9090; } upstream gray_server{ server 192.168.3.177:8080; } lua_package_path "/usr/local/share/lua/5.1/memcached.lua"; server { listen 80; server_name localhost; location / { content_by_lua ‘ clientIP = ngx.req.get_headers()["X-Real-IP"] if clientIP == nil then clientIP = ngx.req.get_headers()["x_forwarded_for"] end if clientIP == nil then clientIP = ngx.var.remote_addr end local memcached = require "resty.memcached" local memc, err = memcached:new() if not memc then ngx.say("failed to instantiate memc: ", err) return end local ok, err = memc:connect("127.0.0.1", 11211) if not ok then ngx.say("failed to connect: ", err) return end local res, flags, err = memc:get(clientIP) if err then ngx.say("failed to get clientIP ", err) return end if res == "1" then ngx.exec("@gray_server") return end ngx.exec("@sc_server") ‘; } location @sc_server{ proxy_pass http://sc_server; } location @gray_server{ proxy_pass http://gray_server; } location /hello { default_type ‘text/plain‘; content_by_lua ‘ngx.say("hello, lua")‘; } location /myip { default_type ‘text/palin‘; content_by_lua ‘ clientIP = ngx.req.get_headers()["x_forwarded_for"] if clientIP == nil then clientIP = ngx.var.remote_addr end ngx.say("IP:",clientIP) ‘; } error_page 500 502 503 504 /50x.html; location = /50x.html { root /usr/share/nginx/html; } } 3.安装lua_memcached插件 wget https://github.com/agentzh/lua-resty-memcached/archive/v0.11.tar.gz tar xf v0.11.tar.gz cp -r lua-resty-memcached-0.11/lib/resty /usr/share/lua/5.1/ 向memcached中插入本机ip数据，作为可以访问灰度环境的IP [root@node1 conf.d]# telnet 127.0.0.1 11211 Trying 127.0.0.1... Connected to 127.0.0.1. Escape character is ‘^]‘. set 192.168.3.84 0 0 1 1 STORED get 192.168.3.84 VALUE 192.168.3.84 0 1 1 END 测试是否可以分离： 不在memcached中的IP访问java_test.jsp [root@node1 tomcat8080]# ifconfig eth0 eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500 inet 192.168.3.177 netmask 255.255.255.0 broadcast 192.168.3.255 inet6 fe80::3c78:50fd:7203:2f0e prefixlen 64 scopeid 0x20<link> ether 00:50:56:3b:dc:7e txqueuelen 1000 (Ethernet) RX packets 495041 bytes 239594322 (228.4 MiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 54942 bytes 10493549 (10.0 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 [root@node1 tomcat8080]# curl http://192.168.3.177/java_test.jsp <HTML> <HEAD> <TITLE>jsp Test Page</TITLE> </HEAD> <BODY> <h1>shengchang xianshang server</h1> <h1>Random number:</h1> 114 </BODY> </HTML> 在memcached环境中的IP访问：
lua脚本的基础知识 [root@node1 ~]# yum install -y lua 基本语法： 1运行方式 交互模式运行： [root@node1 ~]# lua Lua 5.1.4 Copyright (C) 1994-2008 Lua.org, PUC-Rio > print("hello lua") hello lua 写入脚本运行： [root@node1 ~]# cat test.lua #!/usr/bin/lua print("hello lua") [root@node1 ~]# lua test.lua hello lua 2.注释 --行注释 --[[ 块注释 --]] 3.变量 > a = ‘aio\n123"‘ > print(a) aio 123" > a="aio\n123\"" > print(a) aio 123" > a=‘\97io\10\04923"‘ > print(a) aio 123" > a=[[aio >> 123"]] > print(a) aio 123" 布尔类型只有nil和false是false，数字0 空字符串(‘ \0‘ )都是true lua中的变量如果没有特殊说明，全是全局变量 如果是局部变量前面加Local 4.循环 while循环语句 [root@node1 ~]# cat add.lua #!/usr/bin/lua sum = 0 num = 1 while num <= 100 do sum = sum + num num = num + 1 end print("sum=",sum) [root@node1 ~]# lua add.lua sum= 5050 注意： lua没有++ 或者 += 这样的操作 for循环 [root@node1 ~]# cat for.lua #!/usr/bin/lua sum = 0 for i = 1,100 do sum = sum + i end print("sum=",sum) [root@node1 ~]# lua for.lua sum= 5050 if-else判断语句(脚本测试不通过) if age == 40 and sex == "Male" then print("大于40男人") elseif age > 60 and sex ~= "Female" then print("非女人且大于60") else local age = io.read() print(‘your age is‘..age) end
