LAMP架构演进到LAMPGC,再演进到LNMLGC(linux+nginx+mysql+lua+gearman+C)
ck3552
9年前
来自: http://blog.csdn.net//jiao_fuyou/article/details/35985843
LAMP是一个大众的架构了,linux+apache+mysql+php
在我们系统的架构中,做了进一步的演进,linux+apahce+mysql+php+gearman+C
php作页面的展示
核心业务逻辑由C语言实现,php通过gearman中间件调用C任务
由于apache在高并发方面不太给力,因此在需要高并发的场景中,我们进一步演进,linux+nginx+mysql+php+lua+gearman+C
页面部分由nginx+fastcgi+php-fpm来展示
高并发的业务调用由nginx+lua+gearman+C来实现
在这里重点介绍nginx怎样调用gearman中间件
先看下apache+php调用gearman的情况,同步一调用一gearman任务,假如这个任务要3S钟,那么当前这个apache的httpd进程就会被阻塞,它无法为其它客户端服务了
nginx在高并发异步调用的性能够强,这地球人都知道了
lua的协程,也可以实现并发的异步调用
再来看看nginx+lua调用gearman的实现:
nginx同样是一个worker,worker进程里通过lua协程调用gearman任务,即使任务要3S钟,在这3S钟内这个worker进程还是可以为其它客户端服务,这依赖于nginx的epoll的事件触发非阻塞调用和lua协程异步调用的优势,这种方式可以实现高并发的业务调用。
下面给出lua-nginx-module的安装及简单配置过程:
1、需要的源码文件 shell> ls drwxr-xr-x 6 1000 1000 4096 Feb 26 03:14 LuaJIT-2.0.3 drwxrwxr-x 10 root root 4096 Jun 1 2014 lua-nginx-module-0.9.8 drwxr-xr-x 9 1001 1001 4096 Feb 18 03:14 nginx-1.7.2 drwxrwxr-x 9 root root 4096 Sep 26 02:43 ngx_devel_kit-0.2.19 drwxr-xr-x 8 1169 1169 4096 Feb 26 03:17 pcre-8.21 2、安装luajit http://luajit.org/download/LuaJIT-2.0.3.tar.gz shell> cd LuaJIT-2.0.3 shell> make shell> make install 因为安装在缺省路径,所以LuaJIT对应的lib,include均在/usr/local目录里。 3、编译nginx https://codeload.github.com/openresty/lua-nginx-module/tar.gz/v0.9.8 https://codeload.github.com/simpl/ngx_devel_kit/tar.gz/v0.2.19 shell> ./configure --prefix=/usr/local/nginx --add-module=../ngx_devel_kit-0.2.19 --add-module=../lua-nginx-module-0.9.8 --with-pcre=../pcre-8.21 4、启动nginx shell> cd /usr/local/nginx/sbin shell> ./nginx ./nginx: error while loading shared libraries: libluajit-5.1.so.2: cannot open shared object file: No such file or directory 提示找不到luajit库文件 shell> echo "/usr/local/lib" > /etc/ld.so.conf.d/usr_local_lib.conf shell> ldconfig shell> ./nginx 成功 5、nginx应用 将下列配置加入到/usr/local/nginx/conf/nginx.conf中: location /lua { set $test "hello, world."; content_by_lua ' ngx.header.content_type = "text/plain"; ngx.say(ngx.var.test); '; } shell> ./nginx -s reload 浏览顺访问: http://172.16.18.114/lua 显示:hello, world. 大功造成! 6、安装lua-resty-gearman模块 https://github.com/zhhchen/lua-resty-gearman/tree/master/lib/resty 7、nginx通过lua脚本调用gearman 在nginx.conf的http段增加: lua_package_path "/usr/local/lua-resty-gearman/lib/?.lua;;"; 在server下增加: location /test { content_by_lua ' local gearman = require "gearman" local gm = gearman:new() gm:set_timeout(1000) -- 1 sec ngx.header.content_type = "text/plain" local ok, err = gm:connect("172.16.18.162", 4730) if not ok then ngx.say("failed to connect: ", err) return end ok, err = gm:submit_job("reverse", "abcdef") -- submit_job,submit_job_bg,submit_job_high,submit_job_high_bg,submit_job_low,submit_job_low_bg are supported -- submit_job(function_name, workload[, unique]) if not ok then ngx.say("failed to submit job: ", err) return else ngx.say(ok) end -- put it into the connection pool of size 100, -- with 0 idle timeout local ok, err = gm:set_keepalive(0, 100) if not ok then ngx.say("failed to set keepalive: ", err) return end -- or just close the connection right away: -- local ok, err = gm:close() -- if not ok then -- ngx.say("failed to close: ", err) -- return -- end '; } 浏览顺访问: http://172.16.18.114/test 显示:fedcba