Re: Lua, Nginx and Redis

agentzh

Hello!

On Mon, May 7, 2012 at 3:21 PM, Aron Steg <aron...@bcde.com.au> wrote:

I have been looking for a solution to allow us to queue up requests and wait for a response. We have been using nginx + php-fpm + beanstalkd and finding the php-fpm component causing us grief under load. When looking for an alternative solution we bumped into your Nginx, Lua and Redis work. Would you consider some contract work to implement something similar with Beanstalkd? Or alternatively would you be able to assist us to get our solution ported to redis?

Please take a look at the lua-resty-redis library:

https://github.com/agentzh/lua-resty-redis

The redis server can indeed provide queue-like services (e.g., the "rpush" and "blpop" redis commands).

And it should also be *very* easy to write a Lua driver for beanstalkd based on ngx_lua's cosocket API, because it has a very similar wire protocol as memcached's. So it should be straightforward to port the existing lua-resty-memcached library over to the beanstalkd world:

https://github.com/agentzh/lua-resty-memcached

IIRC, smallfish on the openresty mailing list was also working on a lua-resty-beanstalkd library prototype but I'm not sure about its status. You can contact him or work on your own implementation directly.

Hope this helps,
-agentzh

P.S. I'm cc'ing the openresty mailing list: https://groups.google.com/group/openresty/

aron.steg

Hi agentzh,

Thanks so much for such a quick response. Hi Openresty people (if this gets through to you).

I will have a look and see if we can sponsor the lua-resty-beanstalkd development as this would be an effective solution to our problem. I have to say that Redis looks really promising because it has a much larger payload size than Beanstalkd (strings of 500mb are great). However the BLPOP command is missing the two-phase semantics of Beanstalkd. I will investigate internally if we can afford to lose this feature and use lua-resty-redis.

Yours,
A.