Manipulate upstream dynamically

lazy.dogtown · 2014-01-07T22:32:49+00:00

Hello! On Tue, Jan 7, 2014 at 2:47 AM, <i...@ecsystems.nl> wrote: > Only one issue, > > return 0; > src\ngx_http_set_hashed_upstream.c...

Manipulate upstream dynamically

lazy.dogtown

Hi list,

we're building a lua-based loadbalancer for nginx, using lua to manipulate

the list of available upstream-servers, creating cookies for stickyness etc;

my question: is the an easy way to manipulate configured

servers from upstream_module? if not, would it be easy and

advisable to create a module to make the upstream_list

configurable during runtime?

i'd like to stick with the upstream-module, since all

routines for timeouts, failure etc is already there and

well tested, and would like to use lua to manipulate the

upstzream_list, e.g. take servers out of the config, mark servers

backup etc.

i searched google, but except a lot of question to this topic i

found no answer (yet)

regards,

mex

guilherme.e

Hello,

There is a nginx module to make the upstream_list configurable during runtime, but it's not free! :(

http://nginx.com/products/

"Live reconfiguration of server pools to change upstream settings on the fly"

Best regards,

Guilherme

On Tue, Jan 7, 2014 at 12:32 PM, mex <lazy....@gmail.com> wrote:

Hi list,

we're building a lua-based loadbalancer for nginx, using lua to manipulate

the list of available upstream-servers, creating cookies for stickyness etc;

my question: is the an easy way to manipulate configured
servers from upstream_module? if not, would it be easy and
advisable to create a module to make the upstream_list

configurable during runtime?

i'd like to stick with the upstream-module, since all
routines for timeouts, failure etc is already there and
well tested, and would like to use lua to manipulate the
upstzream_list, e.g. take servers out of the config, mark servers
backup etc.

i searched google, but except a lot of question to this topic i
found no answer (yet)

regards,

mex

.

lazy.dogtown

Hi Guilherme,

yes, i know about nginx+

we want to release out stuff as open source, including a management-interface,

similar to /balancer-manager/ from apache

regards,

mex

2014/1/7 Guilherme <guilh...@gmail.com>

Hello,

There is a nginx module to make the upstream_list configurable during runtime, but it's not free! :(

http://nginx.com/products/

"Live reconfiguration of server pools to change upstream settings on the fly"

Best regards,

Guilherme

On Tue, Jan 7, 2014 at 12:32 PM, mex <lazy....@gmail.com> wrote:

Hi list,

we're building a lua-based loadbalancer for nginx, using lua to manipulate

the list of available upstream-servers, creating cookies for stickyness etc;

my question: is the an easy way to manipulate configured
servers from upstream_module? if not, would it be easy and
advisable to create a module to make the upstream_list

configurable during runtime?

i'd like to stick with the upstream-module, since all
routines for timeouts, failure etc is already there and
well tested, and would like to use lua to manipulate the
upstzream_list, e.g. take servers out of the config, mark servers
backup etc.

i searched google, but except a lot of question to this topic i
found no answer (yet)

regards,

mex

.

agentzh

Hello!

On Tue, Jan 7, 2014 at 6:32 AM, mex wrote:
>
> we're building a lua-based loadbalancer for nginx, using lua to manipulate
> the list of available upstream-servers, creating cookies for stickyness etc;
>

That'll be an interesting application of ngx_lua :)

> my question: is the an easy way to manipulate configured
> servers from upstream_module? if not, would it be easy and
> advisable to create a module to make the upstream_list
> configurable during runtime?

It's easy to expose a Lua API for the upstream configurations via an
Nginx C module. This has been on my TODO list for long. And I'd like
to build this this week.

>
> i'd like to stick with the upstream-module, since all
> routines for timeouts, failure etc is already there and
> well tested, and would like to use lua to manipulate the
> upstzream_list, e.g. take servers out of the config, mark servers
> backup etc.
>

Will you list all the features you want? Preferably with a Lua API you
want and sample user Lua code and/or Nginx configurations.

>
> i searched google, but except a lot of question to this topic i
> found no answer (yet)
>

I know it is one of the FAQs.

Regards,
-agentzh

agentzh

Hello!

On Tue, Jan 7, 2014 at 11:33 AM, Yichun Zhang (agentzh) wrote:
>> my question: is the an easy way to manipulate configured
>> servers from upstream_module? if not, would it be easy and
>> advisable to create a module to make the upstream_list
>> configurable during runtime?
>
> It's easy to expose a Lua API for the upstream configurations via an
> Nginx C module. This has been on my TODO list for long. And I'd like
> to build this this week.
>

I've been working on the ngx_lua_upstream nginx module that extends
ngx_lua's Lua API to manipulate nginx's upstream configurations:

    https://github.com/agentzh/lua-upstream-nginx-module#name

Feedback welcome! Patches welcome!

Best regards,
-agentzh

info

On Sunday, January 26, 2014 5:11:06 AM UTC+1, agentzh wrote:

Feedback welcome! Patches welcome!

Best regards,
-agentzh

Heya agentzh,

While compiling ngx_http_lua_upstream_module.c
I get this from Lua (master from 25-1):
objs/lib/lua-nginx-module/src/api\ngx_http_lua_api.h(25) : error C2016: C requires that a struct or union has at least one member
objs/lib/lua-nginx-module/src/api\ngx_http_lua_api.h(25) : error C2061: syntax error : identifier 'uint8_t'
objs/lib/lua-nginx-module/src/api\ngx_http_lua_api.h(33) : error C2059: syntax error : '}'
objs/lib/lua-nginx-module/src/api\ngx_http_lua_api.h(44) : error C2143: syntax error : missing ')' before '*'
objs/lib/lua-nginx-module/src/api\ngx_http_lua_api.h(44) : error C2081: 'ngx_http_lua_value_t' : name in formal parameter list illegal
objs/lib/lua-nginx-module/src/api\ngx_http_lua_api.h(44) : error C2143: syntax error : missing '{' before '*'
objs/lib/lua-nginx-module/src/api\ngx_http_lua_api.h(44) : error C2059: syntax error : ')'
objs/lib/lua-nginx-module/src/api\ngx_http_lua_api.h(44) : warning C4431: missing type specifier - int assumed. Note: C no longer supports default-int
objs/lib/lua-nginx-module/src/api\ngx_http_lua_api.h(44) : error C2040: 'value' : 'int *' differs in levels of indirection from ''
objs/lib/lua-nginx-module/src/api\ngx_http_lua_api.h(44) : warning C4218: nonstandard extension used : must specify at least a storage class or a type

agentzh

Hello!

On Sun, Jan 26, 2014 at 4:54 AM,  <i...@ecsystems.nl> wrote:
> While compiling ngx_http_lua_upstream_module.c
> I get this from Lua (master from 25-1):
> objs/lib/lua-nginx-module/src/api\ngx_http_lua_api.h(25) : error C2016: C
> requires that a struct or union has at least one member
> objs/lib/lua-nginx-module/src/api\ngx_http_lua_api.h(25) : error C2061:
> syntax error : identifier 'uint8_t'

Thank you for the report! Will you try out the following patch for
ngx_lua on your side?

diff --git a/src/api/ngx_http_lua_api.h b/src/api/ngx_http_lua_api.h
index 2a5316c..c61ffe2 100644
--- a/src/api/ngx_http_lua_api.h
+++ b/src/api/ngx_http_lua_api.h
@@ -13,6 +13,7 @@
 #include <ngx_http.h>

 #include <lua.h>
+#include <stdint.h>


 /* Public API for other Nginx modules */

info

On Sunday, January 26, 2014 6:49:14 PM UTC+1, agentzh wrote:

Hello!

Thank you for the report! Will you try out the following patch for
ngx_lua on your side?

diff --git a/src/api/ngx_http_lua_api.h b/src/api/ngx_http_lua_api.h
index 2a5316c..c61ffe2 100644
--- a/src/api/ngx_http_lua_api.h
+++ b/src/api/ngx_http_lua_api.h
@@ -13,6 +13,7 @@
#include <ngx_http.h>

#include <lua.h>
+#include <stdint.h>

/* Public API for other Nginx modules */

Thats it, clean compile :)

agentzh

Hello!

On Sun, Jan 26, 2014 at 11:16 AM,  <i...@ecsystems.nl> wrote:
>
> Thats it, clean compile :)
>

Cool! Thanks for the feedback. Just committed to master:

    https://github.com/chaoslawful/lua-nginx-module/commit/2079446

Best regards,
-agentzh

lazy.dogtown

cool! i'm gonna test this later today.

2014-01-26 Yichun Zhang (agentzh) <age...@gmail.com>

Hello!

On Sun, Jan 26, 2014 at 11:16 AM, <i...@ecsystems.nl> wrote:
>
> Thats it, clean compile :)
>

Cool! Thanks for the feedback. Just committed to master:

https://github.com/chaoslawful/lua-nginx-module/commit/2079446

Best regards,
-agentzh

.