Streams and lua

bryanpfremmer · 2015-11-16T14:22:35+00:00

Hello! On Sun, Nov 15, 2015 at 11:36 PM, Rohit Joshi wrote: > Thanks. I assume 1GB limit is for Lua based cache (resty.lrucache) and not for ngx.shared.D...

Streams and lua

bryanpfremmer

I need to implement a tcp load balancer but need to have a rather complicated health check.  I was hoping I could use lua but it does not appear I can use lua with streams.  Am I missing something or does the module not currently exist?

agentzh

Hello!

On Mon, Nov 16, 2015 at 2:22 PM, Bryan Pfremmer wrote:
> I need to implement a tcp load balancer but need to have a rather complicated health check.  I was hoping I could use lua but it does not appear I can use lua with streams.  Am I missing something or does the module not currently exist?
>

I'm currently actively working on the ngx_stream_lua_module which
should be what you need here. I'll publish it as soon as I have
something usable enough.

Stay tuned :)

Best regards,
-agentzh

lazy.dogtown

Hello agentzh,



>
> I'm currently actively working on the ngx_stream_lua_module which
> should be what you need here. I'll publish it as soon as I have
> something usable enough.

this sounds great; if you need testers please let me know,


regards,

mex

agentzh

Hello!

On Mon, Nov 16, 2015 at 3:09 PM, mex wrote:
>
> this sounds great; if you need testers please let me know,
>

Sure I will. Thanks!

Best regards,
-agentzh

wowon01

Dear All

On Monday, November 16, 2015 at 1:55:52 PM UTC+7, agentzh wrote:

I'm currently actively working on the ngx_stream_lua_module which
should be what you need here. I'll publish it as soon as I have
something usable enough.

Stay tuned :)

Best regards,
-agentzh

well , I think if this module will also use shared dict like lua-resty-upstream ... user will able to write external health check on their own.

in case of lua-resty-upstream i decide to set all host health check as False, and write my own .... that will set host up or down via it's restfull interface.
With this ill be able to decide based on , i.e : Host CPU/RAM usage, MySql Table/database lock .. etc etc
In fact, i'm just a python script kiddies. LUA is far beyond my ability.

Sincerely
-bino-

agentzh

Hello!

On Tue, Nov 17, 2015 at 2:02 PM, Bino Oetomo wrote:
> well , I think if this module will also use shared dict like
> lua-resty-upstream ... user will able to write external health check on
> their own.
>

Yes, ngx_stream_lua_module will eventually have all the Lua APIs
exposed by the existing ngx_http_lua_module which make sense in the
stream context, including but not limited to cosockets, shdicts, light
threads, coroutines, timers, and etc.

> in case of lua-resty-upstream i decide to set all host health check as
> False, and write my own .... that will set host up or down via it's restfull
> interface.
> With this ill be able to decide based on , i.e : Host CPU/RAM usage, MySql
> Table/database lock .. etc etc
> In fact, i'm just a python script kiddies. LUA is far beyond my ability.
>

Well, you're free to do whatever you see fit in the OpenResty world :)
BTW, Lua is not an acronym: http://www.lua.org/about.html#name

Regards,
-agentzh

wowon01

On Wednesday, November 18, 2015 at 1:29:21 AM UTC+7, agentzh wrote:

Hello!

Yes, ngx_stream_lua_module will eventually have all the Lua APIs
exposed by the existing ngx_http_lua_module which make sense in the
stream context, including but not limited to cosockets, shdicts, light
threads, coroutines, timers, and etc.

I Really waiting for this masterpiece

Well, you're free to do whatever you see fit in the OpenResty world :)
BTW, Lua is not an acronym: http://www.lua.org/about.html#name

I Understand

Sincerely
-bino-

wowon01

Just courious .. about ngx_stream_lua_module

Will it 'play' with the stream{} blocks ?

If So, will it use the same shared dict created in http{} block ?

I mean ... if currently (in http{} block) I have --> lua_shared_dict my_upstream 1m; will ngx_stream_lua_module able to use it.

well ... I start familiar with lua-resty-upstream API.

Sincerely
-bino-

agentzh

Hello!

On Wed, Nov 18, 2015 at 9:58 AM, Bino Oetomo wrote:
>
> Just courious .. about ngx_stream_lua_module
>
> Will it 'play' with the stream{} blocks ?
>

Yes.

> If So, will it use the same shared dict created in http{} block ?
>

In the initial versions of ngx_stream_lua_module, no. But eventually
when ngx_http_lua_module and ngx_stream_lua_module share the same
ngx_meta_lua_module, then yes.

> I mean ... if currently (in http{} block) I have --> lua_shared_dict
> my_upstream 1m;  will ngx_stream_lua_module able to use it.
>

Initial versions of ngx_stream_lua_module won't support that but later
when we have ngx_meta_lua_module, then it will work I think.

>
> well ... I start familiar with  lua-resty-upstream API.
>

Understood.

Regards,
-agentzh

louie.kwan

I am looking for a module to allow TCP load balancing for a while as well.

I assume we could use redis and to get lua support with openresty to get dynamic backend configuration. Any health check functions as well?

Looking forward to hearing from you soon and I can be a tester as well.

Thanks.

Louie

On Monday, 16 November 2015 21:03:19 UTC-5, agentzh wrote:

Hello!

On Mon, Nov 16, 2015 at 3:09 PM, mex wrote:
>
> this sounds great; if you need testers please let me know,
>

Sure I will. Thanks!

Best regards,
-agentzh

agentzh

Hello!

On Mon, Nov 30, 2015 at 11:57 AM, Louie Kwan wrote:
> I assume we could use redis and to get lua support with openresty to get
> dynamic backend configuration. Any health check functions as well?
>

Eventually, yes, though not directly in the ngx_stream_lua_module
core, but in places like the existing lua-resty-upstream-healthcheck
library:

    https://github.com/openresty/lua-resty-upstream-healthcheck

> Looking forward to hearing from you soon and I can be a tester as well.
>

Thanks :)

Best regards,
-agentzh