[OPENRESTY] limit the number of requests and/or connection going to a proxied upstream server?

matthieu.labour · 2016-06-04T04:36:48+00:00

Hello! On Fri, Jun 3, 2016 at 1:03 PM, Max wrote: > ubuntu@ip-XXX-XXX-XXX-XXX:~/wrk$ ./wrk -t1 -c10 -d30s http://127.0.0.1:8005 > Running 30s test @ h...

[OPENRESTY] limit the number of requests and/or connection going to a proxied upstream server?

matthieu.labour

Is it possible to limit the number of requests and/or connection going to a proxied upstream server?

Is it something one can do in lua?

Thank you for your help

agentzh

Hello!

On Fri, Jun 3, 2016 at 1:36 PM, Matthieu Labour wrote:
> Is it possible to limit the number of requests and/or connection going to a
> proxied upstream server?
>
> Is it something one can do in lua?
>

I think you can do this with the lua-resty-limit-traffic library:

    https://github.com/openresty/lua-resty-limit-traffic

Well, I'm going to include this library in the OpenResty 1.9.15.2
release directly.

Regards,
-agentzh

matthieu.labour

Thank you for your answer.

Actually my message was a bit confusing. I am trying to guarantee that there will never be more than N requests/ seconds going to and upstream server. On other words I would like to do some rate limiting in the upstream directive.

Example:

upstream backend {
    server backend1.example.com 
    server backend2.example.com <==== I want to guarantee that this server will never receive more than N requests/ seconds (even if backend1 becomes unavailable)

On Friday, June 3, 2016 at 7:45:25 PM UTC-4, agentzh wrote:

Hello!

On Fri, Jun 3, 2016 at 1:36 PM, Matthieu Labour wrote:
> Is it possible to limit the number of requests and/or connection going to a
> proxied upstream server?
>
> Is it something one can do in lua?
>

I think you can do this with the lua-resty-limit-traffic library:

https://github.com/openresty/lua-resty-limit-traffic

Well, I'm going to include this library in the OpenResty 1.9.15.2
release directly.

Regards,
-agentzh

agentzh

You can use that lua library to limit backend connections. Read the docs more carefully. The nginx http upstream cache might make it a bit inaccurate but your limit is just more strict.

-agentzh

lazy.dogtown

agentzh, you're such an UBERGOD.

whenever we come up with a request and stuff we'd like to see in resty
(like this
lua-resty-limit-traffic or the dynamic upstream module that we heavily use and
thought about developing ourselfs) there is a resty-lib from you that exactly

sorry for OT, but this needed to be said :D



thank you very much agentzh,

may the source be with you



2016-06-04 9:41 GMT+02:00 Yichun Zhang (agentzh) <age...@gmail.com>:
> You can use that lua library to limit backend connections. Read the docs
> more carefully. The nginx http upstream cache might make it a bit inaccurate
> but your limit is just more strict.
>
> -agentzh.

ruslan.usifov

mex. Could you share some samples how you achieved backend connections limit? At now I can't understand how lua-resty-limit-traffic library can help, to limit connections to upstreams servers

суббота, 4 июня 2016 г., 13:20:37 UTC+3 пользователь mex написал:

agentzh, you're such an UBERGOD.

whenever we come up with a request and stuff we'd like to see in resty
(like this
lua-resty-limit-traffic or the dynamic upstream module that we heavily use and
thought about developing ourselfs) there is a resty-lib from you that exactly

sorry for OT, but this needed to be said :D

thank you very much agentzh,

may the source be with you

2016-06-04 9:41 GMT+02:00 Yichun Zhang (agentzh) <age...@gmail.com>:
> You can use that lua library to limit backend connections. Read the docs
> more carefully. The nginx http upstream cache might make it a bit inaccurate
> but your limit is just more strict.
>
> -agentzh.