Nginx body filter yield every

mat999 · 2014-05-21T09:21:05+00:00

Hello! On Tue, Aug 26, 2014 at 11:44 AM, brendan oreilly wrote: > The reason i'm > attempting to use your openresty systemtap tools is so I can do som...

Nginx body filter yield every

mat999

I've hit an interesting problem today. I find myself in the need of the ability to filter the body of a request (i.e body filter) in addition to being able to receive these chunks not infrequently.

i.e I need to do processing (and subsequent outputting of body data) every X timeframe regardless of if the upstream server has sent any data.

Ideas? I cant see how this is possible with lua currently.

lordnynex

Can you explain your question with more detail? I'm a bit confused on what you mean by 'regardless of if the upstream server has sent any data'. Does this mean you want the request to the backend to have a timeout? The first time I read it, it almost seems like you're asking about timers, but I can't make out where you want to send the output outside the context of a request.

On Tue, May 20, 2014 at 6:21 PM, Mathew Heard <ma...@gmail.com> wrote:

I've hit an interesting problem today. I find myself in the need of the ability to filter the body of a request (i.e body filter) in addition to being able to receive these chunks not infrequently.

i.e I need to do processing (and subsequent outputting of body data) every X timeframe regardless of if the upstream server has sent any data.

Ideas? I cant see how this is possible with lua currently.

.

mat999

The purpose of this was to allow exact control over the flow body data of a request (and preferably its headers). e.g delaying

Its for a friends research, for which I threw nginx up as a suggestion. For those curious he opted to do this via a standalone basic C HTTP proxy server since it doesn't easily fit into the nginx model.

Thanks for the attempt to help anyway.

On Wednesday, May 21, 2014 4:27:45 PM UTC+10, Lord Nynex wrote:

Can you explain your question with more detail? I'm a bit confused on what you mean by 'regardless of if the upstream server has sent any data'. Does this mean you want the request to the backend to have a timeout? The first time I read it, it almost seems like you're asking about timers, but I can't make out where you want to send the output outside the context of a request.

On Tue, May 20, 2014 at 6:21 PM, Mathew Heard <mat...@gmail.com> wrote:

I've hit an interesting problem today. I find myself in the need of the ability to filter the body of a request (i.e body filter) in addition to being able to receive these chunks not infrequently.

i.e I need to do processing (and subsequent outputting of body data) every X timeframe regardless of if the upstream server has sent any data.

Ideas? I cant see how this is possible with lua currently.

.

agentzh

Hello!

On Sat, Jun 7, 2014 at 10:34 AM, Mathew Heard wrote:
> The purpose of this was to allow exact control over the flow body data of a
> request (and preferably its headers). e.g delaying
>
> Its for a friends research, for which I threw nginx up as a suggestion. For
> those curious he opted to do this via a standalone basic C HTTP proxy server
> since it doesn't easily fit into the nginx model.
>

You cannot do this in the nginx body filter, which is not designed for
this use pattern. But you can easily achieve this based on a proxy
atop ngx_lua's cosocket API where you have complete control over
everything in Lua. There may be some 3rd-party lua-resty-http*
libraries that already do something like this.

Regards,
-agentzh