Compression executes before body_filter_by_lua_file

dominic.lucenario · 2016-06-24T13:43:19+00:00

Hi, You might want to take a look at SecFul who do RESTful API security (http://www.secful.com/). Best regards, Itamar On Jun 22, 2016 4:46 PM, &quot...

Compression executes before body_filter_by_lua_file

dominic.lucenario

Im using OpenResty 1.9.7.4 on top of Ubuntu 14.04 and using is at as a reverse proxy for my webservers.

I want to do some string operation with the response after the proxy pass through the body_filter_by_lua_file while the compression directives are enabled. However, the response I get in the directive (ngx.arg[1]) is already compressed.

Here is my simplified server configuration:

server
{
listen 80;
listen 443 ssl;

root /var/www/html/example.com;
server_name .example.com;
access_log /var/www/html/example_com/access.log;
error_log /var/www/html/example_com/error.log;
underscores_in_headers on;

location /
{
resolver 8.8.8.8;

proxy_pass $scheme://$host;
body_filter_by_lua_file mod_body.lua;

gzip on;
gzip_comp_level 5;
gzip_min_length 256;
gzip_proxied any;
gzip_vary on;
gzip_types text/plain text/css application/_javascript_ text/xml application/xml+rss;
}
}

and this is the mod_body.lua for testing and verification

ngx.log(ngx.ERR,ngx.arg[1])

When I check my error.log file, I got the compressed content from the response. Because of that, I cant perform my usual string operations in the lua file.

Any other suggestions or workaround are mostly welcome.

minggfang

Try disabling compression with this

proxy_set_header Accept-Encoding "";

On Jun 24, 2016, at 1:43 AM, dominic....@gmail.com wrote:

Im using OpenResty 1.9.7.4 on top of Ubuntu 14.04 and using is at as a reverse proxy for my webservers.

I want to do some string operation with the response after the proxy pass through the body_filter_by_lua_file while the compression directives are enabled. However, the response I get in the directive (ngx.arg[1]) is already compressed.
Here is my simplified server configuration:

server
{
listen 80;
listen 443 ssl;

root /var/www/html/example.com;
server_name .example.com;
access_log /var/www/html/example_com/access.log;
error_log /var/www/html/example_com/error.log;
underscores_in_headers on;

location /
{
resolver 8.8.8.8;

proxy_pass $scheme://$host;
body_filter_by_lua_file mod_body.lua;

gzip on;
gzip_comp_level 5;
gzip_min_length 256;
gzip_proxied any;
gzip_vary on;
gzip_types text/plain text/css application/_javascript_ text/xml application/xml+rss;
}
}

and this is the mod_body.lua for testing and verification
ngx.log(ngx.ERR,ngx.arg[1])

When I check my error.log file, I got the compressed content from the response. Because of that, I cant perform my usual string operations in the lua file.

Any other suggestions or workaround are mostly welcome.

--
.

dominic.lucenario

Worked! Thanks.

It seems that my hosting is already compressing the content before I can actually read the response.

On Friday, June 24, 2016 at 1:43:19 PM UTC+8, dominic....@gmail.com wrote:

Im using OpenResty 1.9.7.4 on top of Ubuntu 14.04 and using is at as a reverse proxy for my webservers.

I want to do some string operation with the response after the proxy pass through the body_filter_by_lua_file while the compression directives are enabled. However, the response I get in the directive (ngx.arg[1]) is already compressed.
Here is my simplified server configuration:

server
{
listen 80;
listen 443 ssl;

root /var/www/html/example.com;
server_name .example.com;
access_log /var/www/html/example_com/access.log;
error_log /var/www/html/example_com/error.log;
underscores_in_headers on;

location /
{
resolver 8.8.8.8;

proxy_pass $scheme://$host;
body_filter_by_lua_file mod_body.lua;

gzip on;
gzip_comp_level 5;
gzip_min_length 256;
gzip_proxied any;
gzip_vary on;
gzip_types text/plain text/css application/_javascript_ text/xml application/xml+rss;
}
}

and this is the mod_body.lua for testing and verification
ngx.log(ngx.ERR,ngx.arg[1])

When I check my error.log file, I got the compressed content from the response. Because of that, I cant perform my usual string operations in the lua file.

Any other suggestions or workaround are mostly welcome.