Logging specific requests in separate file other than error.log .

makailol7 · 2014-06-09T14:58:59+00:00

Hi folks! I am happy to announce the new formal release, 1.7.0.1, of the OpenResty bundle: http://openresty.org/#Download Special thanks go to all our...

Logging specific requests in separate file other than error.log .

makailol7

Hello,

I want to log particular requests and all its query parameter with its value in separate file other than error.log .

For example, if the url is like
http://www.example.com/log?var1=val1&var2=val2&var3=val3 OR
http://www.another.com/log?var1=val1&var2=val2&var3=val3

I want to log above requests in a file with below format.

----------------------------------------------------------------
URL : http://www.example.com/log?var1=val1&var2=val2&var3=val3
var1 : val1
var2 : val2
var3 : val3
----------------------------------------------------------------
URL : http://www.another.com/log?var1=val1&var2=val2&var3=val3
var1 : val1
var2 : val2
var3 : val3
----------------------------------------------------------------

Could someone explain me how could this be handled with lua-nginx-module APIs?

Thanks,
Makailol

peter_booth

Makailol,

You can do what you want within the nginx event loop, but personally, I’d avoid it

because you can get the data that you want just from nginx core functionality...

The directive can be used at the location level, even in an if block,

The config fragment below will give you a log file that just contains:

www.example.com GET /log?var1=val1a&var2=val2a&var3=val3a

www.another.com GET /log?var1=val1b&var2=val2b&var3=val3b

which could trivially be reformatted to your specific format

log_format my_special_format ‘$remote_addr $request’;

…

server {

server_name www.example.com;

access_log /path/to/log-file main

location ~ /log/ {

access_log /path/to/log-file main;

access_log /path/to/special-log-file my_special_format;

Peter

On Jun 9, 2014, at 2:58 AM, Makailol Charls <maka...@gmail.com> wrote:

Hello,

I want to log particular requests and all its query parameter with its value in separate file other than error.log .

For example, if the url is like
http://www.example.com/log?var1=val1&var2=val2&var3=val3 OR
http://www.another.com/log?var1=val1&var2=val2&var3=val3

I want to log above requests in a file with below format.

----------------------------------------------------------------
URL : http://www.example.com/log?var1=val1&var2=val2&var3=val3
var1 : val1
var2 : val2
var3 : val3
----------------------------------------------------------------
URL : http://www.another.com/log?var1=val1&var2=val2&var3=val3
var1 : val1
var2 : val2
var3 : val3
----------------------------------------------------------------

Could someone explain me how could this be handled with lua-nginx-module APIs?

Thanks,
Makailol

.

makailol7

Hi Peter,

Thanks for update and suggestion on this.

Yes it is possible to use access_log directive in location context so it is possible to log particular request in separate file but with this configuration it is not possible to set output log formatting as I wrote in previous post. We can log different values but can not add extra line or line break so I was looking for some alternatives in lua-nginx-module .

Thanks
Makailol

On Monday, June 9, 2014 6:37:50 PM UTC+5:30, Peter Booth wrote:

Makailol,

You can do what you want within the nginx event loop, but personally, I’d avoid it
because you can get the data that you want just from nginx core functionality...

The directive can be used at the location level, even in an if block,
The config fragment below will give you a log file that just contains:

www.example.com GET /log?var1=val1a&var2=val2a&var3=val3a
www.another.com GET /log?var1=val1b&var2=val2b&var3=val3b

which could trivially be reformatted to your specific format

log_format my_special_format ‘$remote_addr $request’;
…
server {
server_name www.example.com;
access_log /path/to/log-file main
location ~ /log/ {
access_log /path/to/log-file main;
access_log /path/to/special-log-file my_special_format;

Peter

On Jun 9, 2014, at 2:58 AM, Makailol Charls <maka...@gmail.com> wrote:

Hello,

I want to log particular requests and all its query parameter with its value in separate file other than error.log .

For example, if the url is like
http://www.example.com/log?var1=val1&var2=val2&var3=val3 OR
http://www.another.com/log?var1=val1&var2=val2&var3=val3

I want to log above requests in a file with below format.

----------------------------------------------------------------
URL : http://www.example.com/log?var1=val1&var2=val2&var3=val3
var1 : val1
var2 : val2
var3 : val3
----------------------------------------------------------------
URL : http://www.another.com/log?var1=val1&var2=val2&var3=val3
var1 : val1
var2 : val2
var3 : val3
----------------------------------------------------------------

Could someone explain me how could this be handled with lua-nginx-module APIs?

Thanks,
Makailol

.

agentzh

Hello!

On Wed, Jun 11, 2014 at 4:19 AM, Makailol Charls wrote:
> Thanks for update and suggestion on this.
>
> Yes it is possible to use access_log directive in location context so it is
> possible to log particular request in separate file but with this
> configuration it is not possible to set output log formatting as I wrote in
> previous post. We can log different values but can not add extra line or
> line break so I was looking for some alternatives in lua-nginx-module .
>

Well, you can do file operations directly in your Lua code, preferably
calling into the write() syscall via LuaJIT FFI. The only missing bit
is a hook to honor the USR1 signal and etc. I'll try adding some Lua
hooks to nginx's signal handlers (patches welcome though :)).

Regards,
-agentzh