How to logging requests into database

a4irkin · 2014-07-23T17:20:28+00:00

Hello! On Tue, Jul 22, 2014 at 6:51 PM, chen wrote: > But from the test case I wrote,it seems that ngx_http_finalize_request > can not handle NGX_...

How to logging requests into database

a4irkin

Hi!

What is a best way to logging nginx requests into PostgreSQL?

I need monitoring service response activity and http statuses to identify timeout upstream requests, for example.

Lua module have nice directive log_by_lua, but it is not supporting content_by_lua directive.

Thanks!

---

Aleksey

manchev

Well, just use the access_by_lua/content_by_lua directives and log the request parameters you need.

There are PostgreSQL adapters, but I would strongly recommend using Redis for this job instead.

Take a look at the docs [1] for starters, there are lots of useful examples.

Also, lua-resty-logger-socket library [2] may be of interest to you.

[1]: https://github.com/openresty/lua-nginx-module
[2]: https://github.com/cloudflare/lua-resty-logger-socket

Best,
Vladislav

On Wed, Jul 23, 2014 at 12:20 PM, Aleksey Smart <a4i...@gmail.com> wrote:

Hi!

What is a best way to logging nginx requests into PostgreSQL?
I need monitoring service response activity and http statuses to identify timeout upstream requests, for example.

Lua module have nice directive log_by_lua, but it is not supporting content_by_lua directive.

Thanks!

---
Aleksey

.

a4irkin

Thanks for the answer!

I can't use content_by_lua, because it does not available to get http response status code.

I found solution - undocumented directive post_action. It is very simple to use:

location /file/(?<id>[0-9]+) {

proxy_pass http://myupstream;

post_action /pg_log;

}

location ~ ^/pg_log {

internal;

postgres_escape $e_id $id;

postgres_escape $e_status $status;

postgres_pass 'db';

postgres_query "SELECT log($e_id, $e_status)";

}

среда, 23 июля 2014 г., 13:20:28 UTC+4 пользователь Aleksey Smart написал:

Hi!

What is a best way to logging nginx requests into PostgreSQL?
I need monitoring service response activity and http statuses to identify timeout upstream requests, for example.
Lua module have nice directive log_by_lua, but it is not supporting content_by_lua directive.

Thanks!

---
Aleksey

agentzh

Hello!

On Wed, Jul 23, 2014 at 12:57 PM, Aleksey Smart wrote:
> I can't use content_by_lua, because it does not available to get http
> response status code.
>

You can use log_by_lua + ngx.timer.at (with 0 delay). This is the
approach used by the lua-resty-logger-socket library we are using
online:

    https://github.com/cloudflare/lua-resty-logger-socket

> I found solution - undocumented directive post_action. It is very simple to
> use:
>

post_action is undocumented for a reason: it is buggy and have issues
in special cases. Better avoid it. Use the approach above.

Regards,
-agentzh