Nginx-lua Dynamic location to upstream

marinari.simone · 2017-03-23T02:08:06+00:00

https://github.com/openresty/lua-nginx-module#ngxreqget_body_dataTo get request body data, you can use ngx.req.get_body_data method in content_by_lua_block20...

Nginx-lua Dynamic location to upstream

marinari.simone

Hi there,
I've Just started to play with Lua and this is what I'd like to achieve:
I expose a location and a lua script Will inspect http args.Once It takes the args,It Will call an external api searching for a specific content and It Will writes the returned json values on some lua variables.
Based on the returned values,Nginx Will proxy_pass to the right upstream.
Does Nginx/luajit cache all json values/pages based on different calls?I don't really want to call an external api for every single location request...
Thanks a lot.

martin.gee

You'll need your own cache. https://github.com/sourcelair/ceryx is a project that does a lot of what you're looking for. You can read the code to see how it's using ShareMemory as a cache for routes.

On Wednesday, March 22, 2017 at 1:08:06 PM UTC-5, Simone wrote:

Hi there,
I've Just started to play with Lua and this is what I'd like to achieve:
I expose a location and a lua script Will inspect http args.Once It takes the args,It Will call an external api searching for a specific content and It Will writes the returned json values on some lua variables.
Based on the returned values,Nginx Will proxy_pass to the right upstream.
Does Nginx/luajit cache all json values/pages based on different calls?I don't really want to call an external api for every single location request...
Thanks a lot.

arkade

If you make the request to the external API using ngx.location.capture() via a proxy pass, you can configure the proxy pass to use nginx native caching. Something like:

http {
    proxy_cache_path /path/to/cache keys_zone=my_cache:100m;
}
upstream external_api {
    server external.api.com:443;
}

upstream backend1 {
    server 1.1.1.1:443;
}

upstream backend2 {
    server 2.2.2.2:443;
}

location / {
    set $chosen_backend '';
    set $reqeust_uri '';
    access_by_lua_block {
        local json = require 'cjson'
        local lua_request_uri = '/api/v1/searchterm' .. ngx.var.arg_searchterm
        api_response = ngx.location.capture('/external_api', {
            vars = {
                request_uri = lua_request_uri
            }
        })
        response_json = json.decode(api_response)
        if response_json['result'] then
            ngx.var.chosen_backend = 'backend1' 
        else
            ngx.var.chosen_backend = 'backend2'
        end
    }
    proxy_pass https://$chosen_backend;
}

location /external_api {
    internal;
    proxy_pass https://external_api/$api_request;
    proxy_cache my_cache;
    proxy_cache_key $uri;
    proxy_cache_valid 200 5m;
}

On Thursday, 23 March 2017 05:08:06 UTC+11, Simone wrote:

Hi there,
I've Just started to play with Lua and this is what I'd like to achieve:
I expose a location and a lua script Will inspect http args.Once It takes the args,It Will call an external api searching for a specific content and It Will writes the returned json values on some lua variables.
Based on the returned values,Nginx Will proxy_pass to the right upstream.
Does Nginx/luajit cache all json values/pages based on different calls?I don't really want to call an external api for every single location request...
Thanks a lot.

david.birdsong

What are your route/upstream invalidation requirements?

If it's reasonable to fit in memory, just do the lookups in an access_by_lua* or rewrite_by_lua* block and cache the values in a lua module. If you can live w/ simply expiring out the info on a small interval, use the lua shared memory with whatever expiry is appropriate.

...and then in increasing levels of sophistication:

https://github.com/openresty/srcache-nginx-module

https://github.com/pintsized/ledge

If you can't preset your upstream servers in the config, use balancer_by_lua to allow for your backends to be defined on the fly. Your code can access in data you've retrieved in the access_by or rewrite_by phases.

On Wed, Mar 22, 2017 at 11:08 AM, Simone <marinar...@gmail.com> wrote:

Hi there,
I've Just started to play with Lua and this is what I'd like to achieve:
I expose a location and a lua script Will inspect http args.Once It takes the args,It Will call an external api searching for a specific content and It Will writes the returned json values on some lua variables.
Based on the returned values,Nginx Will proxy_pass to the right upstream.
Does Nginx/luajit cache all json values/pages based on different calls?I don't really want to call an external api for every single location request...
Thanks a lot.
.

josnen

Hey, has anyone else been looking for an online place that doesn't feel like it's working against you? I was getting fed up with complicated interfaces and unclear rules. Then I stumbled upon ivybet. The difference was noticeable right away. The design is clean, and finding a game to play is simple. I've enjoyed several sessions there, and it's become my go-to for some relaxed entertainment. I've had a few nice wins, but more importantly, I've found a platform where I actually feel comfortable spending my time. It's a genuine recommendation.