What to use for SSI/ESI like feature?

boby · 2015-04-07T21:19:58+00:00

Hello,In the future, please paste the exact error message and configuration. The question by itself does not help anyone help you. What follows is a gu...

What to use for SSI/ESI like feature?

boby

Hello,

I am working on a project where I need an SSI/ESI like feature. For full page cache I am now using the srcache-nginx-module with Redis and a PHP backend. There will be at least 3 blocks per page which I need whole-punched with something like SSI/ESI and these will also be cached.

SSI does not play well with Lua, on the other hand if I am using SSI with srcache_fetch only then it won't work on my sub-requests.

What would be a good (elegant and also performance wise) approach to replace SSI/ESI tags in both the backend and srcache_fetch responses? Liked replace-filter-nginx-module, but it does not support Lua replacements which I need. Any ideas or solutions are welcome.

I've done some research and testing, but none worked so far:

* Use a template engine - no buffer and how to process cached responses

* use body_filter_by_lua would fail when chunk ends in the middle of a placeholder

Thank you in advance!

PS: I've posted this also in the srcache issues on Github, @agentzh was kind to give me answer already and suggested to ask here too: https://github.com/openresty/srcache-nginx-module/issues/35

james_9172

Hi Constantin,

On 7 April 2015 at 14:19, Constantin Bejenaru <b...@frozenminds.com> wrote:

Hello,
I am working on a project where I need an SSI/ESI like feature. For full page cache I am now using the srcache-nginx-module with Redis and a PHP backend. There will be at least 3 blocks per page which I need whole-punched with something like SSI/ESI and these will also be cached.
SSI does not play well with Lua, on the other hand if I am using SSI with srcache_fetch only then it won't work on my sub-requests.
What would be a good (elegant and also performance wise) approach to replace SSI/ESI tags in both the backend and srcache_fetch responses? Liked replace-filter-nginx-module, but it does not support Lua replacements which I need. Any ideas or solutions are welcome.
I've done some research and testing, but none worked so far:
* Use a template engine - no buffer and how to process cached responses
* use body_filter_by_lua would fail when chunk ends in the middle of a placeholder

You could take a look at Ledge[1], which would serve as a replacement for srcache but has ESI features, and particularly the "esi" branch[2] which has more complete ESI features (like when/choose) but is a work in progress (I hope to wrap up the ESI work very soon).

Ledge is built around a streaming model, so you don't have to buffer the entire response with fragment inclusion in order to serve anything.

Regards,

James.

[1] https://github.com/pintsized/ledge

[2] https://github.com/pintsized/ledge/tree/esi

James Hurst

ja...@pintsized.co.uk

boby

Thank you James for the suggestion. I am aware of Ledge, and I might use it in the end, but I still hope to find something more simple. Eventually I might fork Ledge and remove lot's of features.

On Tuesday, April 7, 2015 at 7:13:22 PM UTC+3, James Hurst wrote:

Hi Constantin,

On 7 April 2015 at 14:19, Constantin Bejenaru <bo...@frozenminds.com> wrote:
Hello,
I am working on a project where I need an SSI/ESI like feature. For full page cache I am now using the srcache-nginx-module with Redis and a PHP backend. There will be at least 3 blocks per page which I need whole-punched with something like SSI/ESI and these will also be cached.
SSI does not play well with Lua, on the other hand if I am using SSI with srcache_fetch only then it won't work on my sub-requests.
What would be a good (elegant and also performance wise) approach to replace SSI/ESI tags in both the backend and srcache_fetch responses? Liked replace-filter-nginx-module, but it does not support Lua replacements which I need. Any ideas or solutions are welcome.
I've done some research and testing, but none worked so far:
* Use a template engine - no buffer and how to process cached responses
* use body_filter_by_lua would fail when chunk ends in the middle of a placeholder

You could take a look at Ledge[1], which would serve as a replacement for srcache but has ESI features, and particularly the "esi" branch[2] which has more complete ESI features (like when/choose) but is a work in progress (I hope to wrap up the ESI work very soon).

Ledge is built around a streaming model, so you don't have to buffer the entire response with fragment inclusion in order to serve anything.

Regards,

James.

[1] https://github.com/pintsized/ledge
[2] https://github.com/pintsized/ledge/tree/esi

--
James Hurst
ja...@pintsized.co.uk