How to get page with all included static files using lua-resty-http?

ponomarchukov · 2016-05-11T08:52:55+00:00

We are expanding our team to Austin, TX and looking for engineers that want to work on OpenResty. Click on the link ( https://www.jsco.re/8...

How to get page with all included static files using lua-resty-http?

ponomarchukov

I use library lua-resty-http for openresty and try to get web-resource like:

content_by_lua '

-- For simple singleshot requests, use the URI interface.

local http = require "resty.http"

local httpc = http.new()

local res, err = httpc:request_uri("http://www.beer.com/", {

method = "GET",

headers = {

["Content-Type"] = "application/x-www-form-urlencoded",

}

})

if not res then

ngx.say("failed to request: ", err)

return

end

-- In this simple form, there is no manual connection step, so the body is read

-- all in one go, including any trailers, and the connection closed or keptalive

-- for you.

ngx.status = res.status

for k,v in pairs(res.headers) do

end

ngx.say(res.body)

}

It returns me full page HTML content, but CSS styles and JS scripts do not work. I suspect that problem is in path of these static files.

Also sometimes this methos returns page with message 302 Moved.

How I can fix these issies?

agentzh

Hello!

On Tue, May 10, 2016 at 5:52 PM, Oleg P wrote:
>
> It returns me full page HTML content, but CSS styles and JS scripts do not
> work. I suspect that problem is in path of these static files.

You need to parse the resulting HTML responses and crawl those
included static resources via separate requests.

> Also sometimes this methos returns page with message 302 Moved.
>

This case you need to follow the redirect yourself by checking the
Location response header of the 302 response and initiate a new
request to the new location.

Those lua-resty-http libraries are not like web browsers, just
low-level HTTP clients like curl.

Regards,
-agentzh