&quot;Expected the end&quot; error

davidmuscut · 2018-06-04T22:48:09+00:00

I found the root cause of the issue.Issue is there because i am using luacrypto-0.3.2 in my lua file.since luacrypto-0.3.2 does not support openssl 1.1.0 its...

"Expected the end" error

davidmuscut

I have a simple script to parse json output from crt.sh. When I run the script from resty CLI I get the following error. Can someone help explain what's wrong with the script?

# resty test.lua example.org

ERROR: test.lua:16: Expected the end but found T_OBJ_BEGIN at character 294

stack traceback:

test.lua:16: in function 'file_gen'

init_worker_by_lua:46: in function <init_worker_by_lua:44>

[C]: in function 'xpcall'

init_worker_by_lua:53: in function <init_worker_by_lua:51>

The code for test.lua is below:

=================================================

local http = require "resty.http"

local cjson = require "cjson"

local httpc = http.new()

local uri = "https://crt.sh/?q=%.".. arg[1] .. "&output=json"

local res, err = httpc:request_uri(uri, {

method = "GET",

ssl_verify = false

})

if not res then

ngx.say("failed to request: ", err)

return

end

value = cjson.decode(res.body)

================================================

rpaprocki

Looks like the value you're trying to JSON decoded isn't valid JSON, at least according to the cjson module. Best to examine the response body and figure out what's wrong with it (I'm not familiar with crt.sh; does it perhaps return multiple distinct JSON values?)

On Jun 4, 2018, at 07:48, david...@gmail.com wrote:

I have a simple script to parse json output from crt.sh. When I run the script from resty CLI I get the following error. Can someone help explain what's wrong with the script?

# resty test.lua example.org
ERROR: test.lua:16: Expected the end but found T_OBJ_BEGIN at character 294
stack traceback:
test.lua:16: in function 'file_gen'
init_worker_by_lua:46: in function <init_worker_by_lua:44>
[C]: in function 'xpcall'
init_worker_by_lua:53: in function <init_worker_by_lua:51>

The code for test.lua is below:
=================================================
local http = require "resty.http"
local cjson = require "cjson"
local httpc = http.new()
local uri = "https://crt.sh/?q=%.".. arg[1] .. "&output=json"
local res, err = httpc:request_uri(uri, {
method = "GET",
ssl_verify = false
})

if not res then
ngx.say("failed to request: ", err)
return
end

value = cjson.decode(res.body)
================================================

.

rpaprocki

Forwarding to the group:

> Interesting, when I update the script to print res.body and pipe it through jq, I get the response below. Is that what you mean by multiple distinct JSON values?

> # resty test.lua example.org|jq

> {

> "issuer_ca_id": 1397,

> "issuer_name": "C=US, O=DigiCert Inc, OU=www.digicert.com CN=DigiCert SHA2 High Assurance Server CA",

> "name_value": "www.example.org",

> "min_cert_id": 10557607,

> "min_entry_timestamp": "2015-11-05T14:51:33.941",

> "not_before": "2015-11-03T00:00:00",

> "not_after": "2018-11-28T12:00:00"

> }

> {

> "issuer_ca_id": 1397,

> "issuer_name": "C=US, O=DigiCert Inc, OU=www.digicert.com, CN=DigiCert SHA2 High Assurance Server CA",

> "name_value": "www.example.org",

> "min_cert_id": 5857507,

> "min_entry_timestamp": "2014-12-11T14:36:57.201",

> "not_before": "2014-11-06T00:00:00",

> "not_after": "2015-11-13T12:00:00"

> }

Indeed what you're seeing is multiple separate JSON documents. when you call cjson.decode on the whole lua-resty-http res.body field, youre trying to JSON-decode multiple documents. so you'll need to parse the crt.sh output to get individual JSON documents that you can then decode. Annoyingly, it doesn't look like the response from crt.sh output has any sort of convenient delimiter to denote individual documents (based on looking at https://crt.sh/?q=openresty.com&output=json). It looks like each document only contains a single level (no nesting), so you could cheat and search for the '}' character and split based off that. But that would be terribly fragile ;)

On Monday, June 4, 2018 at 8:00:47 AM UTC-7, rpaprocki wrote:

Looks like the value you're trying to JSON decoded isn't valid JSON, at least according to the cjson module. Best to examine the response body and figure out what's wrong with it (I'm not familiar with crt.sh; does it perhaps return multiple distinct JSON values?)

On Jun 4, 2018, at 07:48, david...@gmail.com wrote:

I have a simple script to parse json output from crt.sh. When I run the script from resty CLI I get the following error. Can someone help explain what's wrong with the script?

# resty test.lua example.org
ERROR: test.lua:16: Expected the end but found T_OBJ_BEGIN at character 294
stack traceback:
test.lua:16: in function 'file_gen'
init_worker_by_lua:46: in function <init_worker_by_lua:44>
[C]: in function 'xpcall'
init_worker_by_lua:53: in function <init_worker_by_lua:51>

The code for test.lua is below:
=================================================
local http = require "resty.http"
local cjson = require "cjson"
local httpc = http.new()
local uri = "https://crt.sh/?q=%.".. arg[1] .. "&output=json"
local res, err = httpc:request_uri(uri, {
method = "GET",
ssl_verify = false
})

if not res then
ngx.say("failed to request: ", err)
return
end

value = cjson.decode(res.body)
================================================
-- put=json"
local res, err = httpc:request_uri(uri, {
method = "GET",
ssl_verify = false
})

if not res then
ngx.say("failed to request: ", err)
return
end

value = cjson.decode(res.body)

================================================