Static compilation of lua files (OSX)

sharepadco · 2013-08-20T18:54:04+00:00

Hello! On Wed, Aug 14, 2013 at 3:58 PM, steven kleinert wrote: > Hi, i was looking at > http://wiki.nginx.org/HttpLuaModule#ngx.location.capture_multi...

Static compilation of lua files (OSX)

sharepadco

Hi List,

This is our first post here - so let's just start by telling how great it is to use openresty :) We've been able to write a whole app very quickly, that we will hopefully open source soon.

What we are trying now is to bundle the app by precompiling the lua files with LuaJIT.

Following the comment by Mike Pall here: http://stackoverflow.com/questions/11317269/how-to-compile-lua-scripts-into-a-single-executable-while-still-gaining-the-fas

we have obtained a static library (OSX for now, testing):

file build/spserver.a
build/spserver.a: current ar archive random library

Then, we try to replace in nginx.conf the path with a cpath:

# lua_package_path './src/?.lua;;';
lua_package_cpath './build/spserver.a;;';

While the main controller is loaded directly in nginx.conf:

location @lua {
content_by_lua "local Controller = require 'index'; Controller.main();";
}

But this does not work, from the error log:

runtime error: error loading module 'index' from file './build/spserver.a':
dlopen(./build/spserver.a, 6): no suitable image found. Did find:
./build/spserver.a: unknown file type

Did someone already did this?

Thanks.

agentzh

Hello!

On Tue, Aug 20, 2013 at 3:54 AM,  sharepadco wrote:
> This is our first post here - so let's just start by telling how great it is
> to use openresty :) We've been able to write a whole app very quickly, that
> we will hopefully open source soon.
>

I'm really looking forward to your opensourced apps powered by openresty! :)

> Then, we try to replace in nginx.conf the path with a cpath:
>
>> # lua_package_path './src/?.lua;;';
>> lua_package_cpath './build/spserver.a;;';
>

No, .a files are static archives that need to be statically linked
with your main programs (here, it is the "nginx" executable file).

You misread Mike Pall's answer. To quote his original words, "...link
the libmyluafiles.a library into your main program using -lmyluafiles"

You can link your spserver.a by running nginx or openresty's
./configure command like this (warning: untested):

    ./configure --with-ld-opt="-Wl,-E -L./build -lspserver" ...

And then try calling require() directly in your Lua code, without
configuring the lua_package_cpath directive (which is for loading DSO
only).

> But this does not work, from the error log:
>
>> runtime error: error loading module 'index' from file
>> './build/spserver.a':
>> dlopen(./build/spserver.a, 6): no suitable image found.  Did find:
>> ./build/spserver.a: unknown file type

No wonder you're getting this error  because you're trying to load
spserver.a as a DSO file.

Regards,
-agentzh

sharepadco

Thanks again agentzh.

With your answer and reading up on the subject, seems I totally overlooked the problem.

It doesn't work as such as configure fails with not_found: Will take more time to dig on this.

As I am on a Mac right now, I changed from -Wl,-E to -Wl,-exported_symbols_list,symbol_file, the latter containing _luaJIT_BC_*. I will try with linux quite soon.

Also, I might try using dynamic library obtained by: g++ -fpic -shared -Wl,-all_load spserver.a -Wl,-noall_load -o spserver.dylib.

But this is a not the most important issue right now, so I'll post feedback on this when I'm back to it.

When something works, that could be a great feature to package openresty + conf + lua code + sqlite (for instance) into a standalone binary, so it can be distributed and run very easily by end users.

Le mercredi 21 août 2013 00:58:40 UTC+2, agentzh a écrit :

Hello!

On Tue, Aug 20, 2013 at 3:54 AM, sharepadco wrote:
> This is our first post here - so let's just start by telling how great it is
> to use openresty :) We've been able to write a whole app very quickly, that
> we will hopefully open source soon.
>

I'm really looking forward to your opensourced apps powered by openresty! :)

> Then, we try to replace in nginx.conf the path with a cpath:
>
>> # lua_package_path './src/?.lua;;';
>> lua_package_cpath './build/spserver.a;;';
>

No, .a files are static archives that need to be statically linked
with your main programs (here, it is the "nginx" executable file).

You misread Mike Pall's answer. To quote his original words, "...link
the libmyluafiles.a library into your main program using -lmyluafiles"

You can link your spserver.a by running nginx or openresty's
./configure command like this (warning: untested):

./configure --with-ld-opt="-Wl,-E -L./build -lspserver" ...

And then try calling require() directly in your Lua code, without
configuring the lua_package_cpath directive (which is for loading DSO
only).

> But this does not work, from the error log:
>
>> runtime error: error loading module 'index' from file
>> './build/spserver.a':
>> dlopen(./build/spserver.a, 6): no suitable image found. Did find:
>> ./build/spserver.a: unknown file type

No wonder you're getting this error because you're trying to load
spserver.a as a DSO file.

Regards,
-agentzh

agentzh

Hello!

On Thu, Aug 22, 2013 at 9:35 AM,  sharepadco wrote:
> With your answer and reading up on the subject, seems I totally overlooked
> the problem.
> It doesn't work as such as configure fails with not_found: Will take more
> time to dig on this.
>

You should look into the nginx source directory's objs/autoconf.err
file for detailed errors. The "not found" output from ./configure
could be misleading.

Regards,
-agentzh