multi core cpu advantage for async job

sumanadak · 2016-07-18T14:38:37+00:00

Hi folks, This announcement might be a little bit late. As some of you might have already noted, the new version of the OpenResty web site is done completel...

multi core cpu advantage for async job

sumanadak

Dear,

As per my understanding, to run a async job in nginx lua context, we can use thread, timer or co-routine. As I as know, all these three way of processing async job can run in one core at a time despite you have multi core cpu. How do I take advantage of running parallel in all core?I heard about certain lib like lua lanes : https://cmr.github.io/lanes/ . can it be used directly in ngx lua context?

or it could be simple like, run nginx with more worker processes( no of core), I would like to spawn one async job for each request. Async job takes some computational time. So If I have 4 core cpu, is it 4 jobs run in parallel in 4 core ?

please help me to understand..

itamar

To the best of my understanding, Nginx/Openresty's model is that each worker process is responsible for a certain number of connections (multiplexing the different async i/o operations using the main event loop).
Each worker process runs the Lua runtime your code runs in, with transparent context switching done between requests and different lua threads on any i/o that would block, etc.

Using the correct number of worker processes (if in doubt, just set to 'auto') - you'll utilize the number of cores you'll have and each worker will serve a great number of requests concurrently.

TL;DR: No need to set worker processes count manually. Use 'auto' unless you know something special about your setup.

If you just want to start the async job and don't need to wait for it to complete, use ngx.timer.at(). If your use case requires it, look at Lua threads or co-routines.

On Sun, Jul 17, 2016 at 11:38 PM, Suman Adak <suma...@gmail.com> wrote:

Dear,

As per my understanding, to run a async job in nginx lua context, we can use thread, timer or co-routine. As I as know, all these three way of processing async job can run in one core at a time despite you have multi core cpu. How do I take advantage of running parallel in all core?I heard about certain lib like lua lanes : https://cmr.github.io/lanes/ . can it be used directly in ngx lua context?

or it could be simple like, run nginx with more worker processes( no of core), I would like to spawn one async job for each request. Async job takes some computational time. So If I have 4 core cpu, is it 4 jobs run in parallel in 4 core ?

please help me to understand..

.