Is there anyway to elect leader amount several nginx servers?

drdr.xp · 2014-11-03T12:33:32+00:00

Hello! On Tue, Dec 16, 2014 at 9:47 AM, rvsw wrote: > Is it possibly less effort to extend sub filter to do streaming as a first > step? Essentially,...

Is there anyway to elect leader amount several nginx servers?

drdr.xp

I have a cluster of about 20 nginx instances, each on a single server.

I need these nginx to elect a leader to do management work, including update configuration of each server, update membership of the cluster and moving data between them.

Two members doing configuration updating job concurrently is not allowed. It leads to data inconsistency.

Is there some paxos/raft like module in lua to coordinate such job? or is there a leader election module for resty?

luis.gasca

Not specific to nginx/openresty, but Hashicorp´s Consul template [1] may be useful in your use case.

[1] https://www.hashicorp.com/blog/introducing-consul-template.html

-----Original Message-----
From: "dr-dr xp" <drd...@gmail.com>
Sent: Monday, 3 November, 2014 05:33
To: openresty-en@googlegroups.com
Subject: [openresty-en] Is there anyway to elect leader amount several nginx servers?

I have a cluster of about 20 nginx instances, each on a single server.

I need these nginx to elect a leader to do management work, including update configuration of each server, update membership of the cluster and moving data between them.

Two members doing configuration updating job concurrently is not allowed. It leads to data inconsistency.

Is there some paxos/raft like module in lua to coordinate such job? or is there a leader election module for resty?

--
.

drdr.xp

Thanks. Consul looks very nice for updating conf on many servers. But my need is to let the small cluster of 20 servers to decide WHAT change to make, not HOW to apply changes to the cluster.

I need the small cluster self managed:

It checks status of each server and make a decision to remove/add members from/into it. At any time there must not be more than one process making decision what to add/remove.

On Monday, November 3, 2014 4:43:02 PM UTC+8, luis....@interactive3g.com wrote:

Not specific to nginx/openresty, but Hashicorp´s Consul template [1] may be useful in your use case.

[1] https://www.hashicorp.com/blog/introducing-consul-template.html

-----Original Message-----
From: "dr-dr xp" <drd...@gmail.com>
Sent: Monday, 3 November, 2014 05:33
To: openre...@googlegroups.com
Subject: [openresty-en] Is there anyway to elect leader amount several nginx servers?

I have a cluster of about 20 nginx instances, each on a single server.
I need these nginx to elect a leader to do management work, including update configuration of each server, update membership of the cluster and moving data between them.

Two members doing configuration updating job concurrently is not allowed. It leads to data inconsistency.

Is there some paxos/raft like module in lua to coordinate such job? or is there a leader election module for resty?
.

luis.gasca

Then, maybe serf[1] can help. Again, not specific to nginx

[1] https://www.serfdom.io/

-----Original Message-----
From: "dr-dr xp" <drd...@gmail.com>
Sent: Monday, 3 November, 2014 10:31
To: openresty-en@googlegroups.com
Subject: Re: [openresty-en] Is there anyway to elect leader amount several nginx servers?

Thanks. Consul looks very nice for updating conf on many servers. But my need is to let the small cluster of 20 servers to decide WHAT change to make, not HOW to apply changes to the cluster.

I need the small cluster self managed:

It checks status of each server and make a decision to remove/add members from/into it. At any time there must not be more than one process making decision what to add/remove.

On Monday, November 3, 2014 4:43:02 PM UTC+8, luis....@interactive3g.com wrote:

Not specific to nginx/openresty, but Hashicorp´s Consul template [1] may be useful in your use case.

[1] https://www.hashicorp.com/blog/introducing-consul-template.html

-----Original Message-----
From: "dr-dr xp" <drd...@gmail.com>
Sent: Monday, 3 November, 2014 05:33
To: openre...@googlegroups.com
Subject: [openresty-en] Is there anyway to elect leader amount several nginx servers?

I have a cluster of about 20 nginx instances, each on a single server.
I need these nginx to elect a leader to do management work, including update configuration of each server, update membership of the cluster and moving data between them.

Two members doing configuration updating job concurrently is not allowed. It leads to data inconsistency.

Is there some paxos/raft like module in lua to coordinate such job? or is there a leader election module for resty?

--
.

drdr.xp

This is great. Thanks

On Monday, November 3, 2014 5:36:59 PM UTC+8, luis....@interactive3g.com wrote:

Then, maybe serf[1] can help. Again, not specific to nginx

[1] https://www.serfdom.io/

-----Original Message-----
From: "dr-dr xp" <drd...@gmail.com>
Sent: Monday, 3 November, 2014 10:31
To: openre...@googlegroups.com
Subject: Re: [openresty-en] Is there anyway to elect leader amount several nginx servers?

Thanks. Consul looks very nice for updating conf on many servers. But my need is to let the small cluster of 20 servers to decide WHAT change to make, not HOW to apply changes to the cluster.
I need the small cluster self managed:

It checks status of each server and make a decision to remove/add members from/into it. At any time there must not be more than one process making decision what to add/remove.

On Monday, November 3, 2014 4:43:02 PM UTC+8, luis....@interactive3g.com wrote:

Not specific to nginx/openresty, but Hashicorp´s Consul template [1] may be useful in your use case.

[1] https://www.hashicorp.com/blog/introducing-consul-template.html

-----Original Message-----
From: "dr-dr xp" <drd...@gmail.com>
Sent: Monday, 3 November, 2014 05:33
To: openre...@googlegroups.com
Subject: [openresty-en] Is there anyway to elect leader amount several nginx servers?

I have a cluster of about 20 nginx instances, each on a single server.
I need these nginx to elect a leader to do management work, including update configuration of each server, update membership of the cluster and moving data between them.

Two members doing configuration updating job concurrently is not allowed. It leads to data inconsistency.

Is there some paxos/raft like module in lua to coordinate such job? or is there a leader election module for resty?
.