HTTP To TCP Conversion

santos.das · 2017-03-30T00:49:28+00:00

my gdb version is too old T T, upgrade gdb to version 7.7 everything is ok在 2017年3月27日星期一 UTC+8&...

HTTP To TCP Conversion

santos.das

Hi,

I am planning to use OpenResty as a webserver to the front end of my susbcriber tasks (1:N, 1 Rest Server for N Subscriber Tasks). The communication between the Nginx and my tasks would be over TCP. So, when the OpenResty receives the HTTP messages, it will parse the message and then put to the message to the registered TCP clients (simple round robin load balancing among tcp clients).

Any idea how can this be done. If this requires the development of a new nginx module I can do so. But, I am trying to understand how this can be done.

Thanks, Santos

rpaprocki

On Wed, Mar 29, 2017 at 9:49 AM, Santos Das <sant...@gmail.com> wrote:

Hi,

I am planning to use OpenResty as a webserver to the front end of my susbcriber tasks (1:N, 1 Rest Server for N Subscriber Tasks). The communication between the Nginx and my tasks would be over TCP. So, when the OpenResty receives the HTTP messages, it will parse the message and then put to the message to the registered TCP clients (simple round robin load balancing among tcp clients).

Any idea how can this be done. If this requires the development of a new nginx module I can do so. But, I am trying to understand how this can be done.

Sounds like you would use ngx.tcp.socket (https://github.com/openresty/lua-nginx-module#ngxsockettcp) in order to establish a TCP connection with a task server. Have a solid read through the documentation first :)

There are a handful of community examples and reference libs on talking over sockets. Have a look at https://github.com/hamishforbes/lua-resty-upstream as an example of load balancing upstream TCP connections. Other libs that provide connectivity for various layer 7 protocols, like lua-resty-http or lua-resty-mysql, can be good references as well to familiarize yourself with the lua-nginx-module environment.

Again, make sure to read the docs thoroughly, and try to do something yourself, before asking for help. Better to say "I tried this and it didn't work" vs. "i haven't tried anything at all" :)

elvin.efendiyev

Does Nginx's built-in stream proxy module(https://nginx.org/en/docs/stream/ngx_stream_proxy_module.html) not do what you want?

On Wednesday, March 29, 2017 at 12:49:32 PM UTC-4, Santos Das wrote:

Hi,

I am planning to use OpenResty as a webserver to the front end of my susbcriber tasks (1:N, 1 Rest Server for N Subscriber Tasks). The communication between the Nginx and my tasks would be over TCP. So, when the OpenResty receives the HTTP messages, it will parse the message and then put to the message to the registered TCP clients (simple round robin load balancing among tcp clients).

Any idea how can this be done. If this requires the development of a new nginx module I can do so. But, I am trying to understand how this can be done.

Thanks, Santos

santos.das

Thanks Elvin.

Let me clarify the requirement here.

1. I am also thinking of the using the Nginx stream module.

2. Actually, it has work like two servers (HTTP as well as TCP server) for the usecase I mentioned above. For TCP server I am thinking of using the nginx stream module.

But, what I was looking up here is how to pass the traffic between these two. What ever is being received on the HTTP server will be send to registered the TCP clients.

I was not sure whether that can be done through LUA or I need to develop a NGINX module for this....

Thanks, Santos

On Thu, Mar 30, 2017 at 10:19 AM, Elvin Efendi <elvin.e...@gmail.com> wrote:

Does Nginx's built-in stream proxy module(https://nginx.org/en/docs/stream/ngx_stream_proxy_module.html) not do what you want?

On Wednesday, March 29, 2017 at 12:49:32 PM UTC-4, Santos Das wrote:
Hi,

I am planning to use OpenResty as a webserver to the front end of my susbcriber tasks (1:N, 1 Rest Server for N Subscriber Tasks). The communication between the Nginx and my tasks would be over TCP. So, when the OpenResty receives the HTTP messages, it will parse the message and then put to the message to the registered TCP clients (simple round robin load balancing among tcp clients).

Any idea how can this be done. If this requires the development of a new nginx module I can do so. But, I am trying to understand how this can be done.

Thanks, Santos

.

elvin.efendiyev

I see, thanks for clarification. In this case as @rpaprocki mentioned already you can use https://github.com/openresty/lua-nginx-module#ngxsockettcp.

On Thursday, March 30, 2017 at 5:01:03 AM UTC-4, Santos Das wrote:

Thanks Elvin.

Let me clarify the requirement here.

1. I am also thinking of the using the Nginx stream module.
2. Actually, it has work like two servers (HTTP as well as TCP server) for the usecase I mentioned above. For TCP server I am thinking of using the nginx stream module.

But, what I was looking up here is how to pass the traffic between these two. What ever is being received on the HTTP server will be send to registered the TCP clients.

I was not sure whether that can be done through LUA or I need to develop a NGINX module for this....

Thanks, Santos

On Thu, Mar 30, 2017 at 10:19 AM, Elvin Efendi <elvin.e...@gmail.com> wrote:
Does Nginx's built-in stream proxy module(https://nginx.org/en/docs/stream/ngx_stream_proxy_module.html) not do what you want?

On Wednesday, March 29, 2017 at 12:49:32 PM UTC-4, Santos Das wrote:
Hi,

I am planning to use OpenResty as a webserver to the front end of my susbcriber tasks (1:N, 1 Rest Server for N Subscriber Tasks). The communication between the Nginx and my tasks would be over TCP. So, when the OpenResty receives the HTTP messages, it will parse the message and then put to the message to the registered TCP clients (simple round robin load balancing among tcp clients).

Any idea how can this be done. If this requires the development of a new nginx module I can do so. But, I am trying to understand how this can be done.

Thanks, Santos

.