Large number of flows

Is there a maximum suggested number of flows within NodeRed? We are looking at using it with some workflow nodes from Objectif Lune, we will however have over 200 flows possibly so just wondering how the system would coope with this many

The number of flows does not matter. It is the number of nodes and the amount of work they are doing that could be an issue. That depends very much on your requirement and the capabilities of the computer it is running on. If you have thousands of nodes that are handling thousands of messages a second then you might need a fairly powerful computer. On the other hand if you have 20 nodes but are handling multiple video feeds in real time with image recognition then you might also need a powerful computer.

Bear in mind that Node-red is a single threaded process so a powerful computer with many CPU cores may not give the throughput you expect.

My Node-red experience is limited to Raspberry Pies; it's possible that real computers do things differently.

It's very low impact nodes that are been used. We take customer data and create documents from them, most of the processing is done by the document composition tool which is called via API so that is dooing most of the work, NodeRed is just submitting the data via API. So hopefully we should be ok

Why are there so many flows? Are many of them similar to each other?

Each flow is a differnt application that has different input files, validation rules etc. We have over 50 clients which use our services and many of these have got many differnt document types.

There are similar parts to each job which I've put into subflows but eqch one does has something different

OK. If you can use Link Call nodes rather than Subflows when possible that will reduce the memory required. A Link Call flow only exists once in memory, whereas a Subflow exists once for each use. The link call does not have the ability to configure parameters though, they need to be passed in the messages.

1 Like