Just a shot in the dark, but I had similar issue when I first started using node-red.
Turned out, Ii you use an rbe node on binary data its pretty much inevitable.
Here is the followup thread to the original where I stumbled onto the solution:
https://discourse.nodered.org/t/memory-leak-what-am-i-doing-wrong/627/23