# BigData side-channel?

**URL:** <https://discourse.nodered.org/t/bigdata-side-channel/38862>\
**Category:** General\
**Created:** [9 January 2021 20:00 UTC](https://discourse.nodered.org/t/bigdata-side-channel/38862 "2021-01-09T20:00:20Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![mstormo](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/mstormo/32/35080_2.png) [@mstormo](https://discourse.nodered.org/u/mstormo)\
**Post date:** [9 January 2021 20:00 UTC](https://discourse.nodered.org/t/bigdata-side-channel/38862/1 "2021-01-09T20:00:21Z")

</div>

We have a compute framework which is designed to process TBs of data in real-time. This compute framework uses a DAG, so it fits into the flow of Node-Red. Now, I do not intend Node-Red to process TBs of data in real time using it's engine, but rather handle the setup of the flow, control and notifications.

Are there examples of creating such nodes, where Node-Red is used to set up the flow paths/connections, but where the actual data processing is happening independently?

And example could be something like:  
` [input 4k high-speed camera stream] -> [process filter A] -> [process filter B] -> [storage]`  
Where Node-Red controls the flow connections, and can change the inputs based on events/triggers, but have no hands in the actual dataflow?

Hopefully this makes sense. 🙂

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/1X/d073cd938eafa2e558d7c2cd59003b3ef4963033.png) [@system](https://discourse.nodered.org/u/system)\
**Post date:** [10 March 2021 20:00 UTC](https://discourse.nodered.org/t/bigdata-side-channel/38862/2 "2021-03-10T20:00:29Z")

</div>

Closed on 10 March 2021 20:00 UTC

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.