Hi Folks, I am learning Node-Red and already have implemented together with influxDB and Grafana for basic data acquisition purposes. I would like to also make a vehicle data logger, which require high resolution data and faster acquisition speeds (~300 sps) from CAN BUS and different acceleration …

There is nice thread where speed of Node-RED and many things around it have been discussed. You may find some answers from it. [image] Floating point calculation speed General So scrap Math.pow and just use conventional A * A, and when you say precalc radian to degree shou…

As usual it all depends. Node-RED can be fast but it depends on the amount of processing required eg database/external access and in particular the hardware it’s running on. Specifically pi before version 4 has relatively slow io. I think it would struggle with the data rates you require.

I have tried to publish 5 floating-point values in 300sps to influxDB and system started to be unreliable. I am using Raspberry Pi 4 4GB.

300 (sps ? what is that) messages per second (?) + I/O's to influx on a SD card, you can wait for the moment it wears out, I give it a week. Instead of dumping format it and insert it into influx, stream the data to a logfile and after your session is finished, parse it, and batch it into influx. W…

With sps I mean sample per second, from all 5 sensors. You mean, it will wear out the SD card? Actually, I was also thinking to log the high resolution data to something like HDF5, then dump it. But I have not decided where to start and what is the correct way to do it. I have been using Python a…

I can imagine that 300sps is no issue for the pi as long as you don't write it to a (relatively slow) medium that demands back and forth I/O over a bus. If you intend to perform parsing/transforming actions on each message you will find bottlenecks along the way. I am curious how many a pi could han…

I have a dashboard which is visualising incoming data from a number of remote monitors, doing maths on 3 parts of the messages (at least 20 MQTT messages a second), and parsing the rest using function nodes and a smooth node and it shows no sign of struggling. Easiest way to check it will be setup …

With 300 messages per second from 5 sensors CPU usage goes up to 100% and it is only using basic parsing and splitting.

Is that 300 msgs per sensor (or 1500 msg/sec) or a total of 300 msgs/sec from the 5 sensors?

Well it doesn't matter the count of readings per second. (OK it does but that is not the only thing to look or blame) If you are hitting some limits already (CPU 100%) then you'll need to figure out the bottleneck and try to optimize it. If you are looking for help on that, you'll need to share sam…

[image] zenofmud: Is that 300 msgs per sensor (or 1500 msg/sec) or a total of 300 msgs/sec from the 5 sensors? 300 messages per second from 5 sensors are inserted in single query. [image] hotNipi: Well it doesn't matter the count of readings per second. (OK it does but that is not the on…

Node-RED

Node-RED Forum

How fast is Node-Red?

General

hotNipi 11 December 2019 12:27 3

There is nice thread where speed of Node-RED and many things around it have been discussed. You may find some answers from it.

Topic		Replies	Views
Factors affecting speed of Node Red. Close to real-time capabilities? General	7	1583	5 October 2020
Node red processing slowed General docker , function-node , flows	22	798	6 December 2025
High throughput examples (for arguing for the platform) General	31	2392	19 November 2021
My Node-RED flow feels heavy on Raspberry Pi 4 General node-red-dashboard , function-node	13	446	9 May 2024
I/O switching performance on a Raspberry Pi 4 General	37	2910	15 June 2020

Copyright OpenJS Foundation and Node-RED contributors. All rights reserved. The OpenJS Foundation has registered trademarks and uses trademarks. For a list of trademarks of the OpenJS Foundation, please see our Trademark Policy and Trademark List. Trademarks and logos not indicated on the list of OpenJS Foundation trademarks are trademarks™ or registered® trademarks of their respective holders. Use of them does not imply any affiliation with or endorsement by them.

How fast is Node-Red?

Related topics