Hi Folks, for my project I need to be able to go back in time and access a small set of previously collected senor data values. The set is quite small, about 10 - 25 values, The values are collected over a period of the last 10 days from now. The important value for my event/flow is the minimum …

If you have no need to go back and see the historical data, You can use the Context to store the min value https://nodered.org/docs/writing-functions#storing-data Why over complicate things?

and that context can be persistent over restarts if you wish. [image] A guide to understanding 'Persistent Context' General This is something I wrote up after playing with the context options. I've filed a PR with some of this added to the Node-RED documentation but though…

....that sounds perfect, thank you both for the fast response. @ukmoose , you are right, thought about that, too...but I see the need to access the historic data as part of my use case. The min-value alone might not be sufficient and some re-calculations need to be done from the historical data. @d…

If you decide that you want a complete (or longer) historical data set then have a look at influxdb.

[image] hominidae: I see the need to access the historic data How often are you getting updated values? That makes a massive difference. 25 x 10 x 17280 = 4,320,000 entries! (25 sensors, 10 days, updates every 5 seconds) 25 x 10 x 1440 = 360,000 entries (updates every minute) That drops to…

Just using a File node is super simple and easy to set up. I run many, using them as backups (to Influx) of the raw data that come from devices. Using a Function node you can customise the output for easy import into Excel or whatever. All the data is collected on an ssd which hangs directly off th…

Thanks for the info, @TotallyInformation ...very good calculation of the amount of data which sensors could produce. However my use case is a bit different. There will be only one, maybe two (temperature-) sensors, pushing data every minute. What I need to actually collect and access is just the…

...nice idea @Bobo , to backup the raw data using File node(s)...thanks for sharing

[image] hominidae: What I need to actually collect and access is just the minimum values, reached over the last 5 days, which are approx. 10-25 values in total (per sensor). A minimum value is defined as the temperature that has been previously collected before another, newer-in-time value is h…

[image] TotallyInformation: you should still try using InfluxDB and Grafana I second that. Also, the Grafana Charts are super nice!

Node-RED

Node-RED Forum

Best way to collect, store and retrieve a small (10-25) set of sensor values

General

dceejay 6 April 2019 14:48 3

and that context can be persistent over restarts if you wish.

Topic		Replies	Views
Read messages from a file and process time-based General	12	838	18 December 2020
Storing a value in text format_ using local pc as database General function-node	18	437	14 June 2023
Data storage and defined time checking General	4	448	29 March 2019
Totalizer difference example General	32	3274	20 April 2021
How to effectively use InfluxDB FAQs database	23	3059	15 March 2021

Copyright OpenJS Foundation and Node-RED contributors. All rights reserved. The OpenJS Foundation has registered trademarks and uses trademarks. For a list of trademarks of the OpenJS Foundation, please see our Trademark Policy and Trademark List. Trademarks and logos not indicated on the list of OpenJS Foundation trademarks are trademarks™ or registered® trademarks of their respective holders. Use of them does not imply any affiliation with or endorsement by them.

Best way to collect, store and retrieve a small (10-25) set of sensor values

Related topics