I'm trying to traverse through a large CSV file. Each line, I do some data remodelling and convert it to XML format. Lastly, I save all of it into an XML file. In my actual implementation, the resulting remodelled XML data is 10x larger than the source CSV data. I have a use case where the sourc…

So I tried appending the XML data per iteration and delete the msg.payload before feeding the message to the Join node so it doesn't accumulate data. If you want to iterate, you need to use output msg per line in the file-in node. Still going to be heavy impact. I don't think node-red is the ri…

zenofmud Split this topic 5 September 2021 11:20 6

A post was split to a new topic: Converting CSV to mysql causes error with blank csv columns

Converting CSV to mysql causes error with blank csv columns

Topic		Replies	Views
Memory issue processing large csv file General	3	754	20 December 2021
Converting CSV to mysql causes error with blank csv columns General	3	714	6 September 2021
Memory limits on Rpi processing chart data General	6	353	15 October 2021
Only 84 rows read in bug CSV General	5	570	12 June 2020
Writing a CSV is kicking my butt General	3	57	7 December 2024

Copyright OpenJS Foundation and Node-RED contributors. All rights reserved. The OpenJS Foundation has registered trademarks and uses trademarks. For a list of trademarks of the OpenJS Foundation, please see our Trademark Policy and Trademark List. Trademarks and logos not indicated on the list of OpenJS Foundation trademarks are trademarks™ or registered® trademarks of their respective holders. Use of them does not imply any affiliation with or endorsement by them.

Memory issues processing and writing a large file

Related topics