Hy Guys... Sorry noob question here. I would like to know how can i read a txt file and for each line that the file have do a wget. ( Basically the file will contains EAN from different products and check on a website ) . Since i don't know the end of the file how can i do this without an error ?

We do not have your files that you use as input so we cannot run the flow. The join node needs to go here. [Screenshot 2020-03-24 at 14.39.59]

I do have a server with proxmox ... never heard about ui.vision. Gonna try @meeki007 . Tell me just one thing about your code above. .. I can't make a file with the msg.payload... example msg.payload its ' 783236726732' and i want to create a file (txt) with this msg.payload. if i do {{payload}} or {{msg.payload}} doesn't work. Do you have a better solution ?

I berleive in @meeki007 example you will want to edit the http request node and get rid f the pound sign(#) at the end of the url [Screen Shot 2020-03-07 at 7.41.35 AM]

Why doesn't work with files ? 07/03/2020, 12:57:47[node: ee355129.eac95](http://localhost:1880/#)msg.payload : string[45] 07/03/2020, 12:57:47node: ee355129.eac95 msg.payload : string[45] "C:\Users\Utilizador\.node-red\{{msg.payload}}" 07/03/2020, 12:57:47node: ee355129.eac95 msg.payload : string[45] "C:\Users\Utilizador\.node-red\{{msg.payload}}" 07/03/2020, 12:57:47node: ee355129.eac95 msg.payload : string[45] "C:\Users\Utilizador\.node-red\{{msg.payload}}" 07/03/2020, 12:57:47node: ee355129.eac95 msg.payload : string[45] "C:\Users\Utilizador\.node-red\{{msg.payload}}" 07/03/2020, 12:57:47node: ee355129.eac95 msg.payload : string[45] "C:\Users\Utilizador\.node-red\{{msg.payload}}" 07/03/2020, 12:57:47node: ee355129.eac95 msg.payload : string[45] "C:\Users\Utilizador\.node-red\{{msg.payload}}"

What does yyour flow, that produces that output, look like - export please.

Hy zenofmud [{"id":"d25240ac.1b669","type":"file in","z":"ef5a8c5d.8ab15","name":"","filename":"C:\Users\Utilizador\.node-red\eans1.txt","format":"lines","chunk":false,"sendError":false,"encoding":"none","x":430,"y":700,"wires":[["a964212b.46502"]]},{"id":"5a83b51f.b8f72c","type":"inject","z":"ef5a8c5d.8ab15","name":"","topic":"","payload":"","payloadType":"date","repeat":"","crontab":"","once":false,"onceDelay":0.1,"x":180,"y":700,"wires":[["d25240ac.1b669"]]},{"id":"ee355129.eac95","type":"debug","z":"ef5a8c5d.8ab15","name":"","active":true,"tosidebar":true,"console":false,"tostatus":false,"complete":"false","x":1210,"y":700,"wires":},{"id":"a964212b.46502","type":"file","z":"ef5a8c5d.8ab15","name":"","filename":"C:\Users\Utilizador\.node-red\{{payload}}","appendNewline":true,"createDir":false,"overwriteFile":"false","encoding":"none","x":920,"y":700,"wires":[["ee355129.eac95"]]}]

Try this, add a change node between the two file nodes with this jsonata expression: "C:/Users/Utilizador/.node-red/"&payload and in the `file-out' node remove the entry for file name

Don't think you can use mustache syntax in the http request node. @LucasSaraivaAzevedo This flow will get the urls: [{"id":"c5cf143a.94e328","type":"inject","z":"5dc05a86.d84bcc","name":"","topic":"","payload":"","payloadType":"date","repeat":"","crontab":"","once":false,"onceDelay":0.1,"x":132,"y":216,"wires":[["a69c89c5.69982"]]},{"id":"a69c89c5.69982","type":"file in","z":"5dc05a86.d84bcc","name":"","filename":"/home/administrator/ean.txt","format":"lines","chunk":false,"sendError":false,"encoding":"none","x":336,"y":216,"wires":[["ff652c9e.2b8f38"]]},{"id":"4c6ad38c.58f374","type":"debug","z":"5dc05a86.d84bcc","name":"","active":true,"tosidebar":true,"console":false,"tostatus":false,"complete":"true","targetType":"full","x":1010,"y":216,"wires":[]},{"id":"ff652c9e.2b8f38","type":"function","z":"5dc05a86.d84bcc","name":"","func":"m = msg.payload\nif(m!==\"\"){\n u = \"https://www.radiopopular.pt/pesquisa/\"\n return {url:u+m};\n}","outputs":1,"noerr":0,"x":530,"y":216,"wires":[["fecded6a.78f2c8"]]},{"id":"fecded6a.78f2c8","type":"delay","z":"5dc05a86.d84bcc","name":"","pauseType":"rate","timeout":"5","timeoutUnits":"seconds","rate":"1","nbRateUnits":"3","rateUnits":"second","randomFirst":"1","randomLast":"5","randomUnits":"seconds","drop":false,"x":680,"y":216,"wires":[["205af.149a8251e"]]},{"id":"205af.149a8251e","type":"http request","z":"5dc05a86.d84bcc","name":"","method":"GET","ret":"txt","paytoqs":false,"url":"","persist":false,"authType":"","x":862,"y":216,"wires":[["4c6ad38c.58f374"]]}] But the page is loaded via an post request and the output is dynamically generated via an ajax/xhr request. The http request node/wget/curl will not help with this. You first have to reverse engineer the behaviour of the site, then you can put it into a flow. This is the post data, which should be posted via the http request node - obviously the "where" should be the dynamic ean number. [Screenshot 2020-03-07 at 16.04.46] @unixneo - it is an XHR object, curl/wget will not help you. When you make the request via wget/curl you only get the main page, no xhr request forwarding. I mean, once you have the data, you are good to go, in either curl or node-red, same work for both.

[image] bakman2: The http request node/wget/curl will not help with this. You first have to reverse engineer the behaviour of the site, then you can put it into a flow. That is correct. This is an easy problem to solve if you move the wget/curl to the shell and do the processing in the shell with exec and return the results to Node-RED. However, I do realize that folks want to do this in a Node-RED node so go for it and enjoy! But to be clear, this is a trivial problem to solve if you do the work in the shell and use exec; but on the other hand, I think @LucasSaraivaAzevedo is running on Windows, so I better bug out of this discussion before I summon the sand worms on Arakis upon me :slight_smile:

[image] bakman2: @unixneo - it is an XHR object, curl/wget will not help you. When you make the request via wget/curl you only get the main page, no xhr request forwarding. Cool. Generally, I don't use curl/wget even in the shell; and only use python or php or Javascript,jQuery, etc for these kind of objects. Honestly, I thought the @LucasSaraivaAzevedo requested a curl/wget approach, so I was replying to that. I do not recall @LucasSaraivaAzevedo asking for a different approach, maybe I missed it? In fact, his original question was: @LucasSaraivaAzevedo Sorry noob question here. I would like to know how can i read a txt file and for each line that the file have do a wget So, that is why I am responding ... to the OPs original requirement :slight_smile:

Node-RED

Node-RED Forum

For each Line in a text file do

General

zenofmud 7 March 2020 14:37 14

Your flow is not importable. Pleas read this thread and edit your flow

Topic		Replies	Views
Fetching number from web page General	17	247	13 January 2026
Host files in node red which can fetched on GET request General http-request	6	640	29 May 2023
Extract different values from a multiline string General	24	5409	2 October 2018
Basic question on how to find/get Information on homepage General	9	519	16 December 2020
Using Node-RED to grab data from Webpage (advice required) General	11	739	17 July 2023

Copyright OpenJS Foundation and Node-RED contributors. All rights reserved. The OpenJS Foundation has registered trademarks and uses trademarks. For a list of trademarks of the OpenJS Foundation, please see our Trademark Policy and Trademark List. Trademarks and logos not indicated on the list of OpenJS Foundation trademarks are trademarks™ or registered® trademarks of their respective holders. Use of them does not imply any affiliation with or endorsement by them.

For each Line in a text file do

Related topics