HTTP buffer length

General
1

hello there.
For purpouse of retirieve information from a web page i'been using "http request node" but, it can only give a maximum of 5700 characters, wich is more less than what is needed to get the specified data.

Captura

I've tried to modify the settings.js but it wasnt successfull, it does modify buffer's data in debug space. Does anyone has experince some need like mine?, i'd like to increase the buffer length way more than 5700. Thanks for reading and any advice!. Regards!!

[{"id":"879b872b.68ec38","type":"inject","z":"1d10fa22.32b416","name":"","props":[{"p":"payload"},{"p":"topic","vt":"str"}],"repeat":"","crontab":"","once":false,"onceDelay":0.1,"topic":"","payload":"","payloadType":"date","x":1390,"y":4760,"wires":[["94a468af.1286c8"]]},{"id":"94a468af.1286c8","type":"http request","z":"1d10fa22.32b416","name":"","method":"GET","ret":"txt","paytoqs":"ignore","url":"alloy.geocom.cl","tls":"","persist":false,"proxy":"","authType":"","x":1550,"y":4760,"wires":[["69db9d72.bd3134"]]},{"id":"69db9d72.bd3134","type":"debug","z":"1d10fa22.32b416","name":"","active":true,"tosidebar":true,"console":false,"tostatus":false,"complete":"false","statusVal":"","statusType":"auto","x":1750,"y":4760,"wires":[]}]
2

I suspect you are attempting to access the values on the page?

image
image649×814 42 KB

The request is recieving 5700 characters because that is exactly the size of the HTML

image
image936×336 35.7 KB

HOWEVER - the html for http://alloy.geocom.cl/ does NOT contain any of the data - the data on that page is populated via a SCRIPT and the data actually comes from http://alloy.geocom.cl/xml/dynamic/merge.xml?svTrack=&dataLogger=&ioConfig=&power=&conn_status=

e.g...

image
image1083×709 95.8 KB

so if you instead access that URL and convert from XML to JS object, you can access all the values (and there are lots - happy hunting)

image
image908×736 36 KB

Demo flow...

[{"id":"879b872b.68ec38","type":"inject","z":"1062d7f9.08a808","name":"","props":[{"p":"payload"},{"p":"topic","vt":"str"}],"repeat":"","crontab":"","once":false,"onceDelay":0.1,"topic":"","payload":"","payloadType":"date","x":700,"y":80,"wires":[["94a468af.1286c8"]]},{"id":"69db9d72.bd3134","type":"debug","z":"1062d7f9.08a808","name":"","active":true,"tosidebar":true,"console":false,"tostatus":false,"complete":"payload","targetType":"msg","statusVal":"","statusType":"auto","x":1050,"y":140,"wires":[]},{"id":"94a468af.1286c8","type":"http request","z":"1062d7f9.08a808","name":"","method":"GET","ret":"txt","paytoqs":"ignore","url":"http://alloy.geocom.cl/xml/dynamic/merge.xml?svTrack=&dataLogger=&ioConfig=&power=&conn_status=","tls":"","persist":false,"proxy":"","authType":"","x":860,"y":80,"wires":[["a64020e7.94b56","550c6da9.4faa44"]]},{"id":"a64020e7.94b56","type":"xml","z":"1062d7f9.08a808","name":"","property":"payload","attr":"","chr":"","x":890,"y":140,"wires":[["69db9d72.bd3134"]]},{"id":"550c6da9.4faa44","type":"debug","z":"1062d7f9.08a808","name":"","active":true,"tosidebar":true,"console":false,"tostatus":false,"complete":"payload","targetType":"msg","statusVal":"","statusType":"auto","x":1050,"y":80,"wires":[]}]
3

Ohhh... That's exaclty what i needed, but i dont knew how to get it. Thanks so much Steve-Mci :smile: !!!

4

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.