Retriving json data with a http request

when requesting data from natural resources wales api the payload only contains the first 999 entries in the array. the array size is 300k. the 999 enties does not appear to exceed the 5Mb limit.
Is this a node red limit?

Hi and welcome

Do you mean the sidebar debug window only allows the first 999 to be viewable. If so the whole array is there, it just the sidebar display is saving resources. try sending the payload to file write node and saving it to a text file.

If not you will need to supply a example flow so we can see the issue first hand How to import/export a flow

In order to make code readable and usable it is necessary to surround your code with three backticks (also known as a left quote or backquote ```)

``` 
   code goes here 
```

You can edit and correct your post by clicking the pencil :pencil: icon.

See this post for more details - How to share code or flow json

You may benifit watching the essentials videos. which will give you a greater understanding of node-red basics and the debug sidebar display.

Or it may be that the API is "paged" and only returns 999 (or 1000) entries in a chunk and you have to ask for more via some extra parameter.

Ahh, thanks that makes sense

A quick look at the API docs doesn't mention paging but I don't have an account/key so can't access it live - nor which particular call... (though they seem to support JSON etc replies so that is a good start.

Maybe do as @elcid suggests and write the payload to a file and see how big it really is.