# Using Node Red with LLM
**URL:** https://discourse.nodered.org/t/using-node-red-with-llm/91313
**Category:** General
**Created:** [27 September 2024 18:03 UTC](https://discourse.nodered.org/t/using-node-red-with-llm/91313 "2024-09-27T18:03:18Z")
**Posts on this page:** 5
**Page:** 1
### Author:  [@WhiteLion](https://discourse.nodered.org/u/WhiteLion)
#### Post date: [27 September 2024 18:03 UTC](https://discourse.nodered.org/t/using-node-red-with-llm/91313/1 "2024-09-27T18:03:18Z")
Hiho,
I ve a project where I need to evaluate new articles by any LLM like Chat GPT. I knew the link to a new article most likely 2000 to 6000 words (2 - 6 Articles per day). So I can try to grab it by html node. And send this grabbed html with a prompt to any LLM. The questions I ve are:
- Do you know which LLM cand handle this and cheap or free ?
- How about the plan with grabbing it ? - Would you do other ?
- Some sites may block it ? - How could I find out if the article was grabbed or is incomplete for some reasons ?
Thx for your afford.
---
### Author:  [@TotallyInformation](https://discourse.nodered.org/u/TotallyInformation)
#### Post date: [27 September 2024 18:23 UTC](https://discourse.nodered.org/t/using-node-red-with-llm/91313/2 "2024-09-27T18:23:05Z")
> [@WhiteLion](#):
>
> Do you know which LLM cand handle this
Most of them have API's.
> [@WhiteLion](#):
>
> cheap or free
I think most if not all of the API's on the big LLM's cost money. I've never really managed to work out the cost though as the calculations seem rather complex. I'd be interested though if you manage to work out some costs.
> [@WhiteLion](#):
>
> How about the plan with grabbing it ? - Would you do other ?
Bit hard to say as you haven't really given much to go on. Do remember though that LLM's are totally dependent on their inputs and if you are trying to summarise articles involving subject areas where there is limited input, they will just make stuff up. You need to allow for that.
> [@WhiteLion](#):
>
> Some sites may block it ? - How could I find out if the article was grabbed or is incomplete for some reasons ?
Each API will have terms and conditions of use, you will need to check them and make sure you don't break them.
---
### Author:  [@bakman2](https://discourse.nodered.org/u/bakman2)
#### Post date: [27 September 2024 19:46 UTC](https://discourse.nodered.org/t/using-node-red-with-llm/91313/3 "2024-09-27T19:46:38Z")
If you have a PC with a decent GPU or an Apple silicon based Mac, you can do this locally, a model like llama3.1 has a context window of 128k tokens, 6000 words should be easily feasible together with software like ollama that provides an API. But also note that there are tools that can also include urls to crawl and perform the actions on it directly. I am using open-webui, which has search connectors for urls built-in.
---
### Author:  [@TotallyInformation](https://discourse.nodered.org/u/TotallyInformation)
#### Post date: [27 September 2024 21:14 UTC](https://discourse.nodered.org/t/using-node-red-with-llm/91313/4 "2024-09-27T21:14:38Z")
> [@bakman2](#):
>
> you can do this locally
Assuming you can get a model that contains sufficient data for whatever you are checking of course. Less relevant data = more made up answers.
---
### Author:  [@system](https://discourse.nodered.org/u/system)
#### Post date: [26 December 2024 21:15 UTC](https://discourse.nodered.org/t/using-node-red-with-llm/91313/5 "2024-12-26T21:15:37Z")
This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.