# Web scrape Amazon Vine program

**URL:** <https://discourse.nodered.org/t/web-scrape-amazon-vine-program/85446>\
**Category:** General\
**Created:** [12 February 2024 10:18 UTC](https://discourse.nodered.org/t/web-scrape-amazon-vine-program/85446 "2024-02-12T10:18:04Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![dougle03](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/dougle03/32/32979_2.png) [@dougle03](https://discourse.nodered.org/u/dougle03)\
**Post date:** [12 February 2024 10:18 UTC](https://discourse.nodered.org/t/web-scrape-amazon-vine-program/85446/1 "2024-02-12T10:18:05Z")

</div>

Hi all,  
My partner has recently been invited to take part in the Amazon Vine reviews program. This involves keeping an eye on a specific url for products that can be ordered. If there are no product the text "We do not have any offers for you at this time." is shown in plain text.

So the text above is what I want to scrape for to trigger an automation, or rather when the text is not present, then do an action, but the url is of course behind the login process.

Does anyone know how I can scrape the url for this text, whilst navigating the login session elements?  
I'm comfortable with the actual text scraping and automation part, but getting NodeRed to do the virtual login is the part I'm struggling with.  
Many thanks...

 ![image](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/3X/c/c/cc6eb19595a279a83099e5c0e3594926367b7e1c.png)

---

<div class="post-metadata">

**Author:** ![TotallyInformation](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/totallyinformation/32/31_2.png) [@TotallyInformation](https://discourse.nodered.org/u/TotallyInformation)\
**Post date:** [12 February 2024 11:13 UTC](https://discourse.nodered.org/t/web-scrape-amazon-vine-program/85446/2 "2024-02-12T11:13:08Z")

</div>

If it is a complex login, you may need to use one of the headless browser nodes rather than a simple request node. They will run JavaScript and allow scripting of responses.

---

<div class="post-metadata">

**Author:** ![dougle03](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/dougle03/32/32979_2.png) [@dougle03](https://discourse.nodered.org/u/dougle03)\
**Post date:** [12 February 2024 15:20 UTC](https://discourse.nodered.org/t/web-scrape-amazon-vine-program/85446/3 "2024-02-12T15:20:42Z")

</div>

It's 2FA so perhaps that makes it 'complex'.  
Any ideas on Nodes to look at? I tried searching 'headless' but nothing useful..  
Thanks

---

<div class="post-metadata">

**Author:** ![Steve-Mcl](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/steve-mcl/32/4826_2.png) [@Steve-Mcl](https://discourse.nodered.org/u/Steve-Mcl)\
**Post date:** [12 February 2024 15:32 UTC](https://discourse.nodered.org/t/web-scrape-amazon-vine-program/85446/4 "2024-02-12T15:32:16Z")

</div>

Search selenium, puppeteer, web driver etc.

e.g: [Contrib puppeteer new - #8](https://discourse.nodered.org/t/contrib-puppeteer-new/82370/8)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/1X/d073cd938eafa2e558d7c2cd59003b3ef4963033.png) [@system](https://discourse.nodered.org/u/system)\
**Post date:** [12 May 2024 15:32 UTC](https://discourse.nodered.org/t/web-scrape-amazon-vine-program/85446/5 "2024-05-12T15:32:18Z")

</div>

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.