https://www.scrapingcourse.com/pagination
as the target URL.Workspace
and go to Projects
in the left sidebar.+ New project
at the top right and enter a name for your project (e.g., “E-commerce Product Scraper”).
+ New Workflow
and provide a name for your workflow (e.g., “Product name and price scraper”).
Create Workflow
button.Add Trigger
in your new workflow.
Schedule
.
Custom Interval
from the trigger options.Save and continue
.https://www.scrapingcourse.com/pagination
as the URL to scrape..product-name
, .product-price
) are specific to the page used in this guide. Selectors may vary across websites. For guidance on customizing selectors, refer to the CSS Extractor documentation. If you’re having trouble, the Advanced CSS Selectors Troubleshooting Guide can help resolve common issues.cURL
tab on the right and copy the generated code.
Example code:
HTTP request
step:
+
button below your trigger to add a new step.HTTP / Webhook
.Build an HTTP request
from the actions.Import cURL
and configure the HTTP request using the copied cURL code.
+
button to add another step.Node
action and choose Run Node code
.+
button to add a final step.Google Sheets
.Add Multiple Rows
from the Pre-built Actions.
Connect new account
to link your Google account with Pipedream.{{steps.code.$return_value.rowValues[0]}}
Test step
to verify that the data is correctly added to your Google Sheets.Deploy
in the top right corner of your workflow.wait_for
options. This gives the page more time to fully load before ZenRows tries to scrape it.
How do I handle dynamic content in ZenRows?
What CSS selectors should I use for scraping specific data?
.product-name
. To find the right selector, open the page in your browser, right-click the item you want, and select “Inspect” to view its code.Can I integrate ZenRows with other tools besides Google Sheets?
How do I schedule automatic scraping at regular intervals?
What are the limits of the ZenRows and Pipedream integration?