Does Usage Carry Over Months?
No, monthly plans are reset each month and usage doesn’t roll over.
Can I Scrape Using Browser Extensions?
ZenRows does not offer a browser extension, and our products are designed to work via API requests, proxies, and automated browsers, not through browser extensions.
Browser extensions have significant limitations when it comes to web scraping:
Instead of using an extension, we recommend using one of our API-based solutions, which are optimized for web scraping at scale:
If you’re looking for automated and scalable web scraping, our API solutions are the best fit. Let us know if you need help choosing the right approach! 🚀
Can I See the XHR / AJAX / Fetch Requests that Browsers Perform?
If you need to capture dynamic content loaded via AJAX requests, ZenRows offers different approaches depending on the product you’re using. Some products provide built-in JSON responses, while others require custom configurations to extract network requests.
More and more websites load content dynamically, meaning data is fetched via XHR, AJAX, or Fetch requests instead of being included in the initial HTML. Besides waiting for the content to load, you might want to capture these network requests—similar to how they appear in the Network tab in DevTools.
json_response=true
) captures AJAX requests automatically.By choosing the right ZenRows product and configuration, you can effectively capture network requests and analyze the data that websites load dynamically. Let us know if you need guidance on a specific use case! 🚀
Does ZenRows Bypass Antibot Solutions?
ZenRows is designed to bypass most modern antibot solutions out-of-the-box. We continuously test and optimize our systems to ensure a smooth scraping experience. However, antibot defenses vary by website, and different ZenRows products serve different purposes.
Below is an overview of how each product handles antibot measures and what to expect when using them.
The Universal Scraper API, when combined with Premium Proxies and JS Render, effectively handles most antibot measures. This setup mimics real user behavior, helping bypass bot detection mechanisms.
However, not all pages are protected equally. Many websites enforce stricter protections on internal APIs or login-restricted content. If you’re targeting such endpoints, additional configurations might be needed.
If you’re experiencing blocks despite using Premium Proxies and JS Render, refer to this guide: Using Premium + JS Render and still blocked
Our Scraper APIs are designed for ease of use. Simply send a request to our API, and we handle all antibot measures in the background, delivering the structured content you need. This is the best option for users who want a hassle-free experience without worrying about configuration.
Residential Proxies prioritize anonymity rather than antibot bypassing. They provide IP rotation and geographic targeting but do not include built-in antibot or CAPTCHA-solving capabilities. For heavily protected websites, additional techniques may be required.
The Scraping Browser is highly effective against antibot and anticaptcha solutions, using the same advanced algorithms as the Universal Scraper API. However, if a website enforces a CAPTCHA challenge, we do not automatically bypass it. Solving CAPTCHAs currently requires implementing custom handling, such as integrating third-party CAPTCHA-solving services.
By choosing the right combination of ZenRows tools, you can optimize your web scraping strategy to handle even the most complex antibot defenses. If you need further assistance, feel free to reach out to our support team.
Does ZenRows Have No-Code Options?
ZenRows supports a variety of no-code platforms to help you scrape data from websites without writing a single line of code. These integrations let you connect your scraping workflows with thousands of apps like Google Sheets, Airtable, Notion, Amazon S3, and more.
These no-code integrations are ideal for marketers, analysts, product managers, and anyone looking to automate data collection without needing technical skills.
Use ZenRows’ no-code options when you:
Best Practice: Start with pre-built ZenRows templates in platforms like Zapier or Make to set up your workflow in minutes.
Visit our Integrations Page to explore tutorials and real-world examples that walk you through setting up your first workflow.
Does ZenRows Integrate with External Tools?
Suppose you must scrape data from a website and automatically process it using a third-party tool. We offer various ways to integrate ZenRows with external software and tools. Currently, you can integrate a captcha solver or a no-code tool like Zapier/Make/Clay.
Additionally, you can build your integrations using the ZenRows output, whether HTML or JSON. A good use case for this is the autoparse feature, which returns structured data from a page.
Does ZenRows offer Custom plans?
Yes! Our custom plans are available for high-volume cases. We cannot customize public plans, as they are standardized for all our clients.
How Can I Speed Up My Requests?
Optimizing your requests can significantly improve performance and reduce response times. Below are general best practices, followed by specific recommendations for each ZenRows product.
Each response includes headers that help you manage and optimize your concurrency:
These headers help you:
429 Too Many Requests
error and your IP can be temporarily blocked for 5 minutes. BLK0001
error (IP Address Blocked), it means your IP has exceeded the allowed error rate. The block will last for 5 minutes and will impact your ability to send new requests during that time, affecting your overall scraping speed. For more details, see our API Error Codes documentation.Use these headers to adjust your request flow in real-time, scaling up when possible and backing off before hitting limits.
js_render=true
for static content to improve speedwait
and wait_for
only when requiredpremium_proxy=true
for faster, more consistent responsesHow Is Usage Counted?
API usage counts are managed based on your subscription plan:
How to bypass CAPTCHAs?
ZenRows is designed to bypass most modern antibot solutions out-of-the-box. We continuously test our service to ensure optimal performance.
Handling CAPTCHAs depends on the type of CAPTCHA and the ZenRows product you’re using.
CAPTCHAs on forms are not solved automatically. If you need to submit forms that trigger a CAPTCHA, we offer an integration with a CAPTCHA solver that might work for your use case. Learn more about it here: Using JavaScript Instructions to Solve CAPTCHAs
Each ZenRows product has its own approach to handling CAPTCHAs, depending on the level of antibot protection in place. While some products automatically bypass CAPTCHAs in most cases, others may require additional configurations or external solvers. Below, we outline how each product deals with CAPTCHAs and what you can do to improve your success rate.
By choosing the right ZenRows product and implementing the appropriate CAPTCHA-handling techniques, you can minimize interruptions and improve your scraping success rate. If you need assistance with a specific case, feel free to contact our support team.
What is concurrency?
Concurrency refers to the number of ongoing requests that happen at any given time. By different means, computers and languages can call the API in parallel and wait for results while others are still running. You can use concurrency with any ZenRows plan; check out pricing for more details.
For more details, check our how-to guide on concurrency to see details about implementation in Python and JavaScript.
One crucial thing to understand is that canceling requests on the client side does NOT immediately free up concurrency slots. When you cancel a request:
This can lead to unexpected 429
errors if you’re canceling requests and immediately trying to make new ones, as your concurrency limit might still be reached.
ZenRows implements a security system that may temporarily ban your API key if you send too many failing requests in a short period. Types of failing requests that can trigger this include:
429 Too Many Requests
errors due to exceeding concurrency limits400 Bad Request
errors due to invalid parametersIf your API key gets temporarily banned, you’ll receive an error from the API. If the requests continue, the IP address might get banned for a few minutes and the requests will not even connect with the server.
You can monitor your concurrency usage through response headers:
These headers provide valuable information about your request:
The concurrency limit varies by subscription plan:
Enterprise plans can include custom concurrency limits to fit your needs. Contact us for tailor-made Enterprise solutions.
You’ll receive an error, and that request won’t be queued or retried automatically. You’ll need to manage retries on your end, ensuring you don’t exceed your concurrency limit.
Absolutely! We offer various plans with different concurrency limits to suit your needs. If you find yourself frequently hitting the concurrency limit, consider upgrading.
When using the Universal Scraper API, each response includes these helpful headers:
Concurrency-Limit
: Shows your maximum concurrent request limitConcurrency-Remaining
: Shows how many free concurrency slots you have availableWhenever you exceed your plan concurrency limit, you’ll start receiving “429 Too Many Requests” errors. If you keep sending more and more requests exceeding your plan concurrency limit in a short period of time, the service may temporarily block your IP address to prevent API misuse.
The IP address ban will last only a few minutes, but repeatedly being blocked might end in a long-lasting block. Check the concurrency optimization section for more information on how to limit concurrent requests to prevent being blocked.
When contacting ZenRows support for any issues with your requests, always include:
This information, especially the Request ID, allows our support team to quickly locate your specific request in our logs and provide more effective assistance.
What is Geolocation and What are All the Premium Proxy Countries?
Do you charge failed requests using the Universal Scraper API?
Not at all. We only charge for successful requests :)
404 Not Found
and 410 Gone
errors are chargedI need to scrape millions of websites every month. Is it possible?
You can extract data from as many websites as you want. Throw us 1M requests or 50M; we can perfectly handle it!
Do I need to install anything to use the product?
Not at all. Our platform and infrastructure are cloud-based, making our language-agnostic API easy and seamless to use.