How to Set Up Proxies with WebHarvy (Configuration Tutorial)

Web scraping without proxies exposes your real IP address to the target sites. This can quickly lead to IP blocks, captchas and scraping failures. Proxies are essential to scale web scraping successfully while avoiding detection.

WebHarvy is a popular Windows web scraper that works great with residential proxies. This comprehensive guide covers integrating top proxy brands like BrightData, Smartproxy, Proxy Seller and Soax into WebHarvy.

Risks of Scraping Without Proxies

Scraping sites directly can cause numerous problems:

  • IP Blocks – Sites easily detect and block your real IP if you scrape excessively. This leads to scraping failures.
  • Captchas – After a few requests, sites will present CAPTCHA challenges to detect bots. Proxies help avoid captchas.
  • Rate Limiting – Many sites limit anonymous traffic to a certain requests per minute. Proxies provide additional IP addresses to scale past rate limits.
  • Poor Results – Direct scraping fails to mimic human browsing patterns. Sites may serve bot-deterrent content.

Residential proxies simulate real users browsing from home connections. Using proxies with WebHarvy is a must for successful large-scale scraping.

This guide covers integrating leading proxy providers like BrightData, Smartproxy, Proxy Seller and Soax into WebHarvy on Windows. With the correct setup, you can leverage proxies to scrape sites undetected.


Before starting, make sure you have:

Configuring Proxies in WebHarvy

Enabling and configuring proxies in WebHarvy is simple:

  1. Open WebHarvy and go to Settings > Proxy Settings

  2. Check the “Enable network connection via Proxy Server” option

  3. Select the proxy protocol – HTTP, SOCKS4, SOCKS5

  4. Enter your proxy provider credentials:

    • Address: Hostname of the proxy server
    • Port: Port number of the proxy
    • Username: Your proxy username
    • Password: Your proxy password
  5. Click the “+” icon to add the proxy credentials

  6. Click “Apply” to save the proxy configuration

Test connectivity by inspecting network requests in the browser. Ensure all traffic routes through your proxies.

Setting up Different Proxy Providers

WebHarvy works well with all major proxy brands. Here are examples for the top providers:



Port: 8080

Username: bdf93j2k3

Password: px329dkPC

Protocol: HTTP



Port: 10000

Username: sp93j2k3

Password: px329dkPC

Protocol: SOCKS5

Proxy Seller


Port: 30001

Username: ps93j2k3

Password: px329dkPC

Protocol: SOCKS4



Port: 2080

Username: soax93j2k3

Password: px329dkPC

Protocol: HTTP

You can add multiple proxies to WebHarvy's configuration for additional IP rotation.

Advanced Proxy Techniques

Rotating Proxies

To maximize IP usage, rotate your proxies with each request:

// Load proxy list
const proxies = ['proxy1', 'proxy2', 'proxy3'] 

// Rotate proxy randomly
const proxy = proxies[Math.floor(Math.random() * proxies.length)]

// New request uses different proxy
request(url, {proxy})

Integrate a proxy API to dynamically generate the proxies list.

Debugging Proxies

Inspect browser network logs and WebHarvy logs to troubleshoot proxies:

[DEBUG] Proxy error: Connection refused 
[INFO] Rotating proxy for retry...

Check for connection issues, authentication failures, timeouts, bans etc.

Custom Proxy Chains

Chain multiple proxies together for added anonymity:

proxyChain = ['proxy1', 'proxy2', 'proxy3']

WebHarvy will route each request through the chained proxies.

Troubleshooting Common Proxy Issues

Authentication errorDouble check username and password credentials
Connection refusedVerify proxy hostname and port
SOCKS protocol errorTry switching to HTTP or SOCKS5 proxies
CaptchasReduce scraping frequency and improve proxy rotation
BansContact your provider for new IP allocation
High latencyReduce distance between proxy servers and your target sites

Be sure to closely monitor your proxies for any usage spikes, blocks or errors. Quickly rotate IPs and avoid potential bans.

Scraping Sites Anonymously

Once configured, proxies allow you to scrape sites with WebHarvy undetected:

  1. Set up proxies as shown above
  2. Start new WebHarvy scraping job
  3. Navigate to target site
  4. Highlight and select elements to extract
  5. Name data fields appropriately
  6. Stop selecting and click “Start Scraping”
  7. Export extracted data as CSV, Excel etc.

WebHarvy will route all traffic through your proxies, avoiding blocks and captchas. Monitor utilization to optimize performance.


This guide covered integrating top residential proxy providers with WebHarvy scraper on Windows. With the correct credentials and setup, you can leverage thousands of IPs to scrape data undetected at scale. Proxies are crucial for successful large-scale web scraping.

John Rooney

John Rooney

John Watson Rooney, a self-taught Python developer and content creator with a focus on web scraping, APIs, and automation. I love sharing my knowledge and expertise through my YouTube channel, My channel caters to all levels of developers, from beginners looking to get started in web scraping to experienced programmers seeking to advance their skills with modern techniques. I have worked in the e-commerce sector for many years, gaining extensive real-world experience in data handling, API integrations, and project management. I am passionate about teaching others and simplifying complex concepts to make them more accessible to a wider audience. In addition to my YouTube channel, I also maintain a personal website where I share my coding projects and other related content.

We will be happy to hear your thoughts

      Leave a reply

      Compare items
      • Total (0)