HTTP error 408 in scraping

How to solve the error 408 in Data Scraping Studio, which appears all the time and prevents me from scraping a website?

Posted by Michael Pascual 10 months ago


HTTP error 408 tells you that request is timing out and by default time out configuration is 6 seconds. If any website didn't responds in 6 seconds then either their server is too slow or may be your network as well.

[Error] HTTP ERROR :: 408 : Request Timeout

To resolve this, you can increase the timeout of any scraping agent by following the steps below.

  • Edit the agent
  • Go to Advance Setting
  • Click on Headers tab
  • Go to Connections section and change the timeout to something more then 6 seconds(screenshot below)

scraping time out

Posted by anonymous 10 months ago


weird, I asked about error 301 and the forum post become 408.

 

Anyways, it was just about the site wanting to have a cookie on http request and fix the problem.

 

Thanks for the help

Posted by Michael Pascual 10 months ago


Applogies, the question was moved here : https://www.datascraping.co/doc/questions/173/how-to-deal-with-error-301-in-scraping

Posted by anonymous 10 months ago

Topic Closed! This question is closed and don't accept posts now.

Close me