Linked Questions

0 votes
0 answers
355 views

Iam new to python and making a simple django app to download videos from youtube.It runs withou any error on local host but on production it throws an error : HTTP Error 429: Too Many Requests I know ...
theDude's user avatar
  • 41
0 votes
0 answers
78 views

I have 2 functions virustotal_apiv3_scan and virustotal_apiv3_get. The first one accepts a list of links, sends a post request to the VirusTotal API to check the link, returns a dictionary key - link, ...
xtronix's user avatar
50 votes
6 answers
116k views

Does urllib2 fetch the whole page when a urlopen call is made? I'd like to just read the HTTP response header without getting the page. It looks like urllib2 opens the HTTP connection and then ...
shigeta's user avatar
  • 1,779
4 votes
1 answer
11k views

I am attempting to submit some data to a form programatically. I'm having a small issue whereby the server is "not liking" what I'm sending it. Frustratingly, there is no error messages, or ...
Zack Yoshyaro's user avatar
8 votes
3 answers
6k views

I'm using overpy to query the Overpass API, and the nature of the data is such that I have a lot of queries to execute. I've run into the 429 OverpassTooManyRequests exception and I'm trying to play ...
Chris M.'s user avatar
  • 312
1 vote
1 answer
11k views

Fist I have to say that I'm quite new to Web scraping with Python. I'm trying to scrape datas using these lines of codes import requests from bs4 import BeautifulSoup baseurl ='https://...
Giorgetto's user avatar
  • 155
2 votes
1 answer
17k views

I'm pulling youtube analytics by youtube bulk reports. https://developers.google.com/youtube/reporting/v1/reports/ Everything works fine accept when we have many users, we encounter <HttpError ...
ittus's user avatar
  • 22.5k
2 votes
1 answer
12k views

I have a java program that searches a site for updates. It checks and than sleeps for a period of time set by user. During some testing I set the sleep time to 0 secs, forgot about it and it over-...
Invader Zim's user avatar
4 votes
2 answers
2k views

Often when I try using BeautifulSoup to parse a web page, I get a None result from the BeautifulSoup function, or else an AttributeError is raised. Here are some self-contained (i.e., no internet ...
Karl Knechtel's user avatar
0 votes
2 answers
1k views

I have a list of user ids and I'm interested in crawling their reputation. I wrote a script using beautifulsoup that crawls users reputation. But the problem is, I get Too many requests error when my ...
nzy's user avatar
  • 864
2 votes
1 answer
2k views

After few tries ... getting following response for google search query as given below. Anybody had solution to this please help? search(query=self.name,tld='com',lang='en',num=100,stop=100,pause=5): ...
user7180655's user avatar
0 votes
0 answers
1k views

I am trying to write a script to access the specific values that are displayed in the following line graph: Ideally, I want to get the last value (43) from the line graph. For that I tried to run the ...
user avatar
0 votes
1 answer
1k views

I'm trying to make several GET requests to an API, in parallel, but I'm getting an error ("Too many requests") when trying to do large volumes of requests (1600 items). The following is a ...
ARK's user avatar
  • 11
1 vote
0 answers
1k views

I've recently discovered this whole world of web scraping and am pretty new to it, but it amazes me. After reading some related stuff, I decided to carry on and create my own project. I wanted ...
thegreenhoodie's user avatar

15 30 50 per page