1

I have a scraper made in python2 using requests and beautifulsoup. We do not want to use selenium. Now the website we are scraping has changed its some page. The page is now building the elements on the page using javascript. I want to scrape the page in which the source code is getting generated with javascript - how can this be done?

Improve this question
4
  • Indeed, check this example how to use Beautifulsoup with Selenium. Commented Jun 4, 2021 at 20:19
  • Please use Python3. pythonclock.org Commented Jun 4, 2021 at 20:20
  • @baduker sorry i forgot to mentioned that we are not allow to use selenium. Commented Jun 4, 2021 at 20:26
  • @GulshanKumar, well, that's too bad. :,( Commented Jun 4, 2021 at 20:55
Related questions
5660
How can I access the index value in a 'for' loop?
4484
How can I find the index for a given item in a list?
3983
How do I get the current time in Python?
Load 7 more related questions Show fewer related questions

0

Reset to default

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.