Web Scrapping dynamic content with Python

Question

I would simply like to get the Open Price of a stock with BeautifulSoup or Selenium is okay but i keep getting just the html tag for it and not the actually price i want

# <div class="tv-fundamental-block__value js-symbol-open">33931.0</div>
import requests
from bs4 import BeautifulSoup

url = requests.get('https://www.tradingview.com/symbols/PEPPERSTONE-US30/')
response = url.content

soup = BeautifulSoup(response, 'html.parser')
# print(soup.prettify())
open = soup.find('div', {'class': 'js-symbol-open'})
print(open)

The 33931.0 is the price id like to see in my terminal but i still dont get it

Using selenium ive only gotten the page i already know where i am getting the data from.

kincaid · Accepted Answer · 2023-01-29 09:51:29Z

1

To extract the text content of the element using BeautifulSoup, use the .text property of the element:

open = soup.find('div', {'class': 'js-symbol-open'}).text
print(open)

In selenium:

from selenium import webdriver

driver = webdriver.Firefox()
driver.get('https://www.tradingview.com/symbols/PEPPERSTONE-US30/')

open_price = driver.find_element_by_css_selector('.js-symbol-open').text
print(open_price)

driver.quit()

answered Jan 29, 2023 at 9:51

kincaid

9291 gold badge7 silver badges19 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Jurakin Over a year ago

driver.find_element_by_css_selector('.js-symbol-open') is deprecated in selenium4, use newer syntax from selenium.webdriver.common.by import By; driver.find_element(By.CSS_SELECTOR, '.js-symbol-open')

Teddy Over a year ago

I get this <selenium.webdriver.remote.webelement.WebElement (session="25b611aedf0c9a709503a4c6d6f8814d", element="1ecd6c18-aece-4d8f-94a7-dcb151410b7e")> in the console

Collectives™ on Stack Overflow

Web Scrapping dynamic content with Python

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related