extracting values from html table using beautifulsoup4 (2nd row onwards, 1st and 6th column)

Question

I am new to python and need some guidance on extracting values from specific cells from a HTML table.

The URL that I am working on can be found here

I am looking to get the first 5 values only in the Month and Settlement columns and subsequently display them as:

"MAR 14:426'6"

Problem that I am facing is:

How do I get the loop to start from the 3rd "TR" in the table
How to get only values for td[0] and td[6].
How to restrict the loop to only retrieve values for 5 rows

This is the code that I am working on:

tableData = soup1.find("table", id="DailySettlementTable")
for rows in tableData.findAll('tr'):
    month = rows.find('td')
    print month

Thank you and appreciate any form of guidance!

It may be cleaner and easier to extract all data into a list of lists, and then get the fields you want. It's not as performant, of course, but you probably don't need to worry about that just yet, especially since you're new to python — loopbackbee
– loopbackbee, Commented Dec 18, 2013 at 17:19

Chris · Accepted Answer · 2013-12-18 17:33:01Z

1

You probably want to use slicing.

Here's a modified snippet for your code:

table = soup.find('table', id='DailySettlementTable')

# The slice notation below, [2:7], says to take the third (index 2)
# to the eighth (index 7) values from the rows we get.
for rows in table.find_all('tr')[2:7]:
    cells = rows.find_all('td')
    month = cells[0]
    settle = cells[6]

    print month.string + ':' + settle.string

answered Dec 18, 2013 at 17:33

Chris

139k139 gold badges316 silver badges293 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

extracting values from html table using beautifulsoup4 (2nd row onwards, 1st and 6th column)

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related