Understanding class methods in Python code

Question

I know very little about Python. But I was trying to achieve something in Extract, Transform and Load (ETL) using a small Python scrip. I get the desired result, but still want to understand this script.

from bs4 import BeautifulSoup
import urllib
import re
import string
import csv
urlHandle = urllib.urlopen("http://finance.yahoo.com/q/cp?s=^DJI")
html = urlHandle.read()
soup = BeautifulSoup(html)
table = soup.find('table', attrs = {
    'id': 'yfncsumtab'
})
rows = table.findAll('tr')

a = ''
csvfile = open("F:/data/yahoofinance.csv", 'w')
for tr in rows[5: ]:
    for td in tr.find_all('td', attrs = {
        'class': 'yfnc_tabledata1'
    }):
    a += '"' + td.get_text() + '",'
a += '\n'
csvfile.write(a)
a = '

My questions are in this code, soup is an object returned from BeautifulSoup(html) function. Am I right? So in next statement I guess table is also an object, so that means we are searching for a value in the soup object using the find function and that it's returning an object?

Please correct me on my information I have understood myself in the above code...

urlHandle is a class, urllib is what? and urlopen is a static method.
html is an object, urlhandle is a class, read is a method.
soup is an object, BeautifulSoup(html) is a function.

Please give your feedback on my understanding....and correct me where am wrong with your experienced words!

Jesse Bakker · Accepted Answer · 2016-03-27 13:52:34Z

1

urlHandle is an object, urllib is a module and urlopen is a function
html is an object and read is a method
soup is an object and BeatifulSoup(html) is the constructor for a BeautifulSoup object

It can be quite confusing, but in general you can keep in mind that CamelCased names are classes, which makes CamelCase() the constructor. What you import is a module, which can contain classes and/or functions.

answered Mar 27, 2016 at 13:52

Jesse Bakker

2,65316 silver badges26 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Kate Over a year ago

Jesse Bakker, Thanks !! One more question what is happening in table = soup.find('table', attrs = {'id': 'yfncsumtab') . Here table in an object ? If yes SO is it created while finding using find function in soup object ?

Jesse Bakker Over a year ago

Yes, soup.find finds the table and then creates an object wrapping the html.

Matt Messersmith · Accepted Answer · 2016-03-27 13:53:54Z

1

To be technical, I think it's important to understand that EVERYTHING in Python is an object. So, classes are objects, functions are objects, everything is an object.

That being said, we make distinctions after that, such as "function", "class", etc.

urllib, in particular, is something we call a module.

answered Mar 27, 2016 at 13:53

Matt Messersmith

13.9k8 gold badges54 silver badges57 bronze badges

Comments

formatkaka · Accepted Answer · 2016-03-27 13:57:49Z

1

soup is an instance of the BeautifulSoup .
urlHandle is again instance , urllib is a module and urlopen is a function belonging to this module
html is object and read is a method which is executed.

There is a way you can find out them yourself using the type() function.

answered Mar 27, 2016 at 13:57

formatkaka

1,3784 gold badges13 silver badges27 bronze badges

Comments

Alg_D · Accepted Answer · 2016-03-27 14:02:48Z

0

In Python basically everything is an Object! when you use import, you are including a certain module like urllib.

things like soup = BeautifulSoup(html) means that you create an instance (also an object) of a class BeautifulSoup module, that you initiate/construct passing the html object.

then things like soup.find(... are functions that use the instance of a class to do a certain job. In this case get the first HTML table that has the attribute id with the value 'yfncsumtab'. it returs a Beautifult tag/obj.

answered Mar 27, 2016 at 14:02

Alg_D

2,4307 gold badges37 silver badges68 bronze badges

Collectives™ on Stack Overflow

Understanding class methods in Python code

4 Answers 4

2 Comments

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

2 Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related