Find value of input field in html doc using python

Question

I am trying to get input values from an HTML doc and want to parse out the values of hidden input fields. For example how can I parse out only the value from the snippet below, using python.

    <input type="hidden" autocomplete="off" id="post_form_id" name="post_form_id" value="d619a1eb3becdc05a3ebea530396782f" />
    <input type="hidden" name="fb_dtsg" value="AQCYsohu" autocomplete="off" />

And the output of the python function should return something like:

post_form_id : d619a1eb3becdc05a3ebea530396782f
fb_dtsg : AQCYsohu

Check this beautiful answer here -stackoverflow.com/a/11205758/609782 — Darpan
– Darpan, Commented Aug 4, 2016 at 13:33

jterrace · Accepted Answer · 2011-09-19 16:34:48Z

7

You could use BeautifulSoup:

>>> htmlstr = """    <input type="hidden" autocomplete="off" id="post_form_id" name="post_form_id" value="d619a1eb3becdc05a3ebea530396782f" />
...     <input type="hidden" name="fb_dtsg" value="AQCYsohu" autocomplete="off" />"""
>>> from BeautifulSoup import BeautifulSoup
>>> soup = BeautifulSoup(htmlstr)
>>> [(n['name'], n['value']) for n in soup.findAll('input')]
[(u'post_form_id', u'd619a1eb3becdc05a3ebea530396782f'), (u'fb_dtsg', u'AQCYsohu')]

answered Sep 19, 2011 at 16:34

jterrace

67.5k24 gold badges164 silver badges208 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Vlad Over a year ago

Thanks for suggesting BeautifulSoup, this is even better than what I was looking for.

Acorn · Accepted Answer · 2011-09-19 17:25:15Z

3

Or with lxml:

import lxml.html

htmlstr = '''
    <input type="hidden" autocomplete="off" id="post_form_id" name="post_form_id" value="d619a1eb3becdc05a3ebea530396782f" />
    <input type="hidden" name="fb_dtsg" value="AQCYsohu" autocomplete="off" />
'''

// Parse the string and turn it into a tree of elements
htmltree = lxml.html.fromstring(htmlstr)

// Iterate over each input element in the tree and print the relevant attributes
for input_el in htmltree.xpath('//input'):
    name = input_el.attrib['name']
    value = input_el.attrib['value']

    print "%s : %s" % (name, value)

Gives:

post_form_id : d619a1eb3becdc05a3ebea530396782f
fb_dtsg : AQCYsohu

edited Sep 19, 2011 at 17:25

answered Sep 19, 2011 at 17:16

Acorn

50.8k30 gold badges143 silver badges180 bronze badges

Collectives™ on Stack Overflow

Find value of input field in html doc using python

2 Answers 2

1 Comment

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related