Extract Text from Varied HTML using Python

Question

Let's say you have a varied HTML block like this:

<div class="container">
  <div class="sub-container">
    <a href="example.com">Blue</a>
  </div>
  Black
  </br>
  <div class="sub-container">
    <a href="example.com">Yellow</a>
  </div>
  <div class="sub-container">
    <a href="example.com">Pink</a>
  </div>
  Orange
  </br>
</div>

What would your approach be, using python, to extract the colours from this HTML block?

Perhaps the downvoter (not me) thinks that you should explain what the problem is and what your own approach is. — mzjn
– mzjn, Commented Jun 29, 2018 at 5:05

Rakesh · Accepted Answer · 2018-06-29 05:14:32Z

2

You can use .text to get all the colors from your sample html.

Ex:

from bs4 import BeautifulSoup
s = """<div class="container">
  <div class="sub-container">
    <a href="example.com">Blue</a>
  </div>
  Black
  </br>
  <div class="sub-container">
    <a href="example.com">Yellow</a>
  </div>
  <div class="sub-container">
    <a href="example.com">Pink</a>
  </div>
  Orange
  </br>
</div>"""
soup = BeautifulSoup(s, "html.parser")
print(soup.text.strip().replace(" ", ""))

Output:

Blue

Black


Yellow


Pink

Orange

answered Jun 29, 2018 at 5:14

Rakesh

82.9k17 gold badges86 silver badges122 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

C.Holloway · Accepted Answer · 2018-06-29 04:59:50Z

0

To extract a tag in html with regex, you might want to try this:

<(\w+)[\s\w\d=\-+\.]*>(.*)</\1\s*>

And then use group 2 to find everything inside of that tag. You could also change the start of the regex to:

<(a) (etc...)

And that will only match a tags.

answered Jun 29, 2018 at 4:59

C.Holloway

114 bronze badges

Collectives™ on Stack Overflow

Extract Text from Varied HTML using Python

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related