Python BeautifulSoup extract Class Text only if it contains specific text

Question

is there a way to extract the below class if the whole class text = New

 <li class="ClassifiedDetail">New

tried:

doc.find('li', class_ = 'ClassifiedDetail').attrs['New']

maybe something like if class text = New or contains 'New', take it?

doc.find('li', class_ = 'ClassifiedDetail', text="New") may work — Jose Manuel de Frutos
– Jose Manuel de Frutos, Commented Jan 20, 2022 at 15:33
@JoseManueldeFrutos doesn't work, below is the answer why. thank you. — hello543
– hello543, Commented Jan 20, 2022 at 16:02

HedgeHog · Accepted Answer · 2022-01-20 16:14:25Z

1

Note It is not that clear if you mean class or tag, so I assume you mean the text of a tag

One approach could be use of css selectors and :-soup-contains():

soup.select('li.ClassifiedDetail:-soup-contains("New")')

Alternativ is using string=re.compile(), cause stringor in former versionstext` works only for exact matches of full string:

soup.find_all('li', class_ = 'ClassifiedDetail',text=re.compile('New'))

Example

from bs4 import BeautifulSoup

html='''
<li class="ClassifiedDetail">New</li>
<li class="ClassifiedDetail">New York</li>
<li class="ClassifiedDetail">Ne </li>
<li class="ClassifiedDetail">Old</li>
<li class="ClassifiedDetail">knew</li>
'''

soup = BeautifulSoup(html)
for li in soup.select('li.ClassifiedDetail:-soup-contains("New")'):
    print(li.text)

Output

New
New York

edited Jan 20, 2022 at 16:14

answered Jan 20, 2022 at 15:30

HedgeHog

25.4k5 gold badges18 silver badges43 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Python BeautifulSoup extract Class Text only if it contains specific text

1 Answer 1

Example

Output

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Example

Output

Comments

Your Answer

Sign up or log in

Post as a guest

Related