How to parse a xml feed using feed parser python?

Question

Im trying to parse a feed in python using feedparser. But all I get is None returned. Im not sure what im missing. Here is my code:

import feedparser

def rss(self):
    rss = 'https://news.google.com/news?q=fashion&output=rss'
    feed = feedparser.parse(rss)
    for key in feed.entries: 
        return key.title

If you think there is a better rss/xml feed parse. Please let me know. (Im new to python)

print(key) displays none and print(len(feed.entries)) also displays none

print(feed)
{'feed': {}, 'entries': [], 'bozo': 1, 'bozo_exception': URLError(SSLError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:749)'),)}

print(feedparser)
<module 'feedparser' from '/Users/User_name/python-projects/my_env/lib/python3.6/site-packages/feedparser.py'>

You're returning after just one iteration of the loop. Why not return all the keys' titles using a list or a tuple? — Sam Chats
– Sam Chats, Commented Jul 9, 2017 at 13:02
Hi Sam, Even if I do print(key.title) instead of return. It still results in none — kevinabraham
– kevinabraham, Commented Jul 9, 2017 at 13:25
@stovfl updated to include results of print(feed) and print(feedparser) — kevinabraham
– kevinabraham, Commented Jul 10, 2017 at 10:57

kevinabraham · Accepted Answer · 2017-07-10 11:06:20Z

1

Figured out the issue was actually with the SSL handshake fixed it by adding ssl._create_default_https_context = ssl._create_unverified_context.

For anyone else facing the issue. Full code is:

import feedparser
import ssl
if hasattr(ssl, '_create_unverified_context'):
    ssl._create_default_https_context = ssl._create_unverified_context
rss = 'https://news.google.com/news?q=fashion&output=rss'
feed = feedparser.parse(rss)

print(feed)

answered Jul 10, 2017 at 11:06

kevinabraham

1,4374 gold badges31 silver badges56 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

stovfl Over a year ago

Doing so, will allow anyone with a privileged network position is able to trivially execute a man in the middle attack against a Python application using either of these HTTP clients, and change traffic at will. Enabling certificate verification by default for stdlib http clients

kevinabraham Over a year ago

@stovfl oh right. Would it be better to use create_default_context instead of _create_unverified_context?

stovfl Over a year ago

Neither the first nor the second. I would go to install Certificates using pip install urllib3[secure], read about Section: Certificate verification

Gedeon Mutshipayi · Accepted Answer · 2022-04-18 03:05:41Z

1

Try the following basic code, which works fine for me and gave me 10 items in the feed when I ran it.

Install feedparser from pip

pip install feedparser

Usage

import urllib2
import feedparser

url = "https://news.google.com/news?q=fashion&output=rss"
response = urllib2.urlopen(url).read()

print response

d = feedparser.parse(response)
print len(d.entries)
for item in d.entries:
    print "------"
    print item.title
    if 'subtitle' in item:
        print item.subtitle
    print item.link
    print item.description
    print item.published
    print item.id
    print item.updated
    if 'content' in item:
        print item.content

Or, paste the FULL code you're running, and I'll take a look.

edited Apr 18, 2022 at 3:05

Gedeon Mutshipayi

4,1613 gold badges33 silver badges49 bronze badges

answered Jul 10, 2017 at 10:29

AS Mackay

2,8559 gold badges21 silver badges27 bronze badges

2 Comments

AS Mackay Over a year ago

@kevinabraham I think that means you're simply unable to read data from the feed, it's not a Python coding issue. Do you see data if you try that URL direct from a web browser?

kevinabraham Over a year ago

Yes I can. When I go directly in the link it shows text <rss version="2.0"><channel><generator>NFE/1.0</generator><title>fashion - Google News</title>......

Collectives™ on Stack Overflow

How to parse a xml feed using feed parser python?

2 Answers 2

3 Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

3 Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related