ValueError converting to string after Splitlines()

Question

I'm trying to take some data from an online CSV file and make a table from it. I use splitlines() to isolate each bit of data but I keep getting a ValueError:

ValueError: invalid literal for int() with base 10: 'Year'

Here is my code:

import csv
import urllib.request

url = "https://raw.github.com/datasets/gdp/master/data/gdp.csv"
webpage = urllib.request.urlopen(url)
datareader = csv.reader(webpage.read().decode('utf-8').splitlines())
dataList = []
NewTable = []
print('done')
for row in datareader:
    ##print(row)
    countryName, countryCode, Year, Value= row
    print(Year)
    Year = int(Year)
    ##Value = float(Value)
    rowTuple = countryName, countryCode, Year, Value
    dataList.append(rowTuple)

When I uncomment "print(Year)" I get a list of integers. All numbers between 1960-2012 and I can't figure out why it won't accept the conversion from string to integer.

Any ideas?

Martijn Pieters · Accepted Answer · 2014-02-10 16:26:23Z

2

Your first row in the CSV is a header row, not a data row:

Country Name,Country Code,Year,Value

Skip it with:

datareader = csv.reader(webpage.read().decode('utf-8').splitlines())
next(datareader, None)  # skip the header

You could use the io.TextIOWrapper() object to have the webpage decoded from UTF-8 for you:

import io

webpage = urllib.request.urlopen(url)
datareader = csv.reader(io.TextIOWrapper(webpage, 'utf-8'))
next(datareader, None)  # skip the header

answered Feb 10, 2014 at 16:26

Martijn Pieters

1.1m326 gold badges4.2k silver badges3.4k bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Cilyan Over a year ago

You could suggest using DictReader too.

Collectives™ on Stack Overflow

ValueError converting to string after Splitlines()

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related