Python Pandas Geopy AttributeError 'NoneType' object has no attribute 'raw' , getting city, state and country from long/lat

Question

I've looked around for a solution and tried filtering my df to where the longitude and latitude are not null but to no avail. This is my first time using geopy package so maybe my error is stemming from that. I have a df that includes long/lat coords and I'm trying to attach city, state and country to each observation. When I limit my df to just the first 10 rows my code works like a charm. When I apply it to the whole df(34,556 observations) I get this error code: 'NoneType' object has no attribute 'raw'.


from geopy.geocoders import Nominatim

geolocator = Nominatim(user_agent="geoapiExercises")

df_power_org = pd.read_csv('global_power_plant_database.csv', low_memory=False)

df_power_org = df_power_org[df_power_org.longitude.notnull()]
df_power_org = df_power_org[df_power_org.latitude.notnull()]

def city_state_country(row):
    coord = f"{row['latitude']}, {row['longitude']}"
    location = geolocator.reverse(coord, exactly_one=True, language='en')
    address = location.raw['address']
    city = address.get('city', '')
    state = address.get('state', '')
    country = address.get('country', '')
    row['city'] = city
    row['state'] = state
    row['country2'] = country
    return row

df_power_org = df_power_org.apply(city_state_country, axis=1)

Any advice is deeply appreciated.

I'm using geolocator, I realize I should add that code chunk to the initial post. I'll update that now. — bjohnson894
– bjohnson894, Commented Apr 22, 2022 at 21:24

BeRT2me · Accepted Answer · 2022-04-25 16:24:40Z

2

From geopy's documentation:

Nominatim is free, but provides low request limits.

Digging a little deaper, Nominatim's site states:

No heavy uses (an absolute maximum of 1 request per second).

It's likely that you're being blocked by Nominatim for excessive requests.

If you want to use Nominatim and follow their instructions, you can modify your code to pause after each request... this will take about 10 hours to do all 34k requests.

from geopy.geocoders import Nominatim
from time import sleep

geolocator = Nominatim(user_agent="geoapiExercises")

df_power_org = pd.read_csv('global_power_plant_database.csv', low_memory=False)

df_power_org = df_power_org[df_power_org.longitude.notnull()]
df_power_org = df_power_org[df_power_org.latitude.notnull()]

def city_state_country(row):
    coord = f"{row['latitude']}, {row['longitude']}"
    sleep(1)
    location = geolocator.reverse(coord, exactly_one=True, language='en')
    if not location:
        # if you see many in a row, it's probably Nominatim blocking you.
        # if it's just every once in a while, there were just some bad results. 
        print('Failed with coord: ', coord)
        row['city'], row['state'], row['country2'] = None, None, None
        return row
    address = location.raw['address']
    city = address.get('city', '')
    state = address.get('state', '')
    country = address.get('country', '')
    row['city'] = city
    row['state'] = state
    row['country2'] = country
    return row

df_power_org = df_power_org.apply(city_state_country, axis=1)

edited Apr 25, 2022 at 16:24

answered Apr 22, 2022 at 22:16

BeRT2me

13.3k2 gold badges18 silver badges39 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

BeRT2me Over a year ago

If this is intended at all for a commercial service, please consider using a paid service. My suggestion, having used it before for this purpose, would be to use GoogleV3. 40k reverse requests costs $200, and you get $200 a month in free requests, so you can do the whole dataset for free.

bjohnson894 Over a year ago

Thank you for that detail on the request limit. I attempted running it with the edit suggested, but after approximately 10 minutes it returned the same error code.

BeRT2me Over a year ago

In that case, it may be working properly, but one of your lat/long pairs returns None when reverse geolocated. I'll edit my code with a suggested work around~

Collectives™ on Stack Overflow

Python Pandas Geopy AttributeError 'NoneType' object has no attribute 'raw' , getting city, state and country from long/lat

1 Answer 1

3 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Related