SettingWithCopyWarning in Pandas DataFrame using Python

Question

My task is to drop all rows containing NaNs and encode all the categorical variables inside of data.

I wrote a function that looks like

def preprocess_data(data):

    data = data.dropna()
    le = LabelEncoder()
    data['car name'] = le.fit_transform(data['car name'])

    return data

which takes a dataframe and returns a processed data. Running this function gives me a warning that says:

SettingWithCopyWarning: 
A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

I don't quite get which part of my code is causing this and how to fix it.

What are you passing to preprocess_data?

Andrew L
– Andrew L

2018-01-19 21:32:04 +00:00
Commented Jan 19, 2018 at 21:32 — Andrew L
– Andrew L, Commented Jan 19, 2018 at 21:32

Guillermo Soto Gómez · Accepted Answer · 2020-06-04 20:34:41Z

1

Make sure you tell pandas that data it is its own data frame (and not a slice) by using:

def preprocess_data(data):

    data = data.dropna().copy()
    le = LabelEncoder()
    data['car name'] = le.fit_transform(data['car name'])

    return data

A more detailed explanation here: https://github.com/pandas-dev/pandas/issues/17476

answered Jun 4, 2020 at 20:34

Guillermo Soto Gómez

4294 silver badges7 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Romain · Accepted Answer · 2018-01-19 20:55:00Z

0

Maybe you should give more information and / or the problem is not in the method. The following code does not produce warning.

def preprocess_data(data):

    data = data.dropna()
    le = preprocessing.LabelEncoder()
    data['car name'] = le.fit_transform(data['car name'])
    return data


preprocess_data(pd.DataFrame({'car name': ['nissan', 'dacia'], 'car mode': ['juke', 'logan']}))

#   car mode  car name
# 0     juke         1
# 1    logan         0

answered Jan 19, 2018 at 20:55

Romain

22.2k6 gold badges63 silver badges77 bronze badges

Collectives™ on Stack Overflow

SettingWithCopyWarning in Pandas DataFrame using Python

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related