remove control character whitespaces from dataframe

Question

I have a dataframe df by which I am getting list of list by using this

data = [list(map(str,n.tolist())) for n in df.values]

after that I replace specific control character from data like this

data = [ [e.replace(u'\xa0', u'') for e in tempval ] for tempval in data ]

This works fine but I want this to be done in dataframe itself please suggest something.

jezrael · Accepted Answer · 2016-10-18 10:59:39Z

1

You can use DataFrame.replace:

df = pd.DataFrame({'A':['\xa0','s','w'],
                   'B':['s','w','v'],
                   'C':['e','d','\xa0']})

print (df)
   A  B  C
0     s  e
1  s  w  d
2  w  v

Then for creating list of lists convert DataFrame to numpy array by values and then tolist:

df.replace(u'\xa0',u'', regex=True, inplace=True)
#if need cast all values to str add astype
print (df.astype(str).values.tolist())
[['', 's', 'e'], ['s', 'w', 'd'], ['w', 'v', '']]

answered Oct 18, 2016 at 10:59

jezrael

868k103 gold badges1.4k silver badges1.3k bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

remove control character whitespaces from dataframe

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related