Pandas keyerror while dropping value from a column

Question

I am a beginner in Python and getting an error while trying to drop values from a column in pandas dataframe. I keep getting Keyerror after sometime. Here is the code snippet:

for i in data['FilePath'].keys():
if '.' not in data['FilePath'][i]:
    value = data['FilePath'][i]
    data = data[data['FilePath'] != value]

I keep getting Keyerror near the line "if '.' not in data['FilePath'][i]". Please help me fix this error

FilePath BytesAccessed DateTime 0 /lib/x86_64-linux-gnu/libtinfo.so.5 832.0 [28/Jun/2018:11:53:09] — phoenix
– phoenix, Commented Nov 4, 2018 at 15:32
@nimrodz I have added the sample data. The columns are FilePAth, BytesAccessed and DateTime — phoenix
– phoenix, Commented Nov 4, 2018 at 15:33

edesz · Accepted Answer · 2018-11-04 20:39:28Z

0

If I understand your logic correctly, then you should be be able to do this without a loop. From what I can see, it looks like you want to drop rows if the FilePath column does not begin with .. If this is correct, then below is one way to do this:

Create sample data using nested list

d = [
    ['BytesAccessed','FilePath','DateTime'],
    [0, '/lib/x86_64-linux-gnu/libtinfo.so.5 832.0', '[28/Jun/2018:11:53:09]'], 
    [1, './lib/x86-linux-gnu/yourtext.so.6 932.0', '[28/Jun/2018:11:53:09]'],
    [2, '/lib/x86_64-linux-gnu/mytes0', '[28/Jun/2018:11:53:09]'],
    ]
data = pd.DataFrame(d[1:], columns=d[0])
print(data)

   BytesAccessed                                   FilePath                DateTime
0              0  /lib/x86_64-linux-gnu/libtinfo.so.5 832.0  [28/Jun/2018:11:53:09]
1              1    ./lib/x86-linux-gnu/yourtext.so.6 932.0  [28/Jun/2018:11:53:09]
2              2               /lib/x86_64-linux-gnu/mytes0  [28/Jun/2018:11:53:09]

Filtered data to drop rows that do not contain . at any location in the FilePath column

data_filtered = (data.set_index('FilePath')
                    .filter(like='.', axis=0)
                    .reset_index())[data.columns]
print(data_filtered)

   BytesAccessed                                   FilePath                DateTime
0              0  /lib/x86_64-linux-gnu/libtinfo.so.5 832.0  [28/Jun/2018:11:53:09]
1              1    ./lib/x86-linux-gnu/yourtext.so.6 932.0  [28/Jun/2018:11:53:09]

edited Nov 4, 2018 at 20:39

answered Nov 4, 2018 at 17:56

edesz

12.5k24 gold badges87 silver badges130 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

phoenix Over a year ago

Thanks @W R for this option. I am looking if FilePath contains '.' because there are many entries which doesn't contain any '.'

edesz Over a year ago

Ok, thanks for the additional info. I've modified the sample data to intentionally contain one row (3rd row) that does not contain any .. I also changed the pandas filter to return any rows that contain a ..

phoenix Over a year ago

Thank you so much @W R! This works great. I had no idea that I could use an option like 'filter'.

Collectives™ on Stack Overflow

Pandas keyerror while dropping value from a column

1 Answer 1

3 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related