Pandas Drop Duplicates To CSV

Question

I have the following code:

import pandas as pd

df = pd.read_csv('/home/test/cities.csv')

dupes = df.drop_duplicates(subset=['latitude', 'longitude'], keep=False)

dupes.to_csv('/home/test/results.csv')

I want to drop all records with duplicate latitude and longitude information.

The output CSV file contains all the non-duplicated records.

Any suggestions on how to extract all the duplicate records?

piRSquared · Accepted Answer · 2018-09-20 19:09:49Z

4

`duplicated`

The sister method to drop_duplicates

these_are_the_dupes = df[df.duplicated(subset=['latitude', 'longitude'], keep=False)]

edited Sep 20, 2018 at 19:09

answered Sep 20, 2018 at 19:00

piRSquared

296k68 gold badges509 silver badges654 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Pandas Drop Duplicates To CSV

1 Answer 1

`duplicated`

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related