How to delete very close values to a numpy array?

Question

I have a numpy array which looks like this

array([ 1219,  1220,  2215,  2216,  3459,  3460,  4686,  4687,  5920,
        5921,  7200,  7201,  8498,  8499,  9834,  9835, 10046, 11138,
       11139, 12520, 12521, 12522, 13812, 13813, 14033, 15099, 15100,
       16375, 16376, 17576, 17577, 18634, 18635, 19849, 19850])

And I want to delete the elements which are very close. For example I don't want both 2215 and 2216, I want to keep only the first one 2215. Or for the 4686 and 4687, I want to keep only 4686. How can I do it using only numpy commands?

Yang Yushi · Accepted Answer · 2021-01-26 16:27:42Z

1

One solution I came up with is to calculate the difference of the array, and remove those whose forward difference values are small. Taking advantage of the fact that your array is sorted, the following code works for me.

import numpy as np

arr = np.array([ 1219,  1220,  2215,  2216,  3459,  3460,  4686,  4687,  5920,
    5921,  7200,  7201,  8498,  8499,  9834,  9835, 10046, 11138,
    11139, 12520, 12521, 12522, 13812, 13813, 14033, 15099, 15100,
    16375, 16376, 17576, 17577, 18634, 18635, 19849, 19850])

threshold = 1
diff = np.empty(arr.shape)
diff[0] = np.inf  # always retain the 1st element
diff[1:] = np.diff(arr)
mask = diff > threshold

new_arr = arr[mask]

print(new_arr)

You can adjust the threshold value to play with different levels of tolerance.

answered Jan 26, 2021 at 16:27

Yang Yushi

7554 silver badges22 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

CyberMathIdiot Over a year ago

Thank you very much my friend!

Collectives™ on Stack Overflow

How to delete very close values to a numpy array?

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related