Removing unwanted characters from a string in Python

Question

I have some strings that I want to delete some unwanted characters from them. For example: Adam'sApple ----> AdamsApple.(case insensitive) Can someone help me, I need the fastest way to do it, cause I have a couple of millions of records that have to be polished. Thanks

Could you be more specific? Which exact characters do you want removed? — Syntactic
– Syntactic, Commented May 6, 2010 at 12:06

miku · Accepted Answer · 2010-05-06 12:09:29Z

6

One simple way:

>>> s = "Adam'sApple"
>>> x = s.replace("'", "")
>>> print x
'AdamsApple'

... or take a look at regex substitutions.

answered May 6, 2010 at 12:09

miku

189k47 gold badges314 silver badges317 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Pescolly · Accepted Answer · 2014-09-18 22:41:16Z

Here is a function that removes all the irritating ascii characters, the only exception is "&" which is replaced with "and". I use it to police a filesystem and ensure that all of the files adhere to the file naming scheme I insist everyone uses.

def cleanString(incomingString):
    newstring = incomingString
    newstring = newstring.replace("!","")
    newstring = newstring.replace("@","")
    newstring = newstring.replace("#","")
    newstring = newstring.replace("$","")
    newstring = newstring.replace("%","")
    newstring = newstring.replace("^","")
    newstring = newstring.replace("&","and")
    newstring = newstring.replace("*","")
    newstring = newstring.replace("(","")
    newstring = newstring.replace(")","")
    newstring = newstring.replace("+","")
    newstring = newstring.replace("=","")
    newstring = newstring.replace("?","")
    newstring = newstring.replace("\'","")
    newstring = newstring.replace("\"","")
    newstring = newstring.replace("{","")
    newstring = newstring.replace("}","")
    newstring = newstring.replace("[","")
    newstring = newstring.replace("]","")
    newstring = newstring.replace("<","")
    newstring = newstring.replace(">","")
    newstring = newstring.replace("~","")
    newstring = newstring.replace("`","")
    newstring = newstring.replace(":","")
    newstring = newstring.replace(";","")
    newstring = newstring.replace("|","")
    newstring = newstring.replace("\\","")
    newstring = newstring.replace("/","")        
    return newstring

It was before I got into regular expressions, basically the code equivalent of my embarassing goth phase. Although, it does allow the untrained to make modifications, which is pretty much a necessity at my work.

Mark Tolonen · Accepted Answer · 2010-05-06 14:31:23Z

5

Any characters in the 2nd argument of the translate method are deleted:

>>> "Adam's Apple!".translate(None,"'!")
'Adams Apple'

NOTE: translate requires Python 2.6 or later to use None for the first argument, which otherwise must be a translation string of length 256. string.maketrans('','') can be used in place of None for pre-2.6 versions.

edited May 6, 2010 at 14:31

answered May 6, 2010 at 14:20

Mark Tolonen

181k26 gold badges182 silver badges278 bronze badges

2 Comments

jfs Over a year ago

I might be helpful to explicitly mention string.maketrans('', '') as a substitute for None for Python < 2.6

badp Over a year ago

Six times faster than "".join(char for char in text if char not in bad_chars) :)

dlamotte · Accepted Answer · 2010-05-06 12:09:36Z

2

Try:

"Adam'sApple".replace("'", '')

One step further, to replace multiple characters with nothing:

import re
print re.sub(r'''['"x]''', '', '''a'"xb''')

Yields:

ab

answered May 6, 2010 at 12:09

dlamotte

6,4054 gold badges34 silver badges40 bronze badges

Comments

Delan Azabani · Accepted Answer · 2010-05-06 12:10:12Z

1

str.replace("'","");

answered May 6, 2010 at 12:10

Delan Azabani

81.8k30 gold badges174 silver badges214 bronze badges

Comments

Esteban Küber · Accepted Answer · 2010-05-06 16:09:16Z

1

As has been pointed out several times now, you have to either use replace or regular expressions (most likely you don't need regexes though), but if you also have to make sure that the resulting string is plain ASCII (doesn't contain funky characters like é, ò, µ, æ or φ), you could finally do

>>> u'(like é, ò, µ, æ or φ)'.encode('ascii', 'ignore')
'(like , , ,  or )'

answered May 6, 2010 at 16:09

Esteban Küber

37k15 gold badges82 silver badges97 bronze badges

Comments

Kevin Vignola Ruder · Accepted Answer · 2016-10-04 13:58:20Z

0

An alternative that will take in a string and an array of unwanted chars

    # function that removes unwanted signs from str
    #Pass the string to the function and an array ofunwanted chars

def removeSigns(str,arrayOfChars):

    charFound = False

    newstr = ""

    for letter in str:
        for char in arrayOfChars:
            if letter == char:
                charFound = True
                break
        if charFound == False:
            newstr += letter
        charFound = False

    return newstr

answered Oct 4, 2016 at 13:58

Kevin Vignola Ruder

311 silver badge4 bronze badges

Comments

Prasang Singhal · Accepted Answer · 2018-06-17 17:34:25Z

0

Let's say we have the following list:

states = [' Alabama ', 'Georgia!', 'Georgia', 'georgia', 'south carolina##', 'West virginia?']

Now we will define a function clean_strings()

import re

def clean_strings(strings):
    result = []
    for value in strings:
        value = value.strip()
        value = re.sub('[!#?]', '', value)
        value = value.title()
        result.append(value)
    return result

When we call the function clean_strings(states)

The result will look like:

['Alabama',
'Georgia',
'Georgia',
'Georgia',
'Florida',
'South Carolina',
'West Virginia']

answered Jun 17, 2018 at 17:34

Prasang Singhal

1211 silver badge2 bronze badges

Comments

Niraj Kale · Accepted Answer · 2019-06-20 10:11:10Z

0

I am probably late for the answer but i think below code would also do ( to an extreme end) it will remove all the unncesary chars:

a = '; niraj kale 984wywn on 2/2/2017'
a= re.sub('[^a-zA-Z0-9.?]',' ',a)
a = a.replace('  ',' ').lstrip().rstrip()

which will give

'niraj kale 984wywn on 2 2 2017'

answered Jun 20, 2019 at 10:11

Niraj Kale

1

Collectives™ on Stack Overflow

Removing unwanted characters from a string in Python

9 Answers 9

Comments

1 Comment

2 Comments

Comments

Comments

Comments

Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

9 Answers 9

Comments

1 Comment

2 Comments

Comments

Comments

Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related