Avoid pandas str.replace using a regex

Question

I have the following pandas dataframe. Say it has two columns: id and search_term:

id       search_term
37651    inline switch

I do:

train['search_term'] = train['search_term'].str.replace("in."," in. ")

expecting that the dataset above is unaffected, but I get in return for this dataset:

id       search_term
37651    in.  in.  switch

which means inl is replaced by in. and ine is replaced by in., as if I where using a regular expression, where dot means any character.

How do I rewrite the first command so that, literally, in. is replaced by in. but any in not followed by a dot is untouched, as in:

a = 'inline switch'
a = a.replace('in.','in. ')

a
>>> 'inline switch'

sorry, I want to replace 'dot' literally. I posted an answer below as I found a good post on the regular expression for 'dot'. the problem is that str.replace() in a dataframe uses regex — Alejandro Simkievich
– Alejandro Simkievich, Commented Mar 29, 2016 at 23:39

daisukelab · Accepted Answer · 2021-06-09 05:51:55Z

5

The version 0.23 or newer, the str.replace() got a new option for switching regex. Following will simply turn it off.

df.search_term.str.replace('in.', 'in. ', regex=False)

Will results in:

0    inline switch
1         in. here
Name: search_term, dtype: object

edited Jun 9, 2021 at 5:51

answered Sep 5, 2019 at 1:35

daisukelab

912 silver badges7 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Community · Accepted Answer · 2017-05-23 11:53:53Z

2

and here is the answer: regular expression to match a dot.

str.replace() in pandas indeed uses regex, so that:

df['a'] = df['a'].str.replace('in.', ' in. ')

is not comparable to:

a.replace('in.', ' in. ')

the latter does not use regex. So use '\.' instead of '.' in a statement that uses regex if you really mean dot and not any character.

Regular Expression to match a dot

edited May 23, 2017 at 11:53

CommunityBot

11 silver badge

answered Mar 29, 2016 at 23:38

Alejandro Simkievich

3,8826 gold badges35 silver badges49 bronze badges

1 Comment

Ami Tavory Over a year ago

Note, however, that you can still use regex expressions, while stating that a dot has no special meaning.

Ami Tavory · Accepted Answer · 2016-03-29 23:42:49Z

1

Try escaping the .:

import pandas as pd

df = pd.DataFrame({'search_term': ['inline switch', 'in.here']})
>>> df.search_term.str.replace('in\\.', 'in. ')
0    inline switch
1          in. here
Name: search_term, dtype: object

edited Mar 29, 2016 at 23:42

answered Mar 29, 2016 at 23:39

Ami Tavory

76.7k13 gold badges152 silver badges196 bronze badges

2 Comments

Alejandro Simkievich Over a year ago

thanks Ami. I see you escaped the . in the first argument, but what about the second? if you want to literally replace 'in.' by 'in. ' should you then use str.replace('in\\.', 'in\\. ') or str.replace('in\\.', 'in. ')?

Ami Tavory Over a year ago

@AlejandroSimkievich It would seem logical, but no. See the updated example above. Only the dot in the first string is interpreted as a regex character (which must be escaped).

Collectives™ on Stack Overflow

Avoid pandas str.replace using a regex

3 Answers 3

Comments

1 Comment

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

1 Comment

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related