Python regular expressions and tokenization

Question

I have a string "A.B.C one two three."

I have a task to tokenize this string into ["A.B.C", one, two, three], neglecting the period at the end of the sentence. I'm having trouble removing the period at the end of the sentence by itself without interfering with the A.B.C acronym.

Is there a way for me to remove just periods at the end of a sentence without affecting acronyms using python regexs?

s.rstrip('.') is a quick answer, though perhaps not the best depending on exactly what you need to do. — user2357112
– user2357112, Commented Feb 5, 2014 at 2:41
Do you mean ["A.B.C", "one", "two", "three"] (note the quotes) — SethMMorton
– SethMMorton, Commented Feb 5, 2014 at 2:43
There isn't always a period at the end of the string. i'm tokenizing a large file with many sentences. — Mozbi
– Mozbi, Commented Feb 5, 2014 at 3:13

Hugh Bothwell · Accepted Answer · 2014-02-05 06:24:42Z

2

word = re.compile(r'[A-Za-z.]*[A-Za-z]')
word.findall("A.B.C one two three.")    # => ['A.B.C', 'one', 'two', 'three']

edited Feb 5, 2014 at 6:24

answered Feb 5, 2014 at 3:20

Hugh Bothwell

57k9 gold badges91 silver badges103 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

falsetru Over a year ago

You don't need to escape . inside [...] because . lose its special meaing inside [..] and match . literally.

Hugh Bothwell Over a year ago

@falsetru: (wince) yeah, I knew that ;-)

chk · Accepted Answer · 2014-02-05 03:14:08Z

0

line= "A.B.C one two three."
print line[:-1].split(' ')

may be this way as well

answered Feb 5, 2014 at 3:14

chk

3082 silver badges10 bronze badges

4 Comments

Mozbi Over a year ago

How bout if I just want to replace the period at the end of the sentence by ''. As in, I want it to remain a string? Thanks!

SethMMorton Over a year ago

The OP said there isn't always a period at the end. This assumes there is.

chk Over a year ago

is this you wanted? line = line[:-1]

chk Over a year ago

if we don't want to assume, we should use rstrip as you referred

Collectives™ on Stack Overflow

Python regular expressions and tokenization

2 Answers 2

2 Comments

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related