How do I continue on error in loop condition in python?

Question

I have python code that loops over a file. I'm getting a UTF-8 error (invalid continuation byte) when I read over the file. I just want my program to ignore that.

I've tried using a try except around the code inside, but that won't work since the error is in the condition of the for loop. I've also tried using a try except around the loop but then when it catches the error it doesn't start the loop again.

with open(input_file_path, "r") as input_file:
    for line in input_file:
        # code irrelevant to question

What happens is it gives this error on for line in input_file:

UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe0 in position 5: invalid continuation byte`

I want it to skip that line and move to the next one. Essentially, a try catch on the condition of my for loop.

Are you sure the file should be decoded as a UTF-8 stream? Adding the correct encoding the open function may be the correct answer. — chepner
– chepner, Commented Oct 5, 2019 at 16:20

chk · Accepted Answer · 2019-10-05 16:15:00Z

3

Does this work? (edited to solution OP found)

with open(input_file_path, "r", encoding="utf8", errors="surrogateescape") as input_file:
    for line in input_file:
        try:
            yourcode
        except:
            continue

edited Oct 5, 2019 at 16:15

answered Oct 5, 2019 at 15:44

chk

584 bronze badges

Sign up to request clarification or add additional context in comments.

5 Comments

Sheshank S. Over a year ago

Yes I did and it doesn't work since te error is on the line line in input_file

chk Over a year ago

then its not a line issue but prob a file issue? is the encoding correct?

chk Over a year ago

a quick search came up with this. stackoverflow.com/questions/19699367/…

Sheshank S. Over a year ago

Yes I did see that.

Sheshank S. Over a year ago

If you change your answer to this: with open(input_file_path, "r", encoding="utf8", errors="surrogateescape") as input_file: I'll accept it. That worked for me

BramAppel · Accepted Answer · 2019-10-05 15:50:45Z

1

Have you tried something like this, when the UnicodeDecoceError is raised, the loop will continue with the next iteration.

with open(input_file_path, "rb") as input_file:
    for line in input_file:
        try:
            line_i = line.decode(encoding='utf-8')
        except UnicodeDecodeError:
            continue

edited Oct 5, 2019 at 15:50

answered Oct 5, 2019 at 15:44

BramAppel

1,3561 gold badge11 silver badges22 bronze badges

2 Comments

Sheshank S. Over a year ago

I tried that, but it doesn't work since the error is on the line for line in input_file

BramAppel Over a year ago

@SheshankS. Allright, maybe then read the file content as binary and convert at a later moment.

Sudhansu Kumar · Accepted Answer · 2019-10-05 16:52:53Z

0

You can use

with open(input_file_path, "r", encoding="ISO-8859-1") as input_file:
    for line in input_file:

answered Oct 5, 2019 at 16:52

Sudhansu Kumar

1192 gold badges3 silver badges11 bronze badges

Collectives™ on Stack Overflow

How do I continue on error in loop condition in python?

3 Answers 3

5 Comments

2 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

5 Comments

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related