How can I make a request including "à" character in its URL in Python?

Question

I use the requests module in Python to fetch a result of a web page. However, I found that if the URL includes a character à in its URL, it issues the UnicodeDecodeError:

UnicodeDecodeError: 'utf-8' codec can't decode byte 0xe0 in position 27: invalid continuation byte

Strangely, this only happens if I also add a space in the URL. So for example, the following does not issue an error.

requests.get("http://myurl.com/àieou")

However, the following does:

requests.get("http://myurl.com/àienah aie")

Why does it happen and how can I make the request correctly?

Wonka · Accepted Answer · 2019-05-02 14:42:54Z

2

using the lib urllib to auto-encode characters.

import urllib
requests.get("http://myurl.com/"+urllib.quote_plus("àieou"))

edited May 2, 2019 at 14:42

answered May 2, 2019 at 14:24

Wonka

1,9012 gold badges15 silver badges23 bronze badges

Sign up to request clarification or add additional context in comments.

8 Comments

Blaszard Over a year ago

That worked, thanks. Though it was urllib.parse.quote in Python 3.

Blaszard Over a year ago

Hmmm it still didn't work if the URL includes a space.

Wonka Over a year ago

Its should work and replace space with +. There is some different .quote and .quote_plus. I dont know it currently at the moment, quote_plus is more hardcore.

Olvin Roght Over a year ago

May be you should use quote_plus instead of quote?

Wonka Over a year ago

Yes @OlvinRoght , thought I used quote_plus

|

Olvin Roght · Accepted Answer · 2019-05-02 14:42:02Z

1

Use quote_plus().

from urllib.parse import quote_plus

requests.get("http://myurl.com/" + quote_plus("àienah aie"))

answered May 2, 2019 at 14:42

Olvin Roght

7,8432 gold badges19 silver badges39 bronze badges

Comments

Hans Daigle · Accepted Answer · 2019-05-02 14:22:32Z

0

You can try to url encode your value:

requests.get("http://myurl.com/%C3%A0ieou")

The value for à is %C3%A0 once encoded.

answered May 2, 2019 at 14:22

Hans Daigle

3642 silver badges14 bronze badges

Collectives™ on Stack Overflow

How can I make a request including "à" character in its URL in Python?

3 Answers 3

8 Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

8 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related