>>> import sys
>>> sys.getfilesystemencoding()
'UTF-8'
How do I change that? I know how to change the default system encoding.
>>> reload(sys)
<module 'sys' (built-in)>
>>> sys.setdefaultencoding('ascii')
But there is no sys.setfilesystemencoding.
There are two ways to change it:
export LC_CTYPE=en_US.UTF-8
before launching python:$ LC_CTYPE=C python -c 'import sys; print(sys.getfilesystemencoding())'
ANSI_X3.4-1968
$ LC_CTYPE=en_US.UTF-8 python -c 'import sys; print(sys.getfilesystemencoding())'
UTF-8
Note that LANG serves as the default value for LC_CTYPE if it is not set, while LC_ALL overrides both LC_CTYPE and LANG)
import sys
sys.getfilesystemencoding = lambda: 'UTF-8'
Both methods let functions like os.stat accept unicode (python2.x) strings.
Otherwise those functions raise an exception when they see non-ascii symbols in the filename.
Update:
In the (1) variant the locale has to be available (present in locale -a) for this setting to have the desired effect.
/etc/environment but export LANG=en_US.UTF8 has immediate effectThe file system encoding is, in many cases, an inherent property of the operating system. It cannot be changed — if, for some reason, you need to create files with names encoded differently than the filesystem encoding implies, don't use Unicode strings for filenames. (Or, if you're using Python 3, use a bytes object instead of a string.)
See the documentation for details. In particular, note that, on Windows systems, the file system is natively Unicode, so no conversion is actually taking place, and, consequently, it's impossible to use an alternative filesystem encoding.
sys.setfilesystemencodingfunction and also env varPYTHONFSENCODINGin early versions of Python 3.x. They were problematic and got removed, now Python uses locale encoding as the filesystem encoding. See Painful History of the Filesystem Encoding from Victor Stinner's blog.