Improper encoding in Java Read/Write file

Question

I want to write to a csv file in UTF-8 in java

I am using BufferedWriter out = new BufferedWriter(new OutputStreamWriter(new FileOutputStream("temp.csv"),Charset.forName("UTF-8").newEncoder())); after searching the internet

I am still getting illegal characters.

I want to write "Kürzlich" to my file and later on read and write again from the same file. When I do so I get "KÃ¼rzlich"

How I am getting "Kürzlich": I am parsing a xml file using DOM.

    DocumentBuilderFactory dbFactory = DocumentBuilderFactory.newInstance();
    DocumentBuilder dBuilder = dbFactory.newDocumentBuilder();
    InputStream openstream = url.openStream();
    Document doc = dBuilder.parse(openstream);
    doc.getDocumentElement().normalize();

and then I extract my string.

I do not care how it is shown on the screen. I want to compare the stuff I write in the file with another file which is converted perfectly.

Is it happening because of DOM structure? Is there a way around?

Peter Lawrey · Accepted Answer · 2013-09-05 17:05:43Z

1

You appear to be writing UTF-8, but I don't see how you are reading UTF-8. Most likely you are reading the default encoding.

Try wrapping the openstream with an InputStreamReader specifying the encoding you want.

I suggest you try this to show you can write and read UTF-8

String text = "Kürzlich";
PrintWriter pw = new PrintWriter(new BufferedWriter(new OutputStreamWriter(new FileOutputStream("test.txt"), "UTF-8")));
pw.println(text);
pw.close();

BufferedReader br = new BufferedReader(new InputStreamReader(new FileInputStream("test.txt"), "UTF-8"));
String line = br.readLine();
br.close();
System.out.println("Text is the same is " + (line.equals(text)));

prints

Text is the same is true

edited Sep 5, 2013 at 17:05

answered Sep 4, 2013 at 21:57

Peter Lawrey

535k83 gold badges770 silver badges1.2k bronze badges

Sign up to request clarification or add additional context in comments.

7 Comments

Archit Khosla Over a year ago

I am reading the same way BufferedReader in = new BufferedReader(new InputStreamReader(new FileInputStream(yourFile),Charset.forName("UTF-8").newDecoder())); But it comes later on so should not have anyeffect. It does not even write properly

Peter Lawrey Over a year ago

Are you sure you are reading UTF-8 correctly when you say it is not correct? How about using the in to parse from instead of creating it when it's too late?

Archit Khosla Over a year ago

Assuming I do not read. That is step 2. Just writing to a file using the code mentioned I am not getting correct result.

Peter Lawrey Over a year ago

How do you know it is not the correct result if you are not reading it?

Archit Khosla Over a year ago

I am doing an equals from the from source A and and this file.I tired it before writing to the file too. I check what the file contains in VI (as it does not contain any system encoding) and it shows me illegal characters

|

Collectives™ on Stack Overflow

Improper encoding in Java Read/Write file

1 Answer 1

7 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

7 Comments

Your Answer

Sign up or log in

Post as a guest

Related