Java StreamCorruptedException when sending object containing byte data over a certain size

Question

I have a Java client-server (using ocsf if anyone here knows it) infrastructure I am using to upload files from client to server. The client is actually an Android app (not sure if that matters that much or not in this case)

I am doing this by reading the file data (bytes), wrapping it in an object that contains some other details (user id, etc..) and sending this object over ObjectOutputStream to the server.

It seems everything works fine until the byte array of the file is over a certain size (not sure what this strange threshold is yet but it seems 645KB is already too much). Then, the server throws a StreamCorruptedException when trying to read the object from the ObjectInputStream and closes the socket.

The code of the object message containing the file bytes:

public class MessageUploadFile extends MessageToServer {

private static final long serialVersionUID = 2356276507283427913L;
private String _destId;
private TransferDetails _td;
private byte[] _fileData;


public MessageUploadFile(String srcId, TransferDetails td, byte[] fileData){
    super(srcId);
    _destId = td.getDestinationId();
    _td = td;
    _fileData = fileData;

}

The client side socket and streams initialization:

 clientSocket= new Socket(host, port);
 output = new ObjectOutputStream(clientSocket.getOutputStream());
 input = new ObjectInputStream(clientSocket.getInputStream());

Sending the message using:

 output.writeObject(msg);

These are the streams initialization on the server side:

 input = new ObjectInputStream(clientSocket.getInputStream());
 output = new ObjectOutputStream(clientSocket.getOutputStream());

Reading the message using:

 msg = input.readObject();

Have a look at this question :stackoverflow.com/questions/33067125/… — Ravindra babu
– Ravindra babu, Commented Oct 14, 2015 at 13:43
@ravindra Thanks for your response. The problem is I am not using and cannot use DataOutputStream. I am sending an object for a reason (so I can send the upload details together with the data). Are you saying this is not possible? If so, how can I correlate this metadata with the file data itself? I thought about using a separate socket and using DataStreams on it but the problem of correlating the metadata remains... — Nom1fan
– Nom1fan, Commented Oct 14, 2015 at 14:00
So what you are saying is to basically wrap the OutputStream in a ByteArrayOutputStream and wrap all of this with an ObjectOutputStream? If so, should I do this only on the client side or both client and server side? — Nom1fan
– Nom1fan, Commented Oct 14, 2015 at 14:13

Ravindra babu · Accepted Answer · 2017-03-15 19:51:00Z

1

StreamCorruptedException

A Java StreamCorruptedException can be thrown while deserialising data. It essentially occurs in one of two main cases:

you try to open an ObjectInputStream around some data that wasn't actually written using an ObjectOutputStream

OR

During a readObject() operation, the stream gets in the "wrong place".

From java docs:

Thrown when control information that was read from an object stream violates internal consistency checks.

But I got this exception with large message and moved to byte array solution.

Have a look at this article:http://www.javamex.com/tutorials/io/StreamCorruptedException.shtml

In summary, convert Object to and from byte array and re-create it.

edited Mar 15, 2017 at 19:51

answered Oct 14, 2015 at 15:01

Ravindra babu

39.1k11 gold badges258 silver badges222 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Ravindra babu Over a year ago

Just found explanation from this one: stackoverflow.com/questions/2393179/…

Nom1fan Over a year ago

Thanks for all your help! I really want to adopt your solution. My problem is I feel something still won't be best practice, because I think you should always have the ability to show the user a progress bar of a file upload, and just converting the whole object together with the file data byte array and sending in bulk doesn't allow that. Still feel like I am missing something.

Ravindra babu Over a year ago

I still think you can show the progress bar depending on byte array size. byte[] to Object conversion may not take longer but downloading byte array will take time.

Nom1fan Over a year ago

Thanks for all your help! What I did eventually is initially send an object indicating the upload details (fileSize, sender id, etc..) and then on the server side grabbed the underlining inputStream that was in the ObjectInputStream and transferred just the bytes of the files separately. Once finished the client and server continue to communicate via objects. It works fine for now. Thanks!

Nom1fan · Accepted Answer · 2015-10-15 19:08:35Z

0

What I did eventually is initially send an object indicating the upload details (fileSize, sender id, etc..) and then on the server side grabbed the underlining inputStream that was in the ObjectInputStream and transferred just the bytes of the files separately. Once finished the client and server continue to communicate via objects. It works fine for now.

Hope this helps someone.

answered Oct 15, 2015 at 19:08

Nom1fan

8572 gold badges12 silver badges29 bronze badges

Collectives™ on Stack Overflow

Java StreamCorruptedException when sending object containing byte data over a certain size

2 Answers 2

4 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

4 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related