Zstd decompression error - Unknown frame descriptor

Question

I'm trying to decompress a .zst file the following way :

public byte[] decompress() {
byte[] compressedBytes = Files.readAllBytes(Paths.get(PATH_TO_ZST));
final long size = Zstd.decompressedSize(compressedBytes);
return Zstd.decompress(compressedBytes, (int)size);
}

and I'm running into this :

com.github.luben.zstd.ZstdException: Unknown frame descriptor [java] com.github.luben.zstd.ZstdDecompressCtx.decompressByteArray(ZstdDecompressCtx.java:157) [java] com.github.luben.zstd.ZstdDecompressCtx.decompress(ZstdDecompressCtx.java:214) [java]

Has anyone faced something similar? Thanks!

Nick · Accepted Answer · 2021-08-02 17:59:02Z

1

That error means zstd doesn't recognize the first 4 bytes of the frame. This can be because either:

The data is not in zstd format,
There is excess data at the end of the zstd frame.

You'll also want to check the output of Zstd.decompressedSize() for 0, which means the frame is corrupted, or the size wasn't present in the frame header. See the documentation.

answered Aug 2, 2021 at 17:59

Nick

4172 silver badges10 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Jay Ghiya Over a year ago

This does not help. i am also facing this error. i did compression using zstd and then i also checked decompressionSize which returns original size from the header which gave the right number. then i tried to decompress and that is when i get the error stating unknown frame descriptor.

Joy Oct 8 at 13:38

I faced the same issue, i had added datatype as text in my script. should be BYTEA for postgres

James Wang · Accepted Answer · 2023-03-10 09:05:57Z

0

public byte[] decompress() {
     byte[] compressedBytes = Files.readAllBytes(Paths.get(PATH_TO_ZST));
     final long size = Zstd.decompressedSize(compressedBytes);
     byte[] deCompressedBytes = new byte[size];
     Zstd.decompress(deCompressedBytes,compressedBytes);
     return deCompressedBytes;
}

answered Mar 10, 2023 at 9:05

James Wang

539 bronze badges

Collectives™ on Stack Overflow

Zstd decompression error - Unknown frame descriptor

2 Answers 2

2 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related