Amazon Redshift COPY command fails with following error

Question

I have encountered following error when trying to load a file from S3 to my redshift tables using copy command and unable to find any clue regarding this.

  -----------------------------------------------
  error:  Failed writing body (0 != 776) Cause: Failed to inflateinvalid or incomplete deflate data. zlib error code: -3
  code:      9001
  context:   S3 key being read : s3://redshift-dev-sandbox/Moores.csv
  query:     2565852
  location:  table_s3_scanner.cpp:356
  process:   query0_33 [pid=10565]
  -----------------------------------------------

Can you post your query as well, its zlib related error so looking at query might help identify the issue — mbaxi
– mbaxi, Commented Jul 20, 2016 at 7:08
My copy command query as follows: copy "aw_tushar_allentity".dataset_customerdataset from 's3://redshift-dev-sandbox/Moores.csv' credentials 'aws_access_key_id=xxxx;aws_secret_access_key=xxxx' delimiter ',' CSV IGNOREHEADER 1 GZIP; — Tushar
– Tushar, Commented Jul 20, 2016 at 7:15
Your source data is in simple text CSV format, specifying GZIP option suggests its in compressed format, try removing that option and perform copy — mbaxi
– mbaxi, Commented Jul 20, 2016 at 7:20

Frederic Henri · Accepted Answer · 2016-07-20 09:38:01Z

1

There is a mix up : You cannot specifying a GZIP algorithm on a simple csv file.

You will either have a copy of a csv file:

copy "aw_tushar_allentity".dataset_customerdataset from 's3://redshift-dev-sandbox/Moores.csv' 
credentials 'aws_access_key_id=xxxx;aws_secret_access_key=xxxx'
delimiter ',' CSV IGNOREHEADER 1;

or if your file is compressed from GZIP file:

copy "aw_tushar_allentity".dataset_customerdataset from 's3://redshift-dev-sandbox/Moores.csv.gz' 
credentials 'aws_access_key_id=xxxx;aws_secret_access_key=xxxx'
gzip
delimiter ',' CSV IGNOREHEADER 1;

answered Jul 20, 2016 at 9:38

Frederic Henri

54k12 gold badges119 silver badges141 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Amazon Redshift COPY command fails with following error

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related