Error trying to access Amazon Redshift external table

Question

I have avro files in S3 which I want to be able to query via Redshift. Have used external tables with success in the past but only in parquet/JSON format so wondering whether I'm missing something with the data being in avro format maybe.

I set up a glue crawler to get hold of the schema of the files and that has worked fine. I can access the data in Athena. I've also set up an external schema in Redshift and can see the new external table exists when I query SVV_EXTERNAL_TABLES. However, when I come to query the new table I get the following error:

[XX000][500310] Amazon Invalid operation: Invalid DataCatalog response for external table "spectrum_google_analytics"."man": Cannot deserialize Table. Error:

I don't know why this would work for athena but not spectrum. Hoping you can help. Thanks!

Ritesh Grandhi · Accepted Answer · 2020-08-10 17:09:17Z

1

The same issue happened to be as well when I was trying to use aws-cdk for deploying resources. Turns out having no parameters in properties of Glue Table will cause this weird behaviour (https://github.com/aws/aws-cdk/issues/7826), add some property like classification=Parquet/JSON and try again, worked for me.

answered Aug 10, 2020 at 17:09

Ritesh Grandhi

314 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Error trying to access Amazon Redshift external table

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related