How do I read a csv file from aws s3 in aws lambda

Question

I am new to the AWS services.I am trying to read a csv file from AWS S3 bucket but I cannot read or get any output from AWS lambda.

import json
import boto3
import csv
s3_client = boto3.client('s3')
def lambda_handler(event, context):
    # TODO implement
    try:
        bucket_name = event["Records"][0]["s3"]["bucket"]["name"]
        s3_file_name = event["Records"][0]["s3"]["object"]["key"]
    
        csv_file = s3_client.get_object(Bucket=bucket_name, Key=s3_file_name)
        data = csv_file['Body'].read().splitlines(True)
        reader = csv.reader(data)
        print(reader)
    except Exception as err:
        print(err)
    

    return {
        'statusCode': 200,
        'body': json.dumps('Hello from Lambda!')
}

I am getting this output but I don't get data from my print line why is that?
please help me!

here is s3req test event

Please don't post event as screenshot, but properly formatted json code block. — Marcin
– Marcin, Commented Sep 30, 2021 at 5:51
Can you print the contents of data to see whether it contains anything? Anything that is printed should appear in the log file. — John Rotenstein
– John Rotenstein, Commented Sep 30, 2021 at 7:31

Chuong Nguyen · Accepted Answer · 2021-09-30 05:38:36Z

0

https://docs.python.org/3/library/csv.html

According to the documents, I think you used the wrong way of csv module. So the reader is empty and that's why your code does not return anything

answered Sep 30, 2021 at 5:38

Chuong Nguyen

1,1629 silver badges20 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Jimson James · Accepted Answer · 2023-02-01 16:10:22Z

0

An easy way to read csv is by using pandas.

import boto3
import pandas as pd

s3 = boto3.client('s3')
response = s3.get_object(Bucket=bucket, Key=path)
content = pd.read_csv(response.get("Body"))

answered Feb 1, 2023 at 16:10

Jimson James

3,3978 gold badges51 silver badges88 bronze badges

1 Comment

Adeesha_Anjana Over a year ago

to add pandas for aws lambda need to add a layer, here you can find how to add a layer

Collectives™ on Stack Overflow

How do I read a csv file from aws s3 in aws lambda

2 Answers 2

Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related