convert from string to pandas dataframe

Question

I'm importing a csv file from AWS S3 in AWS Lambdawith below code:

file = s3.get_object(Bucket = bucket, Key = key)
rows = file['Body'].read().decode('utf-8').splitlines(False)

I'm getting input in below format :

data = "a,b,c,d,\"x,y\",e,f"

and I want output in below format:

>>>`>>> df
   0  1  2  3    4  5  6
0  a  b  c  d  x,y  e  f`

i have to split data based on ',' but if some thong is between " " they should remain as it is.

Or if you have any other solution for import csv file from s3 to lambda and converting in Data Frame, Please suggest

Mohamed Thasin ah · Accepted Answer · 2018-11-13 10:11:42Z

7

use csv module

try this,

from csv import reader
import pandas as pd
data=["a,b,c,d,\"x,y\",e,f"]
df=pd.DataFrame( list(reader(data)))
print df

Output:

   0  1  2  3    4  5  6
0  a  b  c  d  x,y  e  f

answered Nov 13, 2018 at 10:11

Mohamed Thasin ah

11.2k11 gold badges65 silver badges120 bronze badges

Sign up to request clarification or add additional context in comments.

1 Answer 1