Converting images to csv file in python

Question

I have converted my image into a csv file and it's like a matrix but I want it to be a single row. How can I convert all of the images in dataset into a csv file (each image into one line).

Here's the code I've used:

from PIL import Image
import numpy as np
import os, os.path, time

format='.jpg'
myDir = "Lotus1"
def createFileList(myDir, format='.jpg'):
    fileList = []
    print(myDir)
    for root, dirs, files in os.walk(myDir, topdown=False):
            for name in files:
               if name.endswith(format):
                  fullName = os.path.join(root, name)
                  fileList.append(fullName)
                  return fileList

fileList = createFileList(myDir)
fileFormat='.jpg'
for fileFormat in fileList:
 format = '.jpg'
 # get original image parameters...
 width, height = fileList.size
 format = fileList.format
 mode = fileList.mode
 # Make image Greyscale
 img_grey = fileList.convert('L')
 # Save Greyscale values
 value = np.asarray(fileList.getdata(),dtype=np.float64).reshape((fileList.size[1],fileList.size[0]))
 np.savetxt("img_pixels.csv", value, delimiter=',')

input : http://uupload.ir/files/pto0_lotus1_1.jpg

output:http://uupload.ir/files/huwh_output.png

write into a new file, onto a single line the content of your matrix ? — IMCoins
– IMCoins, Commented Mar 2, 2018 at 13:39

Pam · Accepted Answer · 2020-01-30 19:38:29Z

20

From your question, I think you want to know about numpy.flatten(). You want to add

value = value.flatten()

right before your np.savetxt call. It will flatten the array to only one dimension and it should then print out as a single line.

The rest of your question is unclear bit it implies you have a directory full of jpeg images and you want a way to read through them all. So first, get a file list:

def createFileList(myDir, format='.jpg'):
fileList = []
print(myDir)
for root, dirs, files in os.walk(myDir, topdown=False):
    for name in files:
        if name.endswith(format):
            fullName = os.path.join(root, name)
            fileList.append(fullName)
return fileList

The surround your code with a for fileName in fileList:

Edited to add complete example Note that I've used csv writer and changed your float64 to ints (which should be ok as pixel data is 0-255

from PIL import Image
import numpy as np
import sys
import os
import csv

#Useful function
def createFileList(myDir, format='.jpg'):
fileList = []
print(myDir)
for root, dirs, files in os.walk(myDir, topdown=False):
    for name in files:
        if name.endswith(format):
            fullName = os.path.join(root, name)
            fileList.append(fullName)
return fileList

# load the original image
myFileList = createFileList('path/to/directory/')

for file in myFileList:
    print(file)
    img_file = Image.open(file)
    # img_file.show()

    # get original image parameters...
    width, height = img_file.size
    format = img_file.format
    mode = img_file.mode

    # Make image Greyscale
    img_grey = img_file.convert('L')
    #img_grey.save('result.png')
    #img_grey.show()

    # Save Greyscale values
    value = np.asarray(img_grey.getdata(), dtype=np.int).reshape((img_grey.size[1], img_grey.size[0]))
    value = value.flatten()
    print(value)
    with open("img_pixels.csv", 'a') as f:
        writer = csv.writer(f)
        writer.writerow(value)

edited Jan 30, 2020 at 19:38

answered Mar 2, 2018 at 14:09

Pam

1,1631 gold badge16 silver badges21 bronze badges

Sign up to request clarification or add additional context in comments.

16 Comments

Nebula Over a year ago

Hi @Pam, I have 285 images and I want to convert it to a csv file, and I want to have each image to be one row of csv file. In a nutsell I want to convert the images to feature vector for other tasks.

Pam Over a year ago

My answer should give you all the code you need. I've assumed all your images have the same height and width, though. If not, you might want to add "width, height" on the start of each line in the csv file.

Nebula Over a year ago

Dear @Pam, I dont have much experience in python. I've edited my code. Is it possible for you to check my code again?

Nyerguds Over a year ago

@Zeinab How will you know the images' dimensions if they're saved as one-dimensional arrays though? you'd need to add some kind of header.

Pam Over a year ago

This isn't a good idea - you want to remove black pixels with no way of putting them back in? The images would be completely destroyed. How big are your images? The clever thing to do would be to resize them. The number of columns is (width x height), from that, you can work out how small your images need to be.

|

Bedir Yilmaz · Accepted Answer · 2018-06-26 14:31:53Z

6

How about you convert your images to 2D numpy arrays and then write them as txt files with .csv extensions and , as delimiters?

Maybe you could use a code like following:

np.savetxt('np.csv', image, delimiter=',')

answered Jun 26, 2018 at 14:31

Bedir Yilmaz

4,1435 gold badges39 silver badges56 bronze badges

Comments

brooksrelyt · Accepted Answer · 2019-05-15 13:20:59Z

6

import numpy as np
import cv2
import os

IMG_DIR = '/home/kushal/Documents/opencv_tutorials/image_reading/dataset'

for img in os.listdir(IMG_DIR):
        img_array = cv2.imread(os.path.join(IMG_DIR,img), cv2.IMREAD_GRAYSCALE)

        img_array = (img_array.flatten())

        img_array  = img_array.reshape(-1, 1).T

        print(img_array)

        with open('output.csv', 'ab') as f:

            np.savetxt(f, img_array, delimiter=",")

edited May 15, 2019 at 13:20

brooksrelyt

4,0536 gold badges37 silver badges58 bronze badges

answered May 15, 2019 at 12:47

k.dhakal

691 silver badge2 bronze badges

1 Comment

Aditya Gupta Over a year ago

is img_array = img_array.reshape(-1, 1).T the same as img_array = img_array.reshape(1, -1) ?

Shivam Dixit · Accepted Answer · 2020-05-07 11:37:09Z

3

import os
import pandas as pd

path = 'path-to-the-folder'
os.chdir(path)
lists = os.listdir(path)
labels = []
file_lst = []

for folder in lists:
    files = os.listdir(path +"/"+folder)
    for file in files:
      path_file = path + "/" + folder + "/" + file
      file_lst.append(path_file)
      labels.append(folder)

dictP_n = {"path": file_lst,
           "label_name": labels,
          "label": labels}   

data  = pd.DataFrame(dictP_n, index = None)
data = data.sample(frac=1)
data['label'] = data['label'].replace({"class1": 0, "class2": 1 })
data.to_csv("path-to-save-location//file_name.csv", index =None)

edited May 7, 2020 at 11:37

answered May 7, 2020 at 11:26

Shivam Dixit

312 bronze badges

Comments

Chris · Accepted Answer · 2023-04-03 00:38:22Z

from logging import root

from PIL import Image
import numpy as np
import sys
import os
import csv

def createfilelist(myDir, format='.jpg'):
    fileList= []
    print(myDir)
    for roots,dirs,files in os.walk(myDir,topdown=False):
        for name in files:
            if name.endswith(format):
                fullname = os.path.join(myDir,name)
                fileList.append(fullname)

    return fileList

myFileList = createfilelist('C:/Users/Rahul/Desktop/CASIA2/Au')

for file in myFileList:
    print(file)
    img_file = Image.open(file)
    width, height = img_file.size
    format = img_file.format
    mode = img_file.mode
    img_grey  = img_file.convert('L')

    value = np.asarray(img_grey.getdata(), dtype=np.int).reshape((img_grey.size[1], img_grey.size[0]))
    value = value.flatten()
    print(value)

    with open("image_to_csv.csv", 'a') as f:
        writer = csv.writer(f)
        writer.writerow(value)

Collectives™ on Stack Overflow

Converting images to csv file in python

5 Answers 5

16 Comments

Comments

1 Comment

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

5 Answers 5

16 Comments

Comments

1 Comment

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related