Loading images and labels from csv file using Tensorflow

Question

I've been trying to get the TensorFlow io api to work this morning.

After some research, I managed to read in the data, but I can not bind image and label correctly when dequeuing.

Here is the code I wrote:

# load csv content
csv_path = tf.train.string_input_producer(['list1.csv', 'list2.csv'])
textReader = tf.TextLineReader()
_, csv_content = textReader.read(csv_path)
im_name, label = tf.decode_csv(csv_content, record_defaults=[[""], [1]])

# load images
im_content = tf.read_file(im_dir+im_name)
image = tf.image.decode_png(im_content, channels=3)
image = tf.cast(image, tf.float32) / 255.
image = tf.image.resize_images(image, 640, 640)

# make batches
im_batch, lb_batch = tf.train.batch([image, label], batch_size=batch)

The order of im_batch and lb_batch is messed up (the images are bound to random labels).

Any idea what's happening? Thanks.

Ted Zhai · Accepted Answer · 2016-05-13 16:26:29Z

6

The code you listed has no problem.

im_batch, lb_batch = tf.train.batch([image, label], batch_size=batch)

The line above binds image and label to the same queue, so whenever you carry out an operation on either im_batch or lb_batch, the queue will pop out a batch number of data units from the other. So a common mistake may be calling im_batch.eval() and lb_batch.eval() separately:

# this is wrong
images = im_batch.eval()
labels = lb_batch.eval()

after im_batch.eval() was called, lb_batch pop out the same amount of data units as well because they are bonded in one queue. so when calling lb_batch.eval() right next, it actually gives the labels of next batch.

The right way to do is to put im_batch and lb_batch into a unit operation, either a graph or sess.run() op list:

this is correct

loss = your_network_model(im_batch, lb_batch) loss.eval()

2.

# this is correct
images, labels = sess.run([im_batch, lb_batch])

answered May 13, 2016 at 16:26

Ted Zhai

763 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Dragos Bobolea Over a year ago

Thank you so much!! It's not like I spent the past 3 days changing everything on my model and wondering why it's not learning anything..

Collectives™ on Stack Overflow

Loading images and labels from csv file using Tensorflow

1 Answer 1

this is correct

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

this is correct

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related