Converting Numpy text array to tf.data.Dataset

Question

i have 2 a numpy nd arrays of shape (2000,) where each element is a list containing words as items. Thus each list is a sentence. The other nd array are just the binary labels.
I want to convert this to tensorflow data Dataset where each item is a sentence with a label.
I tried:

 tf.data.Dataset.from_tensor_slices((dataset, labels))

but i get :

ValueError: Failed to convert a NumPy array to a Tensor (Unsupported object type list).

How could this be done?

AloneTogether · Accepted Answer · 2022-12-05 08:53:52Z

2

This error usually occurs when each list in your array has a different number of elements (words). Try using a ragged representation:

tf.data.Dataset.from_tensor_slices((tf.ragged.constant(dataset), labels))

answered Dec 5, 2022 at 8:53

AloneTogether

26.8k5 gold badges23 silver badges43 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Los Over a year ago

This did the trick, Gracias

Collectives™ on Stack Overflow

Converting Numpy text array to tf.data.Dataset

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related