Error when checking model input: expected lstm_1_input to have 3 dimensions, but got array with shape (339732, 29)

Question

My input is simply a csv file with 339732 rows and two columns :

the first being 29 feature values, i.e. X
the second being a binary label value, i.e. Y

I am trying to train my data on a stacked LSTM model:

data_dim = 29
timesteps = 8
num_classes = 2

model = Sequential()
model.add(LSTM(30, return_sequences=True,
               input_shape=(timesteps, data_dim)))  # returns a sequence of vectors of dimension 30
model.add(LSTM(30, return_sequences=True))  # returns a sequence of vectors of dimension 30
model.add(LSTM(30))  # return a single vector of dimension 30
model.add(Dense(1, activation='softmax'))

model.compile(loss='binary_crossentropy',
              optimizer='rmsprop',
              metrics=['accuracy'])

model.summary()
model.fit(X_train, y_train, batch_size = 400, epochs = 20, verbose = 1)

This throws the error:

Traceback (most recent call last): File "first_approach.py", line 80, in model.fit(X_train, y_train, batch_size = 400, epochs = 20, verbose = 1)

ValueError: Error when checking model input: expected lstm_1_input to have 3 dimensions, but got array with shape (339732, 29)

I tried reshaping my input using X_train.reshape((1,339732, 29)) but it did not work showing error:

ValueError: Error when checking model input: expected lstm_1_input to have shape (None, 8, 29) but got array with shape (1, 339732, 29)

How can I feed in my input to the LSTM ?

Why are you using a LSTM model with no timesteps?

from keras import michael
– from keras import michael

2018-08-27 22:09:28 +00:00
Commented Aug 27, 2018 at 22:09 — from keras import michael
– from keras import michael, Commented Aug 27, 2018 at 22:09

E. Zeytinci · Accepted Answer · 2018-12-03 11:48:09Z

44

Setting timesteps = 1 (since, I want one timestep for each instance) and reshaping the X_train and X_test as:

import numpy as np
X_train = np.reshape(X_train, (X_train.shape[0], 1, X_train.shape[1]))
X_test = np.reshape(X_test, (X_test.shape[0], 1, X_test.shape[1]))

This worked!

edited Dec 3, 2018 at 11:48

E. Zeytinci

2,6332 gold badges23 silver badges40 bronze badges

answered Jun 22, 2017 at 16:22

Saurav--

1,5792 gold badges15 silver badges33 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

from keras import michael · Accepted Answer · 2018-08-25 20:41:09Z

6

Reshape input for LSTM:

X = array([[10, 20, 30], [40, 50, 60], [70, 80, 90]])
X_train = X.reshape(1, 3, 3) # X.reshape(samples, timesteps, features)

edited Aug 25, 2018 at 20:41

from keras import michael

7211 gold badge11 silver badges23 bronze badges

answered Jul 12, 2018 at 8:54

Ashok Kumar Jayaraman

3,1354 gold badges34 silver badges43 bronze badges

Comments

Shadi · Accepted Answer · 2017-07-07 06:43:54Z

5

For timesteps != 1, you can use the below function (adapted from here)

import numpy as np
def create_dataset(dataset, look_back=1):
  dataX, dataY = [], []
  for i in range(len(dataset)-look_back+1):
    a = dataset[i:(i+look_back), :]
    dataX.append(a)
    dataY.append(dataset[i + look_back - 1, :])
  return np.array(dataX), np.array(dataY)

Examples

X = np.reshape(range(30),(3,10)).transpose()
array([[ 0, 10, 20],
       [ 1, 11, 21],
       [ 2, 12, 22],
       [ 3, 13, 23],
       [ 4, 14, 24],
       [ 5, 15, 25],
       [ 6, 16, 26],
       [ 7, 17, 27],
       [ 8, 18, 28],
       [ 9, 19, 29]])

create_dataset(X, look_back=1 )
(array([[[ 0, 10, 20]],
       [[ 1, 11, 21]],
       [[ 2, 12, 22]],
       [[ 3, 13, 23]],
       [[ 4, 14, 24]],
       [[ 5, 15, 25]],
       [[ 6, 16, 26]],
       [[ 7, 17, 27]],
       [[ 8, 18, 28]],
       [[ 9, 19, 29]]]),
array([[ 0, 10, 20],
       [ 1, 11, 21],
       [ 2, 12, 22],
       [ 3, 13, 23],
       [ 4, 14, 24],
       [ 5, 15, 25],
       [ 6, 16, 26],
       [ 7, 17, 27],
       [ 8, 18, 28],
       [ 9, 19, 29]]))

create_dataset(X, look_back=3)
(array([[[ 0, 10, 20],
        [ 1, 11, 21],
        [ 2, 12, 22]],
       [[ 1, 11, 21],
        [ 2, 12, 22],
        [ 3, 13, 23]],
       [[ 2, 12, 22],
        [ 3, 13, 23],
        [ 4, 14, 24]],
       [[ 3, 13, 23],
        [ 4, 14, 24],
        [ 5, 15, 25]],
       [[ 4, 14, 24],
        [ 5, 15, 25],
        [ 6, 16, 26]],
       [[ 5, 15, 25],
        [ 6, 16, 26],
        [ 7, 17, 27]],
       [[ 6, 16, 26],
        [ 7, 17, 27],
        [ 8, 18, 28]],
       [[ 7, 17, 27],
        [ 8, 18, 28],
        [ 9, 19, 29]]]),
array([[ 2, 12, 22],
       [ 3, 13, 23],
       [ 4, 14, 24],
       [ 5, 15, 25],
       [ 6, 16, 26],
       [ 7, 17, 27],
       [ 8, 18, 28],
       [ 9, 19, 29]]))

answered Jul 7, 2017 at 6:43

Shadi

10.4k5 gold badges49 silver badges73 bronze badges

7 Comments

jlewkovich Over a year ago

Getting this error when I pass the object returned from create_dataset() into model.fit() AttributeError: 'tuple' object has no attribute 'shape'

Shadi Over a year ago

create_dataset returns a tuple of x, y. Try x_train, y_train = create_dataset(dataset) and then model.fit(x_train, y_train)

jlewkovich Over a year ago

I have an input training set that is a np.array that is 100 rows and 50 columns. Some of those columns contain float values, some contain "hot encodings" built with keras.utils.to_categorical() which are basically just arrays. I'm confused as to how I'd use x_train and y_train. My training labels are in a separate array, the input model just contains the training data (first input into model.fit())

Shadi Over a year ago

In this case, just ignore y_train from this function and use the one that you have already in your separate array. Also, model.fit would take in the x_train from this function and your own target

jlewkovich Over a year ago

still not working, I've opened a bounty on a question that mimics my problem: stackoverflow.com/questions/51469446/… Basically handling, in a Sequential layer, a training set that contains both arrays and numeric values

|

Collectives™ on Stack Overflow

Error when checking model input: expected lstm_1_input to have 3 dimensions, but got array with shape (339732, 29)

3 Answers 3

Comments

Comments

7 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

Comments

7 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related