fit a keras model with mixed input of type BatchDataset and numpy array

Okay I was able to solve it. I will write the detailed solution because I saw similar question to this posted many times with no answers. This is mixed input and the solution is to rely on a custom generator.

the first step is to make the custom generator. You have to return a list/dict of your inputs + output. I followed this link to make mine. Here's a sample code of my generator:

def generator(subset, batch_size=256):
    i = 0
    DIR = f"data/{subset}"
    image_files = pd.read_csv(f"{DIR}.csv")
    while True:
        batch_x = [list(), list()] # I have two input: image + feature vector
        batch_y = list() # output
        for b in range(batch_size):
            if i == len(image_files):
                i = 0
            filename = image_files.loc[i, "filename"]
            label = image_files.loc[i, "Class"]
            image_file_path = f'{DIR}/{label}/{filename}'
            i += 1
            image = cv2.imread(image_file_path, 0)
            batch_x[0].append(image)
            feat = get_feature_vector(filename)
            batch_x[1].append(feat)
            batch_y.append(one_hot(label))

        batch_x[0] = np.array(batch_x[0])  # convert each list to array
        batch_x[1] = np.array(batch_x[1])
        batch_y = np.array(batch_y)
        yield batch_x, batch_y

Then, make the model using functional tensorflow. When you fit the data, call your generator with the args needed:

history = model.fit(generator('train'),
                             validation_data = generator('validate'))