pySpark list to dataframe

Question

My code below creates a dataframe from lists of columns from other dataframes. I'm getting an error when calling a list that is produce by a set. How can I treat that set of list, in order to add those columns to my dataframe?

Error produce by +list(matchedList)

#extract columns that need to be conform 
datasetMatched = dataset.select(selectedColumns +list(matchedList))
#display(datasetMatched)

TypeError: 'list' object is not callable

Gabio · Accepted Answer · 2020-06-05 15:48:27Z

1

It probably happens due to shadowing the builtin list function. Make sure you didn't define any variable named list in your code.

answered Jun 5, 2020 at 15:48

Gabio

9,5643 gold badges17 silver badges38 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

jgtrz Over a year ago

good point. It also got fix after refreshing my cluster @Gabip

Collectives™ on Stack Overflow

pySpark list to dataframe

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related