Getting pyspark.sql.utils.ParseException: mismatched input '(' expecting {<EOF>

Question

I am trying to rank the column 'Product' based on the revenue from below data frame- salesDF

salesDF=
+-------------+-------+---------+----------+-------+
|transactionID|Product| category|produtType|Revenue|
+-------------+-------+---------+----------+-------+
|          105| Lenova|   laptop|      high|  40000|
|          111| Lenova|   tablet|    medium|  20000|
|          103|   dell|   laptop|     medum|  25000|
|          107| iphone|cellPhone|     small|  70000|
|          113| lenovo|cellPhone|    medium|   8000|
|          108|     mi|cellPhone|     medum|  10000|

Now below iam using spark sql to rank each Product based on the Revenue

rankTheRevenue= salesDF.createTempView("Ranking_DF")
rankProduct= session.sql("select Product, Revenue, rank() over(partion by Product order by Revenue) as Rank_revenue from Ranking_DF")
rankProduct.show()

But iam getting following error

pyspark.sql.utils.ParseException: 
mismatched input '(' expecting {<EOF>, ',', 'CLUSTER', 'DISTRIBUTE', 'EXCEPT', 'FROM', 'GROUP', 'HAVING', 'INTERSECT', 'LATERAL', 'LIMIT', 'ORDER', 'MINUS', 'SORT', 'UNION', 'WHERE', 'WINDOW', '-'}(line 1, pos 36)

Appreciate if anyone can help me to resolve this kind of issue

Thanks

notNull · Accepted Answer · 2020-05-04 02:02:51Z

1

You have a typo at partition by clause as partion by.

Try with:

rankTheRevenue= salesDF.createTempView("Ranking_DF")
rankProduct= session.sql("select Product, Revenue, rank() over(partition by Product order by Revenue) as Rank_revenue from Ranking_DF")
rankProduct.show()

answered May 4, 2020 at 2:02

notNull

31.8k4 gold badges41 silver badges58 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Getting pyspark.sql.utils.ParseException: mismatched input '(' expecting {<EOF>

But iam getting following error

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

But iam getting following error

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related