Exception in thread "main" java.lang.ClassNotFoundException: scala.Any

Question

I am newbie to Scala. I have this code:

import org.apache.spark.sql.types.{StructType, DataType, AnyDataType}
..

val test = spark.sparkContext.parallelize(Tables.value.getOrElse("db.code_tbls",collection.immutable.Map.empty[String, Any]).toList.seq).toDF("code","cde_desc").as[(String, String)]

Above line in my code is throwing java.lang.ClassNotFoundException: scala.Any error. I tried to make my test variable implicit also. But I still get the same error.

Also I tried changing Any to String in .empty[String, Any] code. But still the same error.

In my code Tables is the dataset variable which holds hive table data. If I am not able to get the data from my dataset I am using getOrElse here to get the table name and empty map which I converted into List type. Then I am converting to DF with schema as "code","cde_desc" of type String. Please let me know if I need to add more info. — user2531569
– user2531569, Commented Mar 12, 2019 at 13:42
Are you using Injellij? If yes then try invalidate cache and restart. — Raman Mishra
– Raman Mishra, Commented Mar 12, 2019 at 14:23
Yes. Tried but no luck. For time being I replaced collection.immutable.Map.empty[String, Any] with null. Its working now. Thanks — user2531569
– user2531569, Commented Mar 14, 2019 at 5:05

Abhijat · Accepted Answer · 2020-05-19 15:19:21Z

1

try collection.immutable.Map[String, Any]()

answered May 19, 2020 at 15:19

Abhijat

111 bronze badge

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Exception in thread "main" java.lang.ClassNotFoundException: scala.Any

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related