java.lang.NoSuchMethodError: com.mongodb.internal.connection.Cluster.selectServer

Question

I am new to Apache Spark and I am using Scala and Mongodb to learn it. https://docs.mongodb.com/spark-connector/current/scala-api/ I am trying to read the RDD from my MongoDB database, my notebook script as below:

import com.mongodb.spark.config._
import com.mongodb.spark._

val readConfig = ReadConfig(Map("uri" -> "mongodb+srv://root:[email protected]/test_database.test_collection?retryWrites=true&w=majority"))

val testRDD = MongoSpark.load(sc, readConfig)
print(testRDD.collect)

At the print(testRDD.collect) line, I got this error:

java.lang.NoSuchMethodError: com.mongodb.internal.connection.Cluster.selectServer(Lcom/mongodb/selector/ServerSelector;)Lcom/mongodb/internal/connection/Server;

And more than 10 lines "at..."

Used libraries:

org.mongodb.spark:mongo-spark-connector_2.12:3.0.1
org.mongodb.scala:mongo-scala-driver_2.12:4.2.3

Is this the problem from Mongodb internal libraries or how could I fix it?

Many thanks

Ah, I am using Databricks to code. The libraries that I installed are from Maven. — Eclipsor
– Eclipsor, Commented Aug 22, 2021 at 12:07
I am using Databricks and Notebook to code. I don't use any Jars. I already tested with Python Script for the same feature and it also returns the same error — Eclipsor
– Eclipsor, Commented Aug 22, 2021 at 12:10
I tried both 7.3 LTS (includes Apache Spark 3.0.1, Scala 2.12) and 8.3 (includes Apache Spark 3.1.1, Scala 2.12) Both of them return the same error — Eclipsor
– Eclipsor, Commented Aug 22, 2021 at 14:06

Alex Ott · Accepted Answer · 2021-08-22 15:58:05Z

1

I suspect that there is a conflict between mongo-spark-connector and mongo-scala-driver. The former is using Mongo driver 4.0.5, but the later is based on the version 4.2.3. I would recommend to try only with mongo-spark-connector

answered Aug 22, 2021 at 15:58

Alex Ott

88.1k10 gold badges110 silver badges157 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

vivek dadhich · Accepted Answer · 2021-12-14 06:31:14Z

0

I was also facing the same problem, solved it using mongo-spark-connector-2.12:3.0.1 jar and with that also added jar of Scalaj HTTP » 2.4.2. It's working fine now.

answered Dec 14, 2021 at 6:31

vivek dadhich

1

Collectives™ on Stack Overflow

java.lang.NoSuchMethodError: com.mongodb.internal.connection.Cluster.selectServer

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related