Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incompatibility in Spark 2.1.6 #19

Open
hi-T0day opened this issue Jul 27, 2017 · 5 comments
Open

Incompatibility in Spark 2.1.6 #19

hi-T0day opened this issue Jul 27, 2017 · 5 comments

Comments

@hi-T0day
Copy link

Hello!
I meet up a error when I run the spark_dbscan in Spark 2.1.6.
The error is
java.lang.NoClassDefFoundError: org/apache/spark/Logging
Caused by: java.lang.ClassNotFoundException: org.apache.spark.Logging
Spark 2.0 removes the org.apache.spark.Logging. So spark_dbscan cannot running.
Any solution to this problem?
I have tried to change the other dependencies, but still failed.

@csbenz
Copy link

csbenz commented Sep 13, 2017

Had the same Exception, I had to update the Spark dependency in the build.gradle of the library to make it work. You'll need to clone the repo and update it with the same version you're using on your cluster, or you can directly get my fork if that's easier.

@valera7979
Copy link
Contributor

use org.apache.spark.internal.Logging instead org.apache.spark.Logging

@lccmpn
Copy link

lccmpn commented Mar 14, 2018

@csbenz your fork works only with Spark 1.6.2 and I can't find build.gradle (there's only build.sbt). Am I missing something?

@eriknorlander
Copy link

Can anyone elaborate on their solution to this problem? I'm running Spark 2.3.0

@sfdan473414
Copy link

you can solve this problem the following steps.
step1: you must create a new package started with 'org.apache.spark' ,such as 'org.apache.spark.external'
step2: Creating a trait extends the 'org.apache.spark.internal.Logging' trait ,Note that the access modifier must be public
step3 : now you can access the new trait

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants