Skip to content

Commit

Permalink
upgrade spark version (#3138)
Browse files Browse the repository at this point in the history
  • Loading branch information
Le-Zheng authored Jul 6, 2021
1 parent 8162f18 commit 36aff06
Show file tree
Hide file tree
Showing 3 changed files with 4 additions and 4 deletions.
4 changes: 2 additions & 2 deletions pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -172,7 +172,7 @@
<collections.version>3.2.1</collections.version>
<scoverage.plugin.version>1.1.1</scoverage.plugin.version>
<spark-version.project>2.0</spark-version.project>
<spark.version>2.4.3</spark.version>
<spark.version>2.4.6</spark.version>
<breeze.version>0.13.2</breeze.version>
<spark-scope>provided</spark-scope>

Expand Down Expand Up @@ -545,7 +545,7 @@
<java.version>1.8</java.version>
<javac.version>1.8</javac.version>
<spark-version.project>2.0</spark-version.project>
<spark.version>2.4.3</spark.version>
<spark.version>2.4.6</spark.version>
<scala.major.version>2.11</scala.major.version>
<scala.version>2.11.8</scala.version>
<scala.macros.version>2.1.0</scala.macros.version>
Expand Down
2 changes: 1 addition & 1 deletion pyspark/setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -89,7 +89,7 @@ def setup_package():
license='Apache License, Version 2.0',
url='https://github.com/intel-analytics/Bigdl',
packages=get_bigdl_packages(),
install_requires=['numpy>=1.7', 'pyspark==2.4.3', 'six>=1.10.0'],
install_requires=['numpy>=1.7', 'pyspark==2.4.6', 'six>=1.10.0'],
dependency_links=['https://d3kbcqa49mib13.cloudfront.net/spark-2.0.0-bin-hadoop2.7.tgz'],
include_package_data=True,
package_data={"bigdl.share": ['bigdl/share/lib', 'bigdl/share/conf', 'bigdl/share/bin']},
Expand Down
2 changes: 1 addition & 1 deletion spark/dl/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@
<dependency>
<groupId>org.apache.opennlp</groupId>
<artifactId>opennlp-tools</artifactId>
<version>1.6.0</version>
<version>1.8.2</version>
</dependency>
<dependency>
<groupId>com.twelvemonkeys.imageio</groupId>
Expand Down

0 comments on commit 36aff06

Please sign in to comment.