Merge pull request #2819 from NvTimLiu/release-tmp

Merge branch-21.06 to main [skip ci]

CHANGELOG.md

@@ -1,5 +1,5 @@
 # Change log
-Generated on 2021-06-22
+Generated on 2021-06-25
 
 ## Release 21.06
 
@@ -85,6 +85,9 @@ Generated on 2021-06-22
 ### PRs
 |||
 |:---|:---|
+|[#2806](https://github.com/NVIDIA/spark-rapids/pull/2806)|Noted testing for A10, noted that min driver ver is HW specific|
+|[#2797](https://github.com/NVIDIA/spark-rapids/pull/2797)|Update documentation for InitCap incompatibility|
+|[#2774](https://github.com/NVIDIA/spark-rapids/pull/2774)|Update changelog for 21.06 release [skip ci]|
 |[#2770](https://github.com/NVIDIA/spark-rapids/pull/2770)|[Doc] add more for Alluxio page [skip ci]|
 |[#2745](https://github.com/NVIDIA/spark-rapids/pull/2745)|Add link to Mellanox RoCE documentation and mention --without-ucx installation option|
 |[#2740](https://github.com/NVIDIA/spark-rapids/pull/2740)|Update cudf Java bindings to 21.06.1|

docs/FAQ.md

@@ -35,9 +35,9 @@ the latest release.
 
 ### What hardware is supported? 
 
-The plugin is tested and supported on V100, T4, A30 and A100 datacenter GPUs.  It is possible to run
-the plugin on GeForce desktop hardware with Volta or better architectures.  GeForce hardware does
-not support [CUDA enhanced
+The plugin is tested and supported on V100, T4, A10, A30 and A100 datacenter GPUs.  It is possible
+to run the plugin on GeForce desktop hardware with Volta or better architectures.  GeForce hardware
+does not support [CUDA enhanced
 compatibility](https://docs.nvidia.com/deploy/cuda-compatibility/index.html#enhanced-compat-minor-releases),
 and will need CUDA 11.2 installed. If not, the following error will be displayed:
 

docs/configs.md

@@ -197,7 +197,7 @@ Name | SQL Function(s) | Description | Default Value | Notes
 <a name="sql.expression.If"></a>spark.rapids.sql.expression.If|`if`|IF expression|true|None|
 <a name="sql.expression.In"></a>spark.rapids.sql.expression.In|`in`|IN operator|true|None|
 <a name="sql.expression.InSet"></a>spark.rapids.sql.expression.InSet| |INSET operator|true|None|
-<a name="sql.expression.InitCap"></a>spark.rapids.sql.expression.InitCap|`initcap`|Returns str with the first letter of each word in uppercase. All other letters are in lowercase|false|This is not 100% compatible with the Spark version because in some cases unicode characters change byte width when changing the case. The GPU string conversion does not support these characters. For a full list of unsupported characters see https://github.com/rapidsai/cudf/issues/3132 Spark also only sees the space character as a word deliminator, but this uses more white space characters.|
+<a name="sql.expression.InitCap"></a>spark.rapids.sql.expression.InitCap|`initcap`|Returns str with the first letter of each word in uppercase. All other letters are in lowercase|false|This is not 100% compatible with the Spark version because in some cases unicode characters change byte width when changing the case. The GPU string conversion does not support these characters. For a full list of unsupported characters see https://github.com/rapidsai/cudf/issues/3132 Spark also only sees the space character as a word deliminator, but this will capitalize any character after a non-alphabetic character.  The behavior will be aligned to match Spark in the future per https://github.com/NVIDIA/spark-rapids/issues/2786.|
 <a name="sql.expression.InputFileBlockLength"></a>spark.rapids.sql.expression.InputFileBlockLength|`input_file_block_length`|Returns the length of the block being read, or -1 if not available|true|None|
 <a name="sql.expression.InputFileBlockStart"></a>spark.rapids.sql.expression.InputFileBlockStart|`input_file_block_start`|Returns the start offset of the block being read, or -1 if not available|true|None|
 <a name="sql.expression.InputFileName"></a>spark.rapids.sql.expression.InputFileName|`input_file_name`|Returns the name of the file being read, or empty string if not available|true|None|

docs/download.md

@@ -27,20 +27,23 @@ Hardware Requirements:
 
 The plugin is tested on the following architectures: 
 
-	GPU Architecture: NVIDIA V100, T4 and A30/A100 GPUs
+	GPU Architecture: NVIDIA V100, T4 and A10/A30/A100 GPUs
 
 Software Requirements:
 
 	OS: Ubuntu 18.04, Ubuntu 20.04 or CentOS 7, CentOS 8
 
-	CUDA & Nvidia Drivers: 11.0 or 11.2 & v450.80.02+
+	CUDA & Nvidia Drivers*: 11.0 or 11.2 & v450.80.02+
 
 	Apache Spark 3.0.1, 3.0.2, 3.1.1, 3.1.2, Cloudera CDP 7.1.7, Databricks 7.3 ML LTS or 8.2 ML Runtime, and GCP Dataproc 2.0 
 
 	Apache Hadoop 2.10+ or 3.1.1+ (3.1.1 for nvidia-docker version 2)
 
 	Python 3.6+, Scala 2.12, Java 8 
 
+*Some hardware may have a minimum driver version greater than v450.80.02+.  Check the GPU spec sheet 
+for your hardware's minimum driver version.
+
 ### Download v21.06.0
 * Download the [RAPIDS
   Accelerator for Apache Spark 21.06.0 jar](https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/21.06.0/rapids-4-spark_2.12-21.06.0.jar)
@@ -74,7 +77,7 @@ New functionality for this release includes:
 Performance improvements for this release include: 
 * Moving RAPIDS Shuffle out of beta
 * Updates to UCX error handling
-* GPU Direct storage for spilling
+* GPUDirect Storage for spilling
 
 For a detailed list of changes, please refer to the
 [CHANGELOG](https://github.com/NVIDIA/spark-rapids/blob/main/CHANGELOG.md).

docs/supported_ops.md

@@ -8013,7 +8013,7 @@ Accelerator support is described below.
 <td rowSpan="4">InitCap</td>
 <td rowSpan="4">`initcap`</td>
 <td rowSpan="4">Returns str with the first letter of each word in uppercase. All other letters are in lowercase</td>
-<td rowSpan="4">This is not 100% compatible with the Spark version because in some cases unicode characters change byte width when changing the case. The GPU string conversion does not support these characters. For a full list of unsupported characters see https://github.com/rapidsai/cudf/issues/3132 Spark also only sees the space character as a word deliminator, but this uses more white space characters.</td>
+<td rowSpan="4">This is not 100% compatible with the Spark version because in some cases unicode characters change byte width when changing the case. The GPU string conversion does not support these characters. For a full list of unsupported characters see https://github.com/rapidsai/cudf/issues/3132 Spark also only sees the space character as a word deliminator, but this will capitalize any character after a non-alphabetic character.  The behavior will be aligned to match Spark in the future per https://github.com/NVIDIA/spark-rapids/issues/2786.</td>
 <td rowSpan="2">project</td>
 <td>input</td>
 <td> </td>

sql-plugin/src/main/scala/com/nvidia/spark/rapids/GpuOverrides.scala

@@ -1247,7 +1247,9 @@ object GpuOverrides {
       (a, conf, p, r) => new UnaryExprMeta[InitCap](a, conf, p, r) {
         override def convertToGpu(child: Expression): GpuExpression = GpuInitCap(child)
       }).incompat(CASE_MODIFICATION_INCOMPAT + " Spark also only sees the space character as " +
-      "a word deliminator, but this uses more white space characters."),
+      "a word deliminator, but this will capitalize any character after a non-alphabetic " + 
+      "character.  The behavior will be aligned to match Spark in the future per " +
+      "https://github.com/NVIDIA/spark-rapids/issues/2786."),
     expr[Log](
       "Natural log",
       ExprChecks.mathUnary,