You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
NOTE: Databricks' runtimes support different Apache Spark major releases. Please make sure you choose the correct Spark NLP Maven package name (Maven Coordinate) for your runtime from our [Packages Cheatsheet](https://github.com/JohnSnowLabs/spark-nlp#packages-cheatsheet)
643
+
644
+
#### ONNX GPU Inference on Databricks
645
+
646
+
To run infer ONNX models with GPU on Databricks clusters, we need to perform some additional setup steps. ONNX requires CUDA 12 and cuDNN 9 to be installed.
647
+
648
+
Therefore, we need to use Databricks runtimes starting from version 15, as these come with CUDA 12. However, they come with cuDNN 8, which we need to upgrade manually.
649
+
To do so, we have to add the following script as an [init script](https://docs.databricks.com/en/init-scripts/index.html):
You need to save this script to a shell script file (i.e. `upgrade-cudnn9.sh`) in your workspace. Afterwards, you need to specify it on your compute resource under the *Advanced options* section. cuDNN will be upgraded to version 9 on all nodes before Spark is started.
657
+
658
+
</div><div class="h3-box" markdown="1">
659
+
660
+
### Databricks Notebooks
661
+
662
+
You can view all the Databricks notebooks from this address:
3. In `Libraries` tab inside your cluster you need to follow these steps:
889
-
890
-
3.1. Install New -> PyPI ->`spark-nlp` -> Install5.5.1
891
-
892
-
3.2. Install New -> Maven -> Coordinates ->`com.johnsnowlabs.nlp:spark-nlp_2.12:5.5.1` -> Install
893
-
894
-
4. Now you can attach your notebook to the cluster and use Spark NLP!
895
-
896
-
NOTE: Databrick's runtimes support different Apache Spark major releases. Please make sure you choose the correct Spark NLP Maven pacakge name (Maven Coordinate) for your runtime from our [Packages Cheatsheet](https://github.com/JohnSnowLabs/spark-nlp#packages-cheatsheet)
897
-
898
-
</div><div class="h3-box" markdown="1">
899
-
900
-
#### Databricks Notebooks
901
-
902
-
You can view all the Databricks notebooks from this address:
0 commit comments