spark_nlp_tasks
所属分类:人工智能/神经网络/深度学习
开发工具:Scala
文件大小:0KB
下载次数:0
上传日期:2023-07-22 15:25:37
上 传 者:
sh-1993
说明: 它包括标点符号移除器、camelCase标记器和嵌入平均注释器。,
(it includes punctuation remover, camelCase tokenizer and embeddings average annotators.,)
文件列表:
.bsp/ (0, 2023-07-22)
.bsp/sbt.json (469, 2023-07-22)
.scalafmt.conf (283, 2023-07-22)
LICENSE (11324, 2023-07-22)
build.sbt (1527, 2023-07-22)
project/ (0, 2023-07-22)
project/assembly.sbt (56, 2023-07-22)
project/build.properties (19, 2023-07-22)
project/plugins.sbt (589, 2023-07-22)
src/ (0, 2023-07-22)
src/main/ (0, 2023-07-22)
src/main/scala/ (0, 2023-07-22)
src/main/scala/AverageEmbeddingsAnnotator.scala (121901, 2023-07-22)
src/main/scala/AverageEmbeddingsAnnotatorTest.scala (2193, 2023-07-22)
src/main/scala/CamelCaseSplitterAnnotator.scala (3795, 2023-07-22)
src/main/scala/CamelCaseTokenizerTest.scala (880, 2023-07-22)
src/main/scala/Main.scala (0, 2023-07-22)
src/main/scala/OOVRatioAnnotator.scala (1744, 2023-07-22)
src/main/scala/OOVRatioTest.scala (1338, 2023-07-22)
src/main/scala/PunctuationRemover.scala (3742, 2023-07-22)
src/main/scala/PunctuationRemoverTest.scala (1184, 2023-07-22)
src/test/ (0, 2023-07-22)
src/test/scala/ (0, 2023-07-22)
src/test/scala/PipelineTest.scala (350, 2023-07-22)
# spark-nlp-starter
![Scala CI](https://github.com/maziyarpanahi/spark-nlp-starter/workflows/Scala%20CI/badge.svg)
This is just a simple demo as how to use Spark NLP in a SBT project in Scala. Usually, once you have your application you want to package it and run it via `spark-submit`.
## spark-submit
After your executed `sbt assembly` to get a Fat JAR (without Apache Spark since your environment has Apache Spark already), you can use `spark-submit` like this:
```shell
sbt assembly
```
```shell
~/spark-3.1.1-bin-hadoop3.2/bin/spark-submit \
--class "Main" \
target/scala-2.12/spark-nlp-starter-assembly-1.1.jar
```
This will execute the code in `Main` class and finish successfully.
近期下载者:
相关文件:
收藏者: