sutysisku-tokenizer
所属分类:特征抽取
开发工具:Rust
文件大小:0KB
下载次数:0
上传日期:2023-11-03 16:42:54
上 传 者:
sh-1993
说明: sutysisku标记器
(sutysisku tokenizer)
文件列表:
.appveyor.yml (340, 2023-11-25)
.npmignore (14, 2023-11-25)
.travis.yml (2974, 2023-11-25)
Cargo.toml (1179, 2023-11-25)
LICENSE_APACHE (10850, 2023-11-25)
LICENSE_MIT (1080, 2023-11-25)
Makefile (175, 2023-11-25)
package.json (511, 2023-11-25)
src/ (0, 2023-11-25)
src/lib.rs (1370, 2023-11-25)
src/utils.rs (445, 2023-11-25)
src/wasm/ (0, 2023-11-25)
src/wasm/hash.rs (217, 2023-11-25)
src/wasm/mod.rs (89, 2023-11-25)
src/wasm/sisku.rs (4179, 2023-11-25)
src/wasm/types.rs (778, 2023-11-25)
tests/ (0, 2023-11-25)
tests/web.rs (251, 2023-11-25)
## About
sentence embeddings model tokenizer for la sutysisku
## Build
```
wasm-pack build --target nodejs --out-dir pkg/nodejs
wasm-pack build --target web --out-dir pkg/web
wasm-pack build --target bundler --out-dir pkg/bundler
find ./pkg -name ".gitignore" -type f -delete
npm login
npm publish --access=public
```
## Batteries Included
* [`wasm-bindgen`](https://github.com/rustwasm/wasm-bindgen) for communicating
between WebAssembly and JavaScript.
* [`console_error_panic_hook`](https://github.com/rustwasm/console_error_panic_hook)
for logging panic messages to the developer console.
* `LICENSE-APACHE` and `LICENSE-MIT`: most Rust projects are licensed this way, so these are included for you
## License
Licensed under either of
* Apache License, Version 2.0, ([LICENSE-APACHE](LICENSE-APACHE) or http://www.apache.org/licenses/LICENSE-2.0)
* MIT license ([LICENSE-MIT](LICENSE-MIT) or http://opensource.org/licenses/MIT)
at your option.
### Contribution
Unless you explicitly state otherwise, any contribution intentionally
submitted for inclusion in the work by you, as defined in the Apache-2.0
license, shall be dual licensed as above, without any additional terms or
conditions.
近期下载者:
相关文件:
收藏者: