plrs
所属分类:特征抽取
开发工具:Rust
文件大小:0KB
下载次数:0
上传日期:2024-04-09 04:36:46
上 传 者:
sh-1993
说明: 词汇分析和标记化的多种工具。在更短的时间内为许多用例创建解析器。
(The multi-tool of lexical analysis and tokenization. Make parsers in less time for many use cases.)
文件列表:
plrs/
scripts/
src/
tests/
Cargo.toml
LICENSE
MANIFEST.in
pyproject.toml
requirements.txt
setup.py
# plrs
![Version](https://img.shields.io/pypi/v/plrs)
The multi-tool of lexical analysis and tokenization.
# Install
```
pip install plrs
```
# Build
```
maturin build
```
# Examples
- [zipfs-law](https://github.com/JakeRoggenbuck/zipfs-law)
# API
#### Global variables
```
EOF_TOKEN
```
#### Classes
```
Tokens
Settings
Token
- part
- token
- set_part
- set_token
- __str__
- __repr__
Lexer
- new
- char_forward
- skip_over_char_set
- next
```
#### Functions
```
is_char_symbol
is_char_operator
is_char_whitespace
is_char_numeric
is_single_quote
is_double_quote
ends_token
is_part_numeric
tokenize
```
近期下载者:
相关文件:
收藏者: