plrs

所属分类:特征抽取
开发工具:Rust
文件大小:0KB
下载次数:0
上传日期:2024-04-09 04:36:46
上 传 者sh-1993
说明:  词汇分析和标记化的多种工具。在更短的时间内为许多用例创建解析器。
(The multi-tool of lexical analysis and tokenization. Make parsers in less time for many use cases.)

文件列表:
plrs/
scripts/
src/
tests/
Cargo.toml
LICENSE
MANIFEST.in
pyproject.toml
requirements.txt
setup.py

# plrs ![Version](https://img.shields.io/pypi/v/plrs) The multi-tool of lexical analysis and tokenization. # Install ``` pip install plrs ``` # Build ``` maturin build ``` # Examples - [zipfs-law](https://github.com/JakeRoggenbuck/zipfs-law) # API #### Global variables ``` EOF_TOKEN ``` #### Classes ``` Tokens Settings Token - part - token - set_part - set_token - __str__ - __repr__ Lexer - new - char_forward - skip_over_char_set - next ``` #### Functions ``` is_char_symbol is_char_operator is_char_whitespace is_char_numeric is_single_quote is_double_quote ends_token is_part_numeric tokenize ```

近期下载者

相关文件


收藏者