Tokenizer
所属分类：特征抽取
开发工具：C#
文件大小：482KB
下载次数：0
上传日期：2021-08-09 20:15:17
上 传 者：
sh-1993
说明： 代币器第二项目
(Tokenizer Second Project)
文件列表:
App.config (184, 2021-08-10)
Digit.cs (2225, 2021-08-10)
DigitDot.cs (2007, 2021-08-10)
EnglishCharState.cs (2024, 2021-08-10)
FarsiCharState.cs (2323, 2021-08-10)
Hashtag.cs (1929, 2021-08-10)
IGetBackToInitialState.cs (293, 2021-08-10)
IInitialState.cs (376, 2021-08-10)
IPAddress.cs (1866, 2021-08-10)
IState.cs (194, 2021-08-10)
InitialState.cs (3948, 2021-08-10)
MainForm.Designer.cs (3851, 2021-08-10)
MainForm.cs (3356, 2021-08-10)
MainForm.resx (5698, 2021-08-10)
Program.cs (437, 2021-08-10)
Properties (0, 2021-08-10)
Properties\AssemblyInfo.cs (1408, 2021-08-10)
Properties\Resources.Designer.cs (2791, 2021-08-10)
Properties\Resources.resx (5496, 2021-08-10)
Properties\Settings.Designer.cs (1073, 2021-08-10)
Properties\Settings.settings (242, 2021-08-10)
RealNumber.cs (2255, 2021-08-10)
RealNumberDot.cs (2041, 2021-08-10)
RealNumberDotDigit.cs (2218, 2021-08-10)
RealNumberDotDigitDot.cs (2030, 2021-08-10)
Sharp.cs (2070, 2021-08-10)
SpecialToken.cs (653, 2021-08-10)
Token.cs (540, 2021-08-10)
bin (0, 2021-08-10)
bin\Debug (0, 2021-08-10)
bin\Debug\TokenizerProject.exe (18944, 2021-08-10)
bin\Debug\TokenizerProject.exe.config (184, 2021-08-10)
bin\Debug\TokenizerProject.pdb (71168, 2021-08-10)
bin\Debug\TokenizerProject.vshost.exe (22696, 2021-08-10)
bin\Debug\TokenizerProject.vshost.exe.config (184, 2021-08-10)
bin\Debug\TokenizerProject.vshost.exe.manifest (479, 2021-08-10)
... ...
# Tokenizer
Tokenizer Project
This project uses a state machine to tokenize the plain text. It supports both English and Farsi alphabets.
近期下载者：
相关文件：
收藏者：