Language-Features-for-News

所属分类:数学计算
开发工具:Python
文件大小:0KB
下载次数:0
上传日期:2020-10-14 15:11:04
上 传 者sh-1993
说明:  NELA工具包和其他新闻研究中使用的语言特征,
(Language features used in the NELA Toolkit and other news studies,)

文件列表:
Compute_all_features/ (0, 2020-10-14)
Compute_all_features/Compute_all_features.py (4700, 2020-10-14)
Compute_all_features/resources/ (0, 2020-10-14)
Compute_all_features/resources/NB_Subj_Model.sav (1954347, 2020-10-14)
Compute_all_features/resources/__init__.pyc (173, 2020-10-14)
Compute_all_features/resources/assertives.txt (554, 2020-10-14)
Compute_all_features/resources/bias-lexicon.txt (5051, 2020-10-14)
Compute_all_features/resources/count_vect.sav (1373772, 2020-10-14)
Compute_all_features/resources/factives.txt (224, 2020-10-14)
Compute_all_features/resources/feature_functions.py (11714, 2020-10-14)
Compute_all_features/resources/feature_functions.pyc (13716, 2020-10-14)
Compute_all_features/resources/happiness_index.txt (415823, 2020-10-14)
Compute_all_features/resources/hedges.txt (1335, 2020-10-14)
Compute_all_features/resources/implicatives.txt (251, 2020-10-14)
Compute_all_features/resources/moral foundations dictionary.dic (5291, 2020-10-14)
Compute_all_features/resources/negative-words.txt (44758, 2020-10-14)
Compute_all_features/resources/other_lexicons.txt (395, 2020-10-14)
Compute_all_features/resources/positive-words.txt (19093, 2020-10-14)
Compute_all_features/resources/readability.py (4969, 2020-10-14)
Compute_all_features/resources/readability.pyc (5922, 2020-10-14)
Compute_all_features/resources/readability_utils.py (2170, 2020-10-14)
Compute_all_features/resources/readability_utils.pyc (2606, 2020-10-14)
Compute_all_features/resources/report_verbs.txt (1332, 2020-10-14)
Compute_all_features/resources/source_codes.json (327614, 2020-10-14)
Compute_all_features/resources/stopwords.txt (655, 2020-10-14)
Compute_all_features/resources/subjclueslen.txt (662621, 2020-10-14)
Compute_all_features/resources/syllables_en.py (2682, 2020-10-14)
Compute_all_features/resources/syllables_en.pyc (2805, 2020-10-14)
Compute_all_features/resources/tfidf_transformer.sav (990914, 2020-10-14)
FeatureNameDocumentation.txt (15117, 2020-10-14)
compute_all_features_DB/ (0, 2020-10-14)
compute_all_features_DB/Compute_all_features_DBversion.py (5180, 2020-10-14)
compute_all_features_DB/resources/ (0, 2020-10-14)
compute_all_features_DB/resources/NB_Subj_Model.sav (1954347, 2020-10-14)
compute_all_features_DB/resources/__init__.pyc (173, 2020-10-14)
compute_all_features_DB/resources/assertives.txt (554, 2020-10-14)
compute_all_features_DB/resources/bias-lexicon.txt (5051, 2020-10-14)
compute_all_features_DB/resources/count_vect.sav (1373772, 2020-10-14)
... ...

# Language-Features-for-News **NOTE**: This code is for research purposes only! **NOTE**: This repository is deprecated. Please use the updated version at:https://github.com/BenjaminDHorne/NELAFeatures. **NOTE**: This repository requires the LIWC 2007 Dictionary. To access the dictionary, please contact Dr. James Pennebaker: pennebaker@utexas.edu. The dictionary can be placed in the resources folder once aquired. This repository contains natural language features used in the NELA Toolkit (https://github.com/BenjaminDHorne/The-NELA-Toolkit) and various news studies (see http://homepages.rpi.edu/~horneb/). Before using, ensure you have all Python requirements in requirements.txt and the resource folder. To use simply change the following parameters in Compute_all_features.py: **outfile** - name of csv file to output **outpath** - path to write outfile **text_file_start_path** - path to set of text files or folders of text files to process. The filename will be used as the vector ID in output If you only want to compute a subset of features, simply comment out feature function calls, and change the output variables. Also, keep in mind many of these features are from many other awesome researchers. This is simply an aggregation of my original features and many other features borrowed from others. Many have been shown useful in different news or social media text scenerios, others have not. Please see the feature page in the NELA toolkit for citations. ---------------------------------------------------------------------------------------------------------------------- Any publication resulting from the use of this work must cite the following publication:: Benjamin D. Horne, William Dron, Sara Khedr, and Sibel Adali. "Assessing the News Landscape: A Multi-Module Toolkit for Evaluating the Credibility of News" WWW (2018). ---------------------------------------------------------------------------------------------------------------------- Copyright (c) 2017, Benjamin D. Horne All rights reserved. Redistribution and use in any form, with or without modification, are permitted provided that the above copyright notice, this list of conditions and the following disclaimer are retained. THIS CODE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

近期下载者

相关文件


收藏者