scraping

所属分类:数据挖掘/数据仓库
开发工具:Python
文件大小:8KB
下载次数:0
上传日期:2015-04-08 18:26:07
上 传 者sh-1993
说明:  新闻网站scraper的真实例子。下载与关键词匹配的文章,生成PDF格式的完整内容报告,等等...
(Real life example of news site scraper. Download articles matching key words, generate full content reports in PDF, Excel and SPSS. SPSS generation might only work on Mac or Windows, pushed here to github “as is”. This whole program is just a hack, take it for what it is, something hastily thrown together to. Enough of excuses - I present you)

文件列表:
example-squid.conf (2872, 2015-04-09)
keylist.json (873, 2015-04-09)
main.py (679, 2015-04-09)
scrape (125, 2015-04-09)
scraper.py (20266, 2015-04-09)
test.json (14, 2015-04-09)
testlist.json (49, 2015-04-09)

Real life example of news site scraper. Download articles matching key words, generate full content reports in PDF, Excel and SPSS. SPSS generation might only work on Mac (and Windows?), pushed here to github “as is”. This whole program is just a hack, take it for what it is, something hastily thrown together to solve a problem. Enough with the excuses - I present you the license: The MIT License (MIT) Copyright (c) 2015 vonj Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

近期下载者

相关文件


收藏者