gocrawl

所属分类:数据采集/爬虫
开发工具:GO
文件大小:20KB
下载次数:0
上传日期:2020-04-29 16:16:11
上 传 者sh-1993
说明:  一个用果朗语编写的网络爬虫,扫描马来西亚主要新闻媒体的商业文章
(A web crawler written in Golang that scans through business articles from major news press in Malaysia)

文件列表:
.env.example (106, 2020-04-30)
go.mod (793, 2020-04-30)
go.sum (6278, 2020-04-30)
main.go (808, 2020-04-30)
models (0, 2020-04-30)
models\article.go (1399, 2020-04-30)
models\base.go (1407, 2020-04-30)
news (0, 2020-04-30)
news\base.go (161, 2020-04-30)
news\businessinsider.go (4531, 2020-04-30)
news\chinapress.go (2835, 2020-04-30)
news\investing.go (3004, 2020-04-30)
news\malaymail.go (2615, 2020-04-30)
news\nanyang.go (2974, 2020-04-30)
news\newstraitstimes.go (2171, 2020-04-30)
news\sinchew.go (2943, 2020-04-30)
news\theedge.go (2698, 2020-04-30)
news\thestar.go (2842, 2020-04-30)

## About This is a web crawler that scans through the business articles from major news press in Malaysia. It is scheduled to run the crawling at certain interval and save the content in database. ## License gocrawl is open-sourced software licensed under the [MIT license](http://opensource.org/licenses/MIT).

近期下载者

相关文件


收藏者