文件列表:

backend_server/ (0, 2017-08-14)
backend_server/operations.py (3956, 2017-08-14)
backend_server/operations_test.py (2363, 2017-08-14)
backend_server/service.py (1027, 2017-08-14)
common/ (0, 2017-08-14)
common/mongodb_client.py (371, 2017-08-14)
common/mongodb_client_test.py (326, 2017-08-14)
common/news_api_client.py (1032, 2017-08-14)
common/news_api_client_test.py (275, 2017-08-14)
common/news_recommendation_service_client.py (417, 2017-08-14)
common/news_topic_modeling_service_client.py (328, 2017-08-14)
common/news_topic_modeling_service_client_test.py (295, 2017-08-14)
news.json (6787004, 2017-08-14)
news_pipeline/ (0, 2017-08-14)
news_pipeline/news_deduper.py (2699, 2017-08-14)
news_pipeline/news_fetcher.py (1717, 2017-08-14)
news_pipeline/news_monitor.py (1685, 2017-08-14)
news_pipeline/scrapers/ (0, 2017-08-14)
news_pipeline/scrapers/cnn_news_scraper.py (1046, 2017-08-14)
news_pipeline/scrapers/cnn_news_scraper_test.py (421, 2017-08-14)
news_pipeline/scrapers/user_agents.txt (96049, 2017-08-14)
news_pipeline/tf_idf_test.py (376, 2017-08-14)
news_pipeline/tf_idf_test_2.py (12822, 2017-08-14)
news_pipeline_launcher.sh (379, 2017-08-14)
news_recommendation_service/ (0, 2017-08-14)
news_recommendation_service/click_log_processor.py (3163, 2017-08-14)
news_recommendation_service/click_log_processor_test.py (925, 2017-08-14)
news_recommendation_service/news_classes.py (322, 2017-08-14)
news_recommendation_service/recommendation_service.py (1788, 2017-08-14)
news_topic_modeling_service/ (0, 2017-08-14)
news_topic_modeling_service/backfill.py (670, 2017-08-14)
news_topic_modeling_service/labeled_news.csv (117677, 2017-08-14)
news_topic_modeling_service/model/ (0, 2017-08-14)
news_topic_modeling_service/model/checkpoint (128, 2017-08-14)
news_topic_modeling_service/model/eval_score/ (0, 2017-08-14)
news_topic_modeling_service/model/eval_score/events.out.tfevents.1492566951.jeffrey-VirtualBox (297947, 2017-08-14)
news_topic_modeling_service/model/eval_score/events.out.tfevents.1492635898.jeffrey-VirtualBox (297947, 2017-08-14)
... ...

``` ____ __ _ __ / __ \_________ / /_____ / | / /__ _ _______ / /_/ / ___/ __ \/ __/ __ \/ |/ / _ \ | /| / / ___/ / ____/ / / /_/ / /_/ /_/ / /| / __/ |/ |/ (__ ) /_/ /_/ \____/\__/\____/_/ |_/\___/|__/|__/____/ v-0.0.1 ``` ## Introduction ProtoNews is a news recommendation application. Its primitive idea is to deliver top line news faster yet simpler. It runs machine learning modeling to perform intelligent news recommendations based on users' taps. ProtoNews makes reading news much easier and frees us from the pain of picking up a news article in a way that it just like already knows what we are expecting. (a screenshot of website) ## Features - F1 - F2 - F3 - F4 ## Get Started 1. Run your mongodb server locally(download mongodb). ```sh ./mongod ``` 2. We need to start the data generator, run news_deduper, news_fecther and news_monitor. ```sh ./news_pipeline_launcher.sh ``` 3. Run service.py, recommendation_service.py, server.py, click_log_processor.py to start all services. 4. Go to webserver/server `npm install` `npm start` to start server 5. Go to webserver/client `npm run build` to create build folder then `npm start`. Later, it will jump to the login page, sign up first and log in. As so far, we are done! ## Architecture - [Data Pipeline](https://github.com/Dukecat0613/NewsRecommendation/blob/master/#data-pipeline) - [Kafka](https://github.com/Dukecat0613/NewsRecommendation/blob/master/#kafka) - [MongoDB](https://github.com/Dukecat0613/NewsRecommendation/blob/master/#mongodb) - [Redis](https://github.com/Dukecat0613/NewsRecommendation/blob/master/#redis) - [Back-End](https://github.com/Dukecat0613/NewsRecommendation/blob/master/#back-end) - [Express](https://github.com/Dukecat0613/NewsRecommendation/blob/master/#express) - [Node.js](https://github.com/Dukecat0613/NewsRecommendation/blob/master/#nodejs) - [Front-End](https://github.com/Dukecat0613/NewsRecommendation/blob/master/#front-end) - [Cloud-AWS](https://github.com/Dukecat0613/NewsRecommendation/blob/master/#cloud-aws) - [Database](https://github.com/Dukecat0613/NewsRecommendation/blob/master/#database) - [Kafka Cluster](https://github.com/Dukecat0613/NewsRecommendation/blob/master/#kafka-cluster) - [Web Server](https://github.com/Dukecat0613/NewsRecommendation/blob/master/#web-server) --------- **Data Pipeline** (A pic for our data pipeline) - Kafka - Data Transportation - MongoDB - Redis **Back-End** Node.js + Express as Back-End framework. - Express - Node.js **Front-End** React as Front-End framework **Cloud-AWS** We deployed our Web App on AWS EC2 instances. Database * MongoDB * Redis Kafka Cluster * * Web Server * Server * Client ## Team [](https://github.com/Dukecat0613/NewsRecommendation/blob/master/https://github.com/Dukecat0613) | [](https://github.com/Dukecat0613/NewsRecommendation/blob/master/https://github.com/kuroega) ---|--- [Hang Wu](https://github.com/Dukecat0613/NewsRecommendation/blob/master/https://github.com/Dukecat0613) |[Yuxiang Wang](https://github.com/Dukecat0613/NewsRecommendation/blob/master/https://github.com/kuroega) ## License

近期下载者：

相关文件：

评论：[我要评论] [举报此文件]

收藏者：